Help:Best Practices: Difference between revisions

From Ruisdael Observatory Data Catalog
 
(18 intermediate revisions by 2 users not shown)
Line 1: Line 1:
This page is intended to describe best practices while adding a new dataset entry to the Catalog. In case you think some information is missing, please indicate it on '''[https://github.com/orgs/ruisdael-observatory/projects/1/ GitHub Ruisdael Data Catalog project]'''.  
This page describes best practices for adding new datasets and entering metadata into the catalog. In case you think some information is missing, please indicate it on '''[https://github.com/orgs/ruisdael-observatory/projects/1/ GitHub Ruisdael Data Catalog project]'''.  


= Guidelines for all submissions =
= General guidelines for all submissions =


== Naming ==
== Naming ==
Line 9: Line 9:


Examples:
Examples:
*TU Delft optical disdrometer Parsivel² PAR001 at Cabauw
*'''[https://ruisdael-catalog.citg.tudelft.nl/index.php?title=TU_Delft_optical_disdrometer_Parsivel%C2%B2_PAR001_at_Cabauw TU Delft optical disdrometer Parsivel² PAR001 at Cabauw]'''
*KNMI DALES model outputs over Cabauw
*'''[https://ruisdael-catalog.citg.tudelft.nl/index.php?title=KNMI_DALES_model_outputs_over_Cabauw KNMI DALES model outputs over Cabauw]'''
*TU Delft CMTRACE Level 2 Wind field at Cabauw
*'''[https://ruisdael-catalog.citg.tudelft.nl/index.php?title=TU_Delft_CMTRACE_Level_2_Wind_field_at_Cabauw TU Delft CMTRACE Level 2 Wind field at Cabauw]'''


== Geographic coordinates ==
== Geographic coordinates ==
For datasets produced by stationary instruments (in-situ, remote sensing) and for single-column model outputs, the latitude and longitude coordinates should be entered with a precision of at least 4 digits.
For datasets produced by stationary instruments (in-situ, remote sensing) and for single-column model outputs, the latitude and longitude coordinates should be entered with a precision of at least 4 digits (approx 11 meters). However, the use 5 or 6 significant digits is recommended.  


For non-stationary in-situ and remote sensing observations, use the description field to indicate the measurement domain. For example, the coordinates from the starting and ending points could be mentioned.
For non-stationary in-situ and remote sensing observations, use the description field to indicate the measurement domain. For example, the coordinates from the starting and ending points could be mentioned.


= Description for the different submission types =
== Special Characters & Formatting ==
Use the description field to provide all import information from the new dataset. While writing the Description, try to indicate the data source, the content, and the goal of the data. Try to provide enough information to help users understand the dataset content without downloading the data. Below, you can find a non-exhaustive checklist for the different data types to be used as a starting point.
MediaWiki uses Unicode (UTF-8) for character encoding. This allows for a wide range of characters. For more information about this issue, see https://www.mediawiki.org/wiki/Help:Special_characters


== Checklist for in-situ datasets ==
= Dataset description field =
*What is the instrument's name?
Use the description field to provide key details about the dataset, including its source, content, and purpose. A well-written description allows users to understand the dataset without downloading it and improves discoverability. For clarity, longer descriptions can be structured into sections such as 'Purpose,' 'Measurement Specifications,' and 'Data Processing'. Use the checklists below to ensure all essential information is included.
*What is the instrument's model?
*What is the instrument's Brand?
*What is the data resolution?
*What are the variables listed in the dataset?
*Where is it installed?
*What is it intended for?
*If non-stationary instrument: latitude, longitude, height from starting and ending point.


== Checklist for in-situ and remote sensing datasets ==
* sensor name, model and brand
* location, site name and description of surrounding environment
* spatial and temporal resolution of measurements
* scanning mode(s) (if applicable)
* sensor calibration details (if applicable)
* physical variables contained in the dataset
* purpose of the dataset
* context of the experiment/measurement
* for non-stationary instruments: latitude, longitude, height from starting and ending point.


== Checklist for campaigns and products datasets ==
== Checklist for datasets related to campaigns ==
*What was the campaign goal?
What are the instruments used?
What is the duration?
What are the variables?
What is the data resolution?
If it is a data product, how was it derived?
If any external link to the data processing is available, it can also be listed here.


== Checklist model output submission ==
* name and goal of the campaign
What model was used?
* duration of the campaign
What model version was used, and where can it be found?
* other relevant sensors or models that were used during the campaign
What was the model configuration?
* special operating modes or variable resolutions used
What is the output resolution?
* information on how certain data/products were derived
Is the output from a single column? So, what are the latitude and longitude coordinates?
* link(s) to papers, methods or websites that contain more details
Is the output from a spatial domain? So, what is the domain?


==================================================================
== Checklist for model outputs ==
 
* model type, version and configuration
= First ideas =
* model grid size(s), domain size and extent
 
* spatial and temporal resolution(s) of output(s)
/This page is under construction. Please come back later..
* initial conditions, forcing(s) and data assimilation schemes
 
== General Guidelines ==
* Latitude and longitude coordinates for in-situ and remote sensing datasets should be entered with a precision of at least 4 digits.
* Refrain from using Notes. Put important information directly in the description
* Naming convection for the title: Institute - Sensor - Location
 
== Checklist for in-situ data ==
* dataset description should contain sensor type/brand
* dataset description should contain .. (if applicable)
 
== Checklist for remote-sensing data ==
 
== Checklist for model data ==
* The description should explicitly mention the variables that are provided (e.g., temperature, wind speed, etc..)
 
== Campaign data ==
How to enter campaign data?

Latest revision as of 16:20, 3 April 2025

This page describes best practices for adding new datasets and entering metadata into the catalog. In case you think some information is missing, please indicate it on GitHub Ruisdael Data Catalog project.

General guidelines for all submissions

Naming

The first required field for submitting a new dataset is the name. This name is used to identify the new dataset within the Catalog environment. To name the dataset, please use the following convention: Institute Sensor/Campaign/Product/Model at Location.

 Institute Sensor/Campaign/Product/Model at Location

Examples:

Geographic coordinates

For datasets produced by stationary instruments (in-situ, remote sensing) and for single-column model outputs, the latitude and longitude coordinates should be entered with a precision of at least 4 digits (approx 11 meters). However, the use 5 or 6 significant digits is recommended.

For non-stationary in-situ and remote sensing observations, use the description field to indicate the measurement domain. For example, the coordinates from the starting and ending points could be mentioned.

Special Characters & Formatting

MediaWiki uses Unicode (UTF-8) for character encoding. This allows for a wide range of characters. For more information about this issue, see https://www.mediawiki.org/wiki/Help:Special_characters

Dataset description field

Use the description field to provide key details about the dataset, including its source, content, and purpose. A well-written description allows users to understand the dataset without downloading it and improves discoverability. For clarity, longer descriptions can be structured into sections such as 'Purpose,' 'Measurement Specifications,' and 'Data Processing'. Use the checklists below to ensure all essential information is included.

Checklist for in-situ and remote sensing datasets

  • sensor name, model and brand
  • location, site name and description of surrounding environment
  • spatial and temporal resolution of measurements
  • scanning mode(s) (if applicable)
  • sensor calibration details (if applicable)
  • physical variables contained in the dataset
  • purpose of the dataset
  • context of the experiment/measurement
  • for non-stationary instruments: latitude, longitude, height from starting and ending point.

Checklist for datasets related to campaigns

  • name and goal of the campaign
  • duration of the campaign
  • other relevant sensors or models that were used during the campaign
  • special operating modes or variable resolutions used
  • information on how certain data/products were derived
  • link(s) to papers, methods or websites that contain more details

Checklist for model outputs

  • model type, version and configuration
  • model grid size(s), domain size and extent
  • spatial and temporal resolution(s) of output(s)
  • initial conditions, forcing(s) and data assimilation schemes