Main Page: Difference between revisions

From Ruisdael Observatory Data Catalog
 
(95 intermediate revisions by 2 users not shown)
Line 1: Line 1:
'''Ruisdael Observatory Data Catalog - ''in development'''''


[[File:schema-ruisdael-data-catalog.png|600px]]


Discussions and development take place over [https://github.com/orgs/ruisdael-observatory/projects/1/ github  Ruisdael Data Catalog project]
= Purpose of the Ruisdael data catalog =


Issues can be reported in https://github.com/ruisdael-observatory/Ruisdael-Data-Catalog/issues
Within Ruisdael, data are stored and distributed through various national and international platforms, such as the KNMI Data Platform (KDP), the ACTRIS CloudNet Portal, 4TU Research Data, MAQ Observations, and the Integrated Carbon Observation System ICOS-portal. The Ruisdael data catalog provides a central, comprehensive overview of all available datasets. The catalog allows to:
* Index and describe datasets produced by the Ruisdael Observatory, independently of where they are stored or published.
* Find out where datasets are published/stored, via [[Property:servedBy]].
* Identify the point of contact for each dataset, especially for unpublished datasets, via [[Property:contactPoint]].
* Describe special measurement campaigns or periods, and the datasets associated with them.


'''Note:''' the Ruisdael data catalog is not meant to index software. The latter can be published and accessed via the Ruisdael GitHub page: https://github.com/ruisdael-observatory


= How does it work? =


==Datasets==
The catalog is set up as a collaborative editing content management system (i.e., a Wiki). Everyone can read the Wiki and search the catalog. Registered users can add datasets, edit pages and access more advanced functions.
 
'''Usernames and accounts can be requested via [https://github.com/ruisdael-observatory/Ruisdael-Data-Catalog/issues/new?template=WikiAccount.yml Github issues]''' or by sending an email to Marc Schleiss <M.A.Schleiss@tudelft.nl> or Niels Jansen <N.H.Jansen@tudelft.nl>.
 
A good data catalog requires commitment and discipline. Each consortium partner/unit/PI is responsible for entering and updating the information about their datasets. If you have any questions or need assistance with entering information or managing a particularly challenging dataset, please don't hesitate to contact the admins.
 
= Useful Resources =
 
* The '''[[Help:Catalog editing]]''' contains information on how to edit and add content to the Wiki.
* The '''[[Help:Data Catalog Schema]]''' describes the categories, properties, forms and templates used by the catalog.
* '''[[Help:Wiki administration]]''' includes information on how to maintain this Wiki (for admins only)
* Bugs and other technical issues can be reported to '''https://github.com/ruisdael-observatory/Ruisdael-Data-Catalog/issues'''
* Suggestions for further development of the catalog can be submitted to '''[https://github.com/orgs/ruisdael-observatory/projects/1/ github  Ruisdael Data Catalog project]'''
 
=Ruisdael [[:Category:Dataset|Datasets]]=


'''Create Dataset page with [[Form:Dataset]]'''
'''Create Dataset page with [[Form:Dataset]]'''


'''{{#queryformlink:form=DatasetSearch|link text=Search Datasets}}'''
'''See Datasets on [[Datasets Map]] '''


{{#ask: [[Category:Dataset]]
{{#ask: [[Category:Dataset]]
|?title
  |?type
  |?type
  |?hasStatus
  |?creator_organization=creator(org)
|?theme
|?hasInstitute
  |?servedBy
  |?servedBy
|?atLocation
|?hasGeographicCoordinates
|?startDate
|?endDate
  |?identifier
  |?identifier
  |?accessRights
  |?accessRights
Line 40: Line 64:
  |datatables-searching=1
  |datatables-searching=1
  |datatables-pagingtype=full_numbers
  |datatables-pagingtype=full_numbers
  |datatables-pagelength=20
  |datatables-pagelength=50
  |datatables-lengthmenu=10, 20, 50, 100, 200
  |datatables-lengthmenu=10, 20, 50, 100, 200
  |datatables-scroller.displaybuffer=50
  |datatables-scroller.displaybuffer=50
Line 50: Line 74:
}}
}}


==Partner Institutes==
=Ruisdael [[:Category:DataService|Data Services]]=


{{#ask: [[Category:Institute]]
'''Create new DataService page with [[Form:DataService]]'''
 
{{#ask: [[Category:DataService]]
|?accessRights
|?-servedBy=serves dataset
  |format=datatables
  |format=datatables
|mainlabel=Data Service
  |limit=50
  |limit=50
  |offset=0
  |offset=0
Line 60: Line 89:
  |order=asc
  |order=asc
  |headers=show
  |headers=show
|mainlabel=Institute
  |searchlabel=... further results
  |searchlabel=... further results
  |class=sortable wikitable smwtable
  |class=sortable wikitable smwtable
Line 81: Line 109:
}}
}}


=Ruisdael [[:Category:Campaign|Campaigns]]=


= Important Vocabularies=
'''Create new Campaign page with [[Form:Campaign]]'''
* DCAT: [[MediaWiki:Smw_import_dcat]]
* Dublin Core Terms: [[MediaWiki:Smw_import_dcterms]]
* FOAF: [[MediaWiki:Smw_import_foaf]]


= Schema: =


{{#ask: [[Category:Campaign]]
|?atLocation
|?hasGeographicCoordinates
|?startDate
|?endDate
|?contributesTo=contributes to dataset
|?hasParticipant
|format=datatables
|mainlabel=title
|limit=50
|offset=0
|link=all
|sort=
|order=asc
|headers=show
|searchlabel=... further results
|class=sortable wikitable smwtable
|sep=,&#32;
|prefix=none
|datatables-info=1
|datatables-lengthchange=1
|datatables-ordering=1
|datatables-paging=1
|datatables-searching=1
|datatables-pagingtype=full_numbers
|datatables-pagelength=20
|datatables-lengthmenu=10, 20, 50, 100, 200
|datatables-scroller.displaybuffer=50
|datatables-dom=lfrtip
|datatables-responsive=1
|datatables-searchpanes.collapse=1
|datatables-searchpanes.threshold=0.6
|datatables-searchpanes.mincount=1
}}


==[[:Category:Dataset]]==
=Ruisdael Partner [[:Category:Organization|Organizations]]=


'''Create new Organization page with [[Form:Organization]]'''


[[Form:Dataset]] [[Template:Dataset]]
{{#ask:[[Category:Organization]]
 
  |?isRuisdaelConsortiumPartner
mandatory:
  |?Foaf:name
* '''[[property:title]] ''' (mandatory)
  |?contactPoint
* '''[[property:description]]''' (mandatory)
  |?identifier
* '''[[property:hasStatus]]''' (mandatory)
 
recommended:
* '''[[property:contactPoint]]''' -> foaf:Agent TODO: redlink to Agent form
* '''[[property:theme]] ''' - with controlled vocabulary (include later)
* [[property:keyword]] - with controlled vocabulary  (include later)
 
optional:
*  '''[[property:landingPage]]'''
* [[property:temporalResolution]] (include later)
* '''[[property:accessRights]]'''
* '''[[property:identifier]]'''
* '''[[property:publisher]]''' -> foaf:Agent
* '''[[property:creator]]''' -> foaf:Agent
* [[property:temporal]] -> property:periodOfTime
* [[property:spatial]] -> property:Location
* '''[[property::hasInstitute]]'''
 
==[[:Category:Foaf:Person]]==
 
[[Form:Person]] [[Template:Person]]
 
mandatory:
* [[Property:Foaf:name]]
 
recommended:
* [[Property:identifier]] (ORCID)
* [[Property:Foaf:mbox]] email
* [[Property:hasInstitute]]
* [[Property:hasRole]]
 
 
==[[:Category:DataService]]==
 
'''Create new DataService page with [[Form:DataService]]'''
 
[[Template:DataService]]
 
'''TODO: query Datasets that are servedBy DataService X'''
 
 
{{#ask: [[Category:DataService]]
  |?accessRights
  |?landingPage
  |format=datatables
  |format=datatables
  |limit=50
  |limit=50
Line 149: Line 165:
  |order=asc
  |order=asc
  |headers=show
  |headers=show
|mainlabel=Institute
  |searchlabel=... further results
  |searchlabel=... further results
  |class=sortable wikitable smwtable
  |class=sortable wikitable smwtable
Line 169: Line 186:
}}
}}


mandatory:
=Ruisdael Staff ([[:Category:Foaf:Person|Person]])=
* [[Property:Foaf:name]]
* [[Property:accessRights]] - public / private




optional:
'''Create new Person page with [[Form:Person]]'''
* [[property:landingPage]]
* [[property:contactPoint]] (usure)
* [[Property:Foaf:mbox]] email
* [[Property:documentation]]


=Other structures=
{{#ask: [[Category:Foaf:Person]]
 
|?affiliation 
==[[Template:terminfo]]==
|?hasRole
* input: (1) property of category name. ie. <nowiki>Property:Foaf:mbox</nowiki>, <nowiki>:Category:Dataset</nowiki>
|format=datatables
* invoking:<nowiki>{{terminfo|Property:Foaf:mbox}} OR {{terminfo|:Category:Dataset}}</nowiki>
|limit=50
* examples:
|offset=0
|link=all
|sort=
|order=asc
|headers=show
|mainlabel=Name
|searchlabel=... further results
|class=sortable wikitable smwtable
|sep=,&#32;
|prefix=none
|datatables-info=1
|datatables-lengthchange=1
|datatables-ordering=1
|datatables-paging=1
|datatables-searching=1
|datatables-pagingtype=full_numbers
|datatables-pagelength=50
|datatables-lengthmenu=10, 20, 50, 100, 200
|datatables-scroller.displaybuffer=50
|datatables-dom=lfrtip
|datatables-responsive=1
|datatables-searchpanes.collapse=1
|datatables-searchpanes.threshold=0.6
|datatables-searchpanes.mincount=1
}}


Dataset{{terminfo|:Category:Dataset}}
= Presentations =
mbox{{terminfo|Property:Foaf:mbox}}
* [[Ruisdael Data Catalog - PoC - Ruisdael Science Day 2024]] 2024.09.30
* [[Ruisdael Data Catalog - PoC - presentation 2024.09.06]]

Latest revision as of 14:54, 4 December 2024

schema-ruisdael-data-catalog.png

Purpose of the Ruisdael data catalog

Within Ruisdael, data are stored and distributed through various national and international platforms, such as the KNMI Data Platform (KDP), the ACTRIS CloudNet Portal, 4TU Research Data, MAQ Observations, and the Integrated Carbon Observation System ICOS-portal. The Ruisdael data catalog provides a central, comprehensive overview of all available datasets. The catalog allows to:

  • Index and describe datasets produced by the Ruisdael Observatory, independently of where they are stored or published.
  • Find out where datasets are published/stored, via Property:servedBy.
  • Identify the point of contact for each dataset, especially for unpublished datasets, via Property:contactPoint.
  • Describe special measurement campaigns or periods, and the datasets associated with them.

Note: the Ruisdael data catalog is not meant to index software. The latter can be published and accessed via the Ruisdael GitHub page: https://github.com/ruisdael-observatory

How does it work?

The catalog is set up as a collaborative editing content management system (i.e., a Wiki). Everyone can read the Wiki and search the catalog. Registered users can add datasets, edit pages and access more advanced functions.

Usernames and accounts can be requested via Github issues or by sending an email to Marc Schleiss <M.A.Schleiss@tudelft.nl> or Niels Jansen <N.H.Jansen@tudelft.nl>.

A good data catalog requires commitment and discipline. Each consortium partner/unit/PI is responsible for entering and updating the information about their datasets. If you have any questions or need assistance with entering information or managing a particularly challenging dataset, please don't hesitate to contact the admins.

Useful Resources

Ruisdael Datasets

Create Dataset page with Form:Dataset

Search Datasets

See Datasets on Datasets Map

Ruisdael Data Services

Create new DataService page with Form:DataService

Ruisdael Campaigns

Create new Campaign page with Form:Campaign


Ruisdael Partner Organizations

Create new Organization page with Form:Organization

Ruisdael Staff (Person)

Create new Person page with Form:Person

Presentations

Retrieved from "https://ruisdael-catalog.citg.tudelft.nl/index.php?title=Main_Page&oldid=1101"