View source for Ruisdael Data Catalog - PoC - Ruisdael Science Day 2024


[[File:rcfrupys-400.png|200px]]

<span style="font-size:large">tinyurl.com/rcfrupys</span>

<span style="font-size:larger">https://ruisdael-catalog.citg.tudelft.nl/</span>

__TOC__

=Goals of Data Catalog proof-of-concept=

Considering that '''''data is the main deliverable''''' of the Ruisdael Observatory,<br/>
the Data Catalog attempts to:

* '''index and describe''' datasets produced within Ruisdael Observatory, independently from where it is stored or published - embracing heterogeneity
* '''find where each dataset is published/stored'''<ref>via [[Property:servedBy]] which points to [[:Category:DataService]] instances</ref>
* '''identify the contact-point of each dataset''', special relevant for unpublished datasets <ref>via [[Property:contactPoint]] which points to [[:Category:Foaf:Person]] instances</ref>
* '''link campaigns to datasets'''
* '''leverage individual contributions''' onto a collaborative infrastructure

=Wiki: collaborative editing content management system=

'''suitable to build and maintain a data catalog'''

* out-of-the-box content management system - Wiki 
* anyone with an account can enter and edit content
* anyone with or without an account the view the content
* forms and templates help guiding users' edits
* semantic properties and categories organize and describe content in machine-readable ways, allowing for parametric search and dynamic content aggregation 
* edit-history function allows reverting pages' content to previous versions

==The software: ''[https://www.mediawiki.org/wiki/MediaWiki Mediawiki (MW)]''==
* Open Source Software
* Powers all Wikipedia instances and Wikidata 
* Markup language - easily converted to/from Markdown, HTML, ...
* API
* ecosystem of extensions: ie [https://www.mediawiki.org/wiki/Extension:Page_Forms Page Forms] [https://www.mediawiki.org/wiki/Extension:VisualEditor VisualEditor] [https://www.semantic-mediawiki.org/wiki/Semantic_MediaWiki SMW]

==The extension: ''[https://www.semantic-mediawiki.org/wiki/Semantic_MediaWiki Semantic Mediawiki (SMW)]''==

* Semantic annotations via ''property::value'' pairs and classes (''categories'')
* User defined semantic properties, classes (''categories''), queries, controlled-vocabularies
* RDF export

=Data Catalog structure (schema)=

[[File:schema-ruisdael-data-catalog.png|800px]]

The wiki (Data Catalog) contents are structure loosely around DCAT-AP <ref>"DCAT Application profile for data portals in Europe (DCAT-AP) is a specification based on the Data Catalogue vocabulary (DCAT) for describing public sector datasets in Europe." https://op.europa.eu/nl/web/eu-vocabularies/dcat-ap</ref>

It uses of terms from the following vocabularies:
* Data Catalogue vocabulary (DCAT)<ref>https://www.w3.org/TR/vocab-dcat-3/</ref>: [[MediaWiki:Smw_import_dcat]]
* Dublin Core Metadata Terms(DCMI-Terms)<ref>https://www.dublincore.org/specifications/dublin-core/dcmi-terms/</ref>: [[MediaWiki:Smw_import_dcterms]]
* Friend of a Friend (FOAF)<ref>http://xmlns.com/foaf/spec/</ref>: [[MediaWiki:Smw_import_foaf]]

Organized, around the following categories:
* [[:Category:Dataset]]
* [[:Category:DataService]]
* [[:Category:Foaf:Person]]
* [[:Category:Organization]]
* [[:Category:Campaign]]


More details in [[Help:Data_Catalog_Schema]]
=Entering Data=

From [[Main_Page#Ruisdael_Datasets]]

'''Create Dataset page with [[Form:Dataset]]'''

'''Or "Edit with Form"''' an existing page, ie [[Micro_Rain_Radar_(Metek)_at_Cabauw]]

=Displaying / Searching data=

'''Via query based, dynamic tables''' ie. [[Main Page]]. Or other outputs formats, ie. [[Datasets Map]]'''


'''Via search forms''': {{#queryformlink:form=DatasetSearch|link text=Search Datasets}}'''


=Linking Media=

'''Linking Media (images, PDFs, short videos) to Dataset, Data Services, Campaigns, Organizations'''

'''Via File: pages''' ie. [[File:campaign_data_handling_protocol.pdf]]) "Edit with Form" button

=Getting Started=


'''New users can request accounts via [https://github.com/ruisdael-observatory/Ruisdael-Data-Catalog/issues/new?template=WikiAccount.yml Github issues]''' or email to Marc Schleiss <M.A.Schleiss@tudelft.nl> or Niels Jansen <N.H.Jansen@tudelft.nl>.


'''[[Help:Catalog editing]]''' contains information on how to edit and add content to the wiki


'''[[Help:Data Catalog Schema]]''' includes descriptions of the Categories & Properties, forms and templates used to implement the catalog 


'''Discussions and development take place over [https://github.com/orgs/ruisdael-observatory/projects/1/ github  Ruisdael Data Catalog project]'''


'''Issues can be reported in https://github.com/ruisdael-observatory/Ruisdael-Data-Catalog/issues'''


''[[Help:Wiki administration]]''' includes information on how to maintain this wiki (for admins)

=References=