{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,25]],"date-time":"2025-03-25T19:07:34Z","timestamp":1742929654784,"version":"3.40.3"},"publisher-location":"Cham","reference-count":19,"publisher":"Springer International Publishing","isbn-type":[{"type":"print","value":"9783030615260"},{"type":"electronic","value":"9783030615277"}],"license":[{"start":{"date-parts":[[2020,1,1]],"date-time":"2020-01-01T00:00:00Z","timestamp":1577836800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,15]],"date-time":"2020-10-15T00:00:00Z","timestamp":1602720000000},"content-version":"vor","delay-in-days":288,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this paper, we address the task of representation, semantic annotation, storage, and querying of predictive modelling experiments. We introduce OntoExp, an OntoDM module which gives a more granular representation of a predictive modeling experiment and enables annotation of the experiment\u2019s provenance, algorithm implementations, parameter settings and output metrics. This module is incorporated in SemanticHub, an online system that allows execution, annotation, storage and querying of predictive modeling experiments. The system offers two different user scenarios. The users can either define their own experiment and execute it, or they can browse the repository of completed experimental workflows across different predictive modelling tasks. Here, we showcase the capabilities of the system with executing multi-target regression experiment on a water quality prediction dataset using the Clus software. The system and created repositories are evaluated based on the FAIR data stewardship guidelines. The evaluation shows that OntoExp and SemanticHub provide the infrastructure needed for semantic annotation, execution, storage, and querying of the experiments.<\/jats:p>","DOI":"10.1007\/978-3-030-61527-7_9","type":"book-chapter","created":{"date-parts":[[2020,10,14]],"date-time":"2020-10-14T18:04:39Z","timestamp":1602698679000},"page":"124-139","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Semantic Annotation of Predictive Modelling Experiments"],"prefix":"10.1007","author":[{"given":"Ilin","family":"Tolovski","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2363-712X","authenticated-orcid":false,"given":"Sa\u0161o","family":"D\u017eeroski","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7685-9140","authenticated-orcid":false,"given":"Pan\u010de","family":"Panov","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,10,15]]},"reference":[{"key":"9_CR1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/9780262527811.001.0001","volume-title":"Building Ontologies with Basic Formal Ontology","author":"R Arp","year":"2015","unstructured":"Arp, R., Smith, B., Spear, A.D.: Building Ontologies with Basic Formal Ontology. MIT Press, Cambridge (2015)"},{"key":"9_CR2","doi-asserted-by":"publisher","first-page":"e0154556","DOI":"10.1371\/journal.pone.0154556","volume":"11","author":"A Bandrowski","year":"2016","unstructured":"Bandrowski, A.: The ontology for biomedical investigations. PLOS One 11, e0154556 (2016)","journal-title":"PLOS One"},{"key":"9_CR3","unstructured":"Ceusters, W.: An information artifact ontology perspective on data collections and associated representational artifacts. In: MIE, pp. 68\u201372 (2012)"},{"key":"9_CR4","unstructured":"Coretrustseal for data repositories (2019). https:\/\/www.coretrustseal.org"},{"issue":"1","key":"9_CR5","doi-asserted-by":"publisher","first-page":"23","DOI":"10.3233\/AO-2011-0087","volume":"6","author":"M Courtot","year":"2011","unstructured":"Courtot, M., et al.: MIREOT: the minimum information to reference an external ontology term. Appl. Ontol. 6(1), 23\u201333 (2011)","journal-title":"Appl. Ontol."},{"key":"9_CR6","unstructured":"Esteves, D., Lawrynowicz, A., Panov, P., Soldatova, L., Soru, T., Vanschoren, J.: ML schema core specification. W3C (2016). http:\/\/www.w3.org\/2016\/10\/mls"},{"key":"9_CR7","doi-asserted-by":"crossref","unstructured":"Esteves, D., et al.: MEX vocabulary: a lightweight interchange format for machine learning experiments. In: Proceedings of the 11th International Conference on Semantic Systems, pp. 169\u2013176 (2015)","DOI":"10.1145\/2814864.2814883"},{"issue":"6","key":"9_CR8","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1016\/j.knosys.2008.03.005","volume":"21","author":"EV Hatzikos","year":"2008","unstructured":"Hatzikos, E.V., Tsoumakas, G., Tzanis, G., Bassiliades, N., Vlahavas, I.: An empirical study on sea water quality prediction. Knowl. Based Syst. 21(6), 471\u2013478 (2008)","journal-title":"Knowl. Based Syst."},{"key":"9_CR9","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.websem.2015.01.001","volume":"32","author":"CM Keet","year":"2015","unstructured":"Keet, C.M.: The data mining optimization ontology. J. Web Semant. 32, 43\u201353 (2015)","journal-title":"J. Web Semant."},{"key":"9_CR10","first-page":"55","volume":"32","author":"A Lawrynowicz","year":"2017","unstructured":"Lawrynowicz, A., Esteves, D., Panov, P., Soru, T., Dzeroski, S., Vanschoren, J.: An algorithm, implementation and execution ontology design pattern. Adv. Ontol. Des. Patterns 32, 55 (2017)","journal-title":"Adv. Ontol. Des. Patterns"},{"issue":"1","key":"9_CR11","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1186\/2041-1480-5-25","volume":"5","author":"J Malone","year":"2014","unstructured":"Malone, J.: The Software Ontology (SWO): a resource for reproducibility in biomedical data analysis, curation and digital preservation. J. Biomed. Semant. 5(1), 25 (2014)","journal-title":"J. Biomed. Semant."},{"issue":"5","key":"9_CR12","doi-asserted-by":"publisher","first-page":"1222","DOI":"10.1007\/s10618-014-0363-0","volume":"28","author":"P Panov","year":"2014","unstructured":"Panov, P., Soldatova, L., D\u017eeroski, S.: Ontology of core data mining entities. Data Min. Knowl. Discov. 28(5), 1222\u20131265 (2014). https:\/\/doi.org\/10.1007\/s10618-014-0363-0","journal-title":"Data Min. Knowl. Discov."},{"key":"9_CR13","doi-asserted-by":"publisher","first-page":"900","DOI":"10.1016\/j.ins.2015.08.006","volume":"329","author":"P Panov","year":"2016","unstructured":"Panov, P., Soldatova, L.N., D\u017eeroski, S.: Generic ontology of datatypes. Inf. Sci. 329, 900\u2013920 (2016)","journal-title":"Inf. Sci."},{"key":"9_CR14","unstructured":"Schelter, S., B\u00f6se, J.H., Kirschnick, J., Klein, T., Seufert, S.: Automatically tracking metadata and provenance of machine learning experiments. In: Machine Learning Systems Workshop at NIPS (2017)"},{"issue":"5","key":"9_CR15","doi-asserted-by":"publisher","first-page":"R46","DOI":"10.1186\/gb-2005-6-5-r46","volume":"6","author":"B Smith","year":"2005","unstructured":"Smith, B., et al.: Relations in biomedical ontologies. Genome Biol. 6(5), R46 (2005)","journal-title":"Genome Biol."},{"issue":"11","key":"9_CR16","doi-asserted-by":"publisher","first-page":"1251","DOI":"10.1038\/nbt1346","volume":"25","author":"B Smith","year":"2007","unstructured":"Smith, B., et al.: The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration. Nat. Biotechnol. 25(11), 1251 (2007)","journal-title":"Nat. Biotechnol."},{"key":"9_CR17","unstructured":"Vanschoren, J., Soldatova, L.: Expos\u00e9: an ontology for data mining experiments. In: International Workshop on Third Generation Data Mining, SoKD-2010, pp. 31\u201346 (2010)"},{"key":"9_CR18","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1145\/2641190.2641198","volume":"15","author":"J Vanschoren","year":"2014","unstructured":"Vanschoren, J., Van Rijn, J.N., Bischl, B., Torgo, L.: OpenML: networked science in machine learning. ACM SIGKDD Exp. Newslett. 15, 49\u201360 (2014)","journal-title":"ACM SIGKDD Exp. Newslett."},{"issue":"1","key":"9_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/sdata.2016.18","volume":"3","author":"MD Wilkinson","year":"2016","unstructured":"Wilkinson, M.D.: The fair guiding principles for scientific data management and stewardship. Sci. Data 3(1), 1\u20139 (2016)","journal-title":"Sci. Data"}],"container-title":["Lecture Notes in Computer Science","Discovery Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-61527-7_9","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T11:54:49Z","timestamp":1709812489000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-61527-7_9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020]]},"ISBN":["9783030615260","9783030615277"],"references-count":19,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-61527-7_9","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"type":"print","value":"0302-9743"},{"type":"electronic","value":"1611-3349"}],"subject":[],"published":{"date-parts":[[2020]]},"assertion":[{"value":"15 October 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"DS","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Discovery Science","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Thessaloniki","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Greece","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2020","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"19 October 2020","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"21 October 2020","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"23","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"dis2020","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/ds2020.csd.auth.gr\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Single-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"76","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"26","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"19","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"34% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"4","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Yes","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"The conference took place virtually due to the COVID-19 pandemic","order":10,"name":"additional_info_on_review_process","label":"Additional Info on Review Process","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}