{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T17:50:20Z","timestamp":1770486620990,"version":"3.49.0"},"reference-count":60,"publisher":"Walter de Gruyter GmbH","issue":"4","license":[{"start":{"date-parts":[[2017,12,13]],"date-time":"2017-12-13T00:00:00Z","timestamp":1513123200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/3.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,12,13]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Public resources need to be appropriately annotated with metadata in order to make them discoverable, reproducible and traceable, further enabling them to be interoperable or integrated with other datasets. While data-sharing policies exist to promote the annotation process by data owners, these guidelines are still largely ignored. In this manuscript, we analyse automatic measures of metadata quality, and suggest their application as a mean to encourage data owners to increase the metadata quality of their resources and submissions, thereby contributing to higher quality data, improved data sharing, and the overall accountability of scientific publications. We analyse these metadata quality measures in the context of a real-world repository of metabolomics data (i.e. MetaboLights), including a manual validation of the measures, and an analysis of their evolution over time. Our findings suggest that the proposed measures can be used to mimic a manual assessment of metadata quality.<\/jats:p>","DOI":"10.1515\/jib-2017-0054","type":"journal-article","created":{"date-parts":[[2017,12,13]],"date-time":"2017-12-13T07:59:31Z","timestamp":1513151971000},"source":"Crossref","is-referenced-by-count":13,"title":["Assessing Public Metabolomics Metadata, Towards Improving Quality"],"prefix":"10.1515","volume":"14","author":[{"given":"Jo\u00e3o D.","family":"Ferreira","sequence":"first","affiliation":[{"name":"LaSIGE, Faculdade de Ci\u00eancias, Universidade de Lisboa, Lisboa, Portugal"}]},{"given":"Bruno","family":"In\u00e1cio","sequence":"additional","affiliation":[{"name":"LaSIGE, Faculdade de Ci\u00eancias, Universidade de Lisboa, Lisboa, Portugal"}]},{"given":"Reza M.","family":"Salek","sequence":"additional","affiliation":[{"name":"EMBL-EBI, European Bioinformatics Institute, Hinxton, Cambridge CB10 1SDCambridge, United Kingdom of Great Britain and Northern Ireland"}]},{"given":"Francisco M.","family":"Couto","sequence":"additional","affiliation":[{"name":"LaSIGE, Faculdade de Ci\u00eancias, Universidade de Lisboa, Lisboa, Portugal"}]}],"member":"374","reference":[{"key":"ref541","doi-asserted-by":"crossref","first-page":"1587","DOI":"10.1007\/s11306-015-0810-y","article-title":"COordination of Standards in MetabOlomicS (COSMOS): facilitating integrated metabolomics data access","volume":"11","year":"2015","journal-title":"Metabolomics"},{"key":"ref131","article-title":"Impact of translation on named-entity recognition in radiology texts","volume":"2017","year":"2017","journal-title":"Database"},{"key":"ref231","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1351\/pac200274050835","article-title":"Harmonized guidelines for single-laboratory validation of methods of analysis (IUPAC Technical Report)","volume":"74","year":"2002","journal-title":"Pure Appl Chem"},{"key":"ref101","first-page":"1468","volume-title":"Bioinformatics and biomedicine (BIBM), 2016 IEEE international conference on. IEEE","year":"2016"},{"key":"ref551","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1351\/pac200274050835","article-title":"Harmonized guidelines for single-laboratory validation of methods of analysis (IUPAC Technical Report)","volume":"74","year":"2002","journal-title":"Pure Appl Chem"},{"key":"ref71","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1111\/j.1740-9713.2015.00827.x","article-title":"The reproducibility crisis in science: a statistical counterattack","volume":"12","year":"2015","journal-title":"Significance"},{"key":"ref351","article-title":"Why most published research findings are false","volume":"2","year":"2005","journal-title":"PLoS Med"},{"key":"ref301","doi-asserted-by":"crossref","first-page":"2354","DOI":"10.1093\/bioinformatics\/btq415","article-title":"ISA software suite: supporting standards-compliant experimental annotation and enabling curation at the community level","volume":"26","year":"2010","journal-title":"Bioinformatics"},{"key":"ref511","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11306-007-0082-2","article-title":"Proposed minimum reporting standards for chemical analysis","volume":"3","year":"2007","journal-title":"Metabolomics"},{"key":"ref591","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1007\/s11306-015-0879-3","article-title":"Data standards can boost metabolomics research, and if there is a will, there is a way","volume":"12","year":"2016","journal-title":"Metabolomics"},{"key":"ref391","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1111\/j.1740-9713.2015.00827.x","article-title":"The reproducibility crisis in science: a statistical counterattack","volume":"12","year":"2015","journal-title":"Significance"},{"key":"ref341","article-title":"Ten simple rules for the care and feeding of scientific data","volume":"10","year":"2014","journal-title":"PLoS Comput Biol"},{"key":"ref21","article-title":"Ten simple rules for the care and feeding of scientific data","volume":"10","year":"2014","journal-title":"PLoS Comput Biol"},{"key":"ref621","doi-asserted-by":"crossref","first-page":"2354","DOI":"10.1093\/bioinformatics\/btq415","article-title":"ISA software suite: supporting standards-compliant experimental annotation and enabling curation at the community level","volume":"26","year":"2010","journal-title":"Bioinformatics"},{"key":"ref221","doi-asserted-by":"crossref","first-page":"1587","DOI":"10.1007\/s11306-015-0810-y","article-title":"COordination of Standards in MetabOlomicS (COSMOS): facilitating integrated metabolomics data access","volume":"11","year":"2015","journal-title":"Metabolomics"},{"key":"ref461","article-title":"Introducing the knowledge graph: things, not strings","year":"2012","journal-title":"Official Google Blog"},{"key":"ref181","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1007\/s11306-007-0070-6","article-title":"The metabolomics standards initiative (MSI)","volume":"3","year":"2007","journal-title":"Metabolomics"},{"key":"ref01","first-page":"67","volume-title":"Proceedings of the 10th international conference on uncertainty reasoning for the Semantic","volume":"Web-Volume 1259","year":"2014"},{"key":"ref31","article-title":"Why most published research findings are false","volume":"2","year":"2005","journal-title":"PLoS Med"},{"key":"ref41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/2193-1801-4-1","article-title":"Preclinical data reproducibility for R&D-the challenge for neuroscience","volume":"4","year":"2015","journal-title":"SpringerPlus"},{"key":"ref521","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1007\/s11306-007-0081-3","article-title":"Proposed minimum reporting standards for data analysis in metabolomics","volume":"3","year":"2007","journal-title":"Metabolomics"},{"key":"ref11","first-page":"197","volume-title":"11th International Conference on Practical Applications of Computational Biology & Bioinformatics","year":"2017"},{"key":"ref141","article-title":"Introducing the knowledge graph: things, not strings","year":"2012","journal-title":"Official Google Blog"},{"key":"ref431","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/0004-3702(80)90011-9","article-title":"Circumscription a form of non-monotonic reasoning","volume":"13","year":"1980","journal-title":"Artif Intell"},{"key":"ref381","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1038\/483531a","article-title":"Drug development: raise standards for preclinical cancer research","volume":"483","year":"2012","journal-title":"Nature"},{"key":"ref91","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1186\/1471-2105-9-145","article-title":"ComPath: comparative enzyme analysis and annotation in pathway\/subsystem contexts","volume":"9","year":"2008","journal-title":"BMC Bioinf"},{"key":"ref201","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1007\/s11306-007-0081-3","article-title":"Proposed minimum reporting standards for data analysis in metabolomics","volume":"3","year":"2007","journal-title":"Metabolomics"},{"key":"ref311","first-page":"178","article-title":"Knowledge representation and management: a linked data perspective","year":"2016","journal-title":"IMIA Yearb"},{"key":"ref111","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/0004-3702(80)90011-9","article-title":"Circumscription a form of non-monotonic reasoning","volume":"13","year":"1980","journal-title":"Artif Intell"},{"key":"ref331","first-page":"197","volume-title":"11th International Conference on Practical Applications of Computational Biology & Bioinformatics","year":"2017"},{"key":"ref611","article-title":"The MetaboLights repository: curation challenges in metabolomics","volume":"2013","year":"2013","journal-title":"Database"},{"key":"ref191","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11306-007-0082-2","article-title":"Proposed minimum reporting standards for chemical analysis","volume":"3","year":"2007","journal-title":"Metabolomics"},{"key":"ref421","first-page":"1468","volume-title":"Bioinformatics and biomedicine (BIBM), 2016 IEEE international conference on. IEEE","year":"2016"},{"key":"ref481","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1038\/nbt0504-613","article-title":"Data standards for\u2019omic\u2019science","volume":"22","year":"2004","journal-title":"Nat Biotechnol"},{"key":"ref161","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1038\/nbt0504-613","article-title":"Data standards for\u2019omic\u2019science","volume":"22","year":"2004","journal-title":"Nat Biotechnol"},{"key":"ref531","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s11306-013-0618-6","article-title":"Water, water, every where, but rarely any drop to drink","volume":"10","year":"2014","journal-title":"Metabolomics"},{"key":"ref411","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1186\/1471-2105-9-145","article-title":"ComPath: comparative enzyme analysis and annotation in pathway\/subsystem contexts","volume":"9","year":"2008","journal-title":"BMC Bioinf"},{"key":"ref271","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1007\/s11306-015-0879-3","article-title":"Data standards can boost metabolomics research, and if there is a will, there is a way","volume":"12","year":"2016","journal-title":"Metabolomics"},{"key":"ref321","first-page":"67","volume-title":"Proceedings of the 10th international conference on uncertainty reasoning for the Semantic","volume":"Web-Volume 1259","year":"2014"},{"key":"ref281","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1093\/nar\/gks1004","article-title":"MetaboLights \u2013 an open-access general-purpose repository for metabolomics studies and associated meta-data","volume":"41","year":"2013","journal-title":"Nucleic Acids Res"},{"key":"ref171","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1038\/ng1201-365","article-title":"Minimum information about a microarray experiment (MIAME) \u2013 toward standards for microarray data","volume":"29","year":"2001","journal-title":"Nat Genet"},{"key":"ref571","article-title":"Researchers failing to make raw data public","year":"2011","journal-title":"Nature"},{"key":"ref371","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1038\/nrd3439-c1","article-title":"Believe it or not: how much can we rely on published data on potential drug targets?","volume":"10","year":"2011","journal-title":"Nat Rev Drug Discov"},{"key":"ref81","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1161\/CIRCRESAHA.114.303819","article-title":"Reproducibility in science","volume":"116","year":"2015","journal-title":"Circ Res"},{"key":"ref501","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1007\/s11306-007-0070-6","article-title":"The metabolomics standards initiative (MSI)","volume":"3","year":"2007","journal-title":"Metabolomics"},{"key":"ref631","first-page":"178","article-title":"Knowledge representation and management: a linked data perspective","year":"2016","journal-title":"IMIA Yearb"},{"key":"ref361","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/2193-1801-4-1","article-title":"Preclinical data reproducibility for R&D-the challenge for neuroscience","volume":"4","year":"2015","journal-title":"SpringerPlus"},{"key":"ref211","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s11306-013-0618-6","article-title":"Water, water, every where, but rarely any drop to drink","volume":"10","year":"2014","journal-title":"Metabolomics"},{"key":"ref561","doi-asserted-by":"crossref","first-page":"6","DOI":"10.4103\/1673-5374.125322","article-title":"Facilitating transparency in spinal cord injury studies using data standards and ontologies","volume":"9","year":"2014","journal-title":"Neural Regen Res"},{"key":"ref241","doi-asserted-by":"crossref","first-page":"6","DOI":"10.4103\/1673-5374.125322","article-title":"Facilitating transparency in spinal cord injury studies using data standards and ontologies","volume":"9","year":"2014","journal-title":"Neural Regen Res"},{"key":"ref401","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1161\/CIRCRESAHA.114.303819","article-title":"Reproducibility in science","volume":"116","year":"2015","journal-title":"Circ Res"},{"key":"ref441","year":"2001","journal-title":"Ontology development 101: a guide to creating your first ontology. Stanford knowledge systems laboratory technical report KSL-01-05 and Stanford medical informatics technical report SMI-2001-0880"},{"key":"ref491","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1038\/ng1201-365","article-title":"Minimum information about a microarray experiment (MIAME) \u2013 toward standards for microarray data","volume":"29","year":"2001","journal-title":"Nat Genet"},{"key":"ref51","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1038\/nrd3439-c1","article-title":"Believe it or not: how much can we rely on published data on potential drug targets?","volume":"10","year":"2011","journal-title":"Nat Rev Drug Discov"},{"key":"ref251","article-title":"Researchers failing to make raw data public","year":"2011","journal-title":"Nature"},{"key":"ref601","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1093\/nar\/gks1004","article-title":"MetaboLights \u2013 an open-access general-purpose repository for metabolomics studies and associated meta-data","volume":"41","year":"2013","journal-title":"Nucleic Acids Res"},{"key":"ref61","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1038\/483531a","article-title":"Drug development: raise standards for preclinical cancer research","volume":"483","year":"2012","journal-title":"Nature"},{"key":"ref291","article-title":"The MetaboLights repository: curation challenges in metabolomics","volume":"2013","year":"2013","journal-title":"Database"},{"key":"ref121","year":"2001","journal-title":"Ontology development 101: a guide to creating your first ontology. Stanford knowledge systems laboratory technical report KSL-01-05 and Stanford medical informatics technical report SMI-2001-0880"},{"key":"ref451","article-title":"Impact of translation on named-entity recognition in radiology texts","volume":"2017","year":"2017","journal-title":"Database"}],"container-title":["Journal of Integrative Bioinformatics"],"original-title":[],"link":[{"URL":"https:\/\/www.degruyter.com\/view\/journals\/jib\/14\/4\/article-20170054.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/jib-2017-0054\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T01:57:41Z","timestamp":1619056661000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/jib-2017-0054\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,13]]},"references-count":60,"journal-issue":{"issue":"4"},"URL":"https:\/\/doi.org\/10.1515\/jib-2017-0054","relation":{},"ISSN":["1613-4516"],"issn-type":[{"value":"1613-4516","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,12,13]]}}}