{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,3]],"date-time":"2026-02-03T18:13:59Z","timestamp":1770142439191,"version":"3.49.0"},"reference-count":54,"publisher":"Springer Science and Business Media LLC","issue":"S1","license":[{"start":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T00:00:00Z","timestamp":1683676800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T00:00:00Z","timestamp":1683676800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100019180","name":"HORIZON EUROPE European Research Council","doi-asserted-by":"publisher","award":["825575"],"award-info":[{"award-number":["825575"]}],"id":[{"id":"10.13039\/100019180","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Introduction<\/jats:title>\n                <jats:p>The Semantic Web community provides a common Resource Description Framework (RDF) that allows representation of resources such that they can be linked. To maximize the potential of linked data - machine-actionable interlinked resources on the Web - a certain level of quality of RDF resources should be established, particularly in the biomedical domain in which concepts are complex and high-quality biomedical ontologies are in high demand. However, it is unclear which quality metrics for RDF resources exist that can be automated, which is required given the multitude of RDF resources. Therefore, we aim to determine these metrics and demonstrate an automated approach to assess such metrics of RDF resources.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>An initial set of metrics are identified through literature, standards, and existing tooling. Of these, metrics are selected that fulfil these criteria: (1) objective; (2) automatable; and (3) foundational. Selected metrics are represented in RDF and semantically aligned to existing standards. These metrics are then implemented in an open-source tool. To demonstrate the tool, eight commonly used RDF resources were assessed, including data models in the healthcare domain (HL7 RIM, HL7 FHIR, CDISC CDASH), ontologies (DCT, SIO, FOAF, ORDO), and a metadata profile (GRDDL).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Six objective metrics are identified in 3 categories: <jats:italic>Resolvability<\/jats:italic> (1), <jats:italic>Parsability<\/jats:italic> (1), and <jats:italic>Consistency<\/jats:italic> (4), and represented in RDF. The tool demonstrates that these metrics can be automated, and application in the healthcare domain shows non-resolvable URIs (ranging from 0.3% to 97%) among all eight resources and undefined URIs in HL7 RIM, and FHIR. In the tested resources no errors were found for <jats:italic>parsability<\/jats:italic> and the other three <jats:italic>consistency<\/jats:italic> metrics for correct usage of classes and properties.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>We extracted six objective and automatable metrics from literature, as the foundational quality requirements of RDF resources to maximize the potential of linked data. Automated tooling to assess resources has shown to be effective to identify quality issues that must be avoided. This approach can be expanded to incorporate more automatable metrics so as to reflect additional quality dimensions with the assessment tool implementing more metrics.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-023-02182-8","type":"journal-article","created":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T10:06:53Z","timestamp":1683713213000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Automated approach for quality assessment of RDF resources"],"prefix":"10.1186","volume":"23","author":[{"given":"Shuxin","family":"Zhang","sequence":"first","affiliation":[]},{"given":"Nirupama","family":"Benis","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1704-5980","authenticated-orcid":false,"given":"Ronald","family":"Cornet","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,5,10]]},"reference":[{"key":"2182_CR1","unstructured":"Klyne G, Carroll JJ, McBride B. 2.2.6 Anyone Can Make Statements About Any Resource. https:\/\/www.w3.org\/TR\/rdf-concepts\/section-anyone. Accessed 31 Mar 2022."},{"issue":"3","key":"2182_CR2","doi-asserted-by":"publisher","first-page":"233","DOI":"10.3233\/SW-130117","volume":"4","author":"P Hitzler","year":"2013","unstructured":"Hitzler P, Janowicz K. Linked Data, Big Data, and the 4th Paradigm. Semantic Web. 2013;4(3):233\u20135.","journal-title":"Semantic Web."},{"key":"2182_CR3","unstructured":"McCrae JP. The Linked Open Data Cloud. https:\/\/lod-cloud.net. Accessed 31 Mar 2022."},{"issue":"2","key":"2182_CR4","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1145\/3397512","volume":"64","author":"P Hitzler","year":"2021","unstructured":"Hitzler P. A review of the semantic web field. Commun ACM. 2021;64(2):76\u201383.","journal-title":"Commun ACM."},{"key":"2182_CR5","unstructured":"Cyganiak R, Wood D, Lanthaler M. RDF 1.1 Concepts and Abstract Syntax. W3C Recommendation. 2014. https:\/\/www.w3.org\/TR\/rdf11-concepts\/."},{"issue":"4","key":"2182_CR6","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1016\/j.jbi.2012.06.005","volume":"45","author":"H Saitwal","year":"2012","unstructured":"Saitwal H, Qing D, Jones S, Bernstam EV, Chute CG, Johnson TR. Cross-terminology mapping challenges: a demonstration using medication terminological systems. J Biomed Inf. 2012;45(4):613\u201325.","journal-title":"J Biomed Inf."},{"key":"2182_CR7","doi-asserted-by":"publisher","first-page":"435","DOI":"10.3389\/fphar.2018.00435","volume":"9","author":"A Pacaci","year":"2018","unstructured":"Pacaci A, Gonul S, Sinaci AA, Yuksel M, Laleci Erturkmen GB. A semantic transformation methodology for the secondary use of observational healthcare data in postmarketing safety studies. Front Pharmacol. 2018;9:435.","journal-title":"Front Pharmacol."},{"issue":"1","key":"2182_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13326-016-0047-3","volume":"7","author":"F Dhombres","year":"2016","unstructured":"Dhombres F, Bodenreider O. Interoperability between phenotypes in research and healthcare terminologies-Investigating partial mappings between HPO and SNOMED CT. J Biomed Semantics. 2016;7(1):1\u201313.","journal-title":"J Biomed Semantics."},{"key":"2182_CR9","unstructured":"Vasant D, Chanas L, Malone J, Hanauer M, Olry A, Jupp S, et al. ORDO: an ontology connecting rare disease, epidemiology and genetic data. Phenotype data ISMB2014. 2014."},{"key":"2182_CR10","doi-asserted-by":"crossref","unstructured":"Graves M, Constabaris A, Brickley D. FOAF: connecting people on the semantic web. Cat Classif Q. 2007;43:191\u2013202.","DOI":"10.1300\/J104v43n03_10"},{"key":"2182_CR11","doi-asserted-by":"crossref","unstructured":"Bizer C, Heath T, Berners-Lee T. Linked data - the story so far. Int J Semant Web Inf Syst. 2009;5:1\u201322.","DOI":"10.4018\/jswis.2009081901"},{"issue":"2","key":"2182_CR12","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1109\/MS.2008.30","volume":"25","author":"J Boegh","year":"2008","unstructured":"Boegh J. A new standard for quality requirements. IEEE Softw. 2008;25(2):57.","journal-title":"IEEE Softw."},{"issue":"11","key":"2182_CR13","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1145\/240455.240479","volume":"39","author":"Y Wand","year":"1996","unstructured":"Wand Y, Wang RY. Anchoring data quality dimensions in ontological foundations. Commun ACM. 1996;39(11):86\u201395.","journal-title":"Commun ACM."},{"issue":"1","key":"2182_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.websem.2008.02.005","volume":"7","author":"C Bizer","year":"2009","unstructured":"Bizer C, Cyganiak R. Quality-driven information filtering using the WIQA policy framework. J Web Semantics. 2009;7(1):1\u201310.","journal-title":"J Web Semantics."},{"key":"2182_CR15","doi-asserted-by":"crossref","unstructured":"Mendes P, M\u00fchleisen H, Bizer C. Sieve: linked data quality assessment and fusion. In: ACM international conference proceeding series; 2012. pp. 116\u201323 .","DOI":"10.1145\/2320765.2320803"},{"issue":"1","key":"2182_CR16","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1007\/s41019-015-0004-7","volume":"1","author":"D Firmani","year":"2016","unstructured":"Firmani D, Mecella M, Scannapieco M, Batini C. On the meaningfulness of \u201cbig data quality\u2019\u2019. Data Sci Eng. 2016;1(1):6\u201320.","journal-title":"Data Sci Eng."},{"key":"2182_CR17","doi-asserted-by":"crossref","unstructured":"Tarasowa D, Lange C, Auer S. Measuring the quality of relational-to-RDF mappings. In: international conference on knowledge engineering and the semantic web. Springer;\u00a02015. pp. 210\u201324.\u00a0","DOI":"10.1007\/978-3-319-24543-0_16"},{"issue":"1","key":"2182_CR18","doi-asserted-by":"publisher","first-page":"77","DOI":"10.3233\/SW-170275","volume":"9","author":"M F\u00e4rber","year":"2018","unstructured":"F\u00e4rber M, Bartscherer F, Menne C, Rettinger A. Linked data quality of dbpedia, freebase, opencyc, wikidata, and yago. Semantic Web. 2018;9(1):77\u2013129.","journal-title":"Semantic Web."},{"key":"2182_CR19","unstructured":"F\u00fcrber C, Hepp M. Swiqa\u2013a semantic web information quality assessment framework. 2011."},{"key":"2182_CR20","doi-asserted-by":"crossref","unstructured":"Ge M, Helfert M. Data and information quality assessment in information manufacturing systems. In: lecture notes in business information processing. 2008.","DOI":"10.1007\/978-3-540-79396-0_33"},{"key":"2182_CR21","unstructured":"Schultz A, Matteini A, Isele R, Mendes PN, Bizer C, Becker C. LDIF\u2014A framework for large-scale linked data integration. France: In: 21st International World Wide Web Conference (WWW2012), Developers 831 Track, Lyon, vol. 10. 2012."},{"key":"2182_CR22","doi-asserted-by":"crossref","unstructured":"Kontokostas D, Westphal P, Auer S, Hellmann S, Lehmann J, Cornelissen R, et al. Test-driven evaluation of linked data quality. In Proceedings of the 23rd international conference on World Wide Web. New York: ACM; 2014. pp.747\u201358.\u00a0","DOI":"10.1145\/2566486.2568002"},{"issue":"1","key":"2182_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2992786","volume":"8","author":"J Debattista","year":"2016","unstructured":"Debattista J, Auer S, Lange C. Luzzu-a methodology and framework for linked data quality assessment. J Data Inf Qual (JDIQ). 2016;8(1):1\u201332.","journal-title":"J Data Inf Qual (JDIQ)."},{"key":"2182_CR24","unstructured":"Debattista J, Lange C, Auer S. daQ, an ontology for dataset quality information. Seoul: In proceedings of the LDOW 2014;\u00a02014. p.7\u201311."},{"issue":"suppl-2","key":"2182_CR25","doi-asserted-by":"publisher","first-page":"W541","DOI":"10.1093\/nar\/gkr469","volume":"39","author":"PL Whetzel","year":"2011","unstructured":"Whetzel PL, Noy NF, Shah NH, Alexander PR, Nyulas C, Tudorache T, et al. BioPortal: enhanced functionality via new Web services from the National Center for Biomedical Ontology to access and use ontologies in software applications. Nucleic Acids Res. 2011;39(suppl-2):W541\u20135.","journal-title":"Nucleic Acids Res."},{"issue":"11","key":"2182_CR26","doi-asserted-by":"publisher","first-page":"1251","DOI":"10.1038\/nbt1346","volume":"25","author":"B Smith","year":"2007","unstructured":"Smith B, Ashburner M, Rosse C, Bard J, Bug W, Ceusters W, et al. The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol. 2007;25(11):1251\u20135.","journal-title":"Nat Biotechnol."},{"key":"2182_CR27","doi-asserted-by":"crossref","unstructured":"Zhang S, Benis N, Cornet R. Assessing resolvability and consistency in OBO foundry ontologies: pilot study. In: Studies in Health Technology and Informatics; 2021. p. 104\u20138.","DOI":"10.3233\/SHTI210825"},{"key":"2182_CR28","unstructured":"World Wide Web Consortium. Data catalog vocabulary (DCAT). W3C; 2014."},{"key":"2182_CR29","unstructured":"Beckett D, Berners-Lee T, Prud\u2019hommeaux E, Carothers G. RDF 1.1 Turtle. World Wide Web Consortium. 2014. p. 18\u201331."},{"key":"2182_CR30","unstructured":"25012:2008 I. ISO\/IEC 25012:2008 Software engineering - Software product Quality Requirements and Evaluation (SQuaRE) - Data quality model. https:\/\/www.iso.org\/standard\/35736.html. Accessed 31 Mar 2022."},{"issue":"1","key":"2182_CR31","doi-asserted-by":"publisher","first-page":"63","DOI":"10.3233\/SW-150175","volume":"7","author":"A Zaveri","year":"2016","unstructured":"Zaveri A, Rula A, Maurino A, Pietrobon R, Lehmann J, Auer S. Quality assessment for linked data: A survey. Semantic Web. 2016;7(1):63\u201393.","journal-title":"Semantic Web."},{"key":"2182_CR32","doi-asserted-by":"crossref","unstructured":"Albertoni R, Isaac A. Introducing the data quality vocabulary (DQV). Semantic Web.\u00a02021;12(1):81\u201397.","DOI":"10.3233\/SW-200382"},{"key":"2182_CR33","unstructured":"Debattista J. Data Quality Metric (DQM) vocabulary. http:\/\/purl.org\/eis\/vocab\/dqm#. Accessed 31 Mar 2022."},{"key":"2182_CR34","unstructured":"Brickley D. Resource description framework (RDF) schema specification RDF schemas. W3C. 2012;1999:1\u201320."},{"key":"2182_CR35","unstructured":"Zaveri A, Rula A, Maurino A, Pietrobon R, Lehmann J, Auer S. Linked Data Quality Dimension (LDQD) vocabulary. https:\/\/www.w3.org\/2016\/05\/ldqd. Accessed 31 Mar 2022."},{"key":"2182_CR36","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.websem.2013.05.001","volume":"20","author":"T Baker","year":"2013","unstructured":"Baker T, Bechhofer S, Isaac A, Miles A, Schreiber G, Summers E. Key choices in the design of Simple Knowledge Organization System (SKOS). J Web Semantics. 2013;20:35\u201349.","journal-title":"J Web Semantics."},{"key":"2182_CR37","unstructured":"RDFlib. RDFLib. https:\/\/github.com\/RDFLib\/rdflib. Accessed 31 Mar 2022."},{"key":"2182_CR38","doi-asserted-by":"crossref","unstructured":"Zhang S. An Automated Tool for Assessing Resolvability, Parsability, and Consistency of RDF Resources. https:\/\/github.com\/sxzhang1201\/assess-rdf-resource. Accessed 31 Mar 2022.","DOI":"10.21203\/rs.3.rs-3223793\/v1"},{"key":"2182_CR39","unstructured":"Dominique Haza\u00ebl-Massieux, Dan Connolly. Gleaning resource descriptions from dialects of languages (GRDDL). http:\/\/www.w3.org\/TR\/grddl\/. Accessed 31 Mar 2022."},{"key":"2182_CR40","doi-asserted-by":"publisher","unstructured":"Kunze JA, Baker T. The Dublin core metadata element set. RFC Editor. 2007.\u00a0https:\/\/doi.org\/10.17487\/RFC5013.","DOI":"10.17487\/RFC5013"},{"issue":"1","key":"2182_CR41","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/2041-1480-5-14","volume":"5","author":"M Dumontier","year":"2014","unstructured":"Dumontier M, Baker CJ, Baran J, Callahan A, Chepelev L, Cruz-Toledo J, et al. The Semanticscience Integrated Ontology (SIO) for biomedical research and knowledge discovery. J Biomed Semantics. 2014;5(1):1\u201311.","journal-title":"J Biomed Semantics."},{"issue":"1","key":"2182_CR42","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1197\/jamia.M1888","volume":"13","author":"RH Dolin","year":"2006","unstructured":"Dolin RH, Alschuler L, Boyer S, Beebe C, Behlen FM, Biron PV, et al. HL7 clinical document architecture, release 2. J Am Med Inf Assoc. 2006;13(1):30\u20139.","journal-title":"J Am Med Inf Assoc."},{"key":"2182_CR43","doi-asserted-by":"crossref","unstructured":"Bender D, Sartipi K. HL7 FHIR: an agile and RESTful approach to healthcare information exchange. In: proceedings of CBMS 2013 - 26th IEEE international symposium on computer-based medical systems; 2013. p. 326\u201331.","DOI":"10.1109\/CBMS.2013.6627810"},{"key":"2182_CR44","unstructured":"CDISC. The Clinical Data Acquisition Standards Harmonization (CDASH). https:\/\/www.cdisc.org\/standards\/foundational\/cdash. Accessed 31 Mar 2022."},{"issue":"10","key":"2182_CR45","first-page":"2004","volume":"10","author":"DL McGuinness","year":"2004","unstructured":"McGuinness DL, Van\u00a0Harmelen F, et al. OWL web ontology language overview. W3C Recomm. 2004;10(10):2004.","journal-title":"W3C Recomm"},{"key":"2182_CR46","doi-asserted-by":"publisher","unstructured":"Freed N, Klensin J, Hansen T .Media type specifications and registration procedures. technical report. Internet society.\u00a02013. https:\/\/doi.org\/10.17487\/RFC6838.","DOI":"10.17487\/RFC6838"},{"key":"2182_CR47","doi-asserted-by":"publisher","unstructured":"Hugo W, Le Franc Z, Coen G, Parland-von Essen\u00a0 J, Bonino L. In: D2.5 FAIR semantics recommendations second iteration, zenodo. 2020. https:\/\/doi.org\/10.5281\/zenodo.5362010.","DOI":"10.5281\/zenodo.5362010"},{"key":"2182_CR48","unstructured":"Noy NF, McGuinness DL, et al.  Ontology\ndevelopment 101: A guide to creating your first ontology. Technical Report SMI-2001-0880, Stanford\nMedical Informatics; 2001."},{"key":"2182_CR49","doi-asserted-by":"crossref","unstructured":"Gangemi A. Ontology Design Patterns for Semantic Web Content. In: The Semantic Web \u2013 ISWC 2005. Springer Berlin Heidelberg; 2005. p. 262\u2013276.","DOI":"10.1007\/11574620_21"},{"issue":"1","key":"2182_CR50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13326-017-0169-2","volume":"9","author":"Y He","year":"2018","unstructured":"He Y, Xiang Z, Zheng J, Lin Y, Overton JA, Ong E. The eXtensible ontology development (XOD) principles and tool implementation to support ontology interoperability. J Biomed Semantics. 2018;9(1):1\u201310.","journal-title":"J Biomed Semantics."},{"issue":"1","key":"2182_CR51","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/S1071-5819(02)00127-1","volume":"58","author":"JH Gennari","year":"2003","unstructured":"Gennari JH, Musen MA, Fergerson RW, Grosso WE, Crub\u00e9zy M, Eriksson H, et al. The evolution of Prot\u00e9g\u00e9: an environment for knowledge-based systems development. Int J Hum-Comput Stud. 2003;58(1):89\u2013123.","journal-title":"Int J Hum-Comput Stud."},{"key":"2182_CR52","doi-asserted-by":"crossref","unstructured":"Hemid A, Halilaj L, Khiat A, Lohmann S. RDF doctor: A holistic approach for syntax error detection and correction of RDF data. In: IC3K 2019 - Proceedings of the 11th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management. 2019.","DOI":"10.5220\/0008493205080516"},{"key":"2182_CR53","unstructured":"Verborgh R, De Wilde M. Using openrefine. Packt publishing Ltd; 2013."},{"key":"2182_CR54","unstructured":"Lebo T, Sahoo S, McGuinness D, Belhajjame K, Cheney J, Corsar D, et al. PROV-O: The PROV Ontology. W3C Recommendation 30 April; 2013. http:\/\/www.w3.org\/TR\/2013\/REC-prov-o-20130430\/."}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02182-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-023-02182-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02182-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T08:19:10Z","timestamp":1725956350000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-023-02182-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,10]]},"references-count":54,"journal-issue":{"issue":"S1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2182"],"URL":"https:\/\/doi.org\/10.1186\/s12911-023-02182-8","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,10]]},"assertion":[{"value":"18 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 April 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 May 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"90"}}