{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T16:39:58Z","timestamp":1780418398418,"version":"3.54.1"},"reference-count":129,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2023,12,13]],"date-time":"2023-12-13T00:00:00Z","timestamp":1702425600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SW"],"published-print":{"date-parts":[[2023,12,13]]},"abstract":"<jats:p>With the continuous advancement of methods, tools, and techniques in ontology development, ontologies have emerged in various fields such as machine learning, robotics, biomedical informatics, agricultural informatics, crowdsourcing, database management, and the Internet of Things. Nevertheless, the nonexistence of a universally agreed methodology for specifying and evaluating the quality of an ontology hinders the success of ontology-based systems in such fields as the quality of each component is required for the overall quality of a system and in turn impacts the usability in use. Moreover, a number of anomalies in definitions of ontology quality concepts are visible, and in addition to that, the ontology quality assessment is limited only to a certain set of characteristics in practice even though some other significant characteristics have to be considered for the specified use-case. Thus, in this research, a comprehensive analysis was performed to uncover the existing contributions specifically on ontology quality models, characteristics, and the associated measures of these characteristics. Consequently, the characteristics identified through this review were classified with the associated aspects of the ontology evaluation space. Furthermore, the formalized definitions for each quality characteristic are provided through this study from the ontological perspective based on the accepted theories and standards. Additionally, a thorough analysis of the extent to which the existing works have covered the quality evaluation aspects is presented and the areas further to be investigated are outlined.<\/jats:p>","DOI":"10.3233\/sw-233393","type":"journal-article","created":{"date-parts":[[2023,6,30]],"date-time":"2023-06-30T11:23:46Z","timestamp":1688124226000},"page":"1051-1097","source":"Crossref","is-referenced-by-count":15,"title":["A conceptual model for ontology quality assessment"],"prefix":"10.1177","volume":"14","author":[{"given":"R.S.I.","family":"Wilson","sequence":"first","affiliation":[{"name":"Department of Computer Science and Informatics, Uva Wellassa University, Badulla, Sri Lanka"},{"name":"Department of Information Systems Engineering, University of Colombo School of Computing, Colombo 07, Sri Lanka"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J.S.","family":"Goonetillake","sequence":"additional","affiliation":[{"name":"Department of Information Systems Engineering, University of Colombo School of Computing, Colombo 07, Sri Lanka"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"W.A.","family":"Indika","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Ruhuna, Matara, Sri Lanka"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Athula","family":"Ginige","sequence":"additional","affiliation":[{"name":"School of Computer, Data and Mathematical Sciences, Western Sydney University, NSW, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","reference":[{"issue":"2","key":"10.3233\/SW-233393_ref1","doi-asserted-by":"publisher","first-page":"170","DOI":"10.22266\/ijies2019.0430.17","article-title":"An agile methodology for ontology development","volume":"12","author":"Abdelghany","year":"2019","journal-title":"International Journal of Intelligent Engineering and Systems"},{"key":"10.3233\/SW-233393_ref2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07064-3_38"},{"key":"10.3233\/SW-233393_ref3","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1408"},{"key":"10.3233\/SW-233393_ref4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jbi.2018.02.010","article-title":"Assessing the practice of biomedical ontology evaluation: Gaps and opportunities","volume":"80","author":"Amith","year":"2018","journal-title":"Journal of Biomedical Informatics"},{"key":"10.3233\/SW-233393_ref5","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-019-0859-z"},{"key":"10.3233\/SW-233393_ref6","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-9-S5-S1"},{"key":"10.3233\/SW-233393_ref7","doi-asserted-by":"publisher","DOI":"10.1109\/PACC.2011.5978931"},{"key":"10.3233\/SW-233393_ref8","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-75681-3_9"},{"key":"10.3233\/SW-233393_ref10","doi-asserted-by":"publisher","DOI":"10.1109\/NLPKE.2011.6138244"},{"key":"10.3233\/SW-233393_ref11","first-page":"528","article-title":"The goal question metric approach","volume":"1","author":"Basili","year":"1994","journal-title":"Encyclopedia of Software Engineering"},{"key":"10.3233\/SW-233393_ref12","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAI.2014.30"},{"key":"10.3233\/SW-233393_ref13","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-33173-5"},{"key":"10.3233\/SW-233393_ref14","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1016\/j.datak.2018.05.010","article-title":"How to repair inconsistency in OWL 2 DL ontology versions?","volume":"116","author":"Bayoudhi","year":"2018","journal-title":"Data & Knowledge Engineering"},{"key":"10.3233\/SW-233393_ref15","doi-asserted-by":"publisher","DOI":"10.4067\/S0718-18762014000200006"},{"key":"10.3233\/SW-233393_ref16","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-01347-8_44"},{"key":"10.3233\/SW-233393_ref17","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-2647(06)80241-8"},{"key":"10.3233\/SW-233393_ref18","doi-asserted-by":"publisher","DOI":"10.1145\/1597735.1597743"},{"key":"10.3233\/SW-233393_ref19","unstructured":"B.\u00a0Boehm, J.\u00a0Brown and M.\u00a0Lipow, Quantitative evaluation of software quality, in: Proceedings of the 2nd International Conference on Software Engineering, San Francisco, USA, 1976, pp.\u00a0592\u2013605, https:\/\/dl.acm.org\/doi\/10.5555\/800253.807736."},{"key":"10.3233\/SW-233393_ref20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3233\/AO-220265","article-title":"Foundational ontologies in action: Understanding foundational ontology through examples","volume":"17","author":"Borgo","year":"2022","journal-title":"AO"},{"key":"10.3233\/SW-233393_ref22","unstructured":"J.\u00a0Brank, M.\u00a0Grobelnik and D.\u00a0Mladeni, A survey of ontology evaluation techniques, in: Proc. Conf. Data Min. Data Warehouses, 2005, pp.\u00a0166\u2013170."},{"key":"10.3233\/SW-233393_ref23","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1016\/j.jss.2006.07.009","article-title":"Lessons from applying the systematic literature review process within the software engineering domain","volume":"80","author":"Brereton","year":"2007","journal-title":"Journal of Systems and Software"},{"key":"10.3233\/SW-233393_ref24","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1016\/j.datak.2004.11.010","article-title":"A semiotic metrics suite for assessing the quality of ontologies","volume":"55","author":"Burton-Jones","year":"2005","journal-title":"Data & Knowledge Engineering"},{"key":"10.3233\/SW-233393_ref25","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1145\/953579.811113","article-title":"A framework for the measurement of software quality","volume":"7","author":"Cavano","year":"1978","journal-title":"ACM SIGMETRICS Performance Evaluation Review"},{"key":"10.3233\/SW-233393_ref26","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-41242-4_10"},{"key":"10.3233\/SW-233393_ref27","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1016\/S0169-023X(02)00195-7","article-title":"Methodologies, tools and languages for building ontologies. Where is their meeting point?","volume":"46","author":"Corcho","year":"2003","journal-title":"Data & Knowledge Engineering"},{"key":"10.3233\/SW-233393_ref29","doi-asserted-by":"publisher","first-page":"49","DOI":"10.4018\/jswis.2005040103","article-title":"A survey on ontology creation methodologies","volume":"2","author":"Cristani","year":"2005","journal-title":"International Journal on Semantic Web and Information Systems (IJSWIS)"},{"key":"10.3233\/SW-233393_ref31","unstructured":"J.\u00a0Defeo, Juran\u2019s Quality Handbook: The Complete Guide to Performance Excellence, 7th edn, McGraw Hill, New York, 2016."},{"key":"10.3233\/SW-233393_ref32","doi-asserted-by":"publisher","DOI":"10.1145\/3132218.3132219"},{"key":"10.3233\/SW-233393_ref33","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-41335-3_6"},{"key":"10.3233\/SW-233393_ref34","doi-asserted-by":"publisher","first-page":"1192","DOI":"10.1016\/j.dss.2012.11.013","article-title":"Development and evaluation of ontology for intelligent decision support in medical emergency management for mass gatherings","volume":"54","author":"Delir Haghighi","year":"2013","journal-title":"Decision Support Systems"},{"key":"10.3233\/SW-233393_ref35","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1080\/07421222.2003.11045748","article-title":"The DeLone and McLean model of information systems success: A ten-year update","volume":"19","author":"DeLone","year":"2003","journal-title":"J. Manag. Inf. Syst."},{"key":"10.3233\/SW-233393_ref36","doi-asserted-by":"publisher","DOI":"10.1145\/3333165.3333179"},{"key":"10.3233\/SW-233393_ref37","unstructured":"R.Q.\u00a0Dividino, M.\u00a0Romanelli and D.\u00a0Sonntag, Semiotic-based ontology evaluation tool (S-OntoEval), in: LREC, 2008, http:\/\/www.lrec-conf.org\/proceedings\/lrec2008\/pdf\/671_paper.pdf."},{"key":"10.3233\/SW-233393_ref38","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-11829-6_19"},{"key":"10.3233\/SW-233393_ref39","unstructured":"R.\u00a0Dromey, Software Product Quality: Theory, Model, and Practice, Software Quality Institute, Brisbane, Australia, 1998."},{"key":"10.3233\/SW-233393_ref40","first-page":"159","article-title":"OQuaRE: A SQuaRE-based approach for evaluating the quality of ontologies","volume":"43","author":"Duque-Ramos","year":"2011","journal-title":"Journal of Research and Practice in Information Technology"},{"key":"10.3233\/SW-233393_ref41","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1016\/j.is.2008.09.001","article-title":"Evaluating ontologies: Towards a cognitive measure of quality","volume":"35","author":"Evermann","year":"2010","journal-title":"Information Systems"},{"key":"10.3233\/SW-233393_ref42","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-10871-6_5"},{"key":"10.3233\/SW-233393_ref43","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1017\/S0269888908001367","article-title":"Ontology change: Classification and survey","volume":"23","author":"Flouris","year":"2008","journal-title":"Knowledge Eng. Review"},{"key":"10.3233\/SW-233393_ref44","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-60889-6_22"},{"key":"10.3233\/SW-233393_ref45","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1093\/bib\/bbz009","article-title":"Evaluation of ontology structural metrics based on public repository data","volume":"21","author":"Franco","year":"2020","journal-title":"Briefings in Bioinformatics"},{"key":"10.3233\/SW-233393_ref46","unstructured":"C.\u00a0F\u00fcrber and M.\u00a0Hepp, SWIQA \u2013 a semantic web information quality assessment framework, in: CIS 2011 Proceedings, 2011, p.\u00a076, https:\/\/aisel.aisnet.org\/ecis2011\/76."},{"key":"10.3233\/SW-233393_ref47","doi-asserted-by":"publisher","DOI":"10.1007\/11574620_21"},{"key":"10.3233\/SW-233393_ref48","doi-asserted-by":"crossref","unstructured":"A.\u00a0Gangemi, C.\u00a0Catenacci, M.\u00a0Ciaramita and J.\u00a0Lehmann, A theoretical framework for ontology evaluation and validation, in: Semantic Web Applications and Perspectives (SWAP) \u2013 2nd Italian Semantic Web Workshop, Trento, Italy, 2005, p.\u00a016.","DOI":"10.1007\/11762256_13"},{"key":"10.3233\/SW-233393_ref49","doi-asserted-by":"publisher","DOI":"10.1007\/11762256_13"},{"key":"10.3233\/SW-233393_ref51","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-16318-0_4"},{"key":"10.3233\/SW-233393_ref52","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02481-8_13"},{"key":"10.3233\/SW-233393_ref53","unstructured":"D.\u00a0Garvin, What does \u2018product quality\u2019 really mean? in: Sloan Management Review, Fall, 1984, pp.\u00a025\u201345."},{"key":"10.3233\/SW-233393_ref54","doi-asserted-by":"publisher","first-page":"361","DOI":"10.3233\/978-1-61499-125-0-361","article-title":"New ergonomic metrics for educational ontology design and evaluation","volume":"246","author":"Gavrilova","year":"2012","journal-title":"Frontiers in Artificial Intelligence and Applications"},{"key":"10.3233\/SW-233393_ref55","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1002\/stvr.4370020305","volume-title":"Software Quality: Theory and Management","author":"Gillies","year":"1992"},{"key":"10.3233\/SW-233393_ref56","doi-asserted-by":"publisher","DOI":"10.1109\/CAIA.1995.378808"},{"key":"10.3233\/SW-233393_ref57","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1016\/S0957-4174(96)00067-X","article-title":"Towards a framework to verify knowledge sharing technology","volume":"11","author":"G\u00f3mez-P\u00e9rez","year":"1996","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/SW-233393_ref58","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1002\/1098-111X(200103)16:3<391::AID-INT1014>3.0.CO;2-2","article-title":"Evaluation of ontologies","volume":"16","author":"Gomez-Perez","year":"2001","journal-title":"Int. J. Intell. Syst."},{"key":"10.3233\/SW-233393_ref59","unstructured":"A.\u00a0Gomez-Perez, M.\u00a0Fernandez-Lopez and A.\u00a0de\u00a0Vicente, Towards a method to conceptualize domain ontologies, in: ECAI96 Workshop on Ontological Engineering, Budapest, 1996, pp.\u00a041\u201351, https:\/\/oa.upm.es\/7228\/."},{"key":"10.3233\/SW-233393_ref60","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1613\/jair.3470","article-title":"Completeness guarantees for incomplete ontology reasoners: Theory and practice","volume":"43","author":"Grau","year":"2012","journal-title":"J. Artif. Int. Res."},{"key":"10.3233\/SW-233393_ref61","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1006\/knac.1993.1008","article-title":"A translation approach to portable ontology specifications","volume":"5","author":"Gruber","year":"1993","journal-title":"Knowledge Acquisition"},{"key":"10.3233\/SW-233393_ref62","doi-asserted-by":"publisher","first-page":"907","DOI":"10.1006\/ijhc.1995.1081","article-title":"Toward principles for the design of ontologies used for knowledge sharing","volume":"43","author":"Gruber","year":"1995","journal-title":"International Journal of Human Computer Studies"},{"key":"10.3233\/SW-233393_ref64","unstructured":"M.\u00a0Gruninger and M.S.\u00a0Fox, Methodology for design and evaluation of ontologies, in: Workshop on Basic Ontological Issues in Knowlege Sharing, 1995, http:\/\/www.eil.utoronto.ca\/wp-content\/uploads\/enterprise-modelling\/papers\/gruninger-ijcai95.pdf (accessed September 21, 2021)."},{"key":"10.3233\/SW-233393_ref65","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24750-0_8"},{"key":"10.3233\/SW-233393_ref66","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-64619-6_7"},{"key":"10.3233\/SW-233393_ref67","doi-asserted-by":"publisher","DOI":"10.1007\/11574620_27"},{"key":"10.3233\/SW-233393_ref68","doi-asserted-by":"publisher","DOI":"10.1007\/11431053_13"},{"key":"10.3233\/SW-233393_ref69","doi-asserted-by":"publisher","DOI":"10.3384\/diss.diva-139584"},{"key":"10.3233\/SW-233393_ref71","unstructured":"P.\u00a0Hitzler, Anti-patterns in ontology-driven conceptual modeling: The case of role modeling in OntoUML. Ontology engineering with ontology design patterns, Foundations and Applications 25 (2016), 161."},{"key":"10.3233\/SW-233393_ref72","doi-asserted-by":"publisher","first-page":"1183","DOI":"10.3233\/JIFS-169118","article-title":"Verification of SUMO ontology","volume":"32","author":"Hnatkowska","year":"2017","journal-title":"Journal-of-intelligent-and-fuzzy-systems\/ifs169118"},{"key":"10.3233\/SW-233393_ref81","doi-asserted-by":"publisher","first-page":"171","DOI":"10.3233\/AO-150151","article-title":"An empirically-based framework for ontology modularisation","volume":"10","author":"Khan","year":"2015","journal-title":"Applied Ontology"},{"key":"10.3233\/SW-233393_ref82","unstructured":"M.R.\u00a0Khondoker and P.\u00a0Mueller, Comparing ontology development tools based on an online survey, in: World Congress on Engineering (WCE 10), London, UK, 2010."},{"key":"10.3233\/SW-233393_ref84","doi-asserted-by":"publisher","first-page":"929","DOI":"10.1109\/32.489070","article-title":"Towards a framework for software measurement validation","volume":"21","author":"Kitchenham","year":"1995","journal-title":"IIEEE Trans. Software Eng."},{"key":"10.3233\/SW-233393_ref85","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45810-7_20"},{"key":"10.3233\/SW-233393_ref86","doi-asserted-by":"publisher","DOI":"10.3390\/info12080301"},{"key":"10.3233\/SW-233393_ref87","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888920000065"},{"key":"10.3233\/SW-233393_ref88","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-7700-5_2"},{"key":"10.3233\/SW-233393_ref89","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/j.datak.2013.03.003","article-title":"Debugging the missing is-a structure within taxonomies networked by partial reference alignments","volume":"86","author":"Lambrix","year":"2013","journal-title":"Data & Knowledge Engineering"},{"key":"10.3233\/SW-233393_ref90","unstructured":"B.\u00a0Lantow, OntoMetrics: Application of on-line ontology metric calculation, in: BIR Workshops, 2016, pp.\u00a01\u201312."},{"key":"10.3233\/SW-233393_ref91","doi-asserted-by":"publisher","DOI":"10.5220\/0006084601860191"},{"key":"10.3233\/SW-233393_ref92","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(93)90092-P"},{"key":"10.3233\/SW-233393_ref93","doi-asserted-by":"publisher","DOI":"10.1109\/ICISC.2018.8399041"},{"key":"10.3233\/SW-233393_ref94","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/j.jss.2009.07.047","article-title":"Semantic oriented ontology cohesion metrics for ontology-based systems","volume":"83","author":"Ma","year":"2010","journal-title":"Journal of Systems and Software"},{"key":"10.3233\/SW-233393_ref95","unstructured":"S.\u00a0Mc Gurk, C.\u00a0Abela and J.\u00a0Debattista, Towards Ontology Quality Assessment, in: MEPDaW\/LDQ@ ESWC, 2017, pp.\u00a094\u2013106."},{"key":"10.3233\/SW-233393_ref96","doi-asserted-by":"publisher","DOI":"10.1145\/3329124"},{"key":"10.3233\/SW-233393_ref97","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-41754-7_3"},{"key":"10.3233\/SW-233393_ref98","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1016\/j.datak.2018.02.001","article-title":"Assessing the quality of domain ontologies: Metrics and an automated ranking system","volume":"115","author":"McDaniel","year":"2018","journal-title":"Data & Knowledge Engineering"},{"key":"10.3233\/SW-233393_ref99","unstructured":"B.\u00a0Motik, P.F.\u00a0Patel and B.\u00a0Parsia, OWL 2 Web Ontology Language Structural Specification and Functional-Style Syntax, 2nd edn, 2012, https:\/\/www.w3.org\/TR\/owl2-syntax\/ (accessed December 29, 2021)."},{"key":"10.3233\/SW-233393_ref100","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29764-9_18"},{"key":"10.3233\/SW-233393_ref102","doi-asserted-by":"publisher","first-page":"179","DOI":"10.3233\/AO-130125","article-title":"Towards ontology evaluation across the life cycle: The ontology summit 2013","volume":"8","author":"Neuhaus","year":"2013","journal-title":"Applied Ontology"},{"key":"10.3233\/SW-233393_ref104","doi-asserted-by":"publisher","DOI":"10.1007\/s10799-011-0094-5"},{"key":"10.3233\/SW-233393_ref107","doi-asserted-by":"publisher","DOI":"10.1109\/FSKD.2011.6020046"},{"key":"10.3233\/SW-233393_ref108","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-17449-0_2"},{"key":"10.3233\/SW-233393_ref109","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-54627-8_5"},{"key":"10.3233\/SW-233393_ref110","doi-asserted-by":"crossref","unstructured":"H.S.\u00a0Pinto, S.\u00a0Staab and C.\u00a0Tempich, DILIGENT: Towards a fine-grained methodology for DIstributed, Loosely-controlled and evolvInG Engineering of oNTologies 16 (2004), 393.","DOI":"10.1007\/978-3-540-25956-5_2"},{"key":"10.3233\/SW-233393_ref111","doi-asserted-by":"publisher","first-page":"7","DOI":"10.4018\/ijswis.2014040102","article-title":"OOPs!(ontology pitfall scanner!): An on-line tool for ontology evaluation","volume":"10","author":"Poveda-Villal\u00f3n","year":"2014","journal-title":"International Journal on Semantic Web and Information Systems (IJSWIS)"},{"key":"10.3233\/SW-233393_ref112","doi-asserted-by":"publisher","DOI":"10.5220\/0005591001790186"},{"key":"10.3233\/SW-233393_ref113","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.csi.2014.09.001","article-title":"SemQuaRE: An extension of the SQuaRE quality model for the evaluation of semantic technologies","volume":"38","author":"Radulovic","year":"2015","journal-title":"Computer Standards & Interfaces"},{"key":"10.3233\/SW-233393_ref114","doi-asserted-by":"publisher","first-page":"1291","DOI":"10.1016\/j.compind.2014.07.010","article-title":"OntoQualitas: A framework for ontology quality assessment in information interchanges between heterogeneous systems","volume":"65","author":"Rico","year":"2014","journal-title":"Comput. Ind."},{"key":"10.3233\/SW-233393_ref115","doi-asserted-by":"publisher","DOI":"10.1145\/1597735.1597784"},{"key":"10.3233\/SW-233393_ref116","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/j.engappai.2014.11.012","article-title":"Semantic variance: An intuitive measure for ontology accuracy evaluation","volume":"39","author":"S\u00e1nchez","year":"2015","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"10.3233\/SW-233393_ref117","doi-asserted-by":"crossref","unstructured":"K.\u00a0Schekotihin, P.\u00a0Rodler and W.\u00a0Schmid, Ontodebug: Interactive ontology debugging plug-in for prot\u00e9g\u00e9, in: Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer Verlag, 2018, pp.\u00a0340\u2013359.","DOI":"10.1007\/978-3-319-90050-6_19"},{"key":"10.3233\/SW-233393_ref118","doi-asserted-by":"publisher","DOI":"10.1186\/2041-1480-3-S2-S4"},{"issue":"1","key":"10.3233\/SW-233393_ref120","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1109\/5254.912382","article-title":"Knowledge processes and ontologies","volume":"16","author":"Staab","year":"2001","journal-title":"IEEE Intelligent Systems"},{"key":"10.3233\/SW-233393_ref121","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24750-0"},{"issue":"1","key":"10.3233\/SW-233393_ref122","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1080\/014492900118768","article-title":"Understanding the role of signs and norms in organizations\u2013a semiotic approach to information systems design","volume":"19","author":"Stamper","year":"2000","journal-title":"Behaviour & Information Technology"},{"key":"10.3233\/SW-233393_ref123","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/S0169-023X(97)00056-6","article-title":"Knowledge engineering: Principles and methods","volume":"25","author":"Studer","year":"1998","journal-title":"Data & Knowledge Engineering"},{"key":"10.3233\/SW-233393_ref124","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v12i12.2043"},{"key":"10.3233\/SW-233393_ref125","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-05151-7_16"},{"key":"10.3233\/SW-233393_ref126","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-48005-6_18"},{"key":"10.3233\/SW-233393_ref127","doi-asserted-by":"publisher","DOI":"10.4018\/978-1-60566-400-2.ch008"},{"key":"10.3233\/SW-233393_ref128","unstructured":"B.\u00a0Swartout, P.\u00a0Ramesh, K.\u00a0Knight and T.\u00a0Russ, Toward Distributed Use of Large-Scale Ontologies, AAAI, Symposium on Ontological Engineering, Stanford, 1997."},{"key":"10.3233\/SW-233393_ref129","doi-asserted-by":"publisher","first-page":"2568","DOI":"10.1587\/transinf.2020EDP7041","article-title":"A collaborative framework supporting ontology development based on agile and scrum model","volume":"E 103.D","author":"Takhom","year":"2020","journal-title":"IEICE Trans. Inf. & Syst."},{"key":"10.3233\/SW-233393_ref130","unstructured":"H.\u00a0Tan, A.\u00a0Adlemo, V.\u00a0Tarasov and M.E.\u00a0Johansson, Evaluation of an application ontology, in: The Joint Ontology Workshops, 2017."},{"key":"10.3233\/SW-233393_ref131","doi-asserted-by":"publisher","first-page":"131","DOI":"10.15388\/infedu.2009.09","article-title":"Characteristics of domain ontologies for web based learning and their application for quality evaluation","volume":"8","author":"Tankeleviciene","year":"2009","journal-title":"Informatics in Education"},{"key":"10.3233\/SW-233393_ref132","unstructured":"S.\u00a0Tartir, I.B.\u00a0Arpinar, M.\u00a0Moore, A.P.\u00a0Sheth and B.\u00a0Aleman-Meza, OntoQA: Metric-Based Ontology Quality Analysis, IEEE Workshop on Knowledge Acquisition from Distributed, Autonomous, Semantically Heterogeneous Data and Knowledge Sources, 2005, https:\/\/corescholar.libraries.wright.edu\/knoesis\/660."},{"key":"10.3233\/SW-233393_ref133","doi-asserted-by":"publisher","DOI":"10.1007\/978-90-481-8847-5_5"},{"key":"10.3233\/SW-233393_ref134","unstructured":"W.\u00a0Terkaj, S.\u00a0Borgo and E.\u00a0Sanfilippo, Ontology for industrial engineering: A DOLCE compliant approach, in: CEUR Workshop Proceedings, Vol.\u00a03240, 2022."},{"key":"10.3233\/SW-233393_ref137","unstructured":"D.\u00a0Tsarkov, Improved algorithms for module extraction and atomic decomposition, in: The International Workshop on Description Logics (DL\u201912), Rome, Italy, 2012, pp.\u00a07\u201310."},{"key":"10.3233\/SW-233393_ref138","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1017\/S0269888900007797","article-title":"Ontologies: Principles, methods and applications","volume":"11","author":"Uschold","year":"1996","journal-title":"The Knowledge Engineering Review"},{"key":"10.3233\/SW-233393_ref139","unstructured":"M.\u00a0Uschold and M.\u00a0King, Towards a methodology for building ontologies, in: IJCAI95 Workshop on Basic Ontological Issues in Knowledge Sharing, Montreal, 1995."},{"key":"10.3233\/SW-233393_ref140","doi-asserted-by":"publisher","DOI":"10.1109\/ICDSE.2016.7823945"},{"key":"10.3233\/SW-233393_ref142","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-92673-3_13"},{"key":"10.3233\/SW-233393_ref143","doi-asserted-by":"publisher","DOI":"10.1007\/11915072_2"},{"key":"10.3233\/SW-233393_ref145","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1016\/j.ecoinf.2014.07.008","article-title":"User centered ontology for Sri Lankan farmers","volume":"26","author":"Walisadeera","year":"2015","journal-title":"Ecological Informatics"},{"key":"10.3233\/SW-233393_ref146","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1080\/07421222.1996.11518099","article-title":"Beyond accuracy: What data quality means to data consumers","volume":"12","author":"Wang","year":"1996","journal-title":"Journal of Management Information Systems"},{"key":"10.3233\/SW-233393_ref147","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-86970-0_23"},{"key":"10.3233\/SW-233393_ref148","doi-asserted-by":"publisher","first-page":"12889","DOI":"10.1109\/ACCESS.2022.3146331","article-title":"Towards a usable ontology: The identification of quality characteristics for an ontology-driven decision support system","volume":"10","author":"Wilson","year":"2022","journal-title":"IEEE Access"},{"key":"10.3233\/SW-233393_ref149","doi-asserted-by":"publisher","DOI":"10.1145\/1321440.1321474"},{"issue":"8","key":"10.3233\/SW-233393_ref150","doi-asserted-by":"publisher","first-page":"766","DOI":"10.1016\/j.is.2009.04.002","article-title":"Requirements-oriented methodology for evaluating ontologies","volume":"34","author":"Yu","year":"2009","journal-title":"Information Systems"},{"key":"10.3233\/SW-233393_ref151","doi-asserted-by":"publisher","DOI":"10.1145\/2506182.2506195"},{"key":"10.3233\/SW-233393_ref152","doi-asserted-by":"publisher","DOI":"10.3233\/SW-150175"},{"key":"10.3233\/SW-233393_ref153","doi-asserted-by":"publisher","first-page":"254","DOI":"10.23919\/TST.2017.7914198","article-title":"Quality model and metrics of ontology for semantic descriptions of web services","volume":"22","author":"Zhu","year":"2017","journal-title":"Tsinghua Science and Technology"},{"issue":"3","key":"10.3233\/SW-233393_ref154","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1016\/j.jbi.2009.03.003","article-title":"A review of auditing methods applied to the content of controlled biomedical terminologies","volume":"42","author":"Zhu","year":"2009","journal-title":"J. Biomed. Inform."}],"container-title":["Semantic Web"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/SW-233393","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T05:27:02Z","timestamp":1777613222000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/SW-233393"}},"subtitle":["A systematic review"],"editor":[{"given":"Aldo","family":"Gangemi","sequence":"additional","affiliation":[{"name":"University of Bologna, Italy"}],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2023,12,13]]},"references-count":129,"journal-issue":{"issue":"6"},"URL":"https:\/\/doi.org\/10.3233\/sw-233393","relation":{},"ISSN":["2210-4968","1570-0844"],"issn-type":[{"value":"2210-4968","type":"electronic"},{"value":"1570-0844","type":"print"}],"subject":[],"published":{"date-parts":[[2023,12,13]]}}}