{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T03:18:33Z","timestamp":1778037513053,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,9,11]],"date-time":"2017-09-11T00:00:00Z","timestamp":1505088000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["H2020-MSCA-ITN- 2014,642332"],"award-info":[{"award-number":["H2020-MSCA-ITN- 2014,642332"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,9,11]]},"DOI":"10.1145\/3132218.3132219","type":"proceedings-article","created":{"date-parts":[[2017,12,6]],"date-time":"2017-12-06T21:25:26Z","timestamp":1512595526000},"page":"1-8","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":39,"title":["A Snapshot of Ontology Evaluation Criteria and Strategies"],"prefix":"10.1145","author":[{"given":"Auriol","family":"Degbelo","sequence":"first","affiliation":[{"name":"Institute for Geoinformatics, University of Muenster, Muenster, Germany"}]}],"member":"320","published-online":{"date-parts":[[2017,9,11]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2006.12.005"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/13658810701776767"},{"key":"e_1_3_2_1_3_1","volume-title":"8th International Multiconference, O Marki\u010d, M Gams, U Korde\u017e, M Heri\u010dko, D Mladeni\u0107, M Grobelnik, I Rozman, V Rajkovi\u010d, T Urban\u010di\u010d, M Bernik, and M Bohanec (Eds.)","author":"Brank J","year":"2005","unstructured":"J Brank , M Grobelnik , and D Mladeni\u0107 . 2005 . A survey of ontology evaluation techniques. In Information Society 2005 - 8th International Multiconference, O Marki\u010d, M Gams, U Korde\u017e, M Heri\u010dko, D Mladeni\u0107, M Grobelnik, I Rozman, V Rajkovi\u010d, T Urban\u010di\u010d, M Bernik, and M Bohanec (Eds.) . Ljubljana, Slovenia, 166--169. J Brank, M Grobelnik, and D Mladeni\u0107. 2005. A survey of ontology evaluation techniques. In Information Society 2005 - 8th International Multiconference, O Marki\u010d, M Gams, U Korde\u017e, M Heri\u010dko, D Mladeni\u0107, M Grobelnik, I Rozman, V Rajkovi\u010d, T Urban\u010di\u010d, M Bernik, and M Bohanec (Eds.). Ljubljana, Slovenia, 166--169."},{"key":"e_1_3_2_1_4_1","volume-title":"Automatic evaluation of ontologies","author":"Brank J","unstructured":"J Brank , M Grobelnik , and D Mladeni\u0107 . 2007. Automatic evaluation of ontologies . In Natural Language Processing and Text Mining, A Kao and S R Poteet (Eds.). Springer-Verlag London Limited , 193--219. J Brank, M Grobelnik, and D Mladeni\u0107. 2007. Automatic evaluation of ontologies. In Natural Language Processing and Text Mining, A Kao and S R Poteet (Eds.). Springer-Verlag London Limited, 193--219."},{"key":"e_1_3_2_1_5_1","volume-title":"AAAI Spring Symposium: Semantic Scientific Knowledge Integration, D McGuinness, P Fox, and B Brodaric (Eds.). AAAI","author":"Brodaric B","year":"2008","unstructured":"B Brodaric and F Probst . 2008 . DOLCE ROCKS: integrating geoscience ontologies with DOLCE . In AAAI Spring Symposium: Semantic Scientific Knowledge Integration, D McGuinness, P Fox, and B Brodaric (Eds.). AAAI , Stanford, California, USA, 3--8. B Brodaric and F Probst. 2008. DOLCE ROCKS: integrating geoscience ontologies with DOLCE. In AAAI Spring Symposium: Semantic Scientific Knowledge Integration, D McGuinness, P Fox, and B Brodaric (Eds.). AAAI, Stanford, California, USA, 3--8."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-023X(02)00195-7"},{"key":"e_1_3_2_1_7_1","volume-title":"Spatial and temporal resolution of sensor observations. Dissertations in Geographic Information Science","author":"Degbelo A","unstructured":"A Degbelo . 2015. Spatial and temporal resolution of sensor observations. Dissertations in Geographic Information Science , IOS Press . 206 pages. A Degbelo. 2015. Spatial and temporal resolution of sensor observations. Dissertations in Geographic Information Science, IOS Press. 206 pages."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.3233\/AO-170178"},{"key":"e_1_3_2_1_9_1","volume-title":"Spatio-Temporal Databases: The CHOROCHRONOS Approach, T Sellis, M Koubarakis, A U Frank, S Grumbach, R H G\u00fcting","author":"Frank A","unstructured":"A Frank . 2003. Ontology for spatio-temporal databases . In Spatio-Temporal Databases: The CHOROCHRONOS Approach, T Sellis, M Koubarakis, A U Frank, S Grumbach, R H G\u00fcting , C S Jensen, N Lorentzos, Y Manolopoulos, E Nardelli, B Pernici, B Theodoulidis, N Tryfona, H Schek, and M Scholl (Eds.). Springer-Verlag Berlin Heidelberg , Chapter 2, 9--77. A Frank. 2003. Ontology for spatio-temporal databases. In Spatio-Temporal Databases: The CHOROCHRONOS Approach, T Sellis, M Koubarakis, A U Frank, S Grumbach, R H G\u00fcting, C S Jensen, N Lorentzos, Y Manolopoulos, E Nardelli, B Pernici, B Theodoulidis, N Tryfona, H Schek, and M Scholl (Eds.). Springer-Verlag Berlin Heidelberg, Chapter 2, 9--77."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/11762256_13"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1002\/1098-111X(200103)16:3<391::AID-INT1014>3.0.CO;2-2"},{"key":"e_1_3_2_1_12_1","volume-title":"Handbook on ontologies","author":"G\u00f3mez-P\u00e9rez A","unstructured":"A G\u00f3mez-P\u00e9rez . 2003. Ontology evaluation . In Handbook on ontologies ( 1 st ed.), S Staab and R Studer (Eds.). Springer Berlin Heidelberg , 251--273. A G\u00f3mez-P\u00e9rez. 2003. Ontology evaluation. In Handbook on ontologies (1st ed.), S Staab and R Studer (Eds.). Springer Berlin Heidelberg, 251--273.","edition":"1"},{"key":"e_1_3_2_1_13_1","volume-title":"Evaluation and assessment of the knowledge sharing technology","author":"G\u00f3mez-P\u00e9rez A","unstructured":"A G\u00f3mez-P\u00e9rez , N Juristo , and J Pazos . 1995. Evaluation and assessment of the knowledge sharing technology . In Towards Very Large Knowledge Bases, N J I Mars (Ed.). IOS Press , Enschede, The Netherlands, 289--296. A G\u00f3mez-P\u00e9rez, N Juristo, and J Pazos. 1995. Evaluation and assessment of the knowledge sharing technology. In Towards Very Large Knowledge Bases, N J I Mars (Ed.). IOS Press, Enschede, The Netherlands, 289--296."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.1995.1081"},{"key":"e_1_3_2_1_15_1","volume-title":"Proceedings of the IJCAI Workshop on Basic Ontological Issues in Knowledge Sharing. Montreal","author":"Gr\u00fcninger M","year":"1995","unstructured":"M Gr\u00fcninger and M S Fox . 1995 . Methodology for the design and evaluation of ontologies . In Proceedings of the IJCAI Workshop on Basic Ontological Issues in Knowledge Sharing. Montreal , Quebec, Canada. M Gr\u00fcninger and M S Fox. 1995. Methodology for the design and evaluation of ontologies. In Proceedings of the IJCAI Workshop on Basic Ontological Issues in Knowledge Sharing. Montreal, Quebec, Canada."},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of the 1st International Conference on Formal Ontology in Information Systems (FOIS'98)","author":"Guarino N","year":"1998","unstructured":"N Guarino . 1998 . Formal ontology and information systems . In Proceedings of the 1st International Conference on Formal Ontology in Information Systems (FOIS'98) , N Guarino (Ed.). IOS Press Amsterdam, Trento, Italy, 3--15. N Guarino. 1998. Formal ontology and information systems. In Proceedings of the 1st International Conference on Formal Ontology in Information Systems (FOIS'98), N Guarino (Ed.). IOS Press Amsterdam, Trento, Italy, 3--15."},{"key":"e_1_3_2_1_17_1","volume-title":"Towards very large knowledge bases","author":"Guarino N","unstructured":"N Guarino and P Giaretta . 1995. Ontologies and knowledge bases towards a terminological clarification . In Towards very large knowledge bases , N J I Mars (Ed.). IOS Press , Enschede, The Netherlands, 25--32. N Guarino and P Giaretta. 1995. Ontologies and knowledge bases towards a terminological clarification. In Towards very large knowledge bases, N J I Mars (Ed.). IOS Press, Enschede, The Netherlands, 25--32."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3233\/AO-150143"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/503124.503150"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/1565421.1565425"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/2019445.2019460"},{"key":"e_1_3_2_1_22_1","volume-title":"ESWC and ASWC 2005--2009. In Proceedings of the 2nd International Workshop on Ontology Patterns - WOP2010, E Blomqvist, V Chaudhri, O Corcho, V Presutti, and K Sandkuhl (Eds.). CEUR-WS.org","author":"Hammar K","year":"2010","unstructured":"K Hammar and K Sandkuhl . 2010 . The state of ontology pattern research: a systematic review of ISWC , ESWC and ASWC 2005--2009. In Proceedings of the 2nd International Workshop on Ontology Patterns - WOP2010, E Blomqvist, V Chaudhri, O Corcho, V Presutti, and K Sandkuhl (Eds.). CEUR-WS.org , Shanghai, China. K Hammar and K Sandkuhl. 2010. The state of ontology pattern research: a systematic review of ISWC, ESWC and ASWC 2005--2009. In Proceedings of the 2nd International Workshop on Ontology Patterns - WOP2010, E Blomqvist, V Chaudhri, O Corcho, V Presutti, and K Sandkuhl (Eds.). CEUR-WS.org, Shanghai, China."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbs053"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2513204.2513218"},{"key":"e_1_3_2_1_25_1","volume-title":"The 2nd International Conference of ASK-IT","author":"Kehagias D D","year":"2008","unstructured":"D D Kehagias , I Papadimitriou , J Hois , D Tzovaras , and J Bateman . 2008 . A methodological approach for ontology evaluation and refinement . In The 2nd International Conference of ASK-IT . Nuremberg, Germany. D D Kehagias, I Papadimitriou, J Hois, D Tzovaras, and J Bateman. 2008. A methodological approach for ontology evaluation and refinement. In The 2nd International Conference of ASK-IT. Nuremberg, Germany."},{"key":"e_1_3_2_1_26_1","volume-title":"Research Trends in Geographic Information Science","author":"Kuhn W","unstructured":"W Kuhn . 2009. Semantic engineering . In Research Trends in Geographic Information Science , G Navratil (Ed.). Springer Berlin Heidelberg , 63--76. W Kuhn. 2009. Semantic engineering. In Research Trends in Geographic Information Science, G Navratil (Ed.). Springer Berlin Heidelberg, 63--76."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/2019445.2019457"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.4018\/jdm.2004040101"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/988672.988748"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/2594763.2594765"},{"key":"e_1_3_2_1_31_1","first-page":"53","article-title":"The state of the art in ontology design: a survey and comparative review","volume":"18","author":"Noy N F","year":"1997","unstructured":"N F Noy and C D Hafner . 1997 . The state of the art in ontology design: a survey and comparative review . AI Magazine 18 , 3 (1997), 53 . N F Noy and C D Hafner. 1997. The state of the art in ontology design: a survey and comparative review. AI Magazine 18, 3 (1997), 53.","journal-title":"AI Magazine"},{"key":"e_1_3_2_1_32_1","volume-title":"Semantic Web - Revolutionizing Knowledge Discovery in the Life Sciences","author":"Obrst L","unstructured":"L Obrst , W Ceusters , I Mani , S Ray , and B Smith . 2007. The evaluation of ontologies . In Semantic Web - Revolutionizing Knowledge Discovery in the Life Sciences , C Baker and K Cheung (Eds.). Springer , 139--158. L Obrst, W Ceusters, I Mani, S Ray, and B Smith. 2007. The evaluation of ontologies. In Semantic Web - Revolutionizing Knowledge Discovery in the Life Sciences, C Baker and K Cheung (Eds.). Springer, 139--158."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/2772083.2772295"},{"key":"e_1_3_2_1_34_1","volume-title":"Handbook on ontologies","author":"Sure Y","unstructured":"Y Sure , S Staab , and R Studer . 2009. Ontology engineering methodology . In Handbook on ontologies ( 2 nd ed.), S Staab and R Studer (Eds.). Springer Berlin Heidelberg , 135--152. Y Sure, S Staab, and R Studer. 2009. Ontology engineering methodology. In Handbook on ontologies (2nd ed.), S Staab and R Studer (Eds.). Springer Berlin Heidelberg, 135--152.","edition":"2"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888900007797"},{"key":"e_1_3_2_1_36_1","volume-title":"Handbook on ontologies","author":"Vrande\u010di\u0107 D","unstructured":"D Vrande\u010di\u0107 . 2009. Ontology evaluation . In Handbook on ontologies ( 2 nd ed.), S Staab and R Studer (Eds.). Springer Berlin Heidelberg , 293--313. D Vrande\u010di\u0107. 2009. Ontology evaluation. In Handbook on ontologies (2nd ed.), S Staab and R Studer (Eds.). Springer Berlin Heidelberg, 293--313.","edition":"2"},{"key":"e_1_3_2_1_37_1","first-page":"521","article-title":"Substances without substrata","volume":"12","author":"Wilson N L","year":"1959","unstructured":"N L Wilson . 1959 . Substances without substrata . The Review of Metaphysics 12 , 4 (1959), 521 -- 539 . N L Wilson. 1959. Substances without substrata. The Review of Metaphysics 12, 4 (1959), 521--539.","journal-title":"The Review of Metaphysics"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2907069"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.5555\/1595075.1595917"}],"event":{"name":"Semantics2017: Semantics 2017 - 13th International Conference on Semantic Systems","location":"Amsterdam Netherlands","acronym":"Semantics2017","sponsor":["St. P\u00f6lten University St. P\u00f6lten University of Applied Sciences, Austria","Wolters Kluwer Wolters Kluwer, Germany","Vrije Universeit Amsterdam Vrije Universeit Amsterdam","Semantic Web Company Semantic Web Company","Uinv. Leipzig Universit\u00e4t Leipzig"]},"container-title":["Proceedings of the 13th International Conference on Semantic Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3132218.3132219","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3132218.3132219","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:13:56Z","timestamp":1750212836000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3132218.3132219"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,11]]},"references-count":39,"alternative-id":["10.1145\/3132218.3132219","10.1145\/3132218"],"URL":"https:\/\/doi.org\/10.1145\/3132218.3132219","relation":{},"subject":[],"published":{"date-parts":[[2017,9,11]]},"assertion":[{"value":"2017-09-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}