{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T09:43:33Z","timestamp":1775727813055,"version":"3.50.1"},"reference-count":46,"publisher":"Oxford University Press (OUP)","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Objective Clinical information models are formal specifications for representing the structure and semantics of the clinical content within electronic health record systems. This research aims to define, test, and validate evaluation metrics for software tools designed to support the processes associated with the definition, management, and implementation of these models.<\/jats:p>\n               <jats:p>Methodology The proposed framework builds on previous research that focused on obtaining agreement on the essential requirements in this area. A set of 50 conformance criteria were defined based on the 20 functional requirements agreed by that consensus and applied to evaluate the currently available tools.<\/jats:p>\n               <jats:p>Results Of the 11 initiative developing tools for clinical information modeling identified, 9 were evaluated according to their performance on the evaluation metrics. Results show that functionalities related to management of data types, specifications, metadata, and terminology or ontology bindings have a good level of adoption. Improvements can be made in other areas focused on information modeling and associated processes. Other criteria related to displaying semantic relationships between concepts and communication with terminology servers had low levels of adoption.<\/jats:p>\n               <jats:p>Conclusions The proposed evaluation metrics were successfully tested and validated against a representative sample of existing tools. The results identify the need to improve tool support for information modeling and software development processes, especially in those areas related to governance, clinician involvement, and optimizing the technical validation of testing processes. This research confirmed the potential of these evaluation metrics to support decision makers in identifying the most appropriate tool for their organization.<\/jats:p>\n               <jats:p>OBJECTIVO Los Modelos de Informaci\u00f3n Cl\u00ednica son especificaciones para representar la estructura y caracter\u00edsticas sem\u00e1nticas del contenido cl\u00ednico en los sistemas de Historia Cl\u00ednica Electr\u00f3nica. Esta investigaci\u00f3n define, prueba y valida un marco para la evaluaci\u00f3n de herramientas inform\u00e1ticas dise\u00f1adas para dar soporte en la en los procesos de definici\u00f3n, gesti\u00f3n e implementaci\u00f3n de estos modelos.<\/jats:p>\n               <jats:p>METODOLOGIA El marco de evaluaci\u00f3n propuesto se basa en una investigaci\u00f3n previa para obtener consenso en la definici\u00f3n de requisitos esenciales en esta \u00e1rea. A partir de los 20 requisitos funcionales acordados, un conjunto de 50 criterios de conformidad fueron definidos y aplicados en la evaluaci\u00f3n de las herramientas existentes.<\/jats:p>\n               <jats:p>RESULTADOS Un total de 9 de las 11 iniciativas identificadas desarrollando herramientas para el modelado de informaci\u00f3n cl\u00ednica fueron evaluadas. Los resultados muestran que las funcionalidades relacionadas con la gesti\u00f3n de tipos de datos, especificaciones, metadatos y mapeo con terminolog\u00edas u ontolog\u00edas tienen un buen nivel de adopci\u00f3n. Se identifican posibles mejoras en \u00e1reas relacionadas con los procesos de modelado de informaci\u00f3n. Otros criterios relacionados con presentar las relaciones sem\u00e1nticas entre conceptos y la comunicaci\u00f3n con servidores de terminolog\u00eda tienen un bajo nivel de adopci\u00f3n.<\/jats:p>\n               <jats:p>CONCLUSIONES El marco de evaluaci\u00f3n propuesto fue probado y validado satisfactoriamente contra un conjunto representativo de las herramientas existentes. Los resultados identifican la necesidad de mejorar el soporte de herramientas a los procesos de modelado de informaci\u00f3n y desarrollo de software, especialmente en las \u00e1reas relacionadas con gobernanza, participaci\u00f3n de profesionales cl\u00ednicos y la optimizaci\u00f3n de la validaci\u00f3n t\u00e9cnica en los procesos de pruebas t\u00e9cnicas. Esta investigaci\u00f3n ha confirmado el potencial de este marco de evaluaci\u00f3n para dar soporte a los usuarios en la toma de decisiones sobre que herramienta es m\u00e1s apropiadas para su organizaci\u00f3n.<\/jats:p>","DOI":"10.1093\/jamia\/ocw018","type":"journal-article","created":{"date-parts":[[2016,6,8]],"date-time":"2016-06-08T02:04:27Z","timestamp":1465351467000},"page":"1127-1135","source":"Crossref","is-referenced-by-count":9,"title":["Evaluation of clinical information modeling tools"],"prefix":"10.1093","volume":"23","author":[{"given":"Alberto","family":"Moreno-Conde","sequence":"first","affiliation":[{"name":"1 Centre for Health Informatics and Multiprofessional Education, University College London, London, UK"},{"name":"2 Technological Innovation Group, Virgen del Roc\u00edo University Hospital, Seville, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tony","family":"Austin","sequence":"additional","affiliation":[{"name":"3 Helicon Health Ltd., London, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jes\u00fas","family":"Moreno-Conde","sequence":"additional","affiliation":[{"name":"2 Technological Innovation Group, Virgen del Roc\u00edo University Hospital, Seville, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carlos L","family":"Parra-Calder\u00f3n","sequence":"additional","affiliation":[{"name":"2 Technological Innovation Group, Virgen del Roc\u00edo University Hospital, Seville, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dipak","family":"Kalra","sequence":"additional","affiliation":[{"name":"1 Centre for Health Informatics and Multiprofessional Education, University College London, London, UK"},{"name":"4 European Institute for Health Records (EuroRec), Sint-Martens-Latem, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2016,6,7]]},"reference":[{"key":"2025032904405831100_ocw018-B1","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1056\/NEJMp1006114","article-title":"The \u2018Meaningful Use\u2019 Regulation for Electronic Health Records","volume":"363","author":"Blumenthal","year":"2010","journal-title":"N Engl J Med."},{"key":"2025032904405831100_ocw018-B2"},{"key":"2025032904405831100_ocw018-B3"},{"key":"2025032904405831100_ocw018-B4","first-page":"3","article-title":"Using detailed clinical models to bridge the gap between clinicians and HIT","volume":"141","author":"Goossen","year":"2008","journal-title":"Stud Health Technol Inform."},{"key":"2025032904405831100_ocw018-B5","first-page":"437","article-title":"Facilitating the openEHR approach \u2013 organizational structures for defining high-quality archetypes","volume":"136","author":"Kohl","year":"2008","journal-title":"Stud Health Technol Inform."},{"key":"2025032904405831100_ocw018-B6","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1093\/jamia\/ocv008","article-title":"Clinical information modeling processes for semantic interoperability of electronic health records: systematic review and inductive analysis","volume":"22","author":"Moreno-Conde","year":"2015","journal-title":"J Am Med Inform Assoc."},{"key":"2025032904405831100_ocw018-B7"},{"key":"2025032904405831100_ocw018-B8","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1016\/j.ijmedinf.2015.03.005","article-title":"Requirements for clinical information modelling tools","volume":"84","author":"Moreno-Conde","year":"2015","journal-title":"Int J Med Inform."},{"key":"2025032904405831100_ocw018-B9","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/j.ijmedinf.2010.11.002","article-title":"Applying the archetype approach to the database of a biobank information management system","volume":"80","author":"Sp\u00e4th","year":"2011","journal-title":"Int J Med Inform."},{"key":"2025032904405831100_ocw018-B10","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.csi.2015.06.002","article-title":"Understanding requirements of clinical data standards for developing interoperable knowledge-based DSS: a case study","volume":"42","author":"Gonz\u00e1lez-Ferrer","year":"2015","journal-title":"Comput Stand Interfaces."},{"key":"2025032904405831100_ocw018-B11","first-page":"28","article-title":"Exchanging data via openEHR for patient-specific overviews in intensive care: a case study","author":"Anani","year":"2011","journal-title":"MIE2011\u201323rd International Conference of the European Federation for Medical Informatics"},{"key":"2025032904405831100_ocw018-B12","first-page":"11","article-title":"Model-based Analysis of HL7 CDA R2 Conformance and Requirements Coverage","author":"Boufahja","year":"2015","journal-title":"EJBI"},{"key":"2025032904405831100_ocw018-B13"},{"key":"2025032904405831100_ocw018-B14","first-page":"1","article-title":"Archetypes: constraint-based domain models for future-proof information systems","author":"Beale","year":"2001","journal-title":"OOPSLA 2002 Work Behav Semant"},{"key":"2025032904405831100_ocw018-B15","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1197\/jamia.M1888","article-title":"HL7 clinical document architecture, release 2","volume":"13","author":"Dolin","year":"2006","journal-title":"J Am Med Inform Assoc."},{"key":"2025032904405831100_ocw018-B16","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/S1386-5056(97)00121-4","article-title":"HL7 Version 3\u2014An object-oriented methodology for collaborative standards development","volume":"48","author":"Beeler","year":"1998","journal-title":"Int J Med Inform."},{"key":"2025032904405831100_ocw018-B17"},{"key":"2025032904405831100_ocw018-B18","doi-asserted-by":"crossref","first-page":"1076","DOI":"10.1136\/amiajnl-2014-002875","article-title":"Lessons learned in detailed clinical modeling at Intermountain Healthcare","volume":"21","author":"Oniki","year":"2014","journal-title":"J Am Med Inform Assoc."},{"key":"2025032904405831100_ocw018-B19"},{"key":"2025032904405831100_ocw018-B20","first-page":"71","article-title":"Data interchange standards in healthcare IT\u2014computable semantic interoperability: now possible but still difficult, do we really need a better mousetrap?","volume":"20","author":"Mead","year":"2006","journal-title":"J Healthc Inf Manag"},{"key":"2025032904405831100_ocw018-B21"},{"key":"2025032904405831100_ocw018-B22"},{"key":"2025032904405831100_ocw018-B23"},{"key":"2025032904405831100_ocw018-B24"},{"key":"2025032904405831100_ocw018-B25"},{"key":"2025032904405831100_ocw018-B26"},{"key":"2025032904405831100_ocw018-B27"},{"key":"2025032904405831100_ocw018-B28"},{"key":"2025032904405831100_ocw018-B29"},{"key":"2025032904405831100_ocw018-B30"},{"key":"2025032904405831100_ocw018-B31"},{"key":"2025032904405831100_ocw018-B32","first-page":"470","article-title":"Expression of Security Policy in Medical Systems for Electronic Healthcare Records","volume":"3","author":"Lea","year":"2009","journal-title":"ICMISE"},{"key":"2025032904405831100_ocw018-B33"},{"key":"2025032904405831100_ocw018-B34"},{"key":"2025032904405831100_ocw018-B35"},{"key":"2025032904405831100_ocw018-B36"},{"key":"2025032904405831100_ocw018-B37"},{"key":"2025032904405831100_ocw018-B38"},{"key":"2025032904405831100_ocw018-B39","first-page":"60","article-title":"OntoCR: A CEN\/ISO-13606 clinical repository based on ontologies","author":"Lozano-Rub\u00ed","year":"2016","journal-title":"J Biomed Inform"},{"key":"2025032904405831100_ocw018-B40"},{"key":"2025032904405831100_ocw018-B41"},{"key":"2025032904405831100_ocw018-B42"},{"key":"2025032904405831100_ocw018-B43"},{"key":"2025032904405831100_ocw018-B44"},{"key":"2025032904405831100_ocw018-B45"},{"key":"2025032904405831100_ocw018-B46"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/23\/6\/1127\/62780982\/jamia_23_6_1127.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/23\/6\/1127\/62780982\/jamia_23_6_1127.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,31]],"date-time":"2025-03-31T03:16:05Z","timestamp":1743390965000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/23\/6\/1127\/2399278"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,6,7]]},"references-count":46,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2016,6,7]]},"published-print":{"date-parts":[[2016,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocw018","relation":{},"ISSN":["1527-974X","1067-5027"],"issn-type":[{"value":"1527-974X","type":"electronic"},{"value":"1067-5027","type":"print"}],"subject":[],"published-other":{"date-parts":[[2016,11]]},"published":{"date-parts":[[2016,6,7]]}}}