{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,13]],"date-time":"2025-06-13T05:48:21Z","timestamp":1749793701346,"version":"3.37.3"},"reference-count":71,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T00:00:00Z","timestamp":1693440000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"name":"National Health and Medical Research"},{"DOI":"10.13039\/501100000925","name":"NHMRC","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Centre for Research Excellence in Digital Health","award":["GNT2008645"],"award-info":[{"award-number":["GNT2008645"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,11,17]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>This article proposes a framework to support the scientific research of standards so that they can be better measured, evaluated, and designed.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>Beginning with the notion of common models, the framework describes the general standard problem\u2014the seeming impossibility of creating a singular, persistent, and definitive standard which is not subject to change over time in an open system.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>The standard problem arises from uncertainty driven by variations in operating context, standard quality, differences in implementation, and drift over time. As a result, fitting work using conformance services is needed to repair these gaps between a standard and what is required for real-world use. To guide standards design and repair, a framework for measuring performance in context is suggested, based on signal detection theory and technomarkers. Based on the type of common model in operation, different conformance strategies are identified: (1) Universal conformance (all agents access the same standard); (2) Mediated conformance (an interoperability layer supports heterogeneous agents); and (3) Localized conformance (autonomous adaptive agents manage their own needs). Conformance methods include incremental design, modular design, adaptors, and creating interactive and adaptive agents.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>Machine learning should have a major role in adaptive fitting. Research to guide the choice and design of conformance services may focus on the stability and homogeneity of shared tasks, and whether common models are shared ahead of time or adjusted at task time.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>This analysis conceptually decouples interoperability and standardization. While standards facilitate interoperability, interoperability is achievable without standardization.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad176","type":"journal-article","created":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T06:39:45Z","timestamp":1693550385000},"page":"2086-2097","source":"Crossref","is-referenced-by-count":8,"title":["The standard problem"],"prefix":"10.1093","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6444-6584","authenticated-orcid":false,"given":"Enrico","family":"Coiera","sequence":"first","affiliation":[{"name":"Australian Institute of Health Innovation, Macquarie University , Sydney, NSW 2109, Australia"}]}],"member":"286","published-online":{"date-parts":[[2023,8,31]]},"reference":[{"year":"1999","key":"2023111709543369900_ocad176-B1"},{"key":"2023111709543369900_ocad176-B2","doi-asserted-by":"crossref","first-page":"405","DOI":"10.2307\/25148766","article-title":"Standard making: a critical research frontier for information systems research","volume":"30","author":"Lyytinen","year":"2006","journal-title":"MIS Q"},{"issue":"1","key":"2023111709543369900_ocad176-B3","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1136\/jamia.2010.007864","article-title":"Approaching semantic interoperability in Health Level seven","volume":"18","author":"Dolin","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2023111709543369900_ocad176-B4","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-30370-3","volume-title":"Principles of Health Interoperability: SNOMED CT, HL7 and FHIR","author":"Benson","year":"2016"},{"key":"2023111709543369900_ocad176-B5","volume-title":"Health Information Exchange\u2014Navigating and Managing a Network of Health Information Systems","author":"Dixon","year":"2023","edition":"2nd ed."},{"key":"2023111709543369900_ocad176-B6","first-page":"151","article-title":"The HL7 reference information model under scrutiny","volume":"124","author":"Schadow","year":"2006","journal-title":"Stud Health Technol Inform"},{"key":"2023111709543369900_ocad176-B7","first-page":"133","article-title":"HL7 RIM: an incoherent standard","volume":"124","author":"Smith","year":"2006","journal-title":"Stud Health Technol Inform"},{"issue":"2","key":"2023111709543369900_ocad176-B8","doi-asserted-by":"crossref","first-page":"e64","DOI":"10.2196\/mhealth.3918","article-title":"Can standards and regulations keep up with health technology?","volume":"3","author":"Vincent","year":"2015","journal-title":"JMIR Mhealth Uhealth"},{"key":"2023111709543369900_ocad176-B9","first-page":"1","volume-title":"Hewlett Packard Laboratories Technical Reports","author":"Coiera","year":"1997"},{"issue":"3","key":"2023111709543369900_ocad176-B10","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1136\/jamia.2000.0070277","article-title":"When conversation is better than computation","volume":"7","author":"Coiera","year":"2000","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2023111709543369900_ocad176-B11","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1136\/amiajnl-2012-001520","article-title":"Communication spaces","volume":"21","author":"Coiera","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2023111709543369900_ocad176-B12","first-page":"11","article-title":"Stasis and adaptation","volume":"194","author":"Coiera","year":"2013","journal-title":"Stud Health Technol Inform"},{"key":"2023111709543369900_ocad176-B13","first-page":"1","article-title":"Mediated agent interaction","volume":"2101","author":"Coiera","year":"2001","journal-title":"Lect Notes Artif Int"},{"issue":"28","key":"2023111709543369900_ocad176-B14","first-page":"1","article-title":"Distributed systems principles and paradigms","volume":"2","author":"Van Steen","year":"2002","journal-title":"Network"},{"issue":"2\/3","key":"2023111709543369900_ocad176-B15","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1504\/IJCIS.2006.009433","article-title":"Modelling infrastructures as socio-technical systems","volume":"2","author":"Ottens","year":"2006","journal-title":"Int J Crit Infrastruct"},{"volume-title":"Lamp Caps and Holders Together with Gauges for the Control of Interchangeability and Safety\u2014Part 1: Lamp Caps","year":"1969","author":"International Electrotechnical Commission","key":"2023111709543369900_ocad176-B16"},{"key":"2023111709543369900_ocad176-B17","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/B978-1-4832-1446-7.50028-5","volume-title":"Readings in Cognitive Science","author":"Rosch","year":"1988"},{"volume-title":"Mastering the Dynamics of Innovation","year":"1996","author":"Utterback","key":"2023111709543369900_ocad176-B18"},{"issue":"3","key":"2023111709543369900_ocad176-B19","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1136\/amiajnl-2014-003100","article-title":"Assessing the adequacy of the HL7\/LOINC document ontology role axis","volume":"22","author":"Rajamani","year":"2015","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2023111709543369900_ocad176-B20","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1136\/amiajnl-2014-003151","article-title":"Scalable quality assurance for large SNOMED CT hierarchies using subject-based subtaxonomies","volume":"22","author":"Ochs","year":"2015","journal-title":"J Am Med Inform Assoc"},{"key":"2023111709543369900_ocad176-B21","first-page":"72","volume-title":"The Role of Domain Models in Maintaining Consistency of Large Medical Knowledge Bases","author":"Glowinski","year":"1991"},{"issue":"6","key":"2023111709543369900_ocad176-B22","doi-asserted-by":"crossref","first-page":"1060","DOI":"10.1136\/amiajnl-2014-002883","article-title":"Are meaningful use stage 2 certified EHRs ready for interoperability? Findings from the SMART C-CDA collaborative","volume":"21","author":"D\u2019Amore","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2023111709543369900_ocad176-B23","doi-asserted-by":"crossref","first-page":"d3693","DOI":"10.1136\/bmj.d3693","article-title":"Why system inertia makes health reform so difficult","volume":"342","author":"Coiera","year":"2011","journal-title":"BMJ"},{"issue":"5","key":"2023111709543369900_ocad176-B24","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1177\/0162243910377624","article-title":"This is not a boundary object: reflections on the origin of a concept","volume":"35","author":"Leigh Star","year":"2010","journal-title":"Sci Technol Human Values"},{"volume-title":"FRAM, the Functional Resonance Analysis Method: Modelling Complex Socio-Technical Systems","year":"2012","author":"Hollnagel","key":"2023111709543369900_ocad176-B25"},{"issue":"5","key":"2023111709543369900_ocad176-B26","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/0048-7333(88)90006-6","article-title":"Implementation as mutual adaptation of technology and organization","volume":"17","author":"Leonard","year":"1988","journal-title":"Res Policy"},{"issue":"4","key":"2023111709543369900_ocad176-B27","first-page":"499","article-title":"Reinvention in the innovation process","volume":"1","author":"Rice","year":"1980","journal-title":"Sci Commun"},{"issue":"4","key":"2023111709543369900_ocad176-B28","first-page":"857","article-title":"Users as innovators: a review, critique, and future research directions","volume":"36","author":"Bogers","year":"2010","journal-title":"J Manag"},{"key":"2023111709543369900_ocad176-B29","first-page":"237","volume-title":"Standardizing Health Care Data across an Enterprise","author":"Umberfield","year":"2023"},{"year":"2000","key":"2023111709543369900_ocad176-B30"},{"issue":"2","key":"2023111709543369900_ocad176-B31","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1007\/s10796-009-9218-4","article-title":"Taxonomy, technology and applications of smart objects","volume":"13","author":"L\u00f3pez","year":"2011","journal-title":"Inform Syst Front"},{"year":"2014","author":"Grieve","key":"2023111709543369900_ocad176-B32"},{"key":"2023111709543369900_ocad176-B33","first-page":"100001","article-title":"A review of machine learning algorithms for identification and classification of non-functional requirements","volume":"1","author":"Binkhonain","year":"2019","journal-title":"Expert Syst Appl X"},{"key":"2023111709543369900_ocad176-B34","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/2366.001.0001","volume-title":"Design Rules: The Power of Modularity","author":"Baldwin","year":"2000"},{"key":"2023111709543369900_ocad176-B35","doi-asserted-by":"crossref","first-page":"104251","DOI":"10.1016\/j.jbi.2022.104251","article-title":"A method for structuring complex clinical knowledge and its representational formalisms to support composite knowledge interoperability in healthcare","volume":"137","author":"Lario","year":"2023","journal-title":"J Biomed Inform"},{"key":"2023111709543369900_ocad176-B36","first-page":"37","volume-title":"The Structure of Ill-Structured Solutions: Boundary Objects and Heterogeneous Distributed Problem Solving","author":"Star","year":"1989"},{"issue":"3","key":"2023111709543369900_ocad176-B37","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1177\/030631289019003001","article-title":"Institutional ecology, translations\u2019 and boundary objects: amateurs and professionals in Berkeley\u2019s Museum of Vertebrate Zoology, 1907-39","volume":"19","author":"Star","year":"1989","journal-title":"Soc Stud Sci"},{"issue":"3","key":"2023111709543369900_ocad176-B38","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1093\/jamia\/ocv003","article-title":"Solving the interoperability challenge of a distributed complex patient guidance system: a data integrator based on HL7\u2019s virtual medical record standard","volume":"22","author":"Marcos","year":"2015","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023111709543369900_ocad176-B39","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s10796-011-9309-x","article-title":"Autonomous mapping of HL7 RIM and relational database schema","volume":"14","author":"Umer","year":"2012","journal-title":"Inform Syst Front"},{"issue":"12","key":"2023111709543369900_ocad176-B40","doi-asserted-by":"crossref","first-page":"5848","DOI":"10.3390\/app12125848","article-title":"LUMA: a mapping assistant for standardizing the units of LOINC-coded laboratory tests","volume":"12","author":"Vogl","year":"2022","journal-title":"Appl Sci"},{"issue":"1","key":"2023111709543369900_ocad176-B41","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1186\/s13326-018-0191-z","article-title":"Ontoserver: a syndicated terminology server","volume":"9","author":"Metke-Jimenez","year":"2018","journal-title":"J Biomed Semantics"},{"issue":"3","key":"2023111709543369900_ocad176-B42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4018\/jdwm.2009070101","article-title":"A survey of extract\u2013transform\u2013load technology","volume":"5","author":"Vassiliadis","year":"2009","journal-title":"Int J Data Warehous Min"},{"issue":"4","key":"2023111709543369900_ocad176-B43","doi-asserted-by":"crossref","first-page":"e0266911","DOI":"10.1371\/journal.pone.0266911","article-title":"Extract, transform, load framework for the conversion of health databases to OMOP","volume":"17","author":"Quiroz","year":"2022","journal-title":"PLoS One"},{"first-page":"1","year":"2011","author":"Blair","key":"2023111709543369900_ocad176-B44"},{"issue":"8","key":"2023111709543369900_ocad176-B45","doi-asserted-by":"crossref","first-page":"e28212","DOI":"10.2196\/28212","article-title":"Matching biomedical ontologies: construction of matching clues and systematic evaluation of different combinations of matchers","volume":"9","author":"Wang","year":"2021","journal-title":"JMIR Med Inform"},{"year":"2014","key":"2023111709543369900_ocad176-B46"},{"key":"2023111709543369900_ocad176-B47","doi-asserted-by":"crossref","first-page":"893409","DOI":"10.3389\/fgene.2022.893409","article-title":"Matching biomedical ontologies via a hybrid graph attention network","volume":"13","author":"Wang","year":"2022","journal-title":"Front Genet"},{"issue":"7763","key":"2023111709543369900_ocad176-B48","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1038\/s41586-019-1335-8","article-title":"Unsupervised word embeddings capture latent knowledge from materials science literature","volume":"571","author":"Tshitoyan","year":"2019","journal-title":"Nature"},{"issue":"1","key":"2023111709543369900_ocad176-B49","doi-asserted-by":"crossref","first-page":"14","DOI":"10.3390\/computers12010014","article-title":"Text-to-ontology mapping via natural language processing with application to search for relevant ontologies in catalysis","volume":"12","author":"Korel","year":"2023","journal-title":"Computers"},{"year":"2016","key":"2023111709543369900_ocad176-B50"},{"first-page":"27","year":"2011","author":"Grace","key":"2023111709543369900_ocad176-B51"},{"year":"2020","key":"2023111709543369900_ocad176-B52"},{"year":"2019","key":"2023111709543369900_ocad176-B53"},{"issue":"5","key":"2023111709543369900_ocad176-B54","doi-asserted-by":"crossref","first-page":"3897","DOI":"10.1007\/s10462-021-10097-x","article-title":"Consensus in multi-agent systems: a review","volume":"55","author":"Amirkhani","year":"2022","journal-title":"Artif Intell Rev"},{"key":"2023111709543369900_ocad176-B55","doi-asserted-by":"crossref","DOI":"10.2174\/97816080582421140101","volume-title":"Negotiation and Argumentation in Multi-Agent Systems: Fundamentals, Theories, Systems and Applications","author":"Lopes","year":"2014"},{"issue":"4","key":"2023111709543369900_ocad176-B56","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1007\/s10462-015-9435-9","article-title":"A systematic review of argumentation techniques for multi-agent systems research","volume":"44","author":"Carrera","year":"2015","journal-title":"Artif Intell Rev"},{"issue":"2","key":"2023111709543369900_ocad176-B57","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1002\/rnc.1687","article-title":"Consensus in multi-agent systems with communication constraints","volume":"22","author":"Wen","year":"2012","journal-title":"Int J Robust Nonlinear Control"},{"issue":"5","key":"2023111709543369900_ocad176-B58","doi-asserted-by":"crossref","first-page":"920","DOI":"10.1016\/j.automatica.2011.02.003","article-title":"Distributed consensus for multi-agent systems with delays and noises in transmission channels","volume":"47","author":"Liu","year":"2011","journal-title":"Automatica"},{"year":"2022","key":"2023111709543369900_ocad176-B59"},{"year":"2017","key":"2023111709543369900_ocad176-B60"},{"issue":"3","key":"2023111709543369900_ocad176-B61","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1007\/s11229-010-9745-z","article-title":"A dialogue system specification for explanation","volume":"182","author":"Walton","year":"2011","journal-title":"Synthese"},{"year":"2023","author":"Srinivasan","key":"2023111709543369900_ocad176-B62"},{"year":"2021","author":"Yang","key":"2023111709543369900_ocad176-B63"},{"year":"2020","key":"2023111709543369900_ocad176-B64"},{"key":"2023111709543369900_ocad176-B65","first-page":"173","volume-title":"Chapter 12: Implementation. Guide to Health Informatics","author":"Coiera","year":"2016","edition":"3rd ed"},{"key":"2023111709543369900_ocad176-B66","first-page":"63","article-title":"Compliance or conformance: what should interoperability focus on?","volume":"237","author":"Oemig","year":"2017","journal-title":"Stud Health Technol Inform"},{"key":"2023111709543369900_ocad176-B67","first-page":"528","volume-title":"Studies in Logic and the Foundations of Mathematics","author":"Chomsky","year":"1966"},{"issue":"1-2","key":"2023111709543369900_ocad176-B68","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1007\/s002210050548","article-title":"Innate and learned perceptual abilities in the newborn infant","volume":"123","author":"Slater","year":"1998","journal-title":"Exp Brain Res"},{"year":"2018","author":"Marcus","key":"2023111709543369900_ocad176-B69"},{"key":"2023111709543369900_ocad176-B70","doi-asserted-by":"crossref","DOI":"10.4324\/9781410611949","volume-title":"A Primer of Signal Detection Theory","author":"McNicol","year":"2005"},{"volume-title":"Digital Health Platform Handbook: Building a Digital Information Infrastructure (Infostructure) for Health","year":"2020","author":"World Health Organization","key":"2023111709543369900_ocad176-B71"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/12\/2086\/53477532\/ocad176.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/12\/2086\/53477532\/ocad176.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,17]],"date-time":"2023-11-17T13:27:43Z","timestamp":1700227663000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/12\/2086\/7257695"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,31]]},"references-count":71,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2023,8,31]]},"published-print":{"date-parts":[[2023,11,17]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad176","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"type":"print","value":"1067-5027"},{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2023,12,1]]},"published":{"date-parts":[[2023,8,31]]}}}