{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T11:08:10Z","timestamp":1740136090027,"version":"3.37.3"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2021,11,6]],"date-time":"2021-11-06T00:00:00Z","timestamp":1636156800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"National Health & Medical Research Council Partnership Grant","award":["APP1111925"],"award-info":[{"award-number":["APP1111925"]}]},{"name":"Macquarie University, NSW Health Pathology"},{"DOI":"10.13039\/100008999","name":"Australian Commission on Safety and Quality in Health Care","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008999","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,12,28]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>Suboptimal design of health information technology (IT) systems can lead to the introduction of errors in the diagnostic process. We aimed to identify mechanisms that can affect the safety and effectiveness of these systems in hospital settings thus contributing to the building of an explicit and replicable understanding of the variables that can affect the functioning of IT systems.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and Methods<\/jats:title><jats:p>This qualitative study drew from observations and semistructured interviews from a purposive sample of 46 participants (26 emergency department and 20 laboratory and medical imaging staff) across 3 Australian hospitals. Iterative, inductive coding of the data led to the development of higher-level themes based on relationships between codes.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Two overarching themes emerged: (1) usability and safety of the electronic test result management system; and (2) system redesign considerations about who is meant to follow up, when and how. The usability and safety of digital systems and the way these systems deal with accountability processes are triggered by mechanisms that are contextually dependent.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Our findings highlighted the multitransactional nature of the test result management process involving numerous healthcare professionals across different settings. This communication requires integration of the systems utilized by different departments and transparency of the test result follow-up process to facilitate clear lines of responsibility and accountability.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>Identifying mechanisms that shape the functionality and sustainability of electronic result management can offer a valuable appreciation of key elements that need to be accounted for, and the circumstances in which they need to operate effectively.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocab235","type":"journal-article","created":{"date-parts":[[2021,10,12]],"date-time":"2021-10-12T12:50:38Z","timestamp":1634043038000},"page":"89-96","source":"Crossref","is-referenced-by-count":1,"title":["Identifying the mechanisms that contribute to safe and effective electronic test result management systems\u2014 a multisite qualitative study"],"prefix":"10.1093","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7619-3668","authenticated-orcid":false,"given":"Andrew","family":"Georgiou","sequence":"first","affiliation":[{"name":"Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julie","family":"Li","sequence":"additional","affiliation":[{"name":"Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0715-9124","authenticated-orcid":false,"given":"Judith","family":"Thomas","sequence":"additional","affiliation":[{"name":"Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria R","family":"Dahm","sequence":"additional","affiliation":[{"name":"Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia"},{"name":"College of Arts and Social Sciences, Institute for Communication in Health Care, Australian National University, Canberra, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2021,11,6]]},"reference":[{"issue":"7335","key":"2021122823073291800_ocab235-B1","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1136\/bmj.324.7335.477","article-title":"Evidence base of clinical diagnosis: evaluation of diagnostic procedures","volume":"324","author":"Knottnerus","year":"2002","journal-title":"BMJ"},{"volume-title":"Improving Diagnosis in Health Care","year":"2015","key":"2021122823073291800_ocab235-B2"},{"issue":"2","key":"2021122823073291800_ocab235-B3","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1136\/bmjqs.2010.044339","article-title":"The safety implications of missed test results for hospitalized patients: a systematic review","volume":"20","author":"Callen","year":"2011","journal-title":"BMJ Qual Saf"},{"issue":"10","key":"2021122823073291800_ocab235-B4","doi-asserted-by":"crossref","first-page":"1334","DOI":"10.1007\/s11606-011-1949-5","article-title":"Failure to follow-up test results for ambulatory patients: a systematic review","volume":"27","author":"Callen","year":"2012","journal-title":"J Gen Intern Med"},{"issue":"7","key":"2021122823073291800_ocab235-B5","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1007\/s11606-018-4393-y","article-title":"The impact of automated notification on follow-up of actionable tests pending at discharge: a cluster-randomized controlled trial","volume":"33","author":"Dalal","year":"2018","journal-title":"J Gen Intern Med"},{"issue":"9","key":"2021122823073291800_ocab235-B6","doi-asserted-by":"crossref","first-page":"1002","DOI":"10.1007\/s11606-009-1057-y","article-title":"Adequacy of hospital discharge summaries in documenting tests with pending results and outpatient follow-up providers","volume":"24","author":"Were","year":"2009","journal-title":"J Gen Intern Med"},{"issue":"2","key":"2021122823073291800_ocab235-B7","doi-asserted-by":"crossref","first-page":"121","DOI":"10.7326\/0003-4819-143-2-200507190-00011","article-title":"Patient safety concerns arising from test results that return after hospital discharge","volume":"143","author":"Roy","year":"2005","journal-title":"Ann Intern Med"},{"issue":"4","key":"2021122823073291800_ocab235-B8","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1515\/dx-2018-0083","article-title":"Patient groups, clinicians and healthcare professionals agree\u2014all test results need to be seen, understood and followed up","volume":"5","author":"Dahm","year":"2018","journal-title":"Diagnosis (Berl)"},{"key":"2021122823073291800_ocab235-B9","first-page":"591","article-title":"Diagnostic informatics: its role in enhancing clinical excellence, patient safety and the value of care","volume":"264","author":"Georgiou","year":"2019","journal-title":"Stud Health Technol Inform"},{"issue":"5","key":"2021122823073291800_ocab235-B10","first-page":"1","article-title":"Health IT and diagnostic safety: promise and peril","volume":"2","author":"Carr","year":"2015","journal-title":"Soc Improve Diagn Med"},{"issue":"2","key":"2021122823073291800_ocab235-B11","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.annemergmed.2012.08.032","article-title":"Perceptions of the effect of information and communication technology on the quality of care delivered in emergency departments: a cross-site qualitative study","volume":"61","author":"Callen","year":"2013","journal-title":"Ann Emerg Med"},{"issue":"7","key":"2021122823073291800_ocab235-B12","doi-asserted-by":"crossref","first-page":"678","DOI":"10.1093\/jamia\/ocz032","article-title":"The impact of health information technology on the management and follow-up of test results\u2013a systematic review","volume":"26","author":"Georgiou","year":"2019","journal-title":"J Am Med Inform Assoc"},{"volume-title":"Realistic Evaluation","year":"1997","author":"Pawson","key":"2021122823073291800_ocab235-B13"},{"issue":"8","key":"2021122823073291800_ocab235-B14","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1093\/jamia\/ocy028","article-title":"Does health informatics have a replication crisis?","volume":"25","author":"Coiera","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2021122823073291800_ocab235-B15","doi-asserted-by":"crossref","DOI":"10.1002\/9780470750841","volume-title":"Qualitative Research in Health Care","author":"Pope","year":"2006"},{"year":"2021","key":"2021122823073291800_ocab235-B16"},{"issue":"4","key":"2021122823073291800_ocab235-B17","doi-asserted-by":"crossref","first-page":"3072","DOI":"10.1177\/1460458219889223","article-title":"A comparative study of the utilisation of an electronic test\u2013result management system in emergency and intensive care settings","volume":"26","author":"Thomas","year":"2020","journal-title":"Health Informatics J"},{"issue":"8","key":"2021122823073291800_ocab235-B18","doi-asserted-by":"crossref","first-page":"1214","DOI":"10.1093\/jamia\/ocaa093","article-title":"Variation in electronic test results management and its implications for patient safety: a multisite investigation","volume":"27","author":"Thomas","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2021122823073291800_ocab235-B19","first-page":"68","article-title":"Communicating critical test results: safe practice recommendations","volume":"31","author":"Hanna","year":"2005","journal-title":"Jt Comm J Qual Patient Saf"},{"year":"2014","author":"Ash","key":"2021122823073291800_ocab235-B20"},{"edition":"4th ed","volume-title":"System for Follow up of Tests and Results. Standards for General Practices","year":"2010","key":"2021122823073291800_ocab235-B21"},{"volume-title":"Doing Qualitative Research","year":"1999","author":"Crabtree","key":"2021122823073291800_ocab235-B22"},{"issue":"1","key":"2021122823073291800_ocab235-B23","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1186\/1472-6947-12-68","article-title":"An empirically-derived approach for investigating Health Information Technology: the Elementally Entangled Organisational Communication (EEOC) framework","volume":"12","author":"Georgiou","year":"2012","journal-title":"BMC Med Inform Decis Mak"},{"key":"2021122823073291800_ocab235-B24","first-page":"70","volume-title":"Studies in Health Technologies and Informatics","author":"Li","year":"2017"},{"issue":"10","key":"2021122823073291800_ocab235-B25","doi-asserted-by":"crossref","first-page":"1182","DOI":"10.1001\/jama.299.10.1182","article-title":"The science of improvement","volume":"299","author":"Berwick","year":"2008","journal-title":"JAMA"},{"key":"2021122823073291800_ocab235-B26","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780199226290.001.0001","volume-title":"Engaged Scholarship a Guide for Organizational and Social Research","author":"Van de Ven","year":"2007"},{"issue":"11 Suppl","key":"2021122823073291800_ocab235-B27","doi-asserted-by":"crossref","first-page":"S92","DOI":"10.7326\/M19-0879","article-title":"A Sociotechnical framework for Safety-Related electronic health record research reporting: the safer reporting framework","volume":"172","author":"Singh","year":"2020","journal-title":"Ann Intern Med"},{"issue":"11","key":"2021122823073291800_ocab235-B28","doi-asserted-by":"crossref","first-page":"e005985","DOI":"10.1136\/bmjopen-2014-005985","article-title":"How context affects electronic health record-based test result follow-up: a mixed-methods evaluation","volume":"4","author":"Menon","year":"2014","journal-title":"BMJ Open"},{"issue":"1","key":"2021122823073291800_ocab235-B29","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1186\/1472-6963-13-356","article-title":"The impact of nurse practitioners on care delivery in the emergency department: a multiple perspectives qualitative study","volume":"13","author":"Li","year":"2013","journal-title":"BMC Health Serv Res"},{"volume-title":"Organizational Communication Structure","year":"1993","author":"Johnson","key":"2021122823073291800_ocab235-B30"},{"key":"2021122823073291800_ocab235-B31","doi-asserted-by":"crossref","first-page":"125","DOI":"10.4135\/9781446218563.n7","volume-title":"Managing Organizations: Current Issues","author":"Putnam","year":"1999"},{"key":"2021122823073291800_ocab235-B32","doi-asserted-by":"crossref","first-page":"449","DOI":"10.4135\/9781483329239","volume-title":"Organizational Communication\u2014Perspectives and Trends","author":"Papa","year":"2008"},{"volume-title":"Organizational Communication: Approaches and Processes","year":"2005","author":"Miller","key":"2021122823073291800_ocab235-B33"},{"issue":"8","key":"2021122823073291800_ocab235-B34","doi-asserted-by":"crossref","first-page":"646","DOI":"10.1046\/j.1525-1497.2003.20722.x","article-title":"Medical errors related to discontinuity of care from an inpatient to an outpatient setting","volume":"18","author":"Moore","year":"2003","journal-title":"J Gen Intern Med"},{"year":"2018","key":"2021122823073291800_ocab235-B35"},{"issue":"10","key":"2021122823073291800_ocab235-B36","doi-asserted-by":"crossref","first-page":"1603","DOI":"10.1016\/j.socscimed.2011.03.020","article-title":"Time matters\u2014a theoretical and empirical examination of the temporal landscape of a hospital pathology service and the impact of e-health","volume":"72","author":"Georgiou","year":"2011","journal-title":"Soc Sci Med"},{"key":"2021122823073291800_ocab235-B37","first-page":"1241","volume-title":"Partnerships for Effective eHealth Solutions 13th World Congress on Medical and Health Informatics","author":"Callen","year":"2010"},{"key":"2021122823073291800_ocab235-B38","doi-asserted-by":"crossref","first-page":"S85","DOI":"10.1542\/peds.2008-1755G","article-title":"Electronic results management in pediatric ambulatory care: qualitative assessment","volume":"123 (Supplement 2","author":"Ferris","year":"2009","journal-title":"Pediatrics"},{"issue":"12","key":"2021122823073291800_ocab235-B39","doi-asserted-by":"crossref","first-page":"1066","DOI":"10.1056\/NEJMp0911734","article-title":"Can electronic clinical documentation help prevent diagnostic errors?","volume":"362","author":"Schiff","year":"2010","journal-title":"N Engl J Med"},{"issue":"4","key":"2021122823073291800_ocab235-B40","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1001\/jamainternmed.2016.0209","article-title":"The burden of inbox notifications in commercial electronic health records","volume":"176","author":"Murphy","year":"2016","journal-title":"JAMA Intern Med"},{"issue":"3","key":"2021122823073291800_ocab235-B41","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.amjmed.2009.07.027","article-title":"Notification of abnormal lab test results in an electronic medical record: do any safety concerns remain?","volume":"123","author":"Singh","year":"2010","journal-title":"Am J Med"},{"issue":"11","key":"2021122823073291800_ocab235-B42","doi-asserted-by":"crossref","first-page":"1591","DOI":"10.1016\/j.ajem.2013.06.028","article-title":"4000 clicks: a productivity analysis of electronic medical records in a community hospital ED","volume":"31","author":"Hill","year":"2013","journal-title":"Am J Emerg Med"},{"volume-title":"Integrating Health and Social Care and Making It Work","year":"2003","author":"Edwards","key":"2021122823073291800_ocab235-B43"},{"year":"2008","author":"MacAdam","key":"2021122823073291800_ocab235-B44"},{"issue":"2","key":"2021122823073291800_ocab235-B45","doi-asserted-by":"crossref","first-page":"446","DOI":"10.1111\/1468-0009.12459","article-title":"Rethinking integrated care: a systematic hermeneutic review of the literature on integrated care strategies and concepts","volume":"98","author":"Hughes","year":"2020","journal-title":"Milbank Q"},{"key":"2021122823073291800_ocab235-B46","first-page":"1","article-title":"Why test results are still getting \u201clost\u201d to follow-up: a qualitative study of implementation gaps","author":"Zimolzak","year":"2021","journal-title":"J Gen Intern Med"},{"key":"2021122823073291800_ocab235-B47","doi-asserted-by":"crossref","first-page":"820","DOI":"10.7326\/M17-2425","article-title":"The need for closed-loop systems for management of abnormal test results","author":"Zuccotti","year":"2018","journal-title":"Ann Intern Med"},{"issue":"1","key":"2021122823073291800_ocab235-B48","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-020-01135-9","article-title":"Does health information technology improve acknowledgement of radiology results for discharged Emergency Department patients? A before and after study","volume":"20","author":"Li","year":"2020","journal-title":"BMC Med Inform Decis Mak"},{"issue":"6","key":"2021122823073291800_ocab235-B49","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.1136\/amiajnl-2013-002466","article-title":"Lessons learned from the introduction of an electronic safety net to enhance test result management in an Australian mothers\u2019 hospital","volume":"21","author":"Georgiou","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2021122823073291800_ocab235-B50","first-page":"26","volume-title":"Making Realism Work; Realist Social Theory and Empirical Research","author":"Pawson","year":"2004"},{"key":"2021122823073291800_ocab235-B51","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pmed.1003266","volume-title":"Will COVID-19 Be Evidence-Based Medicine\u2019s Nemesis","author":"Greenhalgh","year":"2020"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/1\/89\/41955559\/ocab235.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/1\/89\/41955559\/ocab235.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,11]],"date-time":"2023-11-11T01:08:00Z","timestamp":1699664880000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/29\/1\/89\/6422476"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,6]]},"references-count":51,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,11,6]]},"published-print":{"date-parts":[[2021,12,28]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab235","relation":{},"ISSN":["1527-974X"],"issn-type":[{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2022,1,1]]},"published":{"date-parts":[[2021,11,6]]}}}