{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T10:50:10Z","timestamp":1772016610714,"version":"3.50.1"},"reference-count":55,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2020,7,28]],"date-time":"2020-07-28T00:00:00Z","timestamp":1595894400000},"content-version":"vor","delay-in-days":1,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000925","name":"National Health and Medical Research Council","doi-asserted-by":"publisher","award":["1111925"],"award-info":[{"award-number":["1111925"]}],"id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Australian Institute of Health Innovation at Macquarie University"},{"DOI":"10.13039\/100015676","name":"NSW Health Pathology","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100015676","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008999","name":"Australian Commission on Safety and Quality in Health Care","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008999","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Chief Investigators on the Partnership Project Grant"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>The management and follow-up of diagnostic test results is a major patient safety concern. The aim of this qualitative study was to explore how clinicians manage test results on an everyday basis (work-as-done) in a health information technology\u2013enabled emergency department setting. The objectives were to identify (1) variations in work-as-done in test results management and (2) the strategies clinicians use to ensure optimal management of diagnostic test results.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and Methods<\/jats:title><jats:p>Qualitative interviews (n\u2009=\u200926) and field observations were conducted across 3 Australian emergency departments. Interview data coded for results management (ie, tracking, acknowledgment, and follow-up), and artifacts, were reviewed to identify variations in descriptions of work-as-done. Thematic analysis was performed to identify common themes.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Despite using the same test result management application, there were variations in how the system was used. We identified 5 themes relating to electronic test results management: (1) tracking test results, (2) use and understanding of system functionality, (3) visibility of result actions and acknowledgment, (4) results inbox use, and (5) challenges associated with the absence of an inbox for results notifications for advanced practice nurses.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Our findings highlight that variations in work-as-done can function to overcome perceived impediments to managing test results in a HIT-enabled environment and thus identify potential risks in the process. By illuminating work-as-done, we identified strategies clinicians use to enhance test result management including paper-based manual processes, cognitive reminders, and adaptive use of electronic medical record functionality.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Test results tracking and follow-up is a priority area in need of health information technology development and training to improve team-based collaboration\/communication of results follow-up and diagnostic safety.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocaa093","type":"journal-article","created":{"date-parts":[[2020,5,6]],"date-time":"2020-05-06T11:22:40Z","timestamp":1588764160000},"page":"1214-1224","source":"Crossref","is-referenced-by-count":8,"title":["Variation in electronic test results management and its implications for patient safety: A multisite investigation"],"prefix":"10.1093","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0715-9124","authenticated-orcid":false,"given":"Judith","family":"Thomas","sequence":"first","affiliation":[{"name":"Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, New South Wales, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria R","family":"Dahm","sequence":"additional","affiliation":[{"name":"Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, New South Wales, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julie","family":"Li","sequence":"additional","affiliation":[{"name":"Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, New South Wales, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Smith","sequence":"additional","affiliation":[{"name":"Emergency Medicine, Illawarra Shoalhaven Local Health District, New South Wales, Australia"},{"name":"Graduate School of Medicine, University of Wollongong, New South Wales, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jacqui","family":"Irvine","sequence":"additional","affiliation":[{"name":"Emergency Medicine, Illawarra Shoalhaven Local Health District, New South Wales, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johanna I","family":"Westbrook","sequence":"additional","affiliation":[{"name":"Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, New South Wales, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7619-3668","authenticated-orcid":false,"given":"Andrew","family":"Georgiou","sequence":"additional","affiliation":[{"name":"Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, New South Wales, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,7,27]]},"reference":[{"key":"2020110613115809400_ocaa093-B1","year":"2019"},{"issue":"4","key":"2020110613115809400_ocaa093-B2","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1136\/amiajnl-2011-000615","article-title":"Design and implementation of an automated email notification system for results of tests pending at discharge","volume":"19","author":"Dalal","year":"2012","journal-title":"J Am Med Inform Assoc"},{"issue":"10","key":"2020110613115809400_ocaa093-B3","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1007\/s11606-012-1986-8","article-title":"Impact of automated alerts on follow-up of post-discharge microbiology results: a cluster randomized controlled trial","volume":"27","author":"El-Kareh","year":"2012","journal-title":"J Gen Intern Med"},{"issue":"9","key":"2020110613115809400_ocaa093-B4","doi-asserted-by":"crossref","first-page":"631","DOI":"10.12788\/jhm.2944","article-title":"Interventions to improve follow-up of laboratory test results pending at discharge: a systematic review","volume":"13","author":"Whitehead","year":"2018","journal-title":"J Hosp Med"},{"issue":"5","key":"2020110613115809400_ocaa093-B5","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1007\/s11606-017-4290-9","article-title":"A systematic review of interventions to follow-up test results pending at discharge","volume":"33","author":"Darragh","year":"2018","journal-title":"J Gen Intern Med"},{"issue":"2","key":"2020110613115809400_ocaa093-B6","doi-asserted-by":"crossref","first-page":"121","DOI":"10.7326\/0003-4819-143-2-200507190-00011","article-title":"Patient safety concerns arising from test results that return after hospital discharge","volume":"143","author":"Roy","year":"2005","journal-title":"Ann Intern Med"},{"issue":"2","key":"2020110613115809400_ocaa093-B7","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1136\/bmjqs.2010.044339","article-title":"The safety implications of missed test results for hospitalised patients: a systematic review","volume":"20","author":"Callen","year":"2011","journal-title":"BMJ Qual Saf Health Care"},{"issue":"9","key":"2020110613115809400_ocaa093-B8","doi-asserted-by":"crossref","first-page":"1002","DOI":"10.1007\/s11606-009-1057-y","article-title":"Adequacy of hospital discharge summaries in documenting tests with pending results and outpatient follow-up providers","volume":"24","author":"Were","year":"2009","journal-title":"J Gen Intern Med"},{"issue":"7","key":"2020110613115809400_ocaa093-B9","doi-asserted-by":"crossref","first-page":"678","DOI":"10.1093\/jamia\/ocz032","article-title":"The impact of health information technology on the management and follow-up of test results \u2013 a systematic review","volume":"26","author":"Georgiou","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2020110613115809400_ocaa093-B10","doi-asserted-by":"crossref","first-page":"37","DOI":"10.3414\/ME09-01-0011","article-title":"The rate of missed test results in an emergency department: an evaluation using an electronic test order and results viewing system","volume":"49","author":"Callen","year":"2010","journal-title":"Methods Inf Med"},{"key":"2020110613115809400_ocaa093-B11","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.ijmedinf.2016.12.006","article-title":"What is the impact of an electronic test result acknowledgement system on emergency department physicians\u2019 work processes? A mixed-method pre-post observational study","volume":"99","author":"Georgiou","year":"2017","journal-title":"Int J Med Inform"},{"key":"2020110613115809400_ocaa093-B12","first-page":"92","article-title":"Balancing risk and resilience: a comparison of the use of a test result management system across two EDs","volume":"252","author":"Li","year":"2018","journal-title":"Stud Health Technol Inform"},{"issue":"1\u20132","key":"2020110613115809400_ocaa093-B13","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/S1532-0464(03)00061-3","article-title":"Design and implementation of a comprehensive outpatient results manager","volume":"36","author":"Poon","year":"2003","journal-title":"J Biomed Inform"},{"issue":"5","key":"2020110613115809400_ocaa093-B14","doi-asserted-by":"crossref","first-page":"933","DOI":"10.2214\/AJR.14.13064","article-title":"Four-year impact of an alert notification system on closed-loop communication of critical test results","volume":"203","author":"Lacson","year":"2014","journal-title":"AJR Am J Roentgenol"},{"issue":"1","key":"2020110613115809400_ocaa093-B15","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1186\/1472-6947-11-22","article-title":"Understanding the management of electronic test result notifications in the outpatient setting","volume":"11","author":"Hysong","year":"2011","journal-title":"BMC Med Inform Decis Mak"},{"issue":"3","key":"2020110613115809400_ocaa093-B16","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1197\/jamia.M2608","article-title":"Computerized alerts improve outpatient laboratory monitoring of transplant patients","volume":"15","author":"Staes","year":"2008","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2020110613115809400_ocaa093-B17","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1007\/s11606-018-4656-7","article-title":"Test result management practices of canadian internal medicine physicians and trainees","volume":"34","author":"Bodley","year":"2019","journal-title":"J Gen Intern Med"},{"issue":"1","key":"2020110613115809400_ocaa093-B18","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1186\/1471-2296-8-32","article-title":"The frequency of missed test results and associated treatment delays in a highly computerized health system","volume":"8","author":"Wahls","year":"2007","journal-title":"BMC Fam Pract"},{"issue":"17","key":"2020110613115809400_ocaa093-B19","doi-asserted-by":"crossref","first-page":"1578","DOI":"10.1001\/archinternmed.2009.263","article-title":"Timely follow-up of abnormal diagnostic imaging test results in an outpatient setting: are electronic medical records achieving their potential?","volume":"169","author":"Singh","year":"2009","journal-title":"Arch Intern Med"},{"issue":"3","key":"2020110613115809400_ocaa093-B20","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.amjmed.2009.07.027","article-title":"Notification of abnormal lab test results in an electronic medical record: do any safety concerns remain?","volume":"123","author":"Singh","year":"2010","journal-title":"Am J Med"},{"issue":"10","key":"2020110613115809400_ocaa093-B21","doi-asserted-by":"crossref","first-page":"1334","DOI":"10.1007\/s11606-011-1949-5","article-title":"Failure to follow-up test results for ambulatory patients: a systematic review","volume":"27","author":"Callen","year":"2012","journal-title":"J Gen Intern Med"},{"issue":"e1","key":"2020110613115809400_ocaa093-B22","doi-asserted-by":"crossref","first-page":"e2","DOI":"10.1136\/amiajnl-2012-001458","article-title":"Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA","volume":"20","author":"Middleton","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"8","key":"2020110613115809400_ocaa093-B23","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1001\/jama.2019.0161","article-title":"A decade of health information technology usability challenges and the path forward","volume":"321","author":"Ratwani","year":"2019","journal-title":"JAMA"},{"issue":"11","key":"2020110613115809400_ocaa093-B24","doi-asserted-by":"crossref","first-page":"1736","DOI":"10.1377\/hlthaff.2018.0738","article-title":"Two decades since to err is human: An assessment of progress and emerging priorities in patient safety","volume":"37","author":"Bates","year":"2018","journal-title":"Health Aff (Millwood)"},{"issue":"12","key":"2020110613115809400_ocaa093-B25","doi-asserted-by":"crossref","first-page":"1276","DOI":"10.1001\/jama.2018.1171","article-title":"Electronic health record usability issues and potential contribution to patient harm","volume":"319","author":"Howe","year":"2018","journal-title":"JAMA"},{"key":"2020110613115809400_ocaa093-B26","volume-title":"The Resilient Health Care Net","author":"Hollnagel","year":"2015"},{"issue":"5","key":"2020110613115809400_ocaa093-B27","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1093\/intqhc\/mzv063","article-title":"Resilient health care: turning patient safety on its head","volume":"27","author":"Braithwaite","year":"2015","journal-title":"Int J Qual Health Care"},{"key":"2020110613115809400_ocaa093-B28","author":"Hollnagel","year":"2019"},{"key":"2020110613115809400_ocaa093-B29","volume-title":"Resilient Health Care, Volume 2: The Resilience of Everyday Clinical Work","author":"Wears","year":"2015"},{"key":"2020110613115809400_ocaa093-B30","doi-asserted-by":"crossref","first-page":"44","DOI":"10.4324\/9780429469695-5","volume-title":"Delivering Resilient Health Care","author":"Debono","year":"2018"},{"key":"2020110613115809400_ocaa093-B31","first-page":"249","volume-title":"Resilient Health Care Volume 2: The Resilience of Everyday Clinical Work","author":"Hollnagel","year":"2013"},{"key":"2020110613115809400_ocaa093-B32","first-page":"11","volume-title":"Resilient Health Care Volume 2: The Resilience of Everyday Clinical Work","author":"Sujan","year":"2015"},{"issue":"8","key":"2020110613115809400_ocaa093-B33","first-page":"485","article-title":"The continuing problem of missed test results in an integrated health system with an advanced electronic medical record","volume":"33","author":"Wahls","year":"2007","journal-title":"Jt Comm J Qual Patient Saf"},{"issue":"6","key":"2020110613115809400_ocaa093-B34","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.1136\/amiajnl-2013-002466","article-title":"Lessons learned from the introduction of an electronic safety net to enhance test result management in an Australian mothers\u2019 hospital","volume":"21","author":"Georgiou","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2020110613115809400_ocaa093-B35","doi-asserted-by":"crossref","first-page":"543","DOI":"10.4338\/ACI-2015-10-RA-0135","article-title":"Workarounds and test results follow-up in electronic health record-based primary care","volume":"7","author":"Menon","year":"2016","journal-title":"Appl Clin Inform"},{"issue":"4","key":"2020110613115809400_ocaa093-B36","doi-asserted-by":"crossref","first-page":"1549","DOI":"10.1177\/1460458218779114","article-title":"Test results management and distributed cognition in electronic health record\u2013enabled primary care","volume":"25","author":"Smith","year":"2019","journal-title":"Health Informatics J"},{"issue":"11","key":"2020110613115809400_ocaa093-B37","doi-asserted-by":"crossref","first-page":"e005985","DOI":"10.1136\/bmjopen-2014-005985","article-title":"How context affects electronic health record-based test result follow-up: A mixed-methods evaluation","volume":"4","author":"Menon","year":"2014","journal-title":"BMJ Open"},{"issue":"20","key":"2020110613115809400_ocaa093-B38","doi-asserted-by":"crossref","first-page":"2223","DOI":"10.1001\/archinte.164.20.2223","article-title":"I wish I had seen this test result earlier!\u201d: dissatisfaction with test result management systems in primary care","volume":"164","author":"Poon","year":"2004","journal-title":"Arch Intern Med"},{"issue":"2","key":"2020110613115809400_ocaa093-B39","doi-asserted-by":"crossref","first-page":"e020235","DOI":"10.1136\/bmjopen-2017-020235","article-title":"Delivering safe and effective test result communication, management and follow-up: a mixed-methods study protocol","volume":"8","author":"Dahm","year":"2018","journal-title":"BMJ Open"},{"issue":"2","key":"2020110613115809400_ocaa093-B40","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using thematic analysis in psychology","volume":"3","author":"Braun","year":"2006","journal-title":"Qual Res Psychol"},{"key":"2020110613115809400_ocaa093-B41","doi-asserted-by":"crossref","DOI":"10.1177\/1049732320913037","article-title":"Managing uncertainty during the communication of diagnostic test information between patients and clinicians in Australian emergency care","author":"Miao","year":"2020","journal-title":"Qual Health Res"},{"key":"2020110613115809400_ocaa093-B42","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.ssci.2018.08.025","article-title":"Methodological strategies in resilient health care studies: an integrative review","volume":"110","author":"Berg","year":"2018","journal-title":"Saf Sci"},{"issue":"5","key":"2020110613115809400_ocaa093-B43","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1188\/14.ONF.545-547","article-title":"The use of triangulation in qualitative research","volume":"41","author":"Carter","year":"2014","journal-title":"Oncol Nurs Forum"},{"key":"2020110613115809400_ocaa093-B44"},{"issue":"1","key":"2020110613115809400_ocaa093-B45","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1186\/1472-6963-13-175","article-title":"Nurses\u2019 workarounds in acute healthcare settings: a scoping review","volume":"13","author":"Debono","year":"2013","journal-title":"BMC Health Serv Res"},{"issue":"4","key":"2020110613115809400_ocaa093-B46","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1111\/anae.14519","article-title":"People, systems and safety: resilience and excellence in healthcare practice","volume":"74","author":"Smith","year":"2019","journal-title":"Anaesthesia"},{"issue":"12","key":"2020110613115809400_ocaa093-B47","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1016\/j.cppeds.2015.10.001","article-title":"Safety-I, Safety-II and resilience engineering","volume":"45","author":"Patterson","year":"2015","journal-title":"Curr Probl Pediatr Adolesc Health Care"},{"issue":"12","key":"2020110613115809400_ocaa093-B48","doi-asserted-by":"crossref","first-page":"1006","DOI":"10.1136\/bmjqs-2012-001661","article-title":"Resilient actions in the diagnostic process and system performance","volume":"22","author":"Smith","year":"2013","journal-title":"BMJ Qual Saf"},{"issue":"3","key":"2020110613115809400_ocaa093-B49","doi-asserted-by":"crossref","first-page":"197","DOI":"10.2345\/0899-8205-51.3.197","article-title":"EHR usability: get it right from the start","volume":"51","author":"Kellogg","year":"2017","journal-title":"Biomed Instrum Technol"},{"issue":"8","key":"2020110613115809400_ocaa093-B50","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1001\/2013.jamainternmed.61","article-title":"Information overload and missed test results in electronic health record-based settings","volume":"173","author":"Singh","year":"2013","journal-title":"JAMA Intern Med"},{"issue":"4","key":"2020110613115809400_ocaa093-B51","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1001\/jamainternmed.2016.0209","article-title":"The burden of inbox notifications in commercial electronic health records","volume":"176","author":"Murphy","year":"2016","journal-title":"JAMA Intern Med"},{"issue":"1","key":"2020110613115809400_ocaa093-B52","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1136\/bmjqs-2017-007447","article-title":"Impact of a national QI programme on reducing electronic health record notifications to clinicians","volume":"28","author":"Shah","year":"2019","journal-title":"BMJ Qual Saf"},{"issue":"7","key":"2020110613115809400_ocaa093-B53","doi-asserted-by":"crossref","first-page":"e421","DOI":"10.1200\/JOP.18.00093","article-title":"Implementation to optimization: a tailored, data-driven approach to improve provider efficiency and confidence in use of the electronic medical record","volume":"14","author":"Kadish","year":"2018","journal-title":"J Oncol Pract"},{"issue":"2","key":"2020110613115809400_ocaa093-B54","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1002\/jhrm.21122","article-title":"An evidence-based toolkit for the development of effective and sustainable root cause analysis system safety solutions","volume":"33","author":"Hettinger","year":"2013","journal-title":"J Healthc Risk Manage"},{"issue":"2","key":"2020110613115809400_ocaa093-B55","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1016\/j.jaad.2017.12.026","article-title":"The burden of inbox-messaging systems and its effect on work-life balance in dermatology","volume":"79","author":"Bittar","year":"2018","journal-title":"J Am Acad Dermatol"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/8\/1214\/34153609\/ocaa093.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/8\/1214\/34153609\/ocaa093.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,23]],"date-time":"2022-10-23T05:18:21Z","timestamp":1666502301000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/8\/1214\/5876967"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,27]]},"references-count":55,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2020,7,27]]},"published-print":{"date-parts":[[2020,8,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa093","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,8]]},"published":{"date-parts":[[2020,7,27]]}}}