{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,26]],"date-time":"2026-04-26T04:26:55Z","timestamp":1777177615764,"version":"3.51.4"},"reference-count":63,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2017,5,18]],"date-time":"2017-05-18T00:00:00Z","timestamp":1495065600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>To systematically review the literature pertaining to asynchronous automated electronic notifications of laboratory results to clinicians.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>PubMed, Web of Science, and the Cochrane Collaboration were queried for studies pertaining to automated electronic notifications of laboratory results. A title review was performed on the primary results, with a further abstract review and full review to produce the final set of included articles.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The full review included 34 articles, representing 19 institutions. Of these, 19 reported implementation and design of systems, 11 reported quasi-experimental studies, 3 reported a randomized controlled trial, and 1 was a meta-analysis. Twenty-seven articles included alerts of critical results, while 5 focused on urgent notifications and 2 on elective notifications. There was considerable variability in clinical setting, system implementation, and results presented.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>Several asynchronous automated electronic notification systems for laboratory results have been evaluated, most from &amp;gt;10 years ago. Further research on the effect of notifications on clinicians as well as the use of modern electronic health records and new methods of notification is warranted to determine their effects on workflow and clinical outcomes.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocx047","type":"journal-article","created":{"date-parts":[[2017,4,11]],"date-time":"2017-04-11T19:11:26Z","timestamp":1491937886000},"page":"1173-1183","source":"Crossref","is-referenced-by-count":23,"title":["Asynchronous automated electronic laboratory result notifications: a systematic review"],"prefix":"10.1093","volume":"24","author":[{"given":"Benjamin H","family":"Slovis","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University, New York, NY, USA"},{"name":"Department of Emergency Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA"}]},{"given":"Thomas A","family":"Nahass","sequence":"additional","affiliation":[{"name":"Rutgers Robert Wood Johnson Medical School, Piscataway, NJ, USA"}]},{"given":"Hojjat","family":"Salmasian","sequence":"additional","affiliation":[{"name":"The Value Institute, NewYork-Presbyterian Hospital, New York, NY, USA"},{"name":"Department of Biomedical Informatics, Columbia University, New York, NY, USA"}]},{"given":"Gilad","family":"Kuperman","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University, New York, NY, USA"},{"name":"Department of Information Systems, NewYork-Presbyterian Hospital, New York, NY, USA"}]},{"given":"David K","family":"Vawdrey","sequence":"additional","affiliation":[{"name":"The Value Institute, NewYork-Presbyterian Hospital, New York, NY, USA"},{"name":"Department of Biomedical Informatics, Columbia University, New York, NY, USA"}]}],"member":"286","published-online":{"date-parts":[[2017,5,18]]},"reference":[{"issue":"4","key":"2021010612100706700_ocx047-B1","doi-asserted-by":"crossref","first-page":"378","DOI":"10.4037\/NCI.0b013e3182a903f9","article-title":"Alarm fatigue: a patient safety concern","volume":"24","author":"Sendelbach","year":"2013","journal-title":"AACN Adv Crit Care."},{"issue":"12","key":"2021010612100706700_ocx047-B2","doi-asserted-by":"crossref","first-page":"1199","DOI":"10.1001\/jama.2014.710","article-title":"Redesigning hospital alarms for patient safety: alarmed and potentially dangerous","volume":"311","author":"Chopra","year":"2014","journal-title":"JAMA."},{"issue":"1","key":"2021010612100706700_ocx047-B3","doi-asserted-by":"crossref","first-page":"299","DOI":"10.4338\/ACI-2013-09-RA-0075","article-title":"An electronic alert for HIV screening in the emergency department increases screening but not the diagnosis of HIV","volume":"5","author":"Schnall","year":"2014","journal-title":"Appl Clin Inform."},{"issue":"6","key":"2021010612100706700_ocx047-B4","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1016\/j.annemergmed.2014.11.017","article-title":"Intercepting wrong-patient orders in a computerized provider order entry system","volume":"65","author":"Green","year":"2015","journal-title":"Annals Emerg Med."},{"key":"2021010612100706700_ocx047-B5","first-page":"951","article-title":"Unit-wide notification of ventilator disconnections","author":"Evans","year":"2005","journal-title":"Proc Annu AMIA Symp."},{"issue":"5","key":"2021010612100706700_ocx047-B6","first-page":"296","article-title":"A computerized laboratory alerting system","volume":"7","author":"Tate","year":"1990","journal-title":"MD Comput."},{"issue":"2","key":"2021010612100706700_ocx047-B7","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF01872746","article-title":"Physician decision-making: evaluation of data used in a computerized ICU","volume":"1","author":"Bradshaw","year":"1984","journal-title":"Int J Clin Monit Comput."},{"key":"2021010612100706700_ocx047-B8","first-page":"54","article-title":"Inferencing strategies for automated ALERTS on critically abnormal laboratory and blood gas data","author":"Shabot","year":"1989","journal-title":"Proc Ann Symp Comput Appl Med Care."},{"issue":"2","key":"2021010612100706700_ocx047-B9","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1136\/bmjqs.2010.044339","article-title":"The safety implications of missed test results for hospitalised patients: a systematic review","volume":"20","author":"Callen","year":"2011","journal-title":"BMJ Qual Saf."},{"key":"2021010612100706700_ocx047-B10","first-page":"704","article-title":"Detecting alerts, notifying the physician, and offering action items: a comprehensive alerting system","author":"Kuperman","year":"1996","journal-title":"Proc Annu AMIA Fall Symp."},{"issue":"1","key":"2021010612100706700_ocx047-B11","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1136\/jamia.1998.0050112","article-title":"How promptly are inpatients treated for critical laboratory results?","volume":"5","author":"Kuperman","year":"1998","journal-title":"J Am Med Inform Assoc."},{"key":"2021010612100706700_ocx047-B12","first-page":"164","article-title":"Nurses, pagers, and patient-specific criteria: three keys to improved critical value reporting","author":"Tate","year":"1995","journal-title":"Proc Annu Symp Comput Appl Med Care."},{"key":"2021010612100706700_ocx047-B13","first-page":"188","article-title":"Clinical event monitoring at the University of Pittsburgh","author":"Wagner","year":"1997","journal-title":"Proc Annu AMIA Fall Symp."},{"key":"2021010612100706700_ocx047-B14","first-page":"131","article-title":"Design and implementation of a real-time clinical alerting system for intensive care unit","author":"Chen","year":"2002","journal-title":"Proc AMIA Symp."},{"issue":"3","key":"2021010612100706700_ocx047-B15","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1197\/jamia.M1009","article-title":"Real-time notification of laboratory data requested by users through alphanumeric pagers","volume":"9","author":"Poon","year":"2002","journal-title":"J Am Med Inform Assoc."},{"issue":"2","key":"2021010612100706700_ocx047-B16","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1136\/qshc.2008.028407","article-title":"Real-time clinical alerting: effect of an automated paging system on response time to critical laboratory values \u2013 a randomised controlled trial","volume":"19","author":"Etchells","year":"2010","journal-title":"Qual Saf Health Care."},{"issue":"13","key":"2021010612100706700_ocx047-B17","doi-asserted-by":"crossref","first-page":"1511","DOI":"10.1001\/archinte.1994.00420130107014","article-title":"Effect of computer-based alerts on the treatment and outcomes of hospitalized patients","volume":"154","author":"Rind","year":"1994","journal-title":"Arch Int Med."},{"issue":"6","key":"2021010612100706700_ocx047-B18","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1097\/00005110-198006000-00005","article-title":"A computerized alert program for acutely ill patients","volume":"10","author":"Johnson","year":"1980","journal-title":"J Nurs Adm."},{"issue":"2","key":"2021010612100706700_ocx047-B19","first-page":"87","article-title":"Technological resources and personnel costs required to implement an automated alert system for ambulatory physicians when patients are discharged from hospitals to home","volume":"20","author":"Field","year":"2012","journal-title":"Inform Prim Care."},{"issue":"2","key":"2021010612100706700_ocx047-B20","first-page":"95","article-title":"A computerized laboratory alerting system in a psychogeriatric unit","volume":"15","author":"Modai","year":"1998","journal-title":"MD Comput."},{"key":"2021010612100706700_ocx047-B21","first-page":"994","article-title":"An alert system for ED laboratory test results","author":"Dong","year":"1998","journal-title":"Proc AMIA Symp."},{"issue":"3","key":"2021010612100706700_ocx047-B22","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1016\/j.jbi.2004.11.010","article-title":"Technology, work, and information flows: lessons from the implementation of a wireless alert pager system","volume":"38","author":"Reddy","year":"2005","journal-title":"J Biomed Inform."},{"issue":"8","key":"2021010612100706700_ocx047-B23","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1001\/2013.jamainternmed.61","article-title":"Information overload and missed test results in electronic health record-based settings","volume":"173","author":"Singh","year":"2013","journal-title":"JAMA Int Med."},{"key":"2021010612100706700_ocx047-B24","unstructured":"Common Example Scenarios in FHIR 2015. https:\/\/www.hl7.org\/fhir\/usecases.html. Accessed March 16, 2017."},{"issue":"4","key":"2021010612100706700_ocx047-B25","doi-asserted-by":"crossref","first-page":"264","DOI":"10.7326\/0003-4819-151-4-200908180-00135","article-title":"Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement","volume":"151","author":"Moher","year":"2009","journal-title":"Annals Int Med."},{"issue":"4","key":"2021010612100706700_ocx047-B26","doi-asserted-by":"crossref","first-page":"W65","DOI":"10.7326\/0003-4819-151-4-200908180-00136","article-title":"The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration","volume":"151","author":"Liberati","year":"2009","journal-title":"Ann Int Med."},{"issue":"1","key":"2021010612100706700_ocx047-B27","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/BF02915529","article-title":"Decision support alerts for clinical laboratory and blood gas data","volume":"7","author":"Shabot","year":"1990","journal-title":"Int J Clin Monit Comput."},{"issue":"3","key":"2021010612100706700_ocx047-B28","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1016\/S0735-1097(84)80104-7","article-title":"Application of a computerized medical decision-making process to the problem of digoxin intoxication","volume":"4","author":"White","year":"1984","journal-title":"J Am Coll Cardiol."},{"issue":"6","key":"2021010612100706700_ocx047-B29","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1016\/0010-4809(89)90077-3","article-title":"Development of a computerized laboratory alerting system","volume":"22","author":"Bradshaw","year":"1989","journal-title":"Comput Biomed Res."},{"key":"2021010612100706700_ocx047-B30","article-title":"Inferencing Strategies for Automated ALERTS on Critically Abnormal Laboratory and Blood Gas Data","journal-title":"Proc Annu Symp Comput Appl Med Care"},{"key":"2021010612100706700_ocx047-B31","first-page":"28","article-title":"The effect of computer-based reminders on the management of hospitalized patients with worsening renal function","author":"Rind","year":"1991","journal-title":"Proc Annu Symp Comput Appl Med Care."},{"key":"2021010612100706700_ocx047-B32","first-page":"193","article-title":"Computers, quality, and the clinical laboratory: a look at critical value reporting","author":"Tate","year":"1993","journal-title":"Proc Annu Symp Comput Appl Med Care."},{"key":"2021010612100706700_ocx047-B33","first-page":"174","article-title":"Real-time wireless decision support alerts on a Palmtop PDA","author":"Shabot","year":"1995","journal-title":"Proc Annu Symp Comput Appl Med Care."},{"key":"2021010612100706700_ocx047-B34","first-page":"243","article-title":"Advanced alerting features: displaying new relevant data and retracting alerts","author":"Kuperman","year":"1997","journal-title":"Proc Annu Fall AMIA Symp."},{"issue":"6","key":"2021010612100706700_ocx047-B35","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1136\/jamia.1999.0060512","article-title":"Improving response to critical laboratory results with automation: results of a randomized controlled trial","volume":"6","author":"Kuperman","year":"1999","journal-title":"J Am Med Inform Assoc."},{"key":"2021010612100706700_ocx047-B36","first-page":"789","article-title":"Wireless clinical alerts for physiologic, laboratory and medication data","author":"Shabot","year":"2000","journal-title":"Proc AMIA Symp."},{"issue":"Pt 1","key":"2021010612100706700_ocx047-B37","first-page":"469","article-title":"A comprehensive computerized critical laboratory results alerting system for ambulatory and hospitalized patients","volume":"84","author":"Iordache","year":"2001","journal-title":"Stud Health Technol Inform."},{"issue":"2","key":"2021010612100706700_ocx047-B38","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1001\/archinte.163.2.200","article-title":"Effect of a computerized alert on the management of hypokalemia in hospitalized patients","volume":"163","author":"Paltiel","year":"2003","journal-title":"Arch Int Med"},{"issue":"4","key":"2021010612100706700_ocx047-B39","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1197\/jamia.M1500","article-title":"A trial of automated safety alerts for inpatient digoxin use with computerized physician order entry","volume":"11","author":"Galanter","year":"2004","journal-title":"J Am Med Inform Assoc."},{"issue":"3","key":"2021010612100706700_ocx047-B40","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1197\/jamia.M2608","article-title":"Computerized alerts improve outpatient laboratory monitoring of transplant patients","volume":"15","author":"Staes","year":"2008","journal-title":"J Am Med Inform Assoc."},{"issue":"2","key":"2021010612100706700_ocx047-B41","first-page":"149","article-title":"Evaluating the short message service alerting system for critical value notification via PDA telephones","volume":"38","author":"Park","year":"2008","journal-title":"Ann Clin Lab Sci."},{"issue":"3","key":"2021010612100706700_ocx047-B42","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1309\/AJCPYS80BUCBXTUH","article-title":"Evaluation of effectiveness of a computerized notification system for reporting critical values","volume":"131","author":"Piva","year":"2009","journal-title":"Am J Clin Pathol."},{"issue":"3","key":"2021010612100706700_ocx047-B43","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1373\/clinchem.2009.135376","article-title":"Implementation of a closed-loop reporting system for critical values and clinical communication in compliance with goals of the joint commission","volume":"56","author":"Parl","year":"2010","journal-title":"Clin Chem."},{"issue":"3","key":"2021010612100706700_ocx047-B44","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.amjmed.2009.07.027","article-title":"Notification of abnormal lab test results in an electronic medical record: do any safety concerns remain?","volume":"123","author":"Singh","year":"2010","journal-title":"Am J Med."},{"issue":"5","key":"2021010612100706700_ocx047-B45","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1016\/j.ajic.2010.08.019","article-title":"Computer laboratory notification system via short message service to reduce health care delays in management of tuberculosis in Taiwan","volume":"39","author":"Chen","year":"2011","journal-title":"Am J Infect Control."},{"issue":"11","key":"2021010612100706700_ocx047-B46","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1136\/bmjqs.2010.051110","article-title":"Real-time automated paging and decision support for critical laboratory abnormalities","volume":"20","author":"Etchells","year":"2011","journal-title":"BMJ Qual Saf."},{"issue":"13\u201314","key":"2021010612100706700_ocx047-B47","doi-asserted-by":"crossref","first-page":"979","DOI":"10.1016\/j.clinbiochem.2012.06.023","article-title":"Effectiveness of automated notification and customer service call centers for timely and accurate reporting of critical values: a laboratory medicine best practices systematic review and meta-analysis","volume":"45","author":"Liebow","year":"2012","journal-title":"Clin Biochem."},{"issue":"Pt 2","key":"2021010612100706700_ocx047-B48","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1177\/0004563214534832","article-title":"A simple electronic alert for acute kidney injury","volume":"52","author":"Flynn","year":"2015","journal-title":"Ann Clin Biochem."},{"issue":"2","key":"2021010612100706700_ocx047-B49","first-page":"87","article-title":"The HELP system","volume":"7","author":"Pryor","year":"1983","journal-title":"J\u00a0Med Sys."},{"key":"2021010612100706700_ocx047-B50","first-page":"617","article-title":"Optimal use of communication channels in clinical event monitoring","author":"Hogan","year":"1998","journal-title":"Proc AMIA Symp."},{"issue":"4 Suppl","key":"2021010612100706700_ocx047-B51","first-page":"AS95","article-title":"Measuring effectiveness. What to expect without a randomized control group","volume":"33","author":"D\u2019Agostino","year":"1995","journal-title":"Med Care"},{"key":"2021010612100706700_ocx047-B52","unstructured":"HealthIT.gov. Health IT Legislation and Regulations. 2016. https:\/\/www.healthit.gov\/policy-researchers-implementers\/health-it-legislation. Accessed March 16, 2017."},{"issue":"8","key":"2021010612100706700_ocx047-B53","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1056\/NEJMc1213481","article-title":"Early results of the meaningful use program for electronic health records","volume":"368","author":"Wright","year":"2013","journal-title":"New Engl J Med."},{"issue":"6","key":"2021010612100706700_ocx047-B54","doi-asserted-by":"crossref","first-page":"663","DOI":"10.5858\/2002-126-0663-LCVPAP","article-title":"Laboratory critical values policies and procedures: a College of American Pathologists Q-Probes Study in 623 institutions","volume":"126","author":"Howanitz","year":"2002","journal-title":"Arch Pathol Lab Med."},{"key":"2021010612100706700_ocx047-B55","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/978-1-4612-2698-7","volume-title":"Decision Support Systems in Critical Care","author":"Shabot","year":"1994"},{"issue":"e1","key":"2021010612100706700_ocx047-B56","doi-asserted-by":"crossref","first-page":"e185","DOI":"10.1093\/jamia\/ocw103","article-title":"Biomedical informatics advancing the national health agenda: the AMIA 2015 year-in-review in clinical and consumer informatics","volume":"24","author":"Roberts","year":"2017","journal-title":"J Am Med Inform Assoc."},{"issue":"26","key":"2021010612100706700_ocx047-B57","doi-asserted-by":"crossref","first-page":"2665","DOI":"10.1056\/NEJMp078085","article-title":"An elusive balance: residents\u2019 work hours and the continuity of care","volume":"356","author":"Okie","year":"2007","journal-title":"New Engl J Med."},{"issue":"1","key":"2021010612100706700_ocx047-B58","doi-asserted-by":"crossref","first-page":"4","DOI":"10.4300\/JGME-D-11-00308.1","article-title":"Shift-to-shift handoff research: where do we go from here?","volume":"4","author":"Riesenberg","year":"2012","journal-title":"J Graduate Med Educ"},{"issue":"1","key":"2021010612100706700_ocx047-B59","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1136\/bmjqs-2015-004587","article-title":"Why do we still page each other? Examining the frequency, types and senders of pages in academic medical services","volume":"26","author":"Carlile","year":"2017","journal-title":"BMJ Qual Saf."},{"key":"2021010612100706700_ocx047-B60","first-page":"140","article-title":"Preferences of interns and residents for E-mail, paging, or traditional methods for the delivery of different types of clinical information","author":"Wagner","year":"1998","journal-title":"Proc AMIA Symp."},{"key":"2021010612100706700_ocx047-B61","first-page":"415","article-title":"Managing the alert process at New York-Presbyterian Hospital","author":"Kuperman","year":"2005","journal-title":"Proc AMIA Annu Symp."},{"key":"2021010612100706700_ocx047-B62","unstructured":"HealthIT.gov. Meaningful Use Definition & Objectives. 2015. https:\/\/www.healthit.gov\/providers-professionals\/meaningful-use-definition-objectives. Accessed March 16, 2017."},{"issue":"1","key":"2021010612100706700_ocx047-B63","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.jbi.2012.08.007","article-title":"Publication bias in clinical trials of electronic health records","volume":"46","author":"Vawdrey","year":"2013","journal-title":"J Biomed Inform."}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/6\/1173\/34945856\/ocx047.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/6\/1173\/34945856\/ocx047.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,27]],"date-time":"2022-07-27T11:49:02Z","timestamp":1658922542000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/24\/6\/1173\/3832893"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,5,18]]},"references-count":63,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2017,5,18]]},"published-print":{"date-parts":[[2017,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocx047","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,11]]},"published":{"date-parts":[[2017,5,18]]}}}