{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,22]],"date-time":"2026-03-22T05:33:34Z","timestamp":1774157614339,"version":"3.50.1"},"reference-count":58,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T00:00:00Z","timestamp":1614729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,7,14]]},"abstract":"Abstract<\/jats:title>\n \n Objective<\/jats:title>\n Develop and evaluate an interactive information visualization embedded within the electronic health record (EHR) by following human-centered design (HCD) processes and leveraging modern health information exchange standards.<\/jats:p>\n <\/jats:sec>\n \n Materials and Methods<\/jats:title>\n We applied an HCD process to develop a Fast Healthcare Interoperability Resources (FHIR) application that displays a patient\u2019s asthma history to clinicians in a pediatric emergency department. We performed a preimplementation comparative system evaluation to measure time on task, number of screens, information retrieval accuracy, cognitive load, user satisfaction, and perceived utility and usefulness. Application usage and system functionality were assessed using application logs and a postimplementation survey of end users.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Usability testing of the Asthma Timeline Application demonstrated a statistically significant reduction in time on task (P\u2009&lt;\u2009.001), number of screens (P\u2009&lt;\u2009.001), and cognitive load (P\u2009&lt;\u2009.001) for clinicians when compared to base EHR functionality. Postimplementation evaluation demonstrated reliable functionality and high user satisfaction.<\/jats:p>\n <\/jats:sec>\n \n Discussion<\/jats:title>\n Following HCD processes to develop an application in the context of clinical operations\/quality improvement is feasible. Our work also highlights the potential benefits and challenges associated with using internationally recognized data exchange standards as currently implemented.<\/jats:p>\n <\/jats:sec>\n \n Conclusion<\/jats:title>\n Compared to standard EHR functionality, our visualization increased clinician efficiency when reviewing the charts of pediatric asthma patients. Application development efforts in an operational context should leverage existing health information exchange standards, such as FHIR, and evidence-based mixed methods approaches.<\/jats:p>\n <\/jats:sec>","DOI":"10.1093\/jamia\/ocab016","type":"journal-article","created":{"date-parts":[[2021,1,21]],"date-time":"2021-01-21T20:18:44Z","timestamp":1611260324000},"page":"1401-1410","source":"Crossref","is-referenced-by-count":29,"title":["Human-centered development of an electronic health record-embedded, interactive information visualization in the emergency department using fast healthcare interoperability resources"],"prefix":"10.1093","volume":"28","author":[{"given":"Jeritt G","family":"Thayer","sequence":"first","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"}]},{"given":"Daria F","family":"Ferro","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"},{"name":"Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania, USA"},{"name":"Division of General Pediatrics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"}]},{"given":"Jeffrey M","family":"Miller","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0554-5715","authenticated-orcid":false,"given":"Dean","family":"Karavite","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8290-5588","authenticated-orcid":false,"given":"Robert W","family":"Grundmeier","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"},{"name":"Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania, USA"},{"name":"Division of General Pediatrics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"}]},{"given":"Levon","family":"Utidjian","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"},{"name":"Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania, USA"},{"name":"Division of General Pediatrics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"}]},{"given":"Joseph J","family":"Zorc","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"},{"name":"Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania, USA"},{"name":"Department of Emergency Medicine, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"}]}],"member":"286","published-online":{"date-parts":[[2021,3,3]]},"reference":[{"issue":"01","key":"2021071421221725900_ocab016-B1","doi-asserted-by":"crossref","first-page":"97","DOI":"10.15265\/IY-2014-0003","article-title":"Big data\u2019 and the electronic health record","volume":"23","author":"Ross","year":"2014","journal-title":"Yearb Med Inform"},{"issue":"2","key":"2021071421221725900_ocab016-B2","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1207\/s15516709cog2102_3","article-title":"The nature of external representations in problem solving","volume":"21","author":"Zhang","year":"1997","journal-title":"Cogn Sci"},{"issue":"6","key":"2021071421221725900_ocab016-B3","doi-asserted-by":"crossref","first-page":"745","DOI":"10.3122\/jabfm.2011.06.100255","article-title":"Information chaos in primary care: implications for physician performance and patient safety","volume":"24","author":"Beasley","year":"2011","journal-title":"J Am Board Fam Med"},{"issue":"1","key":"2021071421221725900_ocab016-B4","doi-asserted-by":"crossref","first-page":"80","DOI":"10.4338\/ACI-2011-11-RA-0066","article-title":"Clinical summarization capabilities of commercially-available and internally-developed electronic health records","volume":"3","author":"Laxmisan","year":"2012","journal-title":"Appl Clin Inform"},{"key":"2021071421221725900_ocab016-B5","first-page":"394","article-title":"Engineering psychology and human performance","volume":"4","author":"Wickens","year":"2013","journal-title":"Eng Psychol Hum Perform"},{"key":"2021071421221725900_ocab016-B6","first-page":"34","article-title":"LifeLines: visualizing personal histories","volume":"30","author":"Plaisant","year":"1998","journal-title":"Proceedings of ACM CHI 1996"},{"issue":"12","key":"2021071421221725900_ocab016-B7","doi-asserted-by":"crossref","first-page":"2659","DOI":"10.1109\/TVCG.2012.225","article-title":"Exploring flow, factors, and outcomes of temporal event sequences with the outflow visualization","volume":"18","author":"Wongsuphasawat","year":"2012","journal-title":"IEEE Trans Visual Comput Graphics"},{"issue":"4","key":"2021071421221725900_ocab016-B8","doi-asserted-by":"crossref","first-page":"e1071","DOI":"10.1542\/peds.2012-1988","article-title":"Improving adherence to otitis media guidelines with clinical decision support and physician feedback","volume":"131","author":"Forrest","year":"2013","journal-title":"Pediatrics"},{"issue":"6","key":"2021071421221725900_ocab016-B9","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1080\/01449290310001624329","article-title":"Key principles for user-centred systems design","volume":"22","author":"Gulliksen","year":"2003","journal-title":"Behav Inf Technol"},{"issue":"2","key":"2021071421221725900_ocab016-B10","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1093\/jamia\/ocy143","article-title":"Designing a medication timeline for patients and physicians","volume":"26","author":"Belden","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"8","key":"2021071421221725900_ocab016-B11","doi-asserted-by":"crossref","first-page":"1225","DOI":"10.1093\/jamia\/ocaa099","article-title":"Integrated displays to improve chronic disease management in ambulatory care: a SMART on FHIR application informed by mixed-methods user testing","volume":"27","author":"Curran","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2021071421221725900_ocab016-B12","year":"2019"},{"key":"2021071421221725900_ocab016-B13","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1016\/j.apergo.2016.12.018","article-title":"Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques","volume":"60","author":"Clark","year":"2017","journal-title":"Appl Ergon"},{"issue":"04","key":"2021071421221725900_ocab016-B14","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1055\/s-0039-1695800","article-title":"Design and evaluation of an integrated, patient-focused electronic health record display for emergency medicine","volume":"10","author":"Wang","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"4","key":"2021071421221725900_ocab016-B15","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1177\/1555343415613723","article-title":"Assessment of innovative emergency department information displays in a clinical simulation center","volume":"9","author":"McGeorge","year":"2015","journal-title":"J Cogn Eng Decis Mak"},{"issue":"1","key":"2021071421221725900_ocab016-B16","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1136\/amiajnl-2012-000887","article-title":"Key principles for a national clinical decision support knowledge sharing framework: synthesis of insights from leading subject matter experts","volume":"20","author":"Kawamoto","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"02","key":"2021071421221725900_ocab016-B17","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1055\/s-0039-1683985","article-title":"Assessing the safety of custom web-based clinical decision support systems in electronic health records: a case study","volume":"10","author":"Thayer","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"11","key":"2021071421221725900_ocab016-B18","doi-asserted-by":"crossref","first-page":"1752","DOI":"10.1377\/hlthaff.2018.0699","article-title":"Identifying electronic health record usability and safety challenges in pediatric settings","volume":"37","author":"Ratwani","year":"2018","journal-title":"Health Aff"},{"issue":"5","key":"2021071421221725900_ocab016-B19","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1093\/jamia\/ocv189","article-title":"SMART on FHIR: a standards-based, interoperable apps platform for electronic health records","volume":"23","author":"Mandel","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"02","key":"2021071421221725900_ocab016-B20","doi-asserted-by":"crossref","first-page":"603","DOI":"10.4338\/ACI-2017-01-CR-0010","article-title":"A FHIR Human Leukocyte Antigen (HLA) interface for platelet transfusion support","volume":"08","author":"Gordon","year":"2017","journal-title":"Appl Clin Inform"},{"issue":"4","key":"2021071421221725900_ocab016-B21","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1093\/jamia\/ocw015","article-title":"SMART precision cancer medicine: a FHIR-based app to provide genomic information at the point of care","volume":"23","author":"Warner","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"02","key":"2021071421221725900_ocab016-B22","doi-asserted-by":"crossref","first-page":"51","DOI":"10.24105\/ejbi.2015.11.2.8","article-title":"Applying FHIR in an integrated health monitoring system","volume":"11","author":"Franz","year":"2015","journal-title":"EJBI"},{"key":"2021071421221725900_ocab016-B23","author":"Bender"},{"key":"2021071421221725900_ocab016-B24","author":"Pervez"},{"key":"2021071421221725900_ocab016-B25"},{"key":"2021071421221725900_ocab016-B26","doi-asserted-by":"crossref","DOI":"10.1201\/9781315272665","volume-title":"Ecological Interface Design","author":"Burns","year":"2004"},{"key":"2021071421221725900_ocab016-B27","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/7304.001.0001","volume-title":"Working Minds: A Practioners Guide to Cognitive Task Analysis","author":"Crandall","year":"2006"},{"key":"2021071421221725900_ocab016-B28","first-page":"535","article-title":"Learning to think like a user: using cognitive task analysis to meet today\u2019s health care design challenges","volume":"32","author":"Militello","year":"1998","journal-title":"Biomed Instrum Technol"},{"key":"2021071421221725900_ocab016-B29","volume-title":"Encyclopedia of Human-Computer Interaction","author":"Abras","year":"2004"},{"key":"2021071421221725900_ocab016-B30","volume-title":"Designing Web Usability","author":"Nielsen","year":"1999"},{"key":"2021071421221725900_ocab016-B31","volume-title":"Usability Inspection Methods","author":"Nielsen"},{"key":"2021071421221725900_ocab016-B32","volume-title":"How to Plan, Design, and Conduct Effective Tests","author":"Rubin","year":"2008"},{"key":"2021071421221725900_ocab016-B33","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","article-title":"Development of NASA-TLX (Task Load Index): results of empirical and theoretical research","volume":"52","author":"Hart","year":"1988","journal-title":"Adv Psychol"},{"issue":"2","key":"2021071421221725900_ocab016-B34","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1080\/19488300.2011.609524","article-title":"Measuring workload of ICU nurses with a questionnaire survey: the NASA Task Load Index (TLX)","volume":"1","author":"Hoonakker","year":"2011","journal-title":"IIE Trans Healthc Syst Eng"},{"issue":"9","key":"2021071421221725900_ocab016-B35","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1177\/154193120605000909","article-title":"Nasa-Task Load Index (NASA-TLX); 20 years later","volume":"50","author":"Hart","year":"2006","journal-title":"Proc Hum Factors Ergon Soc Annu Meet"},{"issue":"1","key":"2021071421221725900_ocab016-B36","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.jbi.2009.07.002","article-title":"The Technology Acceptance Model: its past and its future in health care","volume":"43","author":"Holden","year":"2010","journal-title":"J Biomed Inform"},{"issue":"3","key":"2021071421221725900_ocab016-B37","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1037\/0033-295X.87.3.215","article-title":"Verbal reports as data","volume":"87","author":"Ericsson","year":"1980","journal-title":"Psychol Rev"},{"issue":"4","key":"2021071421221725900_ocab016-B38","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1177\/104973239300300403","article-title":"A description of think aloud method and protocol analysis","volume":"3","author":"Fonteyn","year":"1993","journal-title":"Qual Health Res"},{"key":"2021071421221725900_ocab016-B39","first-page":"379","volume-title":"Behavior Research Methods, Instruments, and Computers","author":"Faulkner","year":"2003"},{"key":"2021071421221725900_ocab016-B40","author":"Nielsen"},{"issue":"4","key":"2021071421221725900_ocab016-B41","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1177\/001872089203400407","article-title":"Refining the test phase of usability evaluation: how many subjects is enough?","volume":"34","author":"Virzi","year":"1992","journal-title":"Hum Factors"},{"key":"2021071421221725900_ocab016-B42","first-page":"285","volume-title":"Conference on Human Factors in Computing Systems - Proceedings","author":"Spool","year":"2001"},{"key":"2021071421221725900_ocab016-B43","volume-title":"Experimental Designs","author":"Cox","year":"1957"},{"issue":"12","key":"2021071421221725900_ocab016-B44","doi-asserted-by":"crossref","first-page":"1276","DOI":"10.1001\/jama.2018.1171","article-title":"Electronic health record usability issues and potential contribution to patient harm","volume":"319","author":"Howe","year":"2018","journal-title":"JAMA"},{"key":"2021071421221725900_ocab016-B45","first-page":"29","article-title":"Interface design for health care environments: the role of cognitive science","volume":"1998","author":"Patel","year":"1998","journal-title":"Proc AMIA Symp"},{"issue":"1","key":"2021071421221725900_ocab016-B46","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.jbi.2004.11.005","article-title":"A user-centered framework for redesigning health care interfaces","volume":"38","author":"Johnson","year":"2005","journal-title":"J Biomed Inform"},{"issue":"6","key":"2021071421221725900_ocab016-B47","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1016\/j.jbi.2011.08.005","article-title":"TURF: toward a unified framework of EHR usability","volume":"44","author":"Zhang","year":"2011","journal-title":"J Biomed Inform"},{"key":"2021071421221725900_ocab016-B48","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1016\/j.apergo.2016.12.018","article-title":"Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques","volume":"60","author":"Clark","year":"2017","journal-title":"Appl Ergon"},{"issue":"4","key":"2021071421221725900_ocab016-B49","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1056\/NEJMp1715127","article-title":"To Care Is Human- Collectively Confronting the Clinician-Burnout Crisis","volume":"378","author":"Dzau","year":"2018","journal-title":"N Engl J Med"},{"issue":"5","key":"2021071421221725900_ocab016-B50","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1370\/afm.2121","article-title":"Tethered to the EHR: primary care physician workload assessment using EHR event log data and time-motion observations","volume":"15","author":"Arndt","year":"2017","journal-title":"Ann Fam Med"},{"issue":"3","key":"2021071421221725900_ocab016-B51","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1016\/j.mayocp.2019.09.024","article-title":"The association between perceived electronic health record usability and professional burnout among US physicians","volume":"95","author":"Melnick","year":"2020","journal-title":"Mayo Clin Proc"},{"issue":"2","key":"2021071421221725900_ocab016-B52","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1093\/jamia\/ocy145","article-title":"Physician stress and burnout: the impact of health information technology","volume":"26","author":"Gardner","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2021071421221725900_ocab016-B53","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1097\/01.HMR.0000304493.87898.72","article-title":"Linking physician burnout and patient outcomes: Exploring the dyadic relationship between physicians and patients","volume":"33","author":"Halbesleben","year":"2008","journal-title":"Health Care Manage Rev"},{"issue":"1","key":"2021071421221725900_ocab016-B54","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1111\/j.1756-8765.2009.01029.x","article-title":"A social-cognitive framework of multidisciplinary team innovation","volume":"2","author":"Paletz","year":"2010","journal-title":"Top Cogn Sci"},{"key":"2021071421221725900_ocab016-B55"},{"key":"2021071421221725900_ocab016-B56"},{"issue":"6","key":"2021071421221725900_ocab016-B57","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.1093\/jamia\/ocv045","article-title":"SMART on FHIR Genomics: facilitating standardized clinico-genomic apps","volume":"22","author":"Alterovitz","year":"2015","journal-title":"J Am Med Inform Assoc"},{"key":"2021071421221725900_ocab016-B58","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ijmedinf.2016.12.005","article-title":"Opening the Duke electronic health record to apps: implementing SMART on FHIR","volume":"99","author":"Bloomfield","year":"2017","journal-title":"Int J Med Inform"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/7\/1401\/38983270\/ocab016.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/7\/1401\/38983270\/ocab016.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,14]],"date-time":"2021-07-14T21:23:59Z","timestamp":1626297839000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/7\/1401\/6157802"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,3]]},"references-count":58,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,3,3]]},"published-print":{"date-parts":[[2021,7,14]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab016","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,7,1]]},"published":{"date-parts":[[2021,3,3]]}}}