{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T01:39:50Z","timestamp":1772156390255,"version":"3.50.1"},"reference-count":146,"publisher":"Oxford University Press (OUP)","issue":"1","funder":[{"name":"Center for the Science of Health Care Delivery"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,1,1]]},"abstract":"<jats:p>Objective: In this systematic review, we aimed to evaluate methodological and reporting trends present in the current literature by investigating published usability studies of electronic health records (EHRs).<\/jats:p>\n               <jats:p>Methods: A literature search was conducted for articles published through January 2015 using MEDLINE (Ovid), EMBASE, Scopus, and Web of Science, supplemented by citation and reference list reviews. Studies were included if they tested the usability of hospital and clinic EHR systems in the inpatient, outpatient, emergency department, or operating room setting.<\/jats:p>\n               <jats:p>Results: A total of 4848 references were identified for title and abstract screening. Full text screening was performed for 197 articles, with 120 meeting the criteria for study inclusion.<\/jats:p>\n               <jats:p>Conclusion: A review of the literature demonstrates a paucity of quality published studies describing scientifically valid and reproducible usability evaluations at various stages of EHR system development. A lack of formal and standardized reporting of EHR usability evaluation results is a major contributor to this knowledge gap, and efforts to improve this deficiency will be one step of moving the field of usability engineering forward.<\/jats:p>","DOI":"10.1093\/jamia\/ocw046","type":"journal-article","created":{"date-parts":[[2016,4,24]],"date-time":"2016-04-24T00:18:19Z","timestamp":1461457099000},"page":"218-226","source":"Crossref","is-referenced-by-count":85,"title":["An appraisal of published usability evaluations of electronic health records via systematic review"],"prefix":"10.1093","volume":"24","author":[{"given":"Marc A","family":"Ellsworth","sequence":"first","affiliation":[{"name":"Division of Neonatal Medicine, Mayo Clinic, Rochester, MN, USA"},{"name":"Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mikhail","family":"Dziadzko","sequence":"additional","affiliation":[{"name":"Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA"},{"name":"Department of Anesthesiology, Mayo Clinic, Rochester, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John C","family":"O'Horo","sequence":"additional","affiliation":[{"name":"Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA"},{"name":"Division of Infectious Diseases, Mayo Clinic, Rochester, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ann M","family":"Farrell","sequence":"additional","affiliation":[{"name":"Mayo Clinic Libraries, Mayo Clinic, Rochester, MN, USA,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiajie","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Health Information Sciences, University of Texas Health Science Center at Houston, Houston, TX, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vitaly","family":"Herasevich","sequence":"additional","affiliation":[{"name":"Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA"},{"name":"Department of Anesthesiology, Mayo Clinic, Rochester, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2016,4,23]]},"reference":[{"key":"2020110612374407900_ocw046-B1","article-title":"Technical evaluation, testing, and validation of the usability of electronic health records. US Department of Commerce, National Institute of Standards and Technology (NIST)","author":"Lowry"},{"key":"2020110612374407900_ocw046-B2","article-title":"NIST guide to the processes approach for improving the usability of electronic health records. US Department of Commerce, National Institute of Standards and Technology (NIST)","author":"Shumacher"},{"issue":"6","key":"2020110612374407900_ocw046-B3","doi-asserted-by":"crossref","first-page":"1506","DOI":"10.1542\/peds.2005-1287","article-title":"Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system","volume":"116","author":"Han","year":"2005","journal-title":"Pediatrics."},{"key":"2020110612374407900_ocw046-B4"},{"key":"2020110612374407900_ocw046-B5"},{"key":"2020110612374407900_ocw046-B6","first-page":"54","article-title":"A framework for reporting on human factor\/usability studies of health information technologies","volume":"194","author":"Peute","year":"2013","journal-title":"Stud Health Technol Inform."},{"key":"2020110612374407900_ocw046-B7","first-page":"327","article-title":"Usability studies on interactive health information systems; where do we stand? Stud Health Technol Inform","volume":"136","author":"Peute","journal-title":"2008"},{"key":"2020110612374407900_ocw046-B8","doi-asserted-by":"crossref","first-page":"g7647","DOI":"10.1136\/bmj.g7647","article-title":"Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation","volume":"349","author":"Shamseer","year":"2015","journal-title":"BMJ."},{"key":"2020110612374407900_ocw046-B9","doi-asserted-by":"crossref","volume-title":"Finding What Works in Health Care: Standards for Systematic Reviews","author":"Eden","DOI":"10.17226\/13059"},{"key":"2020110612374407900_ocw046-B10","volume-title":"Usability Evaluation Handbook for Electronic Health Records","author":"Harrington","year":"2014"},{"issue":"e1","key":"2020110612374407900_ocw046-B11","doi-asserted-by":"crossref","first-page":"e2","DOI":"10.1136\/amiajnl-2012-001458","article-title":"Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA","volume":"20","author":"Middleton","year":"2013","journal-title":"J Am Med Inform Assoc."},{"key":"2020110612374407900_ocw046-B12","first-page":"S82","article-title":"EHR usability burden and its impact on primary care providers workflow","volume":"29","author":"Agha","year":"2014","journal-title":"J Gen Int Med."},{"issue":"12","key":"2020110612374407900_ocw046-B13","doi-asserted-by":"crossref","first-page":"842","DOI":"10.1016\/j.ijmedinf.2012.04.004","article-title":"Evaluation of an integrated graphical display to promote acute change detection in ICU patients","volume":"81","author":"Anders","year":"2012","journal-title":"Int J Med Inform."},{"issue":"6","key":"2020110612374407900_ocw046-B14","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1097\/NCN.0b013e3181f69c5b","article-title":"Prototype to practice: developing and testing a clinical decision support system for secondary stroke prevention in a veterans healthcare facility","volume":"28","author":"Anderson","year":"2010","journal-title":"Comput Inform Nurs."},{"issue":"3","key":"2020110612374407900_ocw046-B15","doi-asserted-by":"crossref","first-page":"e547","DOI":"10.1542\/peds.2011-3408","article-title":"Effects of CPOE on provider cognitive workload: a randomized crossover trial","volume":"130","author":"Avansino","year":"2012","journal-title":"Pediatrics."},{"issue":"3","key":"2020110612374407900_ocw046-B16","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/j.ijmedinf.2011.12.009","article-title":"Record completeness and data concordance in an anesthesia information management system using context-sensitive mandatory data-entry fields","volume":"81","author":"Avidan","year":"2012","journal-title":"Int J Med Inform."},{"issue":"6","key":"2020110612374407900_ocw046-B17","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1016\/j.jemermed.2010.05.014","article-title":"Implementation of an emergency department computer system: design features that users value","volume":"41","author":"Batley","year":"2011","journal-title":"J Emerg Med."},{"issue":"1","key":"2020110612374407900_ocw046-B18","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1136\/amiajnl-2013-001851","article-title":"Understanding the acceptability of a computer decision support system in pediatric primary care","volume":"21","author":"Bauer","year":"2014","journal-title":"J Am Med Inform Assoc."},{"issue":"4","key":"2020110612374407900_ocw046-B19","doi-asserted-by":"crossref","first-page":"e43","DOI":"10.1016\/j.ijmedinf.2009.07.002","article-title":"Example of a human factors engineering approach to a medication administration work system: potential impact on patient safety","volume":"79","author":"Beuscart-Zephir","year":"2010","journal-title":"Int J Med Inform."},{"issue":"Pt 2","key":"2020110612374407900_ocw046-B20","first-page":"1018","article-title":"A usability study of CPOE's medication administration functions: impact on physician-nurse cooperation","volume":"107","author":"Beuscart-Zephir","year":"2004","journal-title":"Stud Health Technol Inform."},{"issue":"Pt 2","key":"2020110612374407900_ocw046-B21","first-page":"816","article-title":"Implementation of a clinical decision support system using a service model: results of a feasibility study","volume":"160","author":"Borbolla","year":"2010","journal-title":"Stud Health Technol Inform."},{"key":"2020110612374407900_ocw046-B22","first-page":"61","article-title":"A physiotherapy EHR specification based on a user-centered approach in the context of public health","volume":"11","author":"Borges","year":"2007","journal-title":"AMIA Annual Symposium Proceedings\/AMIA Symposium"},{"issue":"10","key":"2020110612374407900_ocw046-B23","doi-asserted-by":"crossref","first-page":"940","DOI":"10.1016\/j.ijmedinf.2013.05.010","article-title":"Evaluation of a comprehensive EHR based on the DeLone and McLean model for IS success: approach, results, and success factors","volume":"82","author":"Bossen","year":"2013","journal-title":"Int J Med Inform."},{"key":"2020110612374407900_ocw046-B24","first-page":"864","article-title":"Heuristic evaluation of eNote: an electronic notes system","author":"Bright","year":"2006","journal-title":"AMIAAnnual Symposium Proceedings\/AMIA Symposium"},{"key":"2020110612374407900_ocw046-B25","first-page":"76","article-title":"Usability evaluation of the progress note construction set","author":"Brown","year":"2001","journal-title":"Proceedings\/AMIA Annual Symposium"},{"issue":"4","key":"2020110612374407900_ocw046-B26","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1136\/jamia.2001.0080379","article-title":"Research paper - derivation and evaluation of a document-naming nomenclature","volume":"8","author":"Brown","year":"2001","journal-title":"J Am Med Inform Assoc."},{"issue":"2","key":"2020110612374407900_ocw046-B27","doi-asserted-by":"crossref","first-page":"9910","DOI":"10.1007\/s10916-012-9910-7","article-title":"Evaluating acceptance and user experience of a guideline-based clinical decision support system execution platform","volume":"37","author":"Buenestado","year":"2013","journal-title":"J Med Sys."},{"issue":"6","key":"2020110612374407900_ocw046-B28","doi-asserted-by":"crossref","first-page":"812","DOI":"10.1136\/amiajnl-2010-000018","article-title":"ICU nurses' acceptance of electronic health records","volume":"18","author":"Carayon","year":"2011","journal-title":"J Am Med Inform Assoc."},{"issue":"6","key":"2020110612374407900_ocw046-B29","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1097\/NCN.0b013e3181fc4139","article-title":"Strengths and limitations of the electronic health record for documenting clinical events","volume":"29","author":"Carrington","year":"2011","journal-title":"Comput Inform Nurs."},{"issue":"8","key":"2020110612374407900_ocw046-B30","doi-asserted-by":"crossref","first-page":"e103205","DOI":"10.1371\/journal.pone.0103205","article-title":"A clinical decision support system for integrating tuberculosis and HIV care in Kenya: a human-centered design approach","volume":"9","author":"Catalani","year":"2014","journal-title":"PLoS ONE"},{"issue":"11","key":"2020110612374407900_ocw046-B31","doi-asserted-by":"crossref","first-page":"932","DOI":"10.1136\/bmjqs.2010.050021","article-title":"Usability evaluation of order sets in a computerised provider order entry system","volume":"20","author":"Chan","year":"2011","journal-title":"BMJ Qual Saf."},{"issue":"4","key":"2020110612374407900_ocw046-B32","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/BF02899511","article-title":"Measurement of user performance and attitudes assists the initial design of a computer user display and orientation method","volume":"10","author":"Chase","year":"1994","journal-title":"J Clin Monitor."},{"key":"2020110612374407900_ocw046-B33","first-page":"43","article-title":"Rule based clinical decision support system for hematological disorder","author":"Chen","year":"2013","journal-title":"Proceedings of 4th IEEE International Conference on Software Engineering and Service Science (ICSESS)"},{"issue":"2","key":"2020110612374407900_ocw046-B34","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1097\/PEC.0b013e3181ce2f99","article-title":"Clinician perceptions of an electronic medical record during the first year of implementaton in emergency services","volume":"26","author":"Chisolm","year":"2010","journal-title":"Pediatr Emerg Care."},{"issue":"2","key":"2020110612374407900_ocw046-B35","doi-asserted-by":"crossref","first-page":"571","DOI":"10.4338\/ACI-2014-01-RA-0005","article-title":"Evaluation of a Korean version of a tool for assessing the incorporation of human factors into a medication-related decision support system: the I-MeDeSA","volume":"5","author":"Cho","year":"2014","journal-title":"Appl Clin Inform."},{"issue":"9","key":"2020110612374407900_ocw046-B36","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1016\/j.ijmedinf.2014.05.002","article-title":"Usability testing of Avoiding Diabetes Thru Action Plan Targeting (ADAPT) decision support for integrating care-based counseling of pre-diabetes in an electronic health record","volume":"83","author":"Chrimes","year":"2014","journal-title":"Int J Med Inform."},{"issue":"2","key":"2020110612374407900_ocw046-B37","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1136\/jamia.2001.0080163","article-title":"Studying the human-computer-terminology interface","volume":"8","author":"Cimino","year":"2001","journal-title":"J Am Med Inform Assoc."},{"issue":"6","key":"2020110612374407900_ocw046-B38","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1111\/jep.12277","article-title":"Determining differences in user performance between expert and novice primary care doctors when using an electronic health record (EHR)","volume":"20","author":"Clarke","year":"2014","journal-title":"J Eval Clin Pract."},{"issue":"3","key":"2020110612374407900_ocw046-B39","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1200\/JOP.200017","article-title":"Importance of testing for usability when selecting and implementing an electronic health or medical record system","volume":"6","author":"Corrao","year":"2010","journal-title":"J Oncol Pract."},{"issue":"e2","key":"2020110612374407900_ocw046-B40","doi-asserted-by":"crossref","first-page":"e194","DOI":"10.1136\/amiajnl-2013-002252","article-title":"Evaluation of medium-term consequences of implementing commercial computerized physician order entry and clinical decision support prescribing systems in two 'early adopter' hospitals","volume":"21","author":"Cresswell","year":"2014","journal-title":"J Am Med Inform Assoc."},{"issue":"7","key":"2020110612374407900_ocw046-B41","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1016\/j.ijmedinf.2014.04.008","article-title":"Usability evaluation of pharmacogenomics clinical decision support aids and clinical knowledge resources in a computerized provider order entry system: a mixed methods approach","volume":"83","author":"Devine","year":"2014","journal-title":"Int J Med Inform."},{"key":"2020110612374407900_ocw046-B42","first-page":"1","article-title":"Usability and impact of electronic health records for primary care units in Portugal","author":"Dos Santos","year":"2011","journal-title":"Proceedings of 6th Iberian Conference on Information Systems and Technologies (CISTI)"},{"issue":"10","key":"2020110612374407900_ocw046-B43","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1016\/j.ijhcs.2008.06.002","article-title":"Evaluating usability of a commercial electronic health record: a case study","volume":"66","author":"Edwards","year":"2008","journal-title":"Int J Hum Comput Stud."},{"key":"2020110612374407900_ocw046-B44","first-page":"1","article-title":"Human computer interaction issues in eliciting user requirements for an electronic patient record with multiple users","author":"Fahey","year":"2011","journal-title":"Proceedings of 24th International Symposium on Computer-Based Medical Systems (CBMS)"},{"issue":"4","key":"2020110612374407900_ocw046-B45","doi-asserted-by":"crossref","first-page":"404","DOI":"10.4338\/ACI-2012-05-RA-0017","article-title":"Impact of a prototype visualization tool for new information in EHR clinical documents","volume":"3","author":"Farri","year":"2012","journal-title":"Appl Clin Inform."},{"issue":"4","key":"2020110612374407900_ocw046-B46","doi-asserted-by":"crossref","first-page":"420","DOI":"10.4338\/ACI-2011-07-RA-0043","article-title":"An evaluation of the usability of a computerized decision support system for nursing homes","volume":"2","author":"Fossum","year":"2011","journal-title":"Appl Clin Inform."},{"issue":"4","key":"2020110612374407900_ocw046-B47","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1007\/s11606-007-0417-8","article-title":"An evaluation of the Veterans Health Administration's clinical reminders system: a national survey of generalists","volume":"23","author":"Fung","year":"2008","journal-title":"J Gen Int Med."},{"issue":"5","key":"2020110612374407900_ocw046-B48","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1136\/amiajnl-2011-000281","article-title":"User perspectives on the usability of a regional health information exchange","volume":"18","author":"Gadd","year":"2011","journal-title":"J Am Med Inform Assoc."},{"key":"2020110612374407900_ocw046-B49","first-page":"847","article-title":"Improving the human computer interface design for a physician order entry system","volume":"2003","author":"Gainer","year":"2003","journal-title":"AMIA Annu Symp Proc"},{"issue":"2","key":"2020110612374407900_ocw046-B50","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1093\/annonc\/mdn567","article-title":"Development and daily use of an electronic oncological patient record for the total management of cancer patients: 7 years' experience","volume":"20","author":"Galligioni","year":"2009","journal-title":"Ann Oncol."},{"key":"2020110612374407900_ocw046-B51","first-page":"678","article-title":"Clinician reports of the impact of electronic ordering on an emergency department","volume":"150","author":"Georgiou","year":"2009","journal-title":"Stud Health Technol Inform."},{"issue":"3","key":"2020110612374407900_ocw046-B52","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1007\/s10916-008-9180-6","article-title":"User satisfaction with computerized order entry system and its effect on workplace level of stress","volume":"33","author":"Ghahramani","year":"2009","journal-title":"J Med Syst."},{"key":"2020110612374407900_ocw046-B53","first-page":"2626","article-title":"Towards a Cardiology\/EHR interaction workflow usability evaluation method","author":"Grabenbauer","year":"2014","journal-title":"Proceedings of 47th Hawaii International Conference on System Sciences (HICSS)"},{"key":"2020110612374407900_ocw046-B54","first-page":"257","article-title":"How usability of a web-based clinical decision support system has the potential to contribute to adverse medical events","volume":"6","author":"Graham","year":"2008","journal-title":"AMIAAnnual Symposium Proceedings\/AMIA Symposium"},{"key":"2020110612374407900_ocw046-B55","first-page":"263","article-title":"Field evaluation of commercial computerized provider order entry systems in community hospitals","volume":"6","author":"Guappone","year":"2008","journal-title":"AMIA Annual Symposium Proceedings\/AMIA Symposium"},{"issue":"2","key":"2020110612374407900_ocw046-B56","doi-asserted-by":"crossref","first-page":"202","DOI":"10.4338\/ACI-2011-01-RA-0004","article-title":"Usability evaluation of an electronic medication administration record (eMAR) application","volume":"2","author":"Guo","year":"2011","journal-title":"Appl Clin Inform."},{"key":"2020110612374407900_ocw046-B57","first-page":"549","article-title":"Using a unified usability framework to dramatically improve the usability of an EMR Module","volume":"2011","author":"Harrington","year":"2011","journal-title":"AMIA Annual Symposium Proceedings\/AMIA Symposium."},{"issue":"7-8","key":"2020110612374407900_ocw046-B58","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1097\/NNA.0b013e3182250b23","article-title":"Realizing electronic medical record benefits: an easy-to-do usability study","volume":"41","author":"Harrington","year":"2011","journal-title":"J Nurs Adm."},{"issue":"6","key":"2020110612374407900_ocw046-B59","doi-asserted-by":"crossref","first-page":"3677","DOI":"10.1007\/s10916-012-9841-3","article-title":"Family physicians' perceptions and use of electronic clinical decision support during the first year of implementation","volume":"36","author":"Heselmans","year":"2012","journal-title":"J Med Syst."},{"issue":"3","key":"2020110612374407900_ocw046-B60","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1177\/1460458212437008","article-title":"How will we know if it's working? A multi-faceted approach to measuring usability of a specialty-specific electronic medical record","volume":"18","author":"Hollin","year":"2012","journal-title":"Health Inform J."},{"issue":"5","key":"2020110612374407900_ocw046-B61","doi-asserted-by":"crossref","first-page":"782","DOI":"10.1016\/j.jbi.2010.05.010","article-title":"Complementary methods of system usability evaluation: surveys and observations during software design and development cycles","volume":"43","author":"Horsky","year":"2010","journal-title":"J Biomed Inform."},{"key":"2020110612374407900_ocw046-B62","first-page":"1b","article-title":"Evaluating the usability of a free electronic health record for training","volume":"10","author":"Hoyt","year":"2013","journal-title":"Perspect Health Inf Manag."},{"issue":"1","key":"2020110612374407900_ocw046-B63","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ijmedinf.2013.10.002","article-title":"User experiences with different regional health information exchange systems in Finland","volume":"83","author":"Hypponen","year":"2014","journal-title":"Int J Med Inform."},{"issue":"6","key":"2020110612374407900_ocw046-B64","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1016\/j.jbi.2009.05.005","article-title":"Development and evaluation of nursing user interface screens using multiple methods","volume":"42","author":"Hyun","year":"2009","journal-title":"J Biomed Inform."},{"issue":"3","key":"2020110612374407900_ocw046-B65","first-page":"161","article-title":"Usability of computerised physician order entry in primary care: assessing ePrescribing with a new evaluation model","volume":"19","author":"Jaderlund Hagstedt","year":"2011","journal-title":"Inform Primary Care."},{"key":"2020110612374407900_ocw046-B66","first-page":"303","article-title":"Pre-post evaluation of physicians' satisfaction with a redesigned electronic medical record system","volume":"136","author":"Jaspers","year":"2008","journal-title":"Stud Health Technol Inform."},{"key":"2020110612374407900_ocw046-B67","first-page":"25","article-title":"The use of cognitive methods in analyzing clinicians' task behavior","volume":"93","author":"Jaspers","year":"2002","journal-title":"Stud Health Technol Inform."},{"issue":"11-12","key":"2020110612374407900_ocw046-B68","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1016\/j.ijmedinf.2004.08.003","article-title":"The think aloud method: a guide to user interface design","volume":"73","author":"Jaspers","year":"2004","journal-title":"Int J Med Inform."},{"issue":"1","key":"2020110612374407900_ocw046-B69","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/S1386-5056(01)00202-7","article-title":"Evaluation of the suitability of a patient data management system for ICUs on a general ward","volume":"64","author":"Junger","year":"2001","journal-title":"Int J Med Inform."},{"issue":"1","key":"2020110612374407900_ocw046-B70","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1007\/s00520-011-1086-z","article-title":"A technical solution to improving palliative and hospice care","volume":"20","author":"Kallen","year":"2012","journal-title":"Support Care Cancer."},{"key":"2020110612374407900_ocw046-B71","first-page":"532","article-title":"Usability evaluation of a computerized physician order entry for medication ordering","volume":"150","author":"Khajouei","year":"2009","journal-title":"Stud Health Technol Inform."},{"issue":"5","key":"2020110612374407900_ocw046-B72","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1016\/j.ijmedinf.2011.02.005","article-title":"Determination of the effectiveness of two methods for usability evaluation using a CPOE medication ordering system","volume":"80","author":"Khajouei","year":"2011","journal-title":"Int J Med Inform."},{"issue":"10","key":"2020110612374407900_ocw046-B73","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1016\/j.ijmedinf.2010.08.001","article-title":"Effect of predefined order sets and usability problems on efficiency of computerized medication ordering","volume":"79","author":"Khajouei","year":"2010","journal-title":"Int J Med Inform."},{"issue":"5","key":"2020110612374407900_ocw046-B74","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1016\/j.ijmedinf.2011.02.009","article-title":"Clinicians satisfaction with CPOE ease of use and effect on clinicians' workflow, efficiency and medication safety","volume":"80","author":"Khajouei","year":"2011","journal-title":"Int J Med Inform."},{"key":"2020110612374407900_ocw046-B75","first-page":"427","article-title":"Clinical guideline representation in a CDS: a human information processing method","volume":"180","author":"Kilsdonk","year":"2012","journal-title":"Stud Health Technol Inform."},{"issue":"1","key":"2020110612374407900_ocw046-B76","doi-asserted-by":"crossref","first-page":"135","DOI":"10.4338\/ACI-2011-11-RA-0065","article-title":"A pilot study on usability analysis of emergency department information system by nurses","volume":"3","author":"Kim","year":"2012","journal-title":"Appl Clin Inform."},{"key":"2020110612374407900_ocw046-B77","first-page":"181","article-title":"A longitudinal study of usability in health care - does time heal? Stud Health Technol Inform","volume":"130","author":"Kjeldskov","journal-title":"2007"},{"issue":"1","key":"2020110612374407900_ocw046-B78","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.artmed.2010.02.001","article-title":"Intelligent visualization and exploration of time-oriented data of multiple patients","volume":"49","author":"Klimov","year":"2010","journal-title":"Artif Intell Med."},{"issue":"5","key":"2020110612374407900_ocw046-B79","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1370\/afm.1286","article-title":"A diabetes dashboard and physician efficiency and accuracy in accessing data needed for high-quality diabetes care","volume":"9","author":"Koopman","year":"2011","journal-title":"Ann Fam Med."},{"issue":"1","key":"2020110612374407900_ocw046-B80","first-page":"67","article-title":"Human factors in the large: experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability. Contribution of the IMIA Human Factors Working Group","volume":"9","author":"Kushniruk","year":"2014","journal-title":"Yearb Med Inform."},{"issue":"5","key":"2020110612374407900_ocw046-B81","first-page":"406","article-title":"Assessment of a computerized patient record system: a cognitive approach to evaluating medical technology","volume":"13","author":"Kushniruk","year":"1996","journal-title":"MD Comput."},{"issue":"10","key":"2020110612374407900_ocw046-B82","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1016\/j.ijmedinf.2008.03.004","article-title":"Two-stage evaluation of the impact of a nursing information system in Taiwan","volume":"77","author":"Lee","year":"2008","journal-title":"Int J Med Inform."},{"issue":"11","key":"2020110612374407900_ocw046-B83","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1016\/j.ijmedinf.2012.02.009","article-title":"Integrating usability testing and think-aloud protocol analysis with \"near-live\" clinical simulations in evaluating clinical decision support","volume":"81","author":"Li","year":"2012","journal-title":"Int J Med Inform."},{"issue":"6","key":"2020110612374407900_ocw046-B84","doi-asserted-by":"crossref","first-page":"648","DOI":"10.1016\/j.jbi.2005.12.002","article-title":"Decision support for acute problems: the role of the standardized patient in usability testing","volume":"39","author":"Linder","year":"2006","journal-title":"J Biomed Inform."},{"key":"2020110612374407900_ocw046-B85","first-page":"1","article-title":"A novel methodology for evaluating user interfaces in health care","author":"Longo","year":"2011","journal-title":"Proceedings of 24th International Symposium on Computer-Based Medical Systems (CBMS)"},{"key":"2020110612374407900_ocw046-B86","first-page":"1b","article-title":"A case study of user assessment of a corrections electronic health record","volume":"8","author":"Madison","year":"2011","journal-title":"Perspect Health Inform Manag."},{"key":"2020110612374407900_ocw046-B87","first-page":"S193","article-title":"Usability testing for the development of an electronic health record integrated clinical prediction rules in primary care","volume":"26","author":"Mann","year":"2011","journal-title":"J Gen Int Med."},{"key":"2020110612374407900_ocw046-B88","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1186\/1748-5908-6-109","article-title":"Rationale, design, and implementation protocol of an electronic health record integrated clinical prediction rule (iCPR) randomized trial in primary care","volume":"6","author":"Mann","year":"2011","journal-title":"Implement Sci."},{"key":"2020110612374407900_ocw046-B89","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1186\/1748-5908-7-6","article-title":"Increasing efficacy of primary care-based counseling for diabetes prevention: rationale and design of the ADAPT (Avoiding Diabetes Thru Action Plan Targeting) trial","volume":"7","author":"Mann","year":"2012","journal-title":"Implement Sci."},{"issue":"Pt 1","key":"2020110612374407900_ocw046-B90","first-page":"648","article-title":"Evaluation of KNAVE-II: a tool for intelligent query and exploration of patient data","volume":"107","author":"Martins","journal-title":"Stud Health Technol Inform"},{"issue":"1","key":"2020110612374407900_ocw046-B91","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.artmed.2008.03.006","article-title":"Evaluation of an architecture for intelligent query and exploration of time-oriented clinical data","volume":"43","author":"Martins","year":"2008","journal-title":"Artif Intell Med."},{"issue":"4","key":"2020110612374407900_ocw046-B92","first-page":"209","article-title":"Electronic patient record evaluation in community mental health","volume":"17","author":"Meredith","year":"2009","journal-title":"Inform Prim Care."},{"key":"2020110612374407900_ocw046-B93","first-page":"256","article-title":"Evaluation of a maternal and child electronic health record in a developing country: preliminary results from a field pilot","author":"Mupueleque","year":"2012","journal-title":"Proceedings of the International Conference on Health Informatics"},{"issue":"4","key":"2020110612374407900_ocw046-B94","doi-asserted-by":"crossref","first-page":"958","DOI":"10.4338\/ACI-2014-08-RA-0067","article-title":"User-centered design and usability testing of an innovative health-related quality of life module","volume":"5","author":"Nagykaldi","year":"2014","journal-title":"Appl Clin Inform."},{"issue":"1","key":"2020110612374407900_ocw046-B95","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.jbi.2007.03.006","article-title":"On designing a usable interactive system to support transplant nursing","volume":"41","author":"Narasimhadevara","year":"2008","journal-title":"J Biomed Inform."},{"issue":"6","key":"2020110612374407900_ocw046-B96","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1177\/193229681100500614","article-title":"An analysis of the usability of inpatient insulin ordering in three computerized provider order entry systems","volume":"5","author":"Neinstein","year":"2011","journal-title":"J Diabetes Sci Technol."},{"issue":"5","key":"2020110612374407900_ocw046-B97","doi-asserted-by":"crossref","first-page":"950","DOI":"10.1016\/j.jbi.2012.03.007","article-title":"Usability of a novel clinician interface for genetic results","volume":"45","author":"Neri","year":"2012","journal-title":"J Biomed Inform."},{"issue":"8","key":"2020110612374407900_ocw046-B98","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1016\/j.ijmedinf.2012.02.003","article-title":"Evaluation of the national nursing model and four nursing documentation systems in Finland--lessons learned and directions for the future","volume":"81","author":"Nykanen","year":"2012","journal-title":"Int J Med Inform."},{"key":"2020110612374407900_ocw046-B99","first-page":"848","article-title":"Increasing physician acceptance and use of the computerized ambulatory medical record","author":"O'Dell","year":"1991","journal-title":"Proceedings - the Annual Symposium on Computer Applications in Medical Care"},{"issue":"1","key":"2020110612374407900_ocw046-B100","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.cnur.2013.11.010","article-title":"A nursing focus on EMR usability enhancing documentation of patient outcomes","volume":"49","author":"Page","year":"2014","journal-title":"Nurs Clin North Am."},{"issue":"7","key":"2020110612374407900_ocw046-B101","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1016\/j.ijmedinf.2009.02.008","article-title":"Using multi-perspective methodologies to study users' interactions with the prototype front end of a guideline-based decision support system for diabetic foot care","volume":"78","author":"Peleg","year":"2009","journal-title":"Int J Med Inform."},{"issue":"2-3","key":"2020110612374407900_ocw046-B102","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.ijmedinf.2006.06.003","article-title":"The significance of a usability evaluation of an emerging laboratory order entry system","volume":"76","author":"Peute","year":"2007","journal-title":"Int J Med Inform."},{"issue":"1-2","key":"2020110612374407900_ocw046-B103","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1016\/0360-8352(96)00173-8","article-title":"The usability of information technology within emergency care settings","volume":"31","author":"Pose","year":"1996","journal-title":"Comput Ind Eng."},{"key":"2020110612374407900_ocw046-B104","first-page":"656","article-title":"An EMR based cancer diary - utilisation and initial usability evaluation of a new cancer data visualization tool","volume":"180","author":"Ries","year":"2012","journal-title":"Stud Health Technol Inform."},{"issue":"11","key":"2020110612374407900_ocw046-B105","doi-asserted-by":"crossref","first-page":"1068","DOI":"10.1016\/j.ijmedinf.2013.08.007","article-title":"Use of a human factors approach to uncover informatics needs of nurses in documentation of care","volume":"82","author":"Rogers","year":"2013","journal-title":"Int J Med Inform."},{"issue":"1","key":"2020110612374407900_ocw046-B106","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.jbi.2004.11.006","article-title":"Using qualitative studies to improve the usability of an EMR","volume":"38","author":"Rose","year":"2005","journal-title":"J Biomed Inform."},{"issue":"1","key":"2020110612374407900_ocw046-B107","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1542\/peds.2004-2741","article-title":"Paper versus computer: feasibility of an electronic medical record in general pediatrics","volume":"117","author":"Roukema","year":"2006","journal-title":"Pediatrics."},{"issue":"7","key":"2020110612374407900_ocw046-B108","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1016\/j.ijmedinf.2010.04.001","article-title":"Assessing performance of an electronic health record (EHR) using cognitive task analysis","volume":"79","author":"Saitwal","year":"2010","journal-title":"Int J Med Inform."},{"key":"2020110612374407900_ocw046-B109","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1186\/1472-6947-11-74","article-title":"Redesign of a computerized clinical reminder for colorectal cancer screening: a human-computer interaction evaluation","volume":"11","author":"Saleem","year":"2011","journal-title":"BMC Med Inform Decis Mak."},{"key":"2020110612374407900_ocw046-B110","first-page":"640","article-title":"Using human factors methods to design a new interface for an electronic medical record","author":"Saleem","year":"2007","journal-title":"AMIAAnnual Symposium Proceedings\/AMIA Symposium"},{"key":"2020110612374407900_ocw046-B111","first-page":"1086","article-title":"Improving EMR Usability: a method for both discovering and prioritizing improvements in EMR workflows based on human factors engineering","author":"Santiago","year":"2006","journal-title":"AMIA Annual Symposium Proceedings\/AMIA Symposium"},{"key":"2020110612374407900_ocw046-B112","first-page":"404","article-title":"Usability laboratory as the last outpost before implementation - lessons learnt from testing new patient record functionality","volume":"150","author":"Seland","year":"2009","journal-title":"Stud Health Technol Inform."},{"issue":"1","key":"2020110612374407900_ocw046-B113","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1186\/1472-684X-12-31","article-title":"Novel open-source electronic medical records system for palliative care in low-resource settings","volume":"12","author":"Shah","year":"2013","journal-title":"BMC Palliat Care."},{"key":"2020110612374407900_ocw046-B114","first-page":"584","article-title":"Cognitive analysis of decision support for antibiotic prescribing at the point of ordering in a neonatal intensive care unit","volume":"2009","author":"Sheehan","year":"2009","journal-title":"AMIA Annual Symposium Proceedings\/AMIA Symposium."},{"key":"2020110612374407900_ocw046-B115","first-page":"400","article-title":"Evaluating physician satisfaction regarding user interactions with an electronic medical record system","author":"Sittig","year":"1999","journal-title":"Proceedings\/AMIA Annual Symposium"},{"issue":"Pt 1","key":"2020110612374407900_ocw046-B116","first-page":"131","article-title":"The avoidable misfortune of a computerized patient chart","volume":"160","author":"Sorby","year":"2010","journal-title":"Stud Health Technol Inform."},{"issue":"7","key":"2020110612374407900_ocw046-B117","doi-asserted-by":"crossref","first-page":"518","DOI":"10.7205\/MILMED-D-09-00285","article-title":"A usability assessment of AHLTA in ambulatory clinics at a military medical center","volume":"175","author":"Staggers","year":"2010","journal-title":"Mil Med."},{"issue":"2","key":"2020110612374407900_ocw046-B118","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1097\/01.NCN.0000263981.38801.be","article-title":"Nurses' evaluations of a novel design for an electronic medication administration record","volume":"25","author":"Staggers","year":"2007","journal-title":"Comput Inform Nurs."},{"issue":"Pt 2","key":"2020110612374407900_ocw046-B119","first-page":"1202","article-title":"Usability of clinician order entry systems in Singapore: an assessment of end-user satisfaction","volume":"160","author":"Tan","year":"2010","journal-title":"Stud Health Technol Inform."},{"key":"2020110612374407900_ocw046-B120","first-page":"125","article-title":"Usability improvement of a clinical decision support system","volume":"8519","author":"Thum","year":"2014","journal-title":"LNCS."},{"issue":"2","key":"2020110612374407900_ocw046-B121","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1111\/j.1745-7262.2006.00131.x","article-title":"Optimising workflow in andrology: a new electronic patient record and database","volume":"8","author":"Tuttelmann","year":"2006","journal-title":"Asian J Androl."},{"issue":"5","key":"2020110612374407900_ocw046-B122","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1016\/j.ijmedinf.2012.08.001","article-title":"Addressing critical issues in the development of an Oncology Information System","volume":"82","author":"Urda","year":"2013","journal-title":"Int J Med Inform."},{"key":"2020110612374407900_ocw046-B123","first-page":"331","article-title":"The evaluation of electronic perioperative nursing documentation using a cognitive walkthrough approach","volume":"208","author":"Usselman","year":"2015","journal-title":"Stud Health Technol Inform."},{"key":"2020110612374407900_ocw046-B124","first-page":"690","article-title":"A usability evaluation of an electronic health record system for nursing documentation used in the municipality healthcare services in Norway","volume":"8527","author":"Vatn\u00f8y","year":"2014","journal-title":"LNCS."},{"issue":"10","key":"2020110612374407900_ocw046-B125","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1016\/j.ijmedinf.2011.06.010","article-title":"National questionnaire study on clinical ICT systems proofs: physicians suffer from poor usability","volume":"80","author":"Viitanen","year":"2011","journal-title":"Int J Med Inform."},{"key":"2020110612374407900_ocw046-B126","first-page":"1137","article-title":"Usability evaluation at the point-of-care: a method to identify user information needs in CPOE applications","author":"Washburn","year":"2006","journal-title":"AMIA Annual Symposium Proceedings\/AMIA Symposium"},{"issue":"6","key":"2020110612374407900_ocw046-B127","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1097\/NXN.0b013e31824af81f","article-title":"Developing iCare v.1.0: an academic electronic health record","volume":"30","author":"Wyatt","year":"2012","journal-title":"Comput, Inform, Nurs."},{"issue":"6","key":"2020110612374407900_ocw046-B128","doi-asserted-by":"crossref","first-page":"3817","DOI":"10.1007\/s10916-012-9854-y","article-title":"Evaluation of computerized physician order entry system-a satisfaction survey in Taiwan","volume":"36","author":"Yui","year":"2012","journal-title":"J Med Syst."},{"key":"2020110612374407900_ocw046-B129","first-page":"S9","article-title":"Impact of an electronic pain and opioid risk assessment on documentation and clinical workflow","volume":"1","author":"Zacharoff","year":"2013","journal-title":"J Pain."},{"key":"2020110612374407900_ocw046-B130","first-page":"730","article-title":"Functional analysis of interfaces in U.S. military electronic health record system using UFuRT framework","volume":"2009","author":"Zhang","year":"2009","journal-title":"AMIA Annual Symposium Proceedings\/AMIA Symposium."},{"key":"2020110612374407900_ocw046-B131","article-title":"Comparative usability testing in the selection of electronic medical records software","author":"Ziemkowski","year":"1999","journal-title":"AMIA Annual Symposium Proceedings\/AMIA Symposium"},{"issue":"2","key":"2020110612374407900_ocw046-B132","doi-asserted-by":"crossref","first-page":"68","DOI":"10.5596\/c14-016","article-title":"Product review: covidence (systematic review software)","volume":"35","author":"Babineau","year":"2014","journal-title":"J Canad Health Libraries Assoc."},{"key":"2020110612374407900_ocw046-B133"},{"issue":"2","key":"2020110612374407900_ocw046-B134","first-page":"29","article-title":"SUS: a retrospective","volume":"8","author":"Brooke","year":"2013","journal-title":"J Usability Stud."},{"key":"2020110612374407900_ocw046-B135","first-page":"213","article-title":"Development of an instrument measuring user satisfaction of the human-computer interface","author":"Chin","year":"1988","journal-title":"SIGCHI '88."},{"key":"2020110612374407900_ocw046-B136","doi-asserted-by":"crossref","DOI":"10.1145\/259963.260531","volume-title":"Usability Inspection Methods","author":"Nielsen","year":"1994"},{"issue":"1","key":"2020110612374407900_ocw046-B137","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.jbi.2004.01.003","article-title":"Cognitive and usability engineering methods for the evaluation of clinical information systems","volume":"37","author":"Kushniruk","year":"2004","journal-title":"J Biomed Inform."},{"issue":"3","key":"2020110612374407900_ocw046-B138","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1136\/amiajnl-2010-000020","article-title":"Review of health information technology usability study methodologies","volume":"19","author":"Yen","year":"2012","journal-title":"J Am Med Inform Assoc."},{"issue":"10","key":"2020110612374407900_ocw046-B139","doi-asserted-by":"crossref","first-page":"1070","DOI":"10.1001\/jama.2015.8372","article-title":"Electronic health record vendor adherence to usability certification requirements and testing standards","volume":"314","author":"Ratwani","year":"2015","journal-title":"JAMA."},{"issue":"6","key":"2020110612374407900_ocw046-B140","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1093\/jamia\/ocv050","article-title":"Electronic health record usability: analysis of the user-centered design processes of eleven electronic health record vendors","volume":"22","author":"Ratwani","year":"2015","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2020110612374407900_ocw046-B141","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1016\/j.jbi.2011.08.005","article-title":"TURF: toward a unified framework of EHR usability","volume":"44","author":"Zhang","year":"2011","journal-title":"J Biomed Inform."},{"key":"2020110612374407900_ocw046-B142","volume-title":"Cost-Justifying Usability, Second Edition: An Update for the Internet Age","author":"Bias","year":"2005","edition":"2nd edn."},{"key":"2020110612374407900_ocw046-B143","volume-title":"Moderating Usability Tests","author":"Romano Bergstrom","year":"2013"},{"key":"2020110612374407900_ocw046-B144","article-title":"Doctors barred from discussing safety glitches in U.S.-funded software. 2015","author":"Tahir"},{"key":"2020110612374407900_ocw046-B145","article-title":"EHR issues become part of ebola story in Texas (update: THR clarifies position on EHR)","author":"Perna","year":"2014"},{"key":"2020110612374407900_ocw046-B146","doi-asserted-by":"crossref","first-page":"568303","DOI":"10.1155\/2014\/568303","article-title":"The current status of usability studies of information technologies in China: a systematic study","volume":"2014","author":"Lei","year":"2014","journal-title":"Biomed Res Int."}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/1\/218\/34148753\/ocw046.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/1\/218\/34148753\/ocw046.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T17:53:24Z","timestamp":1604685204000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/24\/1\/218\/2631447"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,4,23]]},"references-count":146,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2016,4,23]]},"published-print":{"date-parts":[[2017,1,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocw046","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,1]]},"published":{"date-parts":[[2016,4,23]]}}}