{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T10:48:45Z","timestamp":1761562125836},"reference-count":17,"publisher":"Oxford University Press (OUP)","issue":"e1","funder":[{"name":"American Medical Association and Raj Ratwani"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,4,1]]},"abstract":"<jats:p>Objective: Currently, there are few resources for electronic health record (EHR) purchasers and end users to understand the usability processes employed by EHR vendors during product design and development. We developed a framework, based on human factors literature and industry standards, to systematically evaluate the user-centered design processes and usability testing methods used by EHR vendors.<\/jats:p>\n               <jats:p>Materials and Methods: We reviewed current usability certification requirements and the human factors literature to develop a 15-point framework for evaluating EHR products. The framework is based on 3 dimensions: user-centered design process, summative testing methodology, and summative testing results. Two vendor usability reports were retrieved from the Office of the National Coordinator\u2019s Certified Health IT Product List and were evaluated using the framework.<\/jats:p>\n               <jats:p>Results: One vendor scored low on the framework (5 pts) while the other vendor scored high on the framework (15 pts). The 2 scored vendor reports demonstrate the framework\u2019s ability to discriminate between the variabilities in vendor processes and to determine which vendors are meeting best practices.<\/jats:p>\n               <jats:p>Discussion: The framework provides a method to more easily comprehend EHR vendors\u2019 usability processes and serves to highlight where EHR vendors may be falling short in terms of best practices. The framework provides a greater level of transparency for both purchasers and end users of EHRs.<\/jats:p>\n               <jats:p>Conclusion: The framework highlights the need for clearer certification requirements and suggests that the authorized certification bodies that examine vendor usability reports may need to be provided with clearer guidance.<\/jats:p>","DOI":"10.1093\/jamia\/ocw092","type":"journal-article","created":{"date-parts":[[2016,7,4]],"date-time":"2016-07-04T00:27:52Z","timestamp":1467592072000},"page":"e35-e39","source":"Crossref","is-referenced-by-count":19,"title":["A framework for evaluating electronic health record vendor user-centered design and usability testing processes"],"prefix":"10.1093","volume":"24","author":[{"given":"Raj M","family":"Ratwani","sequence":"first","affiliation":[{"name":"National Center for Human Factors in Healthcare, MedStar Health, Washington, DC"},{"name":"Department of Emergency Medicine, Georgetown University School of Medicine, Washington, DC,"}]},{"given":"A","family":"Zachary Hettinger","sequence":"additional","affiliation":[{"name":"National Center for Human Factors in Healthcare, MedStar Health, Washington, DC"},{"name":"Department of Emergency Medicine, Georgetown University School of Medicine, Washington, DC,"}]},{"given":"Allison","family":"Kosydar","sequence":"additional","affiliation":[{"name":"National Center for Human Factors in Healthcare, MedStar Health, Washington, DC"}]},{"given":"Rollin J","family":"Fairbanks","sequence":"additional","affiliation":[{"name":"National Center for Human Factors in Healthcare, MedStar Health, Washington, DC"},{"name":"Department of Emergency Medicine, Georgetown University School of Medicine, Washington, DC,"}]},{"given":"Michael L","family":"Hodgkins","sequence":"additional","affiliation":[{"name":"American Medical Association, Chicago, Illinois"}]}],"member":"286","published-online":{"date-parts":[[2016,7,3]]},"reference":[{"issue":"4","key":"2020110612432924400_ocw092-B1","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1016\/j.jemermed.2004.03.019","article-title":"Physician and nurse satisfaction with an Electronic Medical Record system","volume":"27","author":"Likourezos","year":"2004","journal-title":"J Emerg Med."},{"issue":"1","key":"2020110612432924400_ocw092-B2","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1186\/1741-7015-9-46","article-title":"Comparison of user groups\u2019 perspectives of barriers and facilitators to implementing electronic health records: a systematic review","volume":"9","author":"McGinn","year":"2011","journal-title":"BMC Med."},{"key":"2020110612432924400_ocw092-B3","doi-asserted-by":"crossref","DOI":"10.7249\/RB9740","volume-title":"Factors Affecting Physician Professional Satisfaction and Their Implications for Patient Care, Health Systems, and Health Policy","author":"Friedberg","year":"2013"},{"key":"2020110612432924400_ocw092-B4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1136\/amiajnl-2013-002578","article-title":"An analysis of electronic health record-related patient safety concerns","volume":"21","author":"Meeks","year":"2014","journal-title":"J Am Med Inform Assoc."},{"key":"2020110612432924400_ocw092-B5","article-title":"Emergency physician task switching increases with the introduction of a commercial electronic health record","author":"Benda","year":"2015","journal-title":"Ann Emerg Med."},{"key":"2020110612432924400_ocw092-B6","volume-title":"Health Information Technology: Standards, Implementation Specifications, and Certification Criteria for Electronic Health Record Technology, 2014 Edition","author":"Department of Health and Human Services","year":"2012"},{"key":"2020110612432924400_ocw092-B7","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1093\/jamia\/ocv050","article-title":"Electronic health record usability: analysis of the user centered design processes of eleven electronic health record vendors","volume":"22","author":"Ratwani","year":"2015","journal-title":"J Am Med Inform Assoc."},{"issue":"10","key":"2020110612432924400_ocw092-B8","doi-asserted-by":"crossref","first-page":"1070","DOI":"10.1001\/jama.2015.8372","article-title":"Electronic health record vendor adherence to usability certification requirements and testing standards","volume":"314","author":"Ratwani","year":"2015","journal-title":"JAMA."},{"key":"2020110612432924400_ocw092-B9","doi-asserted-by":"crossref","DOI":"10.1201\/b15703","volume-title":"User Centered Design","author":"Norman","year":"1986"},{"key":"2020110612432924400_ocw092-B10","doi-asserted-by":"crossref","DOI":"10.1016\/B978-0-08-052029-2.50007-3","volume-title":"Usability Engineering","author":"Nielsen","year":"1993"},{"key":"2020110612432924400_ocw092-B11","volume-title":"Customized Common Industry Format Template for Electronic Health Record Usability Testing Testing (NIST 7742)","author":"Schumacher","year":"2010"},{"issue":"3","key":"2020110612432924400_ocw092-B12","doi-asserted-by":"crossref","first-page":"379","DOI":"10.3758\/BF03195514","article-title":"Beyond the five-user assumption: benefits of increased sample sizes in usability testing","volume":"35","author":"Faulkner","year":"2003","journal-title":"Behav Res Methods, Instruments, Comput."},{"key":"2020110612432924400_ocw092-B13","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.jbi.2004.01.003","article-title":"Cognitive and usability engineering methods for the evaluation of clinical information systems","volume":"37","author":"Kushniruk","year":"2004","journal-title":"J Biomed Inform."},{"key":"2020110612432924400_ocw092-B14","volume-title":"Qunaitifying the User Experience: Pracitcal Statistics for User Research.","author":"Sauro","year":"2004"},{"key":"2020110612432924400_ocw092-B15","volume-title":"Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics.","author":"Tullis","year":"2013"},{"key":"2020110612432924400_ocw092-B16","doi-asserted-by":"crossref","DOI":"10.1201\/b10439","volume-title":"Handbook of Human Factors in Medical Device Design.","author":"Weinger","year":"2010"},{"key":"2020110612432924400_ocw092-B17","first-page":"218","article-title":"Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces","volume-title":"Proceedings of the 1997 AMIA Annual Fall Symposium.","author":"Kushniruk","year":"1997"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/e1\/e35\/34148970\/ocw092.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/e1\/e35\/34148970\/ocw092.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T18:12:20Z","timestamp":1604686340000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/24\/e1\/e35\/2631482"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,7,3]]},"references-count":17,"journal-issue":{"issue":"e1","published-online":{"date-parts":[[2016,7,3]]},"published-print":{"date-parts":[[2017,4,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocw092","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,4]]},"published":{"date-parts":[[2016,7,3]]}}}