{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T03:19:40Z","timestamp":1787800780427,"version":"build-2784847793"},"reference-count":31,"publisher":"BMJ","issue":"6","license":[{"start":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T00:00:00Z","timestamp":1614729600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["Emerg Med J"],"accepted":{"date-parts":[[2021,1,10]]},"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:sec><jats:title>Background<\/jats:title><jats:p>The large volume of patients, rapid staff turnover and high work pressure mean that the usability of all systems within the ED is important. The transition to electronic health records (EHRs) has brought many benefits to emergency care but imposes a significant burden on staff to enter data. Poor usability has a direct consequence and opportunity cost in staff time and resources that could otherwise be employed in patient care. This research measures the usability of EHR systems in UK EDs using a validated assessment tool.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>This was a survey completed by members and fellows of the Royal College of Emergency Medicine conducted during summer 2019. The primary outcome was the System Usability Scale Score, which ranges from 0 (worst) to 100 (best). Scores were compared with an internationally recognised measure of acceptable usability of 68. Results were analysed by EHR system, country, healthcare organisation and physician grade. Only EHR systems with at least 20 responses were analysed.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>There were 1663 responses from a total population of 8794 (19%) representing 192 healthcare organisations (mainly UK NHS), and 25 EHR systems. Fifteen EHR systems had at least 20 responses and were included in the analysis. No EHR system achieved a median usability score that met the industry standard of acceptable usability.<\/jats:p><jats:p>The median usability score was 53 (IQR 35\u201368). Individual EHR systems\u2019 scores ranged from 35 (IQR 26\u201353) to 65 (IQR 44\u201380).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>In this survey, no UK ED EHR system met the internationally validated standard of acceptable usability for information technology.<\/jats:p><\/jats:sec>","DOI":"10.1136\/emermed-2020-210401","type":"journal-article","created":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T18:44:20Z","timestamp":1614797060000},"page":"410-415","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":56,"title":["Usability of electronic health record systems in UK EDs"],"prefix":"10.1136","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3016-4925","authenticated-orcid":false,"given":"Benjamin Michael","family":"Bloom","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Pott","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen","family":"Thomas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David Ramon","family":"Gaunt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas C","family":"Hughes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2021,3,3]]},"reference":[{"key":"2025062300402004000_38.6.410.1","unstructured":"Brooke J . SUS - A quick and dirty usability scale. In: Jordan PW , Thomas B , McClelland IL , eds. Usability evaluation in industry, 1996: 189\u201394."},{"key":"2025062300402004000_38.6.410.2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2018.12615"},{"key":"2025062300402004000_38.6.410.3","doi-asserted-by":"crossref","DOI":"10.1001\/jamainternmed.2018.8247","article-title":"Deconstructing burnout to define a positive path forward","volume":"179","author":"Lee","year":"2019","journal-title":"JAMA Intern Med"},{"key":"2025062300402004000_38.6.410.4","doi-asserted-by":"crossref","first-page":"1789","DOI":"10.1056\/NEJMp1809698","article-title":"Getting rid of Stupid stuff","volume":"379","author":"Ashton","year":"2018","journal-title":"N Engl J Med"},{"key":"2025062300402004000_38.6.410.5","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMhpr066212"},{"key":"2025062300402004000_38.6.410.6","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-144-10-200605160-00125"},{"key":"2025062300402004000_38.6.410.7","first-page":"29","article-title":"SUS: a retrospective","volume":"8","author":"Brooke","year":"2013","journal-title":"Journal of Usability Studies"},{"key":"2025062300402004000_38.6.410.8","first-page":"114","article-title":"Determining what individual Sus scores mean: adding an Adjective rating scale","volume":"4","author":"Bangor","year":"2009","journal-title":"Journal of Usability Studies"},{"key":"2025062300402004000_38.6.410.9","doi-asserted-by":"publisher","DOI":"10.1080\/10447310802205776"},{"key":"2025062300402004000_38.6.410.10","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1080\/10447318.2012.681221","article-title":"Usability ratings for everyday products measured with the system usability scale","volume":"29","author":"Kortum","year":"2013","journal-title":"Int J Hum Comput Interact"},{"key":"2025062300402004000_38.6.410.11","unstructured":"Sauro J . A practical guide to the system usability scale : background benchmarks & best practices, 2011."},{"key":"2025062300402004000_38.6.410.12","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2008.08.010"},{"key":"2025062300402004000_38.6.410.13","unstructured":"Tullis TS , Stetson JN . A comparison of questionnaires for assessing website usability. Usability Professionals Association Annual Conference, Minneapolis, MN, 2004."},{"key":"2025062300402004000_38.6.410.14","unstructured":"Sauro J . System usability scale, 2019. Available: https:\/\/www.userfocus.co.uk\/articles\/measuring-usability-with-the-SUS.html#:~:text=Despite%20the%20wide%20usage%20of,research%20and%20during%20usability%20evaluations [Accessed 06 Mar 2019]."},{"key":"2025062300402004000_38.6.410.15","unstructured":"StataCorp LP . Stata : release 16. College Station, TX: StataCorp LP, 2019."},{"key":"2025062300402004000_38.6.410.16","doi-asserted-by":"crossref","unstructured":"In Lemeshow S , Sturdivant RX , Hosmer DW . Applied logistic regression (Wiley series in probability and statistics. Wiley, 2013.","DOI":"10.1002\/9781118445112.stat06902"},{"key":"2025062300402004000_38.6.410.17","unstructured":"Bloom B . Usability of electronic health record systems in UK emergency departments 2020."},{"key":"2025062300402004000_38.6.410.18","unstructured":"Health Research Authority . Do I need NHS REC approval? 2019. Available: http:\/\/www.hra-decisiontools.org.uk\/ethics\/index.html [Accessed 25 Jun 2019]."},{"key":"2025062300402004000_38.6.410.19","unstructured":"Health Research Authority . Is my study research? 2019. Available: http:\/\/www.hra-decisiontools.org.uk\/research\/index.html [Accessed 05 Jun 2019]."},{"key":"2025062300402004000_38.6.410.20","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6.3.e34"},{"key":"2025062300402004000_38.6.410.21","doi-asserted-by":"crossref","first-page":"476-487","DOI":"10.1016\/j.mayocp.2019.09.024","article-title":"The association between perceived electronic health record usability and professional burnout among US physicians","volume":"95","author":"Melnick","year":"2020","journal-title":"Mayo Clin Proc"},{"key":"2025062300402004000_38.6.410.22","doi-asserted-by":"crossref","first-page":"1197","DOI":"10.1093\/jamia\/ocy088","article-title":"A usability and safety analysis of electronic health records: a multi-center study","volume":"25","author":"Ratwani","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2025062300402004000_38.6.410.23","doi-asserted-by":"crossref","unstructured":"Mujinga M , Eloff MM , Kroeze JH . System usability scale evaluation of online banking services: a South African study. S Afr J Sci 2018;114.doi:10.17159\/sajs.2018\/20170065","DOI":"10.17159\/sajs.2018\/20170065"},{"key":"2025062300402004000_38.6.410.24","doi-asserted-by":"crossref","first-page":"518","DOI":"10.1080\/10447318.2015.1064658","article-title":"Measuring the usability of mobile applications for phones and tablets","volume":"31","author":"Kortum","year":"2015","journal-title":"Int J Hum Comput Interact"},{"key":"2025062300402004000_38.6.410.25","unstructured":"Adams D , Lee P , Calugar-Pop C . Deloitte mobile consumer survey 2019: the state of the smartphone 2019."},{"key":"2025062300402004000_38.6.410.26","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.l121"},{"key":"2025062300402004000_38.6.410.27","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2005-1287"},{"key":"2025062300402004000_38.6.410.28","doi-asserted-by":"publisher","DOI":"10.1001\/jama.293.10.1197"},{"key":"2025062300402004000_38.6.410.29","doi-asserted-by":"crossref","first-page":"e127","DOI":"10.1016\/S2589-7500(19)30057-3","article-title":"The effects and preventability of 2627 patient safety incidents related to health information technology failures: a retrospective analysis of 10 years of incident reporting in England and Wales","volume":"1","author":"Martin","year":"2019","journal-title":"Lancet Digit Health"},{"key":"2025062300402004000_38.6.410.30","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1111\/1742-6723.13371","article-title":"Diagnoses, damned diagnoses and statistics: dealing with disparate diagnostic coding systems within the new South Wales emergency department data collection","volume":"31","author":"Dinh","year":"2019","journal-title":"Emerg Med Australas"},{"key":"2025062300402004000_38.6.410.31","unstructured":"Oppenheim AN . Questionnaire design, interviewing and attitude measurement. London, 2009."}],"container-title":["Emergency Medicine Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/emermed-2020-210401","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T07:41:06Z","timestamp":1750664466000},"score":1,"resource":{"primary":{"URL":"https:\/\/emj.bmj.com\/lookup\/doi\/10.1136\/emermed-2020-210401"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,3]]},"references-count":31,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,5,24]]},"published-print":{"date-parts":[[2021,6]]}},"alternative-id":["10.1136\/emermed-2020-210401"],"URL":"https:\/\/doi.org\/10.1136\/emermed-2020-210401","relation":{},"ISSN":["1472-0205","1472-0213"],"issn-type":[{"value":"1472-0205","type":"print"},{"value":"1472-0213","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,3]]}}}