{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T07:53:38Z","timestamp":1772697218525,"version":"3.50.1"},"reference-count":55,"publisher":"Georg Thieme Verlag KG","issue":"05","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2021,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\n          Objectives\u2003Medication use in the perioperative setting presents many patient safety challenges that may be improved with electronic clinical decision support (CDS). The objective of this paper is to describe the development and analysis of user feedback for a robust, real-time medication-related CDS application designed to provide patient-specific dosing information and alerts to warn of medication errors in the operating room (OR).<\/jats:p><jats:p>\n          Methods\u2003We designed a novel perioperative medication-related CDS application in four phases: (1) identification of need, (2) alert algorithm development, (3) system design, and (4) user interface design. We conducted group and individual design feedback sessions with front-line clinician leaders and subject matter experts to gather feedback about user requirements for alert content and system usability. Participants were clinicians who provide anesthesia (attending anesthesiologists, nurse anesthetists, and house staff), OR pharmacists, and nurses.<\/jats:p><jats:p>\n          Results\u2003We performed two group and eight individual design feedback sessions, with a total of 35 participants. We identified 20 feedback themes, corresponding to 19 system changes. Key requirements for user acceptance were: Use hard stops only when necessary; provide as much information as feasible about the rationale behind alerts and patient\/clinical context; and allow users to edit fields such as units, time, and baseline values (e.g., baseline blood pressure).<\/jats:p><jats:p>\n          Conclusion\u2003We incorporated user-centered design principles to build a perioperative medication-related CDS application that uses real-time patient data to provide patient-specific dosing information and alerts. Emphasis on early user involvement to elicit user requirements, workflow considerations, and preferences during application development can result in time and money efficiencies and a safer and more usable system.<\/jats:p>","DOI":"10.1055\/s-0041-1736339","type":"journal-article","created":{"date-parts":[[2021,11,25]],"date-time":"2021-11-25T01:52:49Z","timestamp":1637805169000},"page":"984-995","source":"Crossref","is-referenced-by-count":19,"title":["Development of a Perioperative Medication-Related Clinical Decision Support Tool to Prevent Medication Errors: An Analysis of User Feedback"],"prefix":"10.1055","volume":"12","author":[{"given":"Karen C.","family":"Nanji","sequence":"additional","affiliation":[{"name":"Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, Massachusetts, United States"},{"name":"Department of Anaesthesiology, Harvard Medical School, Boston, Massachusetts, United States"},{"name":"Mass General Brigham, Inc., Boston, Massachusetts, United States"}]},{"given":"Pamela M.","family":"Garabedian","sequence":"additional","affiliation":[{"name":"Mass General Brigham, Inc., Boston, Massachusetts, United States"}]},{"given":"Sofia D.","family":"Shaikh","sequence":"additional","affiliation":[{"name":"Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, Massachusetts, United States"}]},{"given":"Marin E.","family":"Langlieb","sequence":"additional","affiliation":[{"name":"Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, Massachusetts, United States"}]},{"given":"Aziz","family":"Boxwala","sequence":"additional","affiliation":[{"name":"Elimu Informatics, Inc., La Jolla, California, United States"}]},{"given":"William J.","family":"Gordon","sequence":"additional","affiliation":[{"name":"Mass General Brigham, Inc., Boston, Massachusetts, United States"},{"name":"Division of General Internal Medicine, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, United States"},{"name":"Department of Medicine, Harvard Medical School, Boston, Massachusetts, United States"}]},{"given":"David W.","family":"Bates","sequence":"additional","affiliation":[{"name":"Mass General Brigham, Inc., Boston, Massachusetts, United States"},{"name":"Division of General Internal Medicine, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, United States"},{"name":"Department of Medicine, Harvard Medical School, Boston, Massachusetts, United States"}]}],"member":"194","published-online":{"date-parts":[[2021,11,24]]},"reference":[{"issue":"01","key":"ref1","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1097\/ALN.0000000000000904","article-title":"Evaluation of perioperative medication errors and adverse drug events","volume":"124","author":"K C Nanji","year":"2016","journal-title":"Anesthesiology"},{"key":"ref2","doi-asserted-by":"crossref","first-page":"d5543","DOI":"10.1136\/bmj.d5543","article-title":"Multimodal system designed to reduce errors in recording and administration of drugs in anaesthesia: prospective randomised clinical evaluation","volume":"343","author":"A F Merry","year":"2011","journal-title":"BMJ"},{"issue":"01","key":"ref3","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1186\/s12916-020-01774-9","article-title":"Preventable medication harm across health care settings: a systematic review and meta-analysis","volume":"18","author":"A Hodkinson","year":"2020","journal-title":"BMC Med"},{"issue":"16","key":"ref4","doi-asserted-by":"crossref","first-page":"1897","DOI":"10.1001\/archinte.162.16.1897","article-title":"Medication errors observed in 36 health care facilities","volume":"162","author":"K N Barker","year":"2002","journal-title":"Arch Intern Med"},{"issue":"16","key":"ref5","doi-asserted-by":"crossref","first-page":"2114","DOI":"10.1001\/jama.285.16.2114","article-title":"Medication errors and adverse drug events in pediatric inpatients","volume":"285","author":"R Kaushal","year":"2001","journal-title":"JAMA"},{"issue":"15","key":"ref6","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1001\/jama.279.15.1200","article-title":"Incidence of adverse drug reactions in hospitalized patients: a meta-analysis of prospective studies","volume":"279","author":"J Lazarou","year":"1998","journal-title":"JAMA"},{"issue":"05","key":"ref7","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1136\/jamia.2009.001719","article-title":"Errors and electronic prescribing: a controlled laboratory study to examine task complexity and interruption effects","volume":"17","author":"F Magrabi","year":"2010","journal-title":"J Am Med Inform Assoc"},{"issue":"01","key":"ref8","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1197\/jamia.M3285","article-title":"The impact of computerized provider order entry on medication errors in a multispecialty group practice","volume":"17","author":"E B Devine","year":"2010","journal-title":"J Am Med Inform Assoc"},{"issue":"09","key":"ref9","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1111\/j.1525-1497.2005.0194.x","article-title":"Outpatient prescribing errors and the impact of computerized prescribing","volume":"20","author":"T K Gandhi","year":"2005","journal-title":"J Gen Intern Med"},{"issue":"06","key":"ref10","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1136\/amiajnl-2011-000205","article-title":"Errors associated with outpatient computerized prescribing systems","volume":"18","author":"K C Nanji","year":"2011","journal-title":"J Am Med Inform Assoc"},{"issue":"05","key":"ref11","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1111\/j.1365-2044.2010.06325.x","article-title":"Clinical assessment of a new anaesthetic drug administration system: a prospective, controlled, longitudinal incident monitoring study","volume":"65","author":"C S Webster","year":"2010","journal-title":"Anaesthesia"},{"issue":"16","key":"ref12","doi-asserted-by":"crossref","first-page":"1556","DOI":"10.1056\/NEJMsa020703","article-title":"Adverse drug events in ambulatory care","volume":"348","author":"T K Gandhi","year":"2003","journal-title":"N Engl J Med"},{"key":"ref14","first-page":"1","article-title":"APSF hosts medication safety conference: consensus group defines challenges and opportunities for improved practice","volume":"25","author":"J Eichhorn","year":"2010","journal-title":"APSF Newsletter"},{"issue":"02","key":"ref15","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1093\/intqhc\/mzu010","article-title":"Standardization in patient safety: the WHO High 5s project","volume":"26","author":"A Leotsakos","year":"2014","journal-title":"Int J Qual Health Care"},{"issue":"06","key":"ref18","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1093\/jamia\/ocv050","article-title":"Electronic health record usability: analysis of the user-centered design processes of eleven electronic health record vendors","volume":"22","author":"R M Ratwani","year":"2015","journal-title":"J Am Med Inform Assoc"},{"issue":"03","key":"ref19","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1016\/j.mayocp.2019.09.024","article-title":"The association between perceived electronic health record usability and professional burnout among US physicians","volume":"95","author":"E R Melnick","year":"2020","journal-title":"Mayo Clin Proc"},{"issue":"15","key":"ref20","doi-asserted-by":"crossref","first-page":"1311","DOI":"10.1001\/jama.280.15.1311","article-title":"Effect of computerized physician order entry and a team intervention on prevention of serious medication errors","volume":"280","author":"D W Bates","year":"1998","journal-title":"JAMA"},{"issue":"06","key":"ref21","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/j.ijmedinf.2007.10.001","article-title":"The impact of computerized physician medication order entry in hospitalized patients\u2013a systematic review","volume":"77","author":"S Eslami","year":"2008","journal-title":"Int J Med Inform"},{"issue":"03","key":"ref22","doi-asserted-by":"crossref","first-page":"221","DOI":"10.2146\/ajhp110084","article-title":"Preventability of adverse drug events involving multiple drugs using publicly available clinical decision support tools","volume":"69","author":"A Wright","year":"2012","journal-title":"Am J Health Syst Pharm"},{"issue":"10","key":"ref23","first-page":"e445","article-title":"Using electronic health record clinical decision support is associated with improved quality of care","volume":"20","author":"R G Mishuris","year":"2014","journal-title":"Am J Manag Care"},{"issue":"01","key":"ref24","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1136\/amiajnl-2011-000124","article-title":"Guided medication dosing for elderly emergency patients using real-time, computerized decision support","volume":"19","author":"R T Griffey","year":"2012","journal-title":"J Am Med Inform Assoc"},{"issue":"04","key":"ref25","doi-asserted-by":"crossref","first-page":"1184","DOI":"10.1542\/peds.2008-1494","article-title":"The effect of computerized physician order entry on medication prescription errors and clinical outcome in pediatric and intensive care: a systematic review","volume":"123","author":"F van Rosse","year":"2009","journal-title":"Pediatrics"},{"issue":"05","key":"ref26","doi-asserted-by":"crossref","first-page":"e006539","DOI":"10.1136\/bmjopen-2014-006539","article-title":"Computerised clinical decision support systems to improve medication safety in long-term care homes: a systematic review","volume":"5","author":"K M Marasinghe","year":"2015","journal-title":"BMJ Open"},{"issue":"05","key":"ref27","doi-asserted-by":"crossref","first-page":"885","DOI":"10.1007\/s10877-016-9921-x","article-title":"A systematic review of near real-time and point-of-care clinical decision support in anesthesia information management systems","volume":"31","author":"A F Simpao","year":"2017","journal-title":"J Clin Monit Comput"},{"issue":"03","key":"ref28","doi-asserted-by":"crossref","first-page":"1458","DOI":"10.1053\/j.jvca.2017.11.002","article-title":"Perioperative information systems: opportunities to improve delivery of care and clinical outcomes in cardiac and vascular surgery","volume":"32","author":"R E Freundlich","year":"2018","journal-title":"J Cardiothorac Vasc Anesth"},{"issue":"06","key":"ref29","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1097\/ACO.0000000000000526","article-title":"Anesthesia information management: clinical decision support","volume":"30","author":"R E Freundlich","year":"2017","journal-title":"Curr Opin Anaesthesiol"},{"issue":"02","key":"ref30","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1213\/ANE.0000000000001636","article-title":"Intraoperative clinical decision support for anesthesia: a narrative review of available systems","volume":"124","author":"B G Nair","year":"2017","journal-title":"Anesth Analg"},{"issue":"05","key":"ref31","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1197\/jamia.M2042","article-title":"Types of unintended consequences related to computerized provider order entry","volume":"13","author":"E M Campbell","year":"2006","journal-title":"J Am Med Inform Assoc"},{"issue":"03","key":"ref32","doi-asserted-by":"crossref","first-page":"686","DOI":"10.4338\/ACI-2017-01-RA-0003","article-title":"Electronic health record alert-related workload as a predictor of burnout in primary care providers","volume":"8","author":"M E Gregory","year":"2017","journal-title":"Appl Clin Inform"},{"issue":"06","key":"ref33","doi-asserted-by":"crossref","first-page":"1202","DOI":"10.1016\/j.jbi.2012.09.002","article-title":"Interface design principles for usable decision support: a targeted review of best practices for clinical prescribing interventions","volume":"45","author":"J Horsky","year":"2012","journal-title":"J Biomed Inform"},{"issue":"05","key":"ref34","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1093\/jamia\/ocx118","article-title":"Interface, information, interaction: a narrative review of design and functional requirements for clinical decision support","volume":"25","author":"K Miller","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"01","key":"ref35","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1186\/s12911-018-0615-9","article-title":"Evidence-based usability design principles for medication alerting systems","volume":"18","author":"R Marcilly","year":"2018","journal-title":"BMC Med Inform Decis Mak"},{"issue":"15","key":"ref37","doi-asserted-by":"crossref","first-page":"1515","DOI":"10.1056\/NEJMsa064637","article-title":"The quality of ambulatory care delivered to children in the United States","volume":"357","author":"R Mangione-Smith","year":"2007","journal-title":"N Engl J Med"},{"issue":"01","key":"ref38","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1097\/EJA.0000000000000683","article-title":"European Society of Anaesthesiology and European Board of Anaesthesiology guidelines for procedural sedation and analgesia in adults","volume":"35","author":"J Hinkelbein","year":"2018","journal-title":"Eur J Anaesthesiol"},{"issue":"02","key":"ref39","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1136\/bmjqs.2009.032524","article-title":"Development of quality of care indicators for patients undergoing total hip or total knee replacement","volume":"20","author":"N F SooHoo","year":"2011","journal-title":"BMJ Qual Saf"},{"issue":"05","key":"ref40","doi-asserted-by":"crossref","first-page":"e014743","DOI":"10.1136\/bmjopen-2016-014743","article-title":"Selection by a panel of clinicians and family representatives of important early morbidities associated with paediatric cardiac surgery suitable for routine monitoring using the nominal group technique and a robust voting process","volume":"7","author":"C Pagel","year":"2017","journal-title":"BMJ Open"},{"issue":"01","key":"ref41","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1007\/s10729-006-9003-6","article-title":"A consensus process for identifying a prioritised list of study questions","volume":"10","author":"M Utley","year":"2007","journal-title":"Health Care Manage Sci"},{"issue":"03","key":"ref42","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1136\/amiajnl-2013-001839","article-title":"Unrealized potential and residual consequences of electronic prescribing on pharmacy workflow in the outpatient pharmacy","volume":"21","author":"K C Nanji","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"ref43","volume-title":"Successful Qualitative Research: A practical guide for beginners","author":"V Clarke","year":"2013"},{"issue":"09","key":"ref44","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1097\/ACM.0000000000000388","article-title":"Standards for reporting qualitative research: a synthesis of recommendations","volume":"89","author":"B C O'Brien","year":"2014","journal-title":"Acad Med"},{"key":"ref47","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1136\/bmj.38398.500764.8F","article-title":"Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success","volume":"330","author":"K Kawamoto","year":"2005","journal-title":"BMJ"},{"issue":"06","key":"ref48","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1093\/jamia\/ocv011","article-title":"Recommendations to improve the usability of drug-drug interaction clinical decision support alerts","volume":"22","author":"T H Payne","year":"2015","journal-title":"J Am Med Inform Assoc"},{"issue":"04","key":"ref49","doi-asserted-by":"crossref","first-page":"e13226","DOI":"10.2196\/13226","article-title":"A digital cognitive aid for anesthesia to support intraoperative crisis management: results of the user-centered design process","volume":"7","author":"S Schild","year":"2019","journal-title":"JMIR Mhealth Uhealth"},{"key":"ref51","volume-title":"Designing for People. An Introduction to Human Factors Engineering","author":"C D Wickens","year":"2003","edition":"2nd ed."},{"issue":"03","key":"ref52","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1145\/208628.1065831","article-title":"Book review: Usability Inspection Methods edited by Jakob Nielsen and Robert L. Mack (John Wiley & Sons, Inc., 1994)","volume":"6","author":"D Merrill","year":"1995","journal-title":"ACM SIGART Bulletin"},{"issue":"04","key":"ref53","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1177\/1089253213490078","article-title":"Clinical decision support for perioperative information management systems","volume":"17","author":"J P Wanderer","year":"2013","journal-title":"Semin Cardiothorac Vasc Anesth"},{"issue":"03","key":"ref54","doi-asserted-by":"crossref","first-page":"678","DOI":"10.1213\/ANE.0000000000000677","article-title":"Influencing anesthesia provider behavior using anesthesia information management system data for near real-time alerts and post hoc reports","volume":"121","author":"R H Epstein","year":"2015","journal-title":"Anesth Analg"},{"issue":"S 01","key":"ref55","doi-asserted-by":"crossref","first-page":"i62","DOI":"10.1136\/amiajnl-2011-000362","article-title":"Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems\u2013I-MeDeSA","volume":"18","author":"M Zachariah","year":"2011","journal-title":"J Am Med Inform Assoc"},{"issue":"04","key":"ref56","doi-asserted-by":"crossref","first-page":"e191709","DOI":"10.1001\/jamanetworkopen.2019.1709","article-title":"Association of the usability of electronic health records with cognitive workload and performance levels among physicians","volume":"2","author":"L M Mazur","year":"2019","journal-title":"JAMA Netw Open"},{"issue":"12","key":"ref57","doi-asserted-by":"crossref","first-page":"1276","DOI":"10.1001\/jama.2018.1171","article-title":"Electronic health record usability issues and potential contribution to patient harm","volume":"319","author":"J L Howe","year":"2018","journal-title":"JAMA"},{"key":"ref58","doi-asserted-by":"crossref","DOI":"10.1145\/632716.632805","volume-title":"The Usability Engineering Lifecycle: A Practitioner's Handbook for User Interface Design","author":"D Mayhew","year":"1999"},{"key":"ref60","doi-asserted-by":"crossref","first-page":"e2","DOI":"10.1136\/amiajnl-2012-001458","article-title":"Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA","volume":"20","author":"B Middleton","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"01","key":"ref61","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.jbi.2004.11.005","article-title":"A user-centered framework for redesigning health care interfaces","volume":"38","author":"C M Johnson","year":"2005","journal-title":"J Biomed Inform"},{"key":"ref62","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.apergo.2016.03.011","article-title":"Iterative user centered design for development of a patient-centered fall prevention toolkit","volume":"56","author":"Z Katsulis","year":"2016","journal-title":"Appl Ergon"},{"issue":"05","key":"ref63","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1136\/jamia.2010.005264","article-title":"A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems","volume":"17","author":"S Phansalkar","year":"2010","journal-title":"J Am Med Inform Assoc"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/s-0041-1736339.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,25]],"date-time":"2021-11-25T01:53:39Z","timestamp":1637805219000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0041-1736339"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10]]},"references-count":55,"journal-issue":{"issue":"05","published-online":{"date-parts":[[2021,10,20]]},"published-print":{"date-parts":[[2021,10]]}},"URL":"https:\/\/doi.org\/10.1055\/s-0041-1736339","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["1869-0327"],"issn-type":[{"value":"1869-0327","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10]]}}}