{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T15:33:47Z","timestamp":1774366427041,"version":"3.50.1"},"reference-count":30,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2019,3,22]],"date-time":"2019-03-22T00:00:00Z","timestamp":1553212800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000133","name":"AHRQ","doi-asserted-by":"publisher","award":["P30-HS023535"],"award-info":[{"award-number":["P30-HS023535"]}],"id":[{"id":"10.13039\/100000133","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100005227","name":"Centers for Medicare & Medicaid Services","doi-asserted-by":"publisher","award":["1C1CMS331050"],"award-info":[{"award-number":["1C1CMS331050"]}],"id":[{"id":"10.13039\/100005227","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We established a Patient Safety Learning Laboratory comprising 2 core and 3 individual project teams to introduce a suite of digital health tools integrated with our electronic health record to identify, assess, and mitigate threats to patient safety in real time. One of the core teams employed systems engineering (SE) and human factors (HF) methods to analyze problems, design and develop improvements to intervention components, support implementation, and evaluate the system of systems as an integrated whole. Of the 29 participants, 19 and 16 participated in surveys and focus groups, respectively, about their perception of SE and HF. We identified 7 themes regarding use of the 12 SE and HF methods over the 4-year project. Qualitative methods (interviews, focus, groups, observations, usability testing) were most frequently used, typically by individual project teams, and generated the most insight. Quantitative methods (failure mode and effects analysis, simulation modeling) typically were used by the SE and HF core team but generated variable insight. A decentralized project structure led to challenges using these SE and HF methods at the project and systems level. We offer recommendations and insights for using SE and HF to support digital health patient safety initiatives.<\/jats:p>","DOI":"10.1093\/jamia\/ocz002","type":"journal-article","created":{"date-parts":[[2019,1,11]],"date-time":"2019-01-11T12:10:42Z","timestamp":1547208642000},"page":"553-560","source":"Crossref","is-referenced-by-count":30,"title":["Systems engineering and human factors support of a system of novel EHR-integrated tools to prevent harm in the hospital"],"prefix":"10.1093","volume":"26","author":[{"given":"Anuj K","family":"Dalal","sequence":"first","affiliation":[{"name":"Brigham and Women\u2019s Hospital, Boston, Massachusetts, USA"},{"name":"Harvard Medical School, Boston, Massachusetts, USA"}]},{"given":"Theresa","family":"Fuller","sequence":"additional","affiliation":[{"name":"Brigham and Women\u2019s Hospital, Boston, Massachusetts, USA"}]},{"given":"Pam","family":"Garabedian","sequence":"additional","affiliation":[{"name":"Partners HealthCare, Boston, Massachusetts, USA"}]},{"given":"Awatef","family":"Ergai","sequence":"additional","affiliation":[{"name":"Healthcare Systems Engineering Institute, Northeastern University, Boston, Massachusetts, USA"}]},{"given":"Corey","family":"Balint","sequence":"additional","affiliation":[{"name":"Healthcare Systems Engineering Institute, Northeastern University, Boston, Massachusetts, USA"}]},{"given":"David W","family":"Bates","sequence":"additional","affiliation":[{"name":"Brigham and Women\u2019s Hospital, Boston, Massachusetts, USA"},{"name":"Harvard Medical School, Boston, Massachusetts, USA"}]},{"given":"James","family":"Benneyan","sequence":"additional","affiliation":[{"name":"Healthcare Systems Engineering Institute, Northeastern University, Boston, Massachusetts, USA"}]}],"member":"286","published-online":{"date-parts":[[2019,3,22]]},"reference":[{"key":"2020110613113126300_ocz002-B1","doi-asserted-by":"crossref","first-page":"a2426.","DOI":"10.1136\/bmj.a2426","article-title":"Is health care getting safer?","volume":"337","author":"Vincent","year":"2008","journal-title":"BMJ"},{"key":"2020110613113126300_ocz002-B2","year":"2017"},{"issue":"12","key":"2020110613113126300_ocz002-B3","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.15537\/smj.2017.12.20631","article-title":"The impact of health information technology on patient safety","volume":"38","author":"Alotaibi","year":"2017","journal-title":"SMJ"},{"issue":"6","key":"2020110613113126300_ocz002-B4","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1136\/amiajnl-2013-002578","article-title":"An analysis of electronic health record-related patient safety concerns","volume":"21","author":"Meeks","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"11","key":"2020110613113126300_ocz002-B5","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1136\/bmjqs-2015-004323","article-title":"Identifying patient safety problems associated with information technology in general practice: an analysis of incident reports","volume":"25","author":"Magrabi","year":"2016","journal-title":"BMJ Qual Saf"},{"issue":"6","key":"2020110613113126300_ocz002-B6","doi-asserted-by":"crossref","first-page":"1068","DOI":"10.1093\/jamia\/ocw005","article-title":"Analysis of clinical decision support system malfunctions: a case series and survey","volume":"23","author":"Wright","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"18","key":"2020110613113126300_ocz002-B7","doi-asserted-by":"crossref","first-page":"1698","DOI":"10.1056\/NEJMsa0907115","article-title":"Effect of bar-code technology on the safety of medication administration","volume":"362","author":"Poon","year":"2010","journal-title":"N Engl J Med"},{"issue":"e1","key":"2020110613113126300_ocz002-B8","doi-asserted-by":"crossref","first-page":"e28","DOI":"10.1136\/amiajnl-2013-001762","article-title":"Exploring the sociotechnical intersection of patient safety and electronic health record implementation","volume":"21","author":"Meeks","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613113126300_ocz002-B9","doi-asserted-by":"crossref","first-page":"i68","DOI":"10.1136\/qshc.2010.042085","article-title":"A new sociotechnical model for studying health information technology in complex adaptive healthcare systems","volume":"19(Suppl 3)","author":"Sittig","year":"2010","journal-title":"Qual Saf Health Care"},{"issue":"5","key":"2020110613113126300_ocz002-B10","first-page":"418","article-title":"The SAFER guides: empowering organizations to improve the safety and effectiveness of electronic health records","volume":"20","author":"Sittig","year":"2014","journal-title":"Am J Manag Care"},{"issue":"3","key":"2020110613113126300_ocz002-B11","doi-asserted-by":"crossref","first-page":"e28.","DOI":"10.2196\/medinform.7476","article-title":"Health Information Technology (HIT) adaptation: refocusing on the journey to successful HIT implementation","volume":"5","author":"Yen","year":"2017","journal-title":"JMIR Med Inform"},{"issue":"8","key":"2020110613113126300_ocz002-B12","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1001\/archinternmed.2009.51","article-title":"Effect of an electronic medication reconciliation application and process redesign on potential adverse drug events: a cluster-randomized trial","volume":"169","author":"Schnipper","year":"2009","journal-title":"Arch Intern Med"},{"issue":"1","key":"2020110613113126300_ocz002-B13","doi-asserted-by":"crossref","first-page":"230.","DOI":"10.1186\/1472-6963-13-230","article-title":"Rationale and design of the Multicenter Medication Reconciliation Quality Improvement Study (MARQUIS)","volume":"13","author":"Salanitro","year":"2013","journal-title":"BMC Health Serv Res"},{"issue":"1","key":"2020110613113126300_ocz002-B14","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1093\/jamia\/ocw037","article-title":"Ten key considerations for the successful optimization of large-scale health information technology","volume":"24","author":"Cresswell","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"e1","key":"2020110613113126300_ocz002-B15","doi-asserted-by":"crossref","first-page":"e9","DOI":"10.1136\/amiajnl-2013-001684","article-title":"Ten key considerations for the successful implementation and adoption of large-scale health information technology","volume":"20","author":"Cresswell","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613113126300_ocz002-B16","doi-asserted-by":"crossref","DOI":"10.1097\/PTS.0000000000000358","article-title":"Medication safety in two intensive care units of a community teaching hospital after electronic health record implementation: sociotechnical and human factors engineering considerations","author":"Carayon","year":"2017","journal-title":"J Patient Saf"},{"key":"2020110613113126300_ocz002-B17","first-page":"23","article-title":"Patient safety: the role of human factors and systems engineering","volume":"153","author":"Carayon","year":"2010","journal-title":"Stud Health Technol Inform"},{"issue":"11","key":"2020110613113126300_ocz002-B18","doi-asserted-by":"crossref","first-page":"1669","DOI":"10.1080\/00140139.2013.838643","article-title":"SEIPS 2.0: a human factors framework for studying and improving the work of healthcare professionals and patients","volume":"56","author":"Holden","year":"2013","journal-title":"Ergonomics"},{"issue":"4","key":"2020110613113126300_ocz002-B19","doi-asserted-by":"crossref","first-page":"810","DOI":"10.1016\/j.jamcollsurg.2015.06.014","article-title":"Using human factors and systems engineering to evaluate readmission after complex surgery","volume":"221","author":"Acher","year":"2015","journal-title":"J Am Coll Surg"},{"issue":"1","key":"2020110613113126300_ocz002-B20","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1080\/00140139.2014.959070","article-title":"A systematic review of human factors and ergonomics (HFE)-based healthcare system redesign for quality of care and patient safety","volume":"58","author":"Xie","year":"2015","journal-title":"Ergonomics"},{"key":"2020110613113126300_ocz002-B21","volume-title":"Building a Better Delivery System: A New Engineering\/Health Care Partnership","author":"Reid","year":"2005","edition":"ed"},{"issue":"01","key":"2020110613113126300_ocz002-B22","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1055\/s-0038-1638638","article-title":"Current challenges and opportunities for better integration of human factors research with development of clinical information systems","volume":"18","author":"Saleem","year":"2009","journal-title":"Yearb Med Inform"},{"key":"2020110613113126300_ocz002-B23","volume-title":"Building a Better Delivery System: A New Engineering\/Health Care Partnership: Systems Engineering: Opportunities for Health Care.","author":"Reid","year":"2005"},{"issue":"8","key":"2020110613113126300_ocz002-B24","first-page":"403","article-title":"Pilot testing fall TIPS (Tailoring Interventions for Patient Safety): a patient-centered fall prevention toolkit","volume":"43","author":"Dykes","year":"2017","journal-title":"Jt Comm J Qual Patient Saf"},{"key":"2020110613113126300_ocz002-B25","doi-asserted-by":"crossref","DOI":"10.1097\/PTS.0000000000000354","article-title":"Validating fall prevention icons to support patient-centered education","author":"Leung","year":"2017","journal-title":"J Patient Saf"},{"issue":"12","key":"2020110613113126300_ocz002-B26","first-page":"676","article-title":"User-centered collaborative design and development of an inpatient safety dashboard","volume":"43","author":"Mlaver","year":"2017","journal-title":"Jt Comm J Qual Patient Saf"},{"issue":"2","key":"2020110613113126300_ocz002-B27","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1055\/s-0038-1645888","article-title":"Applying user-centered design methods to the development of an mHealth application for use in the hospital setting by patients and care partners","volume":"9","author":"Couture","year":"2018","journal-title":"Appl Clin Inform"},{"key":"2020110613113126300_ocz002-B28","article-title":"Mixed-methods evaluation of real-time safety reporting by hospitalized patients and their care partners: the mysafecare application","author":"Collins","year":"2018","journal-title":"J Patient Saf"},{"key":"2020110613113126300_ocz002-B29","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1515\/9780748636303-008","volume-title":"Practice-Led Research, Research-led Practice in the Creative Arts","author":"Brown","year":"2009"},{"issue":"26","key":"2020110613113126300_ocz002-B30","doi-asserted-by":"crossref","first-page":"2493","DOI":"10.1056\/NEJMp1512241","article-title":"Improving diagnosis in health care\u2013the next imperative for patient safety","volume":"373","author":"Singh","year":"2015","journal-title":"N Engl J Med"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/6\/553\/34153731\/ocz002.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/6\/553\/34153731\/ocz002.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,10]],"date-time":"2022-09-10T03:24:51Z","timestamp":1662780291000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/26\/6\/553\/5418902"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,22]]},"references-count":30,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2019,3,22]]},"published-print":{"date-parts":[[2019,6,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocz002","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,6]]},"published":{"date-parts":[[2019,3,22]]}}}