{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T04:22:08Z","timestamp":1771647728227,"version":"3.50.1"},"reference-count":30,"publisher":"Oxford University Press (OUP)","issue":"1","funder":[{"DOI":"10.13039\/100000133","name":"Agency for Healthcare Research & Quality","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000133","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006093","name":"Patient-Centered Outcomes Research Institute","doi-asserted-by":"publisher","award":["K12HS026395"],"award-info":[{"award-number":["K12HS026395"]}],"id":[{"id":"10.13039\/100006093","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Department of Veterans Affairs, Tennessee Valley Healthcare System"},{"DOI":"10.13039\/100000936","name":"Gordon and Betty Moore Foundation","doi-asserted-by":"publisher","award":["GBMF9048"],"award-info":[{"award-number":["GBMF9048"]}],"id":[{"id":"10.13039\/100000936","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000738","name":"Department of Veterans Affairs","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000738","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000936","name":"Gordon and Betty Moore Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000936","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,12,22]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>We examined the influence of 4 different risk information formats on inpatient nurses\u2019 preferences and decisions with an acute clinical deterioration decision-support system.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and methods<\/jats:title>\n                  <jats:p>We conducted a comparative usability evaluation in which participants provided responses to multiple user interface options in a simulated setting. We collected qualitative data using think aloud methods. We collected quantitative data by asking participants which action they would perform after each time point in 3 different patient scenarios.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>More participants (n\u2009=\u20096) preferred the probability format over relative risk ratios (n\u2009=\u20092), absolute differences (n\u2009=\u20092), and number of persons out of 100 (n\u2009=\u20090). Participants liked average lines, having a trend graph to supplement the risk estimate, and consistent colors between trend graphs and possible actions. Participants did not like too much text information or the presence of confidence intervals. From a decision-making perspective, use of the probability format was associated with greater concordance in actions taken by participants compared to the other 3 risk information formats.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>By focusing on nurses\u2019 preferences and decisions with several risk information display formats and collecting both qualitative and quantitative data, we have provided meaningful insights for the design of clinical decision-support systems containing complex quantitative information.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>This study adds to our knowledge of presenting risk information to nurses within clinical decision-support systems. We encourage those developing risk-based systems for inpatient nurses to consider expressing risk in a probability format and include a graph (with average line) to display the patient\u2019s recent trends.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad209","type":"journal-article","created":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T23:29:17Z","timestamp":1698708557000},"page":"61-69","source":"Crossref","is-referenced-by-count":6,"title":["Inpatient nurses\u2019 preferences and decisions with risk information visualization"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2797-6508","authenticated-orcid":false,"given":"Alvin D","family":"Jeffery","sequence":"first","affiliation":[{"name":"School of Nursing, Vanderbilt University , Nashville, TN 37240, United States"},{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center , Nashville, TN 37203, United States"},{"name":"Tennessee Valley Healthcare System, United States Department of Veterans Affairs , Nashville, TN 37212, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carrie","family":"Reale","sequence":"additional","affiliation":[{"name":"Center for Research and Innovation in Systems Safety, Vanderbilt University Medical Center , Nashville, TN 37232, United States"},{"name":"Department of Anesthesiology, Vanderbilt University Medical Center , Nashville, TN 37232, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Janelle","family":"Faiman","sequence":"additional","affiliation":[{"name":"Center for Research and Innovation in Systems Safety, Vanderbilt University Medical Center , Nashville, TN 37232, United States"},{"name":"Department of Anesthesiology, Vanderbilt University Medical Center , Nashville, TN 37232, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vera","family":"Borkowski","sequence":"additional","affiliation":[{"name":"School of Nursing, Vanderbilt University , Nashville, TN 37240, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Russ","family":"Beebe","sequence":"additional","affiliation":[{"name":"Center for Research and Innovation in Systems Safety, Vanderbilt University Medical Center , Nashville, TN 37232, United States"},{"name":"Department of Anesthesiology, Vanderbilt University Medical Center , Nashville, TN 37232, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael E","family":"Matheny","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center , Nashville, TN 37203, United States"},{"name":"Tennessee Valley Healthcare System, United States Department of Veterans Affairs , Nashville, TN 37212, United States"},{"name":"Department of Biostatistics, Vanderbilt University Medical Center , Nashville, TN 37232, United States"},{"name":"Department of Medicine, Vanderbilt University Medical Center , Nashville, TN 37232, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shilo","family":"Anders","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center , Nashville, TN 37203, United States"},{"name":"Center for Research and Innovation in Systems Safety, Vanderbilt University Medical Center , Nashville, TN 37232, United States"},{"name":"Department of Anesthesiology, Vanderbilt University Medical Center , Nashville, TN 37232, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,10,31]]},"reference":[{"issue":"2","key":"2023122220304631000_ocad209-B1","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1093\/jamia\/ocw084","article-title":"Integrative review of clinical decision support for registered nurses in acute care settings","volume":"24","author":"Dunn Lopez","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2023122220304631000_ocad209-B2","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1093\/jamia\/ocx118","article-title":"Interface, information, interaction: a narrative review of design and functional requirements for clinical decision support","volume":"25","author":"Miller","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2023122220304631000_ocad209-B3","first-page":"257","article-title":"How usability of a web-based clinical decision support system has the potential to contribute to adverse medical events","volume":":","author":"Graham","year":"2008","journal-title":"AMIA Annu Symp Proc"},{"issue":"1","key":"2023122220304631000_ocad209-B4","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/s11606-008-0857-9","article-title":"Computerized provider order entry adoption: implications for clinical workflow","volume":"24","author":"Campbell","year":"2009","journal-title":"J Gen Intern Med"},{"issue":"7-8","key":"2023122220304631000_ocad209-B5","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1016\/j.ijmedinf.2005.01.003","article-title":"Technology induced error and usability: the relationship between usability problems and prescription errors when using a handheld application","volume":"74","author":"Kushniruk","year":"2005","journal-title":"Int J Med Inform"},{"issue":"2","key":"2023122220304631000_ocad209-B6","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1177\/1460458216631072","article-title":"An analysis of electronic health record-related patient safety incidents","volume":"23","author":"Palojoki","year":"2017","journal-title":"Health Informatics J"},{"key":"2023122220304631000_ocad209-B7","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.ijmedinf.2016.10.010","article-title":"Usability problems do not heal by themselves: national survey on physicians\u2019 experiences with EHRs in Finland","volume":"97","author":"Kaipio","year":"2017","journal-title":"Int J Med Inform"},{"issue":"8","key":"2023122220304631000_ocad209-B8","doi-asserted-by":"crossref","first-page":"e199609","DOI":"10.1001\/jamanetworkopen.2019.9609","article-title":"Association of electronic health record design and use factors with clinician stress and burnout","volume":"2","author":"Kroth","year":"2019","journal-title":"JAMA Netw Open"},{"issue":"5","key":"2023122220304631000_ocad209-B9","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1177\/0018720815576827","article-title":"Usability and safety in electronic medical records interface design: a review of recent literature and guideline formulation","volume":"57","author":"Zahabi","year":"2015","journal-title":"Hum Factors"},{"issue":"4","key":"2023122220304631000_ocad209-B10","doi-asserted-by":"crossref","first-page":"270","DOI":"10.7326\/M14-0295","article-title":"Evidence-based risk communication: a systematic review","volume":"161","author":"Zipkin","year":"2014","journal-title":"Ann Intern Med"},{"issue":"6","key":"2023122220304631000_ocad209-B11","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1197\/jamia.M2115","article-title":"Design features of graphs in health risk communication: a systematic review","volume":"13","author":"Ancker","year":"2006","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2023122220304631000_ocad209-B21","doi-asserted-by":"crossref","first-page":"1102","DOI":"10.1093\/jamia\/ocx060","article-title":"Participatory design of probability-based decision support tools for in-hospital nurses","volume":"24","author":"Jeffery","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2023122220304631000_ocad209-B12","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1037\/a0024850","article-title":"Numbers can be worth a thousand pictures: individual differences in understanding graphical and numerical representations of health-related information","volume":"31","author":"Gaissmaier","year":"2012","journal-title":"Health Psychol"},{"issue":"4","key":"2023122220304631000_ocad209-B13","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1002\/bdm.751","article-title":"Individual differences in graph literacy: overcoming denominator neglect in risk comprehension","volume":"25","author":"Okan","year":"2012","journal-title":"J Behav Decis Mak"},{"issue":"4","key":"2023122220304631000_ocad209-B14","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1055\/s-0039-1697592","article-title":"A systematic review of patient-facing visualizations of personal health data","volume":"10","author":"Turchioe","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"2","key":"2023122220304631000_ocad209-B15","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1097\/NCQ.0000000000000149","article-title":"Nurses\u2019 numeracy and graphical literacy: informing studies of clinical decision support interfaces","volume":"31","author":"Lopez","year":"2016","journal-title":"J Nurs Care Qual"},{"issue":"2","key":"2023122220304631000_ocad209-B16","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1093\/jamia\/ocx042","article-title":"The impact of home care nurses\u2019 numeracy and graph literacy on comprehension of visual display information: implications for dashboard design","volume":"25","author":"Dowding","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2023122220304631000_ocad209-B17","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1093\/jamia\/ocaa021","article-title":"How did you get to this number? Stakeholder needs for implementing predictive analytics: a pre-implementation qualitative study","volume":"27","author":"Benda","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2023122220304631000_ocad209-B18","doi-asserted-by":"crossref","first-page":"25","DOI":"10.3390\/informatics7030025","article-title":"Clinical implementation of predictive models embedded within electronic health record systems: a systematic review","volume":"7","author":"Lee","year":"2020","journal-title":"Informatics (MDPI)"},{"issue":"7","key":"2023122220304631000_ocad209-B19","doi-asserted-by":"crossref","first-page":"1148","DOI":"10.1377\/hlthaff.2014.0352","article-title":"Implementing electronic health care predictive analytics: considerations and challenges","volume":"33","author":"Amarasingham","year":"2014","journal-title":"Health Aff"},{"issue":"3","key":"2023122220304631000_ocad209-B20","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1136\/qshc.2007.023622","article-title":"The incidence and nature of in-hospital adverse events: a systematic review","volume":"17","author":"de Vries","year":"2008","journal-title":"Qual Saf Health Care"},{"key":"2023122220304631000_ocad209-B22","volume-title":"11th Colombian Computing Conference (CCC)","author":"Jimenez","year":"2016"},{"issue":"5","key":"2023122220304631000_ocad209-B23","doi-asserted-by":"crossref","first-page":"1582","DOI":"10.1007\/s11999-014-3966-2","article-title":"How prevalent are hazardous attitudes among orthopaedic surgeons?","volume":"473","author":"Bruinsma","year":"2015","journal-title":"Clin Orthop Relat Res"},{"issue":"1","key":"2023122220304631000_ocad209-B24","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1207\/s15327108ijap1501_2","article-title":"Measurement of hazardous attitudes among pilots","volume":"15","author":"Hunter","year":"2005","journal-title":"Int J Aviat Psychol"},{"issue":"5","key":"2023122220304631000_ocad209-B25","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1016\/j.ijmedinf.2008.10.002","article-title":"A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence","volume":"78","author":"Jaspers","year":"2009","journal-title":"Int J Med Inform"},{"key":"2023122220304631000_ocad209-B26","volume-title":"Health Information Technology Usability Evaluation: Methods, Models, and Measures [3420882]","author":"Yen","year":"2010"},{"issue":"e2","key":"2023122220304631000_ocad209-B27","doi-asserted-by":"crossref","first-page":"e241","DOI":"10.1136\/amiajnl-2013-001811","article-title":"Examining construct and predictive validity of the health-it usability evaluation scale: confirmatory factor analysis and structural equation modeling results","volume":"21","author":"Yen","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2023122220304631000_ocad209-B28","author":"Miami University of Ohio","year":"2004"},{"issue":"11","key":"2023122220304631000_ocad209-B29","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1016\/j.ijmedinf.2012.02.009","article-title":"Integrating usability testing and think-aloud protocol analysis with \u201cnear-live\u201d clinical simulations in evaluating clinical decision support","volume":"81","author":"Li","year":"2012","journal-title":"Int J Med Inform"},{"issue":"6","key":"2023122220304631000_ocad209-B30","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1080\/13548506.2013.766352","article-title":"The framing effect in medical decision-making: a review of the literature","volume":"18","author":"Gong","year":"2013","journal-title":"Psychol Health Med"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/1\/61\/54762158\/ocad209.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/1\/61\/54762158\/ocad209.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,22]],"date-time":"2023-12-22T20:31:29Z","timestamp":1703277089000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/1\/61\/7333907"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,31]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,10,31]]},"published-print":{"date-parts":[[2023,12,22]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad209","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,1,1]]},"published":{"date-parts":[[2023,10,31]]}}}