{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T00:06:04Z","timestamp":1773014764744,"version":"3.50.1"},"reference-count":31,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2020,3,6]],"date-time":"2020-03-06T00:00:00Z","timestamp":1583452800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100006093","name":"Patient Centered Outcomes Research Institute","doi-asserted-by":"crossref","award":["HSB-1604-35187"],"award-info":[{"award-number":["HSB-1604-35187"]}],"id":[{"id":"10.13039\/100006093","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,5,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>Predictive analytics are potentially powerful tools, but to improve healthcare delivery, they must be carefully integrated into healthcare organizations. Our objective was to identify facilitators, challenges, and recommendations for implementing a novel predictive algorithm which aims to prospectively identify patients with high preventable utilization to proactively involve them in preventative interventions.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and Methods<\/jats:title><jats:p>In preparation for implementing the predictive algorithm in 3 organizations, we interviewed 3 stakeholder groups: health systems operations (eg, chief medical officers, department chairs), informatics personnel, and potential end users (eg, physicians, nurses, social workers). We applied thematic analysis to derive key themes and categorize them into the dimensions of Sittig and Singh\u2019s original sociotechnical model for studying health information technology in complex adaptive healthcare systems. Recruiting and analysis were conducted iteratively until thematic saturation was achieved.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Forty-nine interviews were conducted in 3 healthcare organizations. Technical components of the implementation (hardware and software) raised fewer concerns than alignment with sociotechnical factors. Stakeholders wanted decision support based on the algorithm to be clear and actionable and incorporated into current workflows. However, how to make this disease-independent classification tool actionable was perceived as a challenge, and appropriate patient interventions informed by the algorithm appeared likely to require substantial external and institutional resources. Stakeholders also described the criticality of trust, credibility, and interpretability of the predictive algorithm.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Although predictive analytics can classify patients with high accuracy, they cannot advance healthcare processes and outcomes without careful implementation that takes into account the sociotechnical system. Key stakeholders have strong perceptions about facilitators and challenges to shape successful implementation.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocaa021","type":"journal-article","created":{"date-parts":[[2020,2,25]],"date-time":"2020-02-25T20:15:26Z","timestamp":1582661726000},"page":"709-716","source":"Crossref","is-referenced-by-count":43,"title":["\u201cHow did you get to this number?\u201d Stakeholder needs for implementing predictive analytics: a pre-implementation qualitative study"],"prefix":"10.1093","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3256-0243","authenticated-orcid":false,"given":"Natalie C","family":"Benda","sequence":"first","affiliation":[{"name":"Department of Healthcare Policy & Research, Weill Cornell Medicine, New York, NY, USA"}]},{"given":"Lala Tanmoy","family":"Das","sequence":"additional","affiliation":[{"name":"Weill Cornell\/Rockefeller\/Sloan Kettering Tri-Institutional MD-PhD Program, New York, NY, USA"}]},{"given":"Erika L","family":"Abramson","sequence":"additional","affiliation":[{"name":"Department of Healthcare Policy & Research, Weill Cornell Medicine, New York, NY, USA"},{"name":"Department of Pediatrics, Weill Cornell Medicine, New York, NY, USA"}]},{"given":"Katherine","family":"Blackburn","sequence":"additional","affiliation":[{"name":"Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, FL, USA"}]},{"given":"Amy","family":"Thoman","sequence":"additional","affiliation":[{"name":"Department of Healthcare Policy & Research, Weill Cornell Medicine, New York, NY, USA"}]},{"given":"Rainu","family":"Kaushal","sequence":"additional","affiliation":[{"name":"Department of Healthcare Policy & Research, Weill Cornell Medicine, New York, NY, USA"},{"name":"Department of Pediatrics, Weill Cornell Medicine, New York, NY, USA"}]},{"given":"Yongkang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Healthcare Policy & Research, Weill Cornell Medicine, New York, NY, USA"}]},{"given":"Jessica S","family":"Ancker","sequence":"additional","affiliation":[{"name":"Department of Healthcare Policy & Research, Weill Cornell Medicine, New York, NY, USA"}]}],"member":"286","published-online":{"date-parts":[[2020,3,6]]},"reference":[{"key":"2020110613091518100_ocaa021-B1","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1038\/s41746-018-0029-1","article-title":"Scalable and accurate deep learning with electronic health records","volume":"1","author":"Rajkomar","year":"2018","journal-title":"NPJ Digit Med"},{"issue":"5","key":"2020110613091518100_ocaa021-B2","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1016\/j.annemergmed.2017.08.005","article-title":"Machine-learning-based electronic triage more accurately differentiates patients with respect to clinical outcomes compared with the emergency severity index","volume":"71","author":"Levin","year":"2018","journal-title":"Ann Emerg Med"},{"issue":"7","key":"2020110613091518100_ocaa021-B3","first-page":"1","article-title":"A targeted real-time early warning score (TREWScore) for septic shock","volume":"299","author":"Henry","year":"2015","journal-title":"Sci Transl Med"},{"issue":"1","key":"2020110613091518100_ocaa021-B4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10916-017-0858-5","article-title":"Effect of a real-time electronic dashboard on a rapid response system","volume":"42","author":"Fletcher","year":"2018","journal-title":"J Med Syst"},{"issue":"7","key":"2020110613091518100_ocaa021-B5","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1377\/hlthaff.2014.0041","article-title":"Big data in health care: using analytics to identify and manage high-risk and high-cost patients","volume":"33","author":"Bates","year":"2014","journal-title":"Health Aff"},{"issue":"10","key":"2020110613091518100_ocaa021-B6","doi-asserted-by":"crossref","first-page":"706","DOI":"10.7326\/M17-0767","article-title":"Concentration of potentially preventable spending among high-cost Medicare subpopulations: an observational study","volume":"167","author":"Figueroa","year":"2017","journal-title":"Ann Intern Med"},{"key":"2020110613091518100_ocaa021-B7","author":"Sl"},{"key":"2020110613091518100_ocaa021-B8","year":"2014"},{"issue":"10","key":"2020110613091518100_ocaa021-B9","doi-asserted-by":"crossref","first-page":"909","DOI":"10.1056\/NEJMp1608511","article-title":"Caring for high-need, high-cost patients\u2014an urgent priority","volume":"375","author":"Blumenthal","year":"2016","journal-title":"N Engl J Med"},{"key":"2020110613091518100_ocaa021-B10","author":"Zhang","year":"2020"},{"key":"2020110613091518100_ocaa021-B11","author":"Goins","year":"2019"},{"key":"2020110613091518100_ocaa021-B12","year":"2019"},{"issue":"6","key":"2020110613091518100_ocaa021-B13","first-page":"306","article-title":"Comparing aging in place to home health care: Impact of nurse care coordination on utilization and costs","volume":"33","author":"Popejoy","year":"2015","journal-title":"Nurs Econ"},{"issue":"5","key":"2020110613091518100_ocaa021-B14","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1089\/pop.2014.0131","article-title":"Transformation of care: integrating the registered nurse care coordinator into the patient-centered medical home","volume":"18","author":"Biernacki","year":"2015","journal-title":"Popul Health Manag"},{"issue":"6","key":"2020110613091518100_ocaa021-B15","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1001\/jamainternmed.2018.0823","article-title":"Approach for achieving effective care for high-need patients","volume":"178","author":"Figueroa","year":"2018","journal-title":"JAMA Intern Med"},{"key":"2020110613091518100_ocaa021-B16","doi-asserted-by":"crossref","DOI":"10.17226\/27115","volume-title":"Effective Care for High-Need Patients","author":"Long","year":"2017"},{"issue":"14","key":"2020110613091518100_ocaa021-B17","doi-asserted-by":"crossref","first-page":"1351","DOI":"10.1001\/jama.2019.10306","article-title":"Making machine learning models clinically useful","volume":"322","author":"Shah","year":"2019","journal-title":"JAMA"},{"key":"2020110613091518100_ocaa021-B18","doi-asserted-by":"crossref","DOI":"10.4324\/9781498757461","volume-title":"Improving Outcomes with Clinical Decision-Support: An Implementer\u2019s Guide","author":"Osheroff","year":"2012"},{"key":"2020110613091518100_ocaa021-B19","author":"Levy-Fix","year":"2019"},{"issue":"6","key":"2020110613091518100_ocaa021-B20","doi-asserted-by":"crossref","first-page":"1102","DOI":"10.1093\/jamia\/ocx060","article-title":"Participatory design of probability-based decision support tools for in-hospital nurses","volume":"24","author":"Jeffery","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"2020110613091518100_ocaa021-B21","doi-asserted-by":"crossref","first-page":"1148","DOI":"10.1377\/hlthaff.2014.0352","article-title":"Implementing electronic health care predictive analytics: considerations and challenges","volume":"33","author":"Amarasingham","year":"2014","journal-title":"Health Aff (Millwood)"},{"issue":"4","key":"2020110613091518100_ocaa021-B22","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1080\/13645570701401305","article-title":"Sampling knowledge: The Hermeneutics of snowball sampling in qualitative research","volume":"11","author":"Noy","year":"2008","journal-title":"Int J Soc Res Methodol"},{"key":"2020110613091518100_ocaa021-B23","doi-asserted-by":"crossref","first-page":"i68","DOI":"10.1136\/qshc.2010.042085","article-title":"A new sociotechnical model for studying health information technology in complex adaptive healthcare systems","volume":"19 (Suppl 3","author":"Sittig","year":"2010","journal-title":"Qual Saf Health Care"},{"key":"2020110613091518100_ocaa021-B24","volume-title":"Basics of Qualitative Research","author":"Strauss","year":"2015"},{"key":"2020110613091518100_ocaa021-B25","author":"Saldana","year":"2015"},{"key":"2020110613091518100_ocaa021-B26","volume-title":"Qualitative Data Analysis: A Methods Sourcebook","author":"Miles","year":"2014","edition":"3rd ed"},{"key":"2020110613091518100_ocaa021-B27","volume-title":"Diffusion of Innovations","author":"Rogers","year":"2010"},{"issue":"4","key":"2020110613091518100_ocaa021-B28","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1177\/001872088803000404","article-title":"Cognitive engineering: human problem solving with tools","volume":"30","author":"Woods","year":"1988","journal-title":"Human Factors"},{"key":"2020110613091518100_ocaa021-B29","first-page":"1","article-title":"Human factors design in the clinical environment: development and assessment of an interface for visualizing emergency medicine clinician workload","author":"Benda","year":"2018","journal-title":"IISE Trans Occup Ergon Human Fact"},{"key":"2020110613091518100_ocaa021-B30","author":"Khullar","year":"2019"},{"key":"2020110613091518100_ocaa021-B31","year":"2020"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/5\/709\/34152712\/ocaa021.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/5\/709\/34152712\/ocaa021.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T16:38:49Z","timestamp":1695832729000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/5\/709\/5803107"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,6]]},"references-count":31,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2020,3,6]]},"published-print":{"date-parts":[[2020,5,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa021","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,5]]},"published":{"date-parts":[[2020,3,6]]}}}