{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T00:34:45Z","timestamp":1772152485923,"version":"3.50.1"},"reference-count":27,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2020,10,26]],"date-time":"2020-10-26T00:00:00Z","timestamp":1603670400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,12,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Improving the patient experience has become an essential component of any healthcare system\u2019s performance metrics portfolio. In this study, we developed a machine learning model to predict a patient\u2019s response to the Hospital Consumer Assessment of Healthcare Providers and Systems survey\u2019s \u201cDoctor Communications\u201d domain questions while simultaneously identifying most impactful providers in a network.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>This is an observational study of patients admitted to a single tertiary care hospital between 2016 and 2020. Using machine learning algorithms, electronic health record data were used to predict patient responses to Hospital Consumer Assessment of Healthcare Providers and Systems survey questions in the doctor domain, and patients who are at risk for responding negatively were identified. Model performance was assessed by area under receiver-operating characteristic curve. Social network analysis metrics were also used to identify providers most impactful to patient experience.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Using a random forest algorithm, patients\u2019 responses to the following 3 questions were predicted: \u201cDuring this hospital stay how often did doctors. 1) treat you with courtesy and respect? 2) explain things in a way that you could understand? 3) listen carefully to you?\u201d with areas under the receiver-operating characteristic curve of 0.876, 0.819, and 0.819, respectively. Social network analysis found that doctors with higher centrality appear to have an outsized influence on patient experience, as measured by rank in the random forest model in the doctor domain.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>A machine learning algorithm identified patients at risk of a negative experience. Furthermore, a doctor social network framework provides metrics for identifying those providers that are most influential on the patient experience.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocaa194","type":"journal-article","created":{"date-parts":[[2020,8,4]],"date-time":"2020-08-04T11:29:34Z","timestamp":1596540574000},"page":"1834-1843","source":"Crossref","is-referenced-by-count":19,"title":["An approach to predicting patient experience through machine learning and social network analysis"],"prefix":"10.1093","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2806-5493","authenticated-orcid":false,"given":"Vitej","family":"Bari","sequence":"first","affiliation":[{"name":"Department of Information Services, Northwell Health, New Hyde Park, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jamie S","family":"Hirsch","sequence":"additional","affiliation":[{"name":"Department of Information Services, Northwell Health, New Hyde Park, New York, USA"},{"name":"Donald and Barbara Zucker School of Medicine at Hofstra\/Northwell, Hofstra University, Hempstead, New York, USA"},{"name":"Institute of Health Innovations and Outcomes Research, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joseph","family":"Narvaez","sequence":"additional","affiliation":[{"name":"Office of Patient and Customer Experience, Northwell Health, Lake Success, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert","family":"Sardinia","sequence":"additional","affiliation":[{"name":"Office of Patient and Customer Experience, Northwell Health, Lake Success, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kevin R","family":"Bock","sequence":"additional","affiliation":[{"name":"Department of Information Services, Northwell Health, New Hyde Park, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael I","family":"Oppenheim","sequence":"additional","affiliation":[{"name":"Department of Information Services, Northwell Health, New Hyde Park, New York, USA"},{"name":"Donald and Barbara Zucker School of Medicine at Hofstra\/Northwell, Hofstra University, Hempstead, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marsha","family":"Meytlis","sequence":"additional","affiliation":[{"name":"Department of Information Services, Northwell Health, New Hyde Park, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,10,26]]},"reference":[{"issue":"5","key":"2020121009244297700_ocaa194-B1","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1377\/hlthaff.2010.0238","article-title":"Analysis and commentary measuring patient experience as a strategy for improving primary care","volume":"29","author":"Browne","year":"2010","journal-title":"Health Aff (Millwood)"},{"issue":"1","key":"2020121009244297700_ocaa194-B2","doi-asserted-by":"crossref","first-page":"e001570","DOI":"10.1136\/bmjopen-2012-001570","article-title":"A systematic review of evidence on the links between patient experience and clinical safety and effectiveness","volume":"3","author":"Doyle","year":"2013","journal-title":"BMJ Open"},{"key":"2020121009244297700_ocaa194-B3","year":"2019"},{"issue":"CN_suppl_1","key":"2020121009244297700_ocaa194-B4","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1093\/neuros\/nyy106","article-title":"Correlation between Press Ganey scores and quality outcomes from the national neurosurgery quality and outcomes database (lumbar spine) for a hospital employed neurosurgical practice","volume":"65","author":"Olivero","year":"2018","journal-title":"Neurosurgery"},{"issue":"2","key":"2020121009244297700_ocaa194-B5","doi-asserted-by":"crossref","first-page":"N21","DOI":"10.1227\/01.neu.0000417536.07871.ed","article-title":"HCAHPS replaces Press Ganey survey as quality measure for patient hospital experience","volume":"71","author":"Zusman","year":"2012","journal-title":"Neurosurgery"},{"issue":"10","key":"2020121009244297700_ocaa194-B6","doi-asserted-by":"crossref","first-page":"1126","DOI":"10.1016\/j.amjmed.2005.01.060","article-title":"The relation of patient satisfaction with complaints against physicians and malpractice lawsuits","volume":"118","author":"Stelfox","year":"2005","journal-title":"Am J Med"},{"issue":"11","key":"2020121009244297700_ocaa194-B7","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1016\/j.spinee.2016.04.007","article-title":"Factors impacting Press Ganey patient satisfaction scores in orthopedic surgery spine clinic","volume":"16","author":"Etier","year":"2016","journal-title":"Spine J"},{"issue":"1","key":"2020121009244297700_ocaa194-B8","doi-asserted-by":"crossref","first-page":"3","DOI":"10.15171\/jept.2017.16","article-title":"Factors predicting patient satisfaction in the emergency department: a single-center study","volume":"4","author":"Younesian","year":"2017","journal-title":"J Emerg Pract Trauma"},{"issue":"4","key":"2020121009244297700_ocaa194-B9","first-page":"515","article-title":"Keys to patient satisfaction in the emergency department: results of a multiple facility study","volume":"41","author":"Hall","year":"1996","journal-title":"Hospital Health Serv Adm"},{"issue":"1","key":"2020121009244297700_ocaa194-B10","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1177\/1077558709339066","article-title":"Do hospitals rank differently on HCAHPS for different patient subgroups?","volume":"67","author":"Elliott","year":"2010","journal-title":"Med Care Res Rev"},{"issue":"9","key":"2020121009244297700_ocaa194-B11","first-page":"1423","article-title":"Effective physician-patient communication and health outcomes: a review","volume":"152","author":"Stewart","year":"1995","journal-title":"CMAJ"},{"issue":"11","key":"2020121009244297700_ocaa194-B12","doi-asserted-by":"crossref","first-page":"1403","DOI":"10.1001\/jama.288.11.1403","article-title":"Discontinuation of use and switching of antidepressants: influence of patient-physician communication","volume":"288","author":"Bull","year":"2002","journal-title":"JAMA"},{"issue":"1","key":"2020121009244297700_ocaa194-B13","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1176\/appi.ajp.158.1.29","article-title":"The patient-provider relationship: attachment theory and adherence to treatment in diabetes","volume":"158","author":"Ciechanowski","year":"2001","journal-title":"Am J Psychiary"},{"issue":"11","key":"2020121009244297700_ocaa194-B14","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1001\/jama.281.11.1037","article-title":"Perils, pitfalls, and possibilities in talking about medical risk","volume":"281","author":"Bogardus","year":"1991","journal-title":"JAMA"},{"issue":"1","key":"2020121009244297700_ocaa194-B15","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1177\/1077558709341065","article-title":"Development, implementation, and public reporting of the HCAHPS survey","volume":"67","author":"Giordano","year":"2010","journal-title":"Med Care Res Rev"},{"issue":"4","key":"2020121009244297700_ocaa194-B16","doi-asserted-by":"crossref","first-page":"631","DOI":"10.4300\/JGME-D-16-00182.1","article-title":"How residents say they learn: a national multi- specialty survey of first-and second-year residents","volume":"8","author":"Baldwin","year":"2016","journal-title":"J Grad Med Educ"},{"key":"2020121009244297700_ocaa194-B17","article-title":"Diffusion of knowledge and behaviors among trainee doctors in an acute medical unit and implications for quality improvement work: a mixed methods social network analysis","volume":"9","author":"Sullivan","year":"2019","journal-title":"BMJ"},{"key":"2020121009244297700_ocaa194-B18","first-page":"2825","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Fabian","year":"2011","journal-title":"J Mach Learn Res"},{"issue":"1","key":"2020121009244297700_ocaa194-B19","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach Learn"},{"key":"2020121009244297700_ocaa194-B20","volume-title":"Pattern Classification","author":"Duda","year":"2012"},{"issue":"S1","key":"2020121009244297700_ocaa194-B21","doi-asserted-by":"crossref","first-page":"S65","DOI":"10.1186\/1471-2105-10-S1-S65","article-title":"A random forest approach to the detection of epistatic interactions in case-control studies","volume":"10","author":"Jiang","year":"2009","journal-title":"BMC Bioinformatics"},{"issue":"7","key":"2020121009244297700_ocaa194-B22","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1016\/S0031-3203(96)00142-2","article-title":"The use of the area under the ROC curve in the evaluation of machine learning algorithms","volume":"30","author":"Bradley","year":"1997","journal-title":"Pattern Recogn"},{"issue":"3","key":"2020121009244297700_ocaa194-B23","doi-asserted-by":"crossref","first-page":"e0118432","DOI":"10.1371\/journal.pone.0118432","article-title":"The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets","volume":"10","author":"Saito","year":"2015","journal-title":"PLoS One"},{"issue":"10","key":"2020121009244297700_ocaa194-B24","doi-asserted-by":"crossref","first-page":"911","DOI":"10.1093\/jamia\/ocz022","article-title":"Data-driven modeling of diabetes care teams using social network analysis","volume":"26","author":"Ostovari","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2020121009244297700_ocaa194-B25","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1186\/s12913-016-1595-z","article-title":"Evidence of non-response bias in the Press-Ganey patient satisfaction survey","volume":"16","author":"Tyser","year":"2016","journal-title":"BMC Health Serv Res"},{"issue":"8","key":"2020121009244297700_ocaa194-B26","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1002\/jhm.2371","article-title":"Demographic factors and hospital size predict patient satisfaction variance\u2014implications for hospital value-based purchasing","volume":"10","author":"McFarland","year":"2015","journal-title":"J Hosp Med"},{"issue":"4","key":"2020121009244297700_ocaa194-B27","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1097\/HMR.0000000000000154","article-title":"Predicting HCAHPS scores from hospitals\u2019 social media pages: a sentiment analysis","volume":"43","author":"Huppertz","year":"2018","journal-title":"Health Care Manag Rev"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/12\/1834\/34838562\/ocaa194.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/12\/1834\/34838562\/ocaa194.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,12,10]],"date-time":"2020-12-10T14:41:13Z","timestamp":1607611273000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/12\/1834\/5940446"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,26]]},"references-count":27,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,10,26]]},"published-print":{"date-parts":[[2020,12,9]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa194","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,12]]},"published":{"date-parts":[[2020,10,26]]}}}