{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T00:27:07Z","timestamp":1781224027981,"version":"3.54.1"},"reference-count":40,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,8,25]],"date-time":"2021-08-25T00:00:00Z","timestamp":1629849600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Horizon 2020","award":["777090"],"award-info":[{"award-number":["777090"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>The field of patient-centred healthcare has, during recent years, adopted machine learning and data science techniques to support clinical decision making and improve patient outcomes. We conduct a literature review with the aim of summarising the existing methodologies that apply machine learning methods on patient-reported outcome measures datasets for predicting clinical outcomes to support further research and development within the field. We identify 15 articles published within the last decade that employ machine learning methods at various stages of exploiting datasets consisting of patient-reported outcome measures for predicting clinical outcomes, presenting promising research and demonstrating the utility of patient-reported outcome measures data for developmental research, personalised treatment and precision medicine with the help of machine learning-based decision-support systems. Furthermore, we identify and discuss the gaps and challenges, such as inconsistency in reporting the results across different articles, use of different evaluation metrics, legal aspects of using the data, and data unavailability, among others, which can potentially be addressed in future studies.<\/jats:p>","DOI":"10.3390\/informatics8030056","type":"journal-article","created":{"date-parts":[[2021,8,25]],"date-time":"2021-08-25T23:25:50Z","timestamp":1629933950000},"page":"56","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":45,"title":["Application of Machine Learning Methods on Patient Reported Outcome Measurements for Predicting Outcomes: A Literature Review"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0499-4853","authenticated-orcid":false,"given":"Deepika","family":"Verma","sequence":"first","affiliation":[{"name":"Department of Computer Science, Norwegian University of Science and Technology, 7034 Trondheim, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4256-7676","authenticated-orcid":false,"given":"Kerstin","family":"Bach","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Norwegian University of Science and Technology, 7034 Trondheim, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3355-2680","authenticated-orcid":false,"given":"Paul Jarle","family":"Mork","sequence":"additional","affiliation":[{"name":"Department of Public Health and Nursing, Norwegian University of Science and Technology, 7034 Trondheim, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1093\/bjaed\/mkw060","article-title":"Patient-reported outcome measures and patient-reported experience measures","volume":"17","author":"Kingsley","year":"2017","journal-title":"Bja Educ."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.jclinepi.2017.04.017","article-title":"Montreal Accord on Patient-Reported Outcomes (PROs) use series\u2014Paper 4: Patient-reported outcomes can inform clinical decision making in chronic care","volume":"89","author":"Noonan","year":"2017","journal-title":"J. Clin. Epidemiol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1056\/NEJMp1109283","article-title":"Shared decision making\u2014The pinnacle patient-centered care","volume":"366","author":"Barry","year":"2012","journal-title":"N. Engl. J. Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e21389","DOI":"10.1097\/MD.0000000000021389","article-title":"Interventions to facilitate shared decision-making using decision aids with patients in Primary Health Care: A systematic review","volume":"99","year":"2020","journal-title":"Medicine"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1018","DOI":"10.1177\/0272989X18801308","article-title":"Informed, Patient-Centered Decisions Associated with Better Health Outcomes in Orthopedics: Prospective Cohort Study","volume":"38","author":"Sepucha","year":"2018","journal-title":"Med. Decis. Mak."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"e0023","DOI":"10.2106\/JBJS.OA.16.00023","article-title":"A patient-focused technology-enabled program improves outcomes in primary total hip and knee replacement surgery","volume":"2","author":"Jayakumar","year":"2017","journal-title":"JBJS Open Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1177\/0840470417716470","article-title":"How health leaders can benefit from predictive analytics","volume":"Volume 30","author":"Giga","year":"2017","journal-title":"Healthcare Management Forum"},{"key":"ref_8","unstructured":"Pham, D.N., and Park, S.B. (2014). Predicting Procedure Duration to Improve Scheduling of Elective Surgery. PRICAI 2014: Trends in Artificial Intelligence, Springer International Publishing."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"287","DOI":"10.4066\/AMJ.2013.1652","article-title":"Using prediction to improve elective surgery scheduling","volume":"6","author":"Kargar","year":"2013","journal-title":"Australas. Med. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1007\/s10916-010-9486-z","article-title":"Prediction of surgery times and scheduling of operation theaters in optholmology department","volume":"36","author":"Devi","year":"2012","journal-title":"J. Med. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1093\/bja\/aex117","article-title":"Predicting postoperative morbidity in adult elective surgical patients using the Surgical Outcome Risk Tool (SORT)","volume":"119","author":"Wong","year":"2017","journal-title":"BJA Br. J. Anaesth."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1097\/ALN.0b013e3182a4e94d","article-title":"Risk stratification tools for predicting morbidity and mortality in adult patients undergoing major surgery: Qualitative systematic review","volume":"119","author":"Moonesinghe","year":"2013","journal-title":"Anesthesiology"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1111\/anae.13418","article-title":"Prediction of 30-day mortality after hip fracture surgery by the Nottingham Hip Fracture Score and the Surgical Outcome Risk Tool","volume":"71","author":"Marufu","year":"2016","journal-title":"Anaesthesia"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1723","DOI":"10.1038\/ajg.2013.332","article-title":"Machine learning algorithms outperform conventional regression models in predicting development of hepatocellular carcinoma","volume":"108","author":"Singal","year":"2013","journal-title":"Am. J. Gastroenterol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1627","DOI":"10.1002\/ejp.1782","article-title":"Self-reported prognostic factors in adults reporting neck or low back pain: An umbrella review","volume":"25","author":"Mansell","year":"2021","journal-title":"Eur. J. Pain"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.berh.2006.08.004","article-title":"Low back pain (non-specific)","volume":"21","author":"Krismer","year":"2007","journal-title":"Best Pract. Res. Clin. Rheumatol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"e44","DOI":"10.1038\/ctg.2013.19","article-title":"A primer on predictive models","volume":"5","author":"Waljee","year":"2014","journal-title":"Clin. Transl. Gastroenterol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.jad.2017.02.019","article-title":"Using the NANA toolkit at home to predict older adults\u2019 future depression","volume":"213","author":"Andrews","year":"2017","journal-title":"J. Affect. Disord."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wang, X., and Gottumukkala, V. (2020). Patient Reported Outcomes: Is this the Missing Link in Patient-centered Perioperative Care?. Best Pract. Res. Clin. Anaesthesiol.","DOI":"10.1016\/j.bpa.2020.10.006"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1056\/NEJMp1702978","article-title":"Patient-Reported Outcomes\u2014Are They Living Up to Their Potential?","volume":"377","author":"Baumhauer","year":"2017","journal-title":"N. Engl. J. Med."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1007\/s10549-012-2174-6","article-title":"Predicting two-year quality of life after breast cancer surgery using artificial neural network and linear regression models","volume":"135","author":"Shi","year":"2012","journal-title":"Breast Cancer Res. Treat."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Huber, M., Kurz, C., and Leidl, R. (2019). Predicting patient-reported outcomes following hip and knee replacement surgery using supervised machine learning. BMC Med. Inform. Decis. Mak., 19.","DOI":"10.1186\/s12911-018-0731-6"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3207","DOI":"10.1007\/s00167-019-05822-7","article-title":"Machine learning methods are comparable to logistic regression techniques in predicting severe walking limitation following total knee arthroplasty","volume":"28","author":"Pua","year":"2019","journal-title":"Knee Surg. Sport. Traumatol. Arthrosc."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1267","DOI":"10.1097\/CORR.0000000000000687","article-title":"Can machine learning algorithms predict which patients will achieve minimally clinically important differences from total joint arthroplasty?","volume":"477","author":"Fontana","year":"2019","journal-title":"Clin. Orthop. Relat. Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e290","DOI":"10.1016\/j.jse.2020.09.007","article-title":"Development of Supervised Machine Learning Algorithms for Prediction of Satisfaction at Two Years Following Total Shoulder Arthroplasty","volume":"30","author":"Polce","year":"2020","journal-title":"J. Shoulder Elb. Surg."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1097\/CORR.0000000000000601","article-title":"Can machine learning methods produce accurate and easy-to-use prediction models of 30-day complications and mortality after knee or hip arthroplasty?","volume":"477","author":"Harris","year":"2019","journal-title":"Clin. Orthop. Relat. Res."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1366","DOI":"10.1038\/mp.2015.198","article-title":"Testing a machine-learning algorithm to predict the persistence and severity of major depressive disorder from baseline self-reports","volume":"21","author":"Kessler","year":"2016","journal-title":"Mol. Psychiatry"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/S2215-0366(15)00471-X","article-title":"Cross-trial prediction of treatment outcome in depression: A machine learning approach","volume":"3","author":"Chekroud","year":"2016","journal-title":"Lancet Psychiatry"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1001\/jamapsychiatry.2017.0025","article-title":"Reevaluating the efficacy and predictability of antidepressant treatments: A symptom clustering approach","volume":"74","author":"Chekroud","year":"2017","journal-title":"JAMA Psychiatry"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e12001","DOI":"10.2196\/12001","article-title":"Defining and predicting pain volatility in users of the Manage My Pain app: Analysis using data mining and machine learning methods","volume":"20","author":"Rahman","year":"2018","journal-title":"J. Med. Internet Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"e15601","DOI":"10.2196\/15601","article-title":"Interpretability and class imbalance in prediction models for pain volatility in manage my pain app users: Analysis using feature selection and majority voting methods","volume":"7","author":"Rahman","year":"2019","journal-title":"JMIR Med. Inform."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.ijmedinf.2017.11.010","article-title":"Evaluation of Three Machine Learning Models for Self-Referral Decision Support on Low Back Pain in Primary Care","volume":"110","author":"Poel","year":"2018","journal-title":"Int. J. Med. Inform."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2865","DOI":"10.1007\/s11606-020-05982-0","article-title":"Impact of Instrumental Activities of Daily Living Limitations on Hospital Readmission: An Observational Study Using Machine Learning","volume":"35","author":"Schiltz","year":"2020","journal-title":"J. Gen. Intern. Med."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1177\/2380084419885612","article-title":"Developing Children\u2019s Oral Health Assessment Toolkits Using Machine Learning Algorithm","volume":"5","author":"Wang","year":"2020","journal-title":"JDR Clin. Transl. Res."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy function approximation: A gradient boosting machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Ann. Stat."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1016\/S0895-4356(03)00207-5","article-title":"External validation is necessary in prediction research:: A clinical example","volume":"56","author":"Bleeker","year":"2003","journal-title":"J. Clin. Epidemiol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.jclinepi.2015.04.005","article-title":"Prediction models need appropriate internal, internal-external, and external validation","volume":"69","author":"Steyerberg","year":"2016","journal-title":"J. Clin. Epidemiol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1097\/SHK.0000000000001253","article-title":"Association of sex with clinical outcome in critically ill sepsis patients: A retrospective analysis of the large clinical database MIMIC-III","volume":"52","author":"Xu","year":"2019","journal-title":"Shock"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wang, S., McDermott, M.B., Chauhan, G., Ghassemi, M., Hughes, M.C., and Naumann, T. (2020, January 2\u20134). Mimic-extract: A data extraction, preprocessing, and representation pipeline for mimic-iii. Proceedings of the ACM Conference on Health, Inference, and Learning, Toronto, ON, Canada.","DOI":"10.1145\/3368555.3384469"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1007\/s00134-018-5208-7","article-title":"Transthoracic echocardiography and mortality in sepsis: Analysis of the MIMIC-III database","volume":"44","author":"Feng","year":"2018","journal-title":"Intensive Care Med."}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/8\/3\/56\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:51:23Z","timestamp":1760165483000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/8\/3\/56"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,25]]},"references-count":40,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["informatics8030056"],"URL":"https:\/\/doi.org\/10.3390\/informatics8030056","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,25]]}}}