{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T17:45:45Z","timestamp":1789753545271,"version":"4.0.1"},"reference-count":109,"publisher":"American Society of Clinical Oncology (ASCO)","issue":"7","content-domain":{"domain":["ascopubs.org"],"crossmark-restriction":true},"short-container-title":["JCO Clinical Cancer Informatics"],"published-print":{"date-parts":[[2023,9]]},"abstract":"<jats:sec>\n                    <jats:title>PURPOSE<\/jats:title>\n                    <jats:p>This discussion paper outlines challenges and proposes solutions for successfully implementing prediction models that incorporate patient-reported outcomes (PROs) in cancer practice.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>METHODS<\/jats:title>\n                    <jats:p>We organized a full-day multidisciplinary meeting of people with expertise in cancer care delivery, PRO collection, PRO use in prediction modeling, computing, implementation, and decision science. The discussions presented here focused on identifying challenges to the development, implementation and use of prediction models incorporating PROs, and suggesting possible solutions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>RESULTS<\/jats:title>\n                    <jats:p>Specific challenges and solutions were identified across three broad areas. (1) Understanding decision making and implementation: necessitating multidisciplinary collaboration in the early stages and throughout; early stakeholder engagement to define the decision problem and ensure acceptability of PROs in prediction; understanding patient\/clinician interpretation of PRO predictions and uncertainty to optimize prediction impact; striving for model integration into existing electronic health records; and early regulatory alignment. (2) Recognizing the limitations to PRO collection and their impact on prediction: incorporating validated, clinically important PROs to maximize model generalizability and clinical engagement; and minimizing missing PRO data (resulting from both structural digital exclusion and time-varying factors) to avoid exacerbating existing inequalities. (3) Statistical and modeling challenges: incorporating statistical methods to address missing data; ensuring predictive modeling recognizes complex causal relationships; and considering temporal and geographic recalibration so that model predictions reflect the relevant population.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>CONCLUSION<\/jats:title>\n                    <jats:p>Developing and implementing PRO-based prediction models in cancer care requires extensive multidisciplinary working from the earliest stages, recognition of implementation challenges because of PRO collection and model presentation, and robust statistical methods to manage missing data, causality, and calibration. Prediction models incorporating PROs should be viewed as complex interventions, with their development and impact assessment carried out to reflect this.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1200\/cci.23.00070","type":"journal-article","created":{"date-parts":[[2023,11,17]],"date-time":"2023-11-17T15:59:52Z","timestamp":1700236792000},"update-policy":"https:\/\/doi.org\/10.1200\/crossmark","source":"Crossref","is-referenced-by-count":13,"title":["Fixing the Leaky Pipe: How to Improve the Uptake of Patient-Reported Outcomes\u2013Based Prognostic and Predictive Models in Cancer Clinical Practice"],"prefix":"10.1200","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6846-4341","authenticated-orcid":false,"given":"Katie L.","family":"Spencer","sequence":"first","affiliation":[{"name":"Leeds Institute of Health Sciences, University of Leeds, Leeds, United Kingdom"},{"name":"Leeds Cancer Centre, Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5477-6643","authenticated-orcid":false,"given":"Kate L.","family":"Absolom","sequence":"additional","affiliation":[{"name":"Leeds Institute of Health Sciences, University of Leeds, Leeds, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7399-0194","authenticated-orcid":false,"given":"Matthew J.","family":"Allsop","sequence":"additional","affiliation":[{"name":"Leeds Institute of Health Sciences, University of Leeds, Leeds, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samuel D.","family":"Relton","sequence":"additional","affiliation":[{"name":"Leeds Institute of Data Analytics, University of Leeds, Leeds, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6553-2652","authenticated-orcid":false,"given":"Jessica","family":"Pearce","sequence":"additional","affiliation":[{"name":"Leeds Cancer Centre, Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom"},{"name":"Leeds Institute of Medical Research, University of Leeds, Leeds, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8840-0599","authenticated-orcid":false,"given":"Kuan","family":"Liao","sequence":"additional","affiliation":[{"name":"Division of Informatics, Imaging and Data Sciences, Faculty of Biology, Medicine and Health, Centre for Health Informatics, Manchester Academic Health Science Centre, The University of Manchester, Manchester, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8812-8417","authenticated-orcid":false,"given":"Sairah","family":"Naseer","sequence":"additional","affiliation":[{"name":"School of Medicine, University of Leeds, Leeds, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3165-8879","authenticated-orcid":false,"given":"Omolola","family":"Salako","sequence":"additional","affiliation":[{"name":"College of Medicine, University of Lagos, Lagos, Nigeria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8052-2893","authenticated-orcid":false,"given":"Daniel","family":"Howdon","sequence":"additional","affiliation":[{"name":"Leeds Institute of Health Sciences, University of Leeds, Leeds, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jenny","family":"Hewison","sequence":"additional","affiliation":[{"name":"Leeds Institute of Health Sciences, University of Leeds, Leeds, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1899-5942","authenticated-orcid":false,"given":"Galina","family":"Velikova","sequence":"additional","affiliation":[{"name":"Leeds Cancer Centre, Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom"},{"name":"Leeds Institute of Medical Research, University of Leeds, Leeds, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5617-9781","authenticated-orcid":false,"given":"Corinne","family":"Faivre-Finn","sequence":"additional","affiliation":[{"name":"Institute of Cancer Sciences, University of Manchester, Manchester, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1978-5795","authenticated-orcid":false,"given":"Hilary L.","family":"Bekker","sequence":"additional","affiliation":[{"name":"Leeds Institute of Health Sciences, University of Leeds, Leeds, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sabine N.","family":"van der Veer","sequence":"additional","affiliation":[{"name":"Division of Informatics, Imaging and Data Sciences, Faculty of Biology, Medicine and Health, Centre for Health Informatics, Manchester Academic Health Science Centre, The University of Manchester, Manchester, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"233","reference":[{"key":"b1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(04)17670-8"},{"key":"b2","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocac002"},{"key":"b3","doi-asserted-by":"publisher","DOI":"10.1002\/pon.3283"},{"key":"b4","doi-asserted-by":"publisher","DOI":"10.1001\/jama.279.21.1709"},{"key":"b5","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2010.32.4459"},{"key":"b6","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2003.03.059"},{"key":"b7","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(16)30383-7"},{"key":"b8","doi-asserted-by":"publisher","DOI":"10.1093\/annonc\/mds341"},{"key":"b9","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0161407"},{"key":"b10","doi-asserted-by":"publisher","DOI":"10.1177\/0269216308098799"},{"key":"b13","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpainsymman.2016.12.330"},{"key":"b14","doi-asserted-by":"publisher","DOI":"10.1093\/annonc\/mdl343"},{"key":"b15","doi-asserted-by":"publisher","DOI":"10.1111\/1754-9485.13185"},{"key":"b16","doi-asserted-by":"publisher","DOI":"10.1016\/j.clon.2021.11.022"},{"key":"b17","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1001381"},{"key":"b18","doi-asserted-by":"publisher","DOI":"10.1002\/hed.25075"},{"key":"b19","doi-asserted-by":"publisher","DOI":"10.1016\/j.ctrv.2018.02.003"},{"key":"b20","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(19)30177-9"},{"key":"b21","doi-asserted-by":"publisher","DOI":"10.1007\/s00586-017-5320-3"},{"key":"b22","doi-asserted-by":"publisher","DOI":"10.1016\/j.clon.2020.06.016"},{"key":"b23","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2011.34.7625"},{"key":"b24","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2015.65.4327"},{"key":"b25","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2018.78.8687"},{"key":"b26","doi-asserted-by":"publisher","DOI":"10.1046\/j.1532-5415.2001.49281.x"},{"key":"b27","doi-asserted-by":"publisher","DOI":"10.1093\/annonc\/mdr587"},{"key":"b28","doi-asserted-by":"publisher","DOI":"10.1016\/j.jgo.2019.04.016"},{"key":"b29","doi-asserted-by":"publisher","DOI":"10.1016\/j.jgo.2019.08.011"},{"key":"b30","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(06)70910-X"},{"key":"b31","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2015.63.0830"},{"key":"b32","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2018.18085"},{"key":"b33","doi-asserted-by":"publisher","DOI":"10.1016\/j.annonc.2022.04.007"},{"key":"b35","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.20.02015"},{"key":"b36","doi-asserted-by":"publisher","DOI":"10.1007\/s00520-017-3865-7"},{"key":"b37","doi-asserted-by":"publisher","DOI":"10.1016\/j.critrevonc.2012.02.011"},{"key":"b38","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(09)70200-1"},{"key":"b39","doi-asserted-by":"publisher","DOI":"10.1186\/s12885-022-10151-z"},{"key":"b40","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(19)30656-4"},{"key":"b41","first-page":"137","volume":"37","author":"Howdon D","year":"2022","journal-title":"Clin Transl Radiat Oncol"},{"key":"b43","doi-asserted-by":"publisher","DOI":"10.1183\/13993003.00250-2022"},{"key":"b44","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780199546275.003.0007"},{"key":"b45","unstructured":"Von Neumann J, Morgenstern O: Theory of Games and Economic Behavior (ed 2 rev). Princeton, NJ, Princeton University Press, 1947, p xviii, 641"},{"key":"b46","unstructured":"Klein GA: Decision Making in Action: Models and Methods. Norwood, NJ, Ablex Pub, 1993, p 480"},{"key":"b47","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.3960030404"},{"key":"b48","volume-title":"Decision Analysis and Behavioral Research","author":"Von Winterfeldt D","year":"1993"},{"key":"b49","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2022-064067"},{"key":"b50","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6947-11-62"},{"key":"b51","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.n2061"},{"key":"b52","doi-asserted-by":"publisher","DOI":"10.1186\/s41512-018-0033-6"},{"key":"b53","doi-asserted-by":"publisher","DOI":"10.1200\/CCI.21.00137"},{"key":"b54","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooz001"},{"key":"b55","doi-asserted-by":"publisher","DOI":"10.1093\/annonc\/mdx317"},{"key":"b56","doi-asserted-by":"publisher","DOI":"10.3390\/informatics7030025"},{"key":"b57","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2012-001484"},{"key":"b58","doi-asserted-by":"publisher","DOI":"10.2196\/26381"},{"key":"b59","first-page":"634","volume":"264","author":"Kabukye JK","year":"2019","journal-title":"Stud Health Technol Inform"},{"key":"b60","doi-asserted-by":"publisher","DOI":"10.1007\/s00520-021-06545-7"},{"key":"b61","doi-asserted-by":"publisher","DOI":"10.1186\/1477-7525-8-10"},{"key":"b62","doi-asserted-by":"publisher","DOI":"10.1016\/j.hlpt.2022.100608"},{"key":"b63","doi-asserted-by":"publisher","DOI":"10.1016\/j.esmoop.2021.100292"},{"key":"b64","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2021.104659"},{"key":"b65","doi-asserted-by":"publisher","DOI":"10.1634\/theoncologist.2019-0057"},{"key":"b66","doi-asserted-by":"publisher","DOI":"10.1136\/bmjgh-2020-002475"},{"key":"b67","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocab127"},{"key":"b71","doi-asserted-by":"publisher","DOI":"10.3310\/hta25280"},{"key":"b73","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-021-00549-7"},{"key":"b74","doi-asserted-by":"publisher","DOI":"10.1002\/jmrs.421"},{"key":"b75","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6963-13-211"},{"key":"b76","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.3741"},{"key":"b77","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpainsymman.2021.07.032"},{"key":"b78","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000146"},{"key":"b79","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2005.04.275"},{"key":"b80","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocab138"},{"key":"b81","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2023.41.16_suppl.e13689"},{"key":"b82","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0195447"},{"key":"b84","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2012.47.6804"},{"key":"b85","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2016.03.032"},{"key":"b86","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2015-010938"},{"key":"b87","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-022-33826-4"},{"key":"b88","doi-asserted-by":"publisher","DOI":"10.1081\/CNV-120005928"},{"key":"b89","doi-asserted-by":"publisher","DOI":"10.1007\/s11136-011-0054-x"},{"key":"b90","doi-asserted-by":"publisher","DOI":"10.1186\/s41687-022-00457-8"},{"key":"b91","doi-asserted-by":"publisher","DOI":"10.1002\/hec.3173"},{"key":"b92","doi-asserted-by":"publisher","DOI":"10.1007\/s00403-022-02479-0"},{"key":"b93","doi-asserted-by":"publisher","DOI":"10.1016\/j.critrevonc.2022.103867"},{"key":"b94","doi-asserted-by":"publisher","DOI":"10.1186\/s12885-021-09157-w"},{"key":"b96","doi-asserted-by":"publisher","DOI":"10.1093\/annonc\/mdv181"},{"key":"b97","doi-asserted-by":"publisher","DOI":"10.1111\/j.1524-4733.2007.00292.x"},{"key":"b98","doi-asserted-by":"publisher","DOI":"10.1111\/sms.13854"},{"key":"b99","doi-asserted-by":"publisher","DOI":"10.7326\/M18-1376"},{"key":"b100","doi-asserted-by":"publisher","DOI":"10.1016\/j.eururo.2014.11.025"},{"key":"b101","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2020-048008"},{"key":"b102","doi-asserted-by":"publisher","DOI":"10.1177\/0962280210395740"},{"key":"b103","doi-asserted-by":"publisher","DOI":"10.1111\/j.1541-0420.2011.01666.x"},{"key":"b104","doi-asserted-by":"publisher","DOI":"10.1007\/s10654-020-00636-1"},{"key":"b105","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.b2393"},{"key":"b106","doi-asserted-by":"publisher","DOI":"10.7326\/M22-0844"},{"key":"b107","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-018-0542-6"},{"key":"b108","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2011.06.003"},{"key":"b109","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejca.2005.06.022"},{"key":"b110","doi-asserted-by":"publisher","DOI":"10.1016\/j.eururo.2018.08.038"},{"key":"b111","first-page":"625","volume":"2017","author":"Davis SE","year":"2017","journal-title":"AMIA Annu Symp Proc"},{"key":"b112","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1080\/07350015.1988.10509640","volume":"6","author":"Alwan LC","year":"1988","journal-title":"J Bus Econ Stat"},{"key":"b113","doi-asserted-by":"publisher","DOI":"10.1186\/s41512-020-00090-3"},{"key":"b114","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.i3140"},{"key":"b115","doi-asserted-by":"publisher","DOI":"10.1007\/s00134-013-3202-7"},{"key":"b116","doi-asserted-by":"publisher","DOI":"10.1016\/S2589-7500(20)30186-2"},{"key":"b117","doi-asserted-by":"publisher","DOI":"10.1038\/s41588-019-0379-x"},{"key":"b118","doi-asserted-by":"publisher","DOI":"10.1198\/016214501753168154"},{"key":"b119","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2016.03.017"}],"container-title":["JCO Clinical Cancer Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ascopubs.org\/doi\/pdfdirect\/10.1200\/CCI.23.00070","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,2]],"date-time":"2024-11-02T01:17:23Z","timestamp":1730510243000},"score":1,"resource":{"primary":{"URL":"https:\/\/ascopubs.org\/doi\/10.1200\/CCI.23.00070"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9]]},"references-count":109,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2023,9]]}},"alternative-id":["10.1200\/CCI.23.00070"],"URL":"https:\/\/doi.org\/10.1200\/cci.23.00070","relation":{},"ISSN":["2473-4276"],"issn-type":[{"value":"2473-4276","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9]]},"assertion":[{"value":"2023-04-24","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-08","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-29","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-11-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2300070"}}