{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,15]],"date-time":"2025-08-15T00:59:27Z","timestamp":1755219567955,"version":"3.43.0"},"reference-count":52,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T00:00:00Z","timestamp":1754524800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Digit. Health"],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Childhood cancer survivors have a higher risk of mental health and adaptive problems compared with their siblings, for example. Assessing the need for psychosocial support is essential for prevention. This project aims to investigate the use of supervised machine learning in the form of text classification in identifying childhood cancer patients needing psychosocial support from nursing notes when at least 1\u2005year had passed from their cancer diagnosis.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We evaluated three well-known machine learning\u2013based models to recognize patients who had outpatient clinic reservations in the mental health\u2013related care units from free-text nursing notes of 1,672 patients. For model training, the patients were children diagnosed with diabetes mellitus or cancer, while evaluation of the model was done on the patients diagnosed with cancer. A stratified fivefold nested cross-validation was used. We designed this as a binary classification task, with the following labels: no support (0) or psychosocial support (1) was needed. Patients with the latter label were identified by having an outpatient appointment reservation in a mental health\u2013related care unit at least 1\u2005year after their primary diagnosis.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The random forest classification model trained on both cancer and diabetes patients performed best for the cancer patient population in three-times repeated nested cross-validation with 0.798 mean area under the receiver operating characteristics curve and was better with 99% probability (credibility interval \u22120.2840 to \u22120.0422) than the neural network\u2013based model using only cancer patients in training when comparing all classifiers pairwise by using the Bayesian correlated t-test.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Using machine learning to predict childhood cancer patients needing psychosocial support was possible using nursing notes with a good area under the receiver operating characteristics curve. The reported experiment indicates that machine learning may assist in identifying patients likely to need mental health\u2013related support later in life.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fdgth.2025.1585309","type":"journal-article","created":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T05:29:41Z","timestamp":1754544581000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Supervised machine learning applied in nursing notes for identifying the need of childhood cancer patients for psychosocial support"],"prefix":"10.3389","volume":"7","author":[{"given":"Akseli","family":"Reunamo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hans","family":"Moen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sanna","family":"Salanter\u00e4","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"P\u00e4ivi M.","family":"L\u00e4hteenm\u00e4ki","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2025,8,7]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1182","DOI":"10.1126\/science.aaw4892","article-title":"Science and health for all children with cancer","volume":"363","author":"Lam","year":"2019","journal-title":"Science"},{"key":"B2","doi-asserted-by":"publisher","first-page":"1546","DOI":"10.1016\/S1470-2045(18)30657-0","article-title":"Long-term follow-up care needed for children surviving cancer: still a long way to go","volume":"19","author":"Winther","year":"2018","journal-title":"Lancet Oncol"},{"key":"B3","doi-asserted-by":"publisher","first-page":"S419","DOI":"10.1002\/pbc.25675","article-title":"Standards for the psychosocial care of children with cancer and their families: an introduction to the special issue","volume":"62","author":"Wiener","year":"2015","journal-title":"Pediatr Blood Cancer"},{"key":"B4","doi-asserted-by":"publisher","first-page":"4","DOI":"10.5334\/ijic.3046","article-title":"Cancer survivorship care: person centered care in a multidisciplinary shared care model","volume":"18","author":"Loonen","year":"2018","journal-title":"Int J Integr Care"},{"key":"B5","doi-asserted-by":"publisher","first-page":"2754","DOI":"10.1002\/pon.4881","article-title":"Roles of positive psychological outcomes in future health perception and mental health problems: a report from the childhood cancer survivor study","volume":"27","author":"Weinstein","year":"2018","journal-title":"Psychooncology"},{"key":"B6","doi-asserted-by":"publisher","first-page":"2190","DOI":"10.1200\/JCO.2017.76.5552","article-title":"Psychological symptoms, social outcomes, socioeconomic attainment, and health behaviors among survivors of childhood cancer: current state of the literature","volume":"36","author":"Brinkman","year":"2018","journal-title":"J Clin Oncol"},{"key":"B7","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1054\/bjoc.2000.1545","article-title":"How successful are oncologists in identifying patient distress, perceived social support, and need for psychosocial counselling?","volume":"84","author":"S\u00f6llner","year":"2001","journal-title":"Br J Cancer"},{"key":"B8","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1016\/j.cpr.2005.10.002","article-title":"A systematic and conceptual review of posttraumatic stress in childhood cancer survivors and their parents","volume":"26","author":"Bruce","year":"2006","journal-title":"Clin Psychol Rev"},{"key":"B9","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1007\/s11764-019-00822-5","article-title":"Posttraumatic stress as a contributor to behavioral health outcomes and healthcare utilization in adult survivors of childhood cancer: a report from the childhood cancer survivor study","volume":"13","author":"Crochet","year":"2019","journal-title":"J Cancer Surviv"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1796","DOI":"10.1002\/ijc.31789","article-title":"Surviving childhood cancer: a systematic review of studies on risk and determinants of adverse socioeconomic outcomes","volume":"144","author":"Frederiksen","year":"2019","journal-title":"Int J Cancer"},{"key":"B11","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1136\/bmj.323.7307.271","article-title":"Developing strategies for long term follow up of survivors of childhood cancer","volume":"323","author":"Wallace","year":"2001","journal-title":"Br Med J"},{"key":"B12","doi-asserted-by":"publisher","first-page":"3186","DOI":"10.1016\/j.ejca.2006.08.001","article-title":"Follow-up after childhood cancer: evaluation of a three-level model","volume":"42","author":"Eiser","year":"2006","journal-title":"Eur J Cancer"},{"key":"B13","doi-asserted-by":"publisher","first-page":"3459","DOI":"10.1007\/s00520-019-05195-0","article-title":"Psychosocial difficulties identified by health care providers as they predict pain-related quality of life in children with cancer","volume":"28","author":"Nofech-Mozes","year":"2020","journal-title":"Support Care Cancer"},{"key":"B14","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1093\/jpepsy\/jsv096","article-title":"Profiles of dispositional expectancies and affectivity predict later psychosocial functioning in children and adolescents with cancer","volume":"41","author":"Okado","year":"2016","journal-title":"J Pediatr Psychol"},{"year":"","key":"B15","article-title":"International guideline harmonization group"},{"key":"B16","doi-asserted-by":"publisher","first-page":"e28678","DOI":"10.1002\/pbc.28678","article-title":"Use of electronic patient data storage for evaluating and setting the risk category of late effects in childhood cancer survivors","volume":"67","author":"Rajala","year":"2020","journal-title":"Pediatr Blood Cancer"},{"key":"B17","doi-asserted-by":"publisher","first-page":"737","DOI":"10.1093\/jpepsy\/jsy012","article-title":"Screening for family psychosocial risk in pediatric cancer: validation of the psychosocial assessment tool (PAT) version 3","volume":"43","author":"Kazak","year":"2018","journal-title":"J Pediatr Psychol"},{"key":"B18","doi-asserted-by":"publisher","first-page":"2405","DOI":"10.1002\/cncr.34215","article-title":"Recommendations for the surveillance of education and employment outcomes in survivors of childhood, adolescent, and young adult cancer: a report from the international late effects of childhood cancer guideline harmonization group","volume":"128","author":"Devine","year":"2022","journal-title":"Cancer"},{"key":"B19","doi-asserted-by":"publisher","first-page":"e184","DOI":"10.1016\/S1470-2045(21)00750-6","article-title":"Recommendations for the surveillance of mental health problems in childhood, adolescent, and young adult cancer survivors: a report from the international late effects of childhood cancer guideline harmonization group","volume":"23","author":"Marchak","year":"2022","journal-title":"Lancet Oncol"},{"key":"B20","doi-asserted-by":"publisher","first-page":"e65001","DOI":"10.2196\/65001","article-title":"A hybrid deep learning-based feature selection approach for supporting early detection of long-term behavioral outcomes in survivors of cancer: cross-sectional study","volume":"6","author":"Huang","year":"2025","journal-title":"JMIR Bioinform Biotech"},{"key":"B21","doi-asserted-by":"publisher","first-page":"e12239","DOI":"10.2196\/12239","article-title":"Natural language processing of clinical notes on chronic diseases: systematic review","volume":"7","author":"Sheikhalishahi","year":"2019","journal-title":"JMIR Med Inform"},{"key":"B22","doi-asserted-by":"publisher","first-page":"e52322","DOI":"10.2196\/52322","article-title":"Machine learning approaches to predict symptoms in people with cancer: systematic review","volume":"10","author":"Zeinali","year":"2024","journal-title":"JMIR Cancer"},{"key":"B23","doi-asserted-by":"publisher","first-page":"e10","DOI":"10.2196\/cancer.9050","article-title":"Assessing unmet information needs of breast cancer survivors: exploratory study of online health forums using text classification and retrieval","volume":"4","author":"McRoy","year":"2018","journal-title":"JMIR Cancer"},{"key":"B24","doi-asserted-by":"publisher","first-page":"e33182","DOI":"10.2196\/33182","article-title":"Machine learning-based short-term mortality prediction models for patients with cancer using electronic health record data: systematic review and critical appraisal","volume":"10","author":"Lu","year":"2022","journal-title":"JMIR Med Inform"},{"key":"B25","doi-asserted-by":"publisher","first-page":"1207","DOI":"10.1177\/02692163221105595","article-title":"Machine learning models to detect social distress, spiritual pain, and severe physical psychological symptoms in terminally ill patients with cancer from unstructured text data in electronic medical records","volume":"36","author":"Masukawa","year":"2022","journal-title":"Palliat Med"},{"key":"B26","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1038\/s43856-024-00495-x","article-title":"Predicting which patients with cancer will see a psychiatrist or counsellor from their initial oncology consultation document using natural language processing","volume":"4","author":"Nunez","year":"2024","journal-title":"Commun Med (Lond)"},{"key":"B27","doi-asserted-by":"publisher","first-page":"952","DOI":"10.1055\/s-0039-3401814","article-title":"Unsupervised machine learning of topics documented by nurses about hospitalized patients prior to a rapid-response event","volume":"10","author":"Korach","year":"2019","journal-title":"Appl Clin Inform"},{"key":"B28","doi-asserted-by":"crossref","first-page":"365","DOI":"10.18653\/v1\/W17-2347","article-title":"Detecting mentions of pain and acute confusion in Finnish clinical text","volume-title":"BioNLP 2017","author":"Moen","year":"2017"},{"key":"B29","doi-asserted-by":"publisher","first-page":"3399","DOI":"10.1002\/nop2.1594","article-title":"Towards automated risk prediction of persistent pain: exploring psychosocial factors from electronic health records after breast cancer surgery","volume":"10","author":"Liukas","year":"2023","journal-title":"Nurs Open"},{"article-title":"Code for analysis used in the article \u201cSupervised machine learning applied nursing notes for identifying childhood cancer patients\u2019 need for psychosocial support\u201d","year":"2025","author":"Reunamo","key":"B30"},{"key":"B31","doi-asserted-by":"publisher","first-page":"55","DOI":"10.7326\/M14-0697","article-title":"Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement","volume":"162","author":"Collins","year":"2015","journal-title":"Ann Intern Med"},{"key":"B32","doi-asserted-by":"publisher","first-page":"545","DOI":"10.1017\/S1351324920000224","article-title":"Universal Lemmatizer: a sequence-to-sequence model for lemmatizing Universal Dependencies treebanks","volume":"27","author":"Kanerva","year":"2021","journal-title":"Nat Lang Eng"},{"volume-title":"Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit","year":"2009","author":"Bird","key":"B33"},{"key":"B34","doi-asserted-by":"publisher","first-page":"2825","DOI":"10.5555\/1953048.2078195","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J Mach Learn Res"},{"key":"B35","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1142\/S0218488598000094","article-title":"The vanishing gradient problem during learning recurrent neural nets and problem solutions","volume":"6","author":"Hochreiter","year":"1998","journal-title":"Int J Uncertain Fuzziness Knowl Based Syst"},{"key":"B36","doi-asserted-by":"publisher","first-page":"e0232525","DOI":"10.1371\/journal.pone.0232525","article-title":"The influence of preprocessing on text classification using a bag-of-words representation","volume":"15","author":"HaCohen-Kerner","year":"2020","journal-title":"PLoS One"},{"key":"B37","first-page":"38","article-title":"Transformers: state-of-the-art natural language processing","author":"Wolf","year":"2020"},{"key":"B38","first-page":"721","article-title":"PyTorch: an imperative style, high-performance deep learning library","volume-title":"Proceedings of the 33rd International Conference on Neural Information Processing Systems","author":"Paszke","year":"2019"},{"article-title":"Multilingual is not enough: BERT for Finnish. arXiv [preprint]","year":"2019","author":"Virtanen","key":"B39"},{"key":"B40","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1186\/1471-2105-7-91","article-title":"Bias in error estimation when using cross-validation for model selection","volume":"7","author":"Varma","year":"2006","journal-title":"BMC Bioinform"},{"key":"B41","doi-asserted-by":"publisher","first-page":"2079","DOI":"10.5555\/1756006.1859921","article-title":"On over-fitting in model selection and subsequent selection bias in performance evaluation","volume":"11","author":"Cawley","year":"2010","journal-title":"J Mach Learn Res"},{"key":"B42","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An introduction to ROC analysis","volume":"27","author":"Fawcett","year":"2006","journal-title":"Pattern Recognit Lett"},{"key":"B43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.5555\/3122009.3176821","article-title":"Time for a change: a tutorial for comparing multiple classifiers through Bayesian analysis","volume":"18","author":"Benavoli","year":"2017","journal-title":"J Mach"},{"key":"B44","doi-asserted-by":"publisher","first-page":"1541","DOI":"10.21105\/joss.01541","article-title":"Bayestestr: describing effects and their uncertainty, existence and significance within the Bayesian framework","volume":"4","author":"Makowski","year":"2019","journal-title":"JOSS"},{"key":"B45","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1037\/a0024377","article-title":"Bayes factor approaches for testing interval null hypotheses","volume":"16","author":"Morey","year":"2011","journal-title":"Psychol Methods"},{"key":"B46","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1177\/1745691611406923","article-title":"Statistical evidence in experimental psychology: an empirical comparison using 855 t tests","volume":"6","author":"Wetzels","year":"2011","journal-title":"Perspect Psychol Sci"},{"key":"B47","doi-asserted-by":"publisher","first-page":"573","DOI":"10.1037\/a0029146","article-title":"Bayesian estimation supersedes the t test","volume":"142","author":"Kruschke","year":"2013","journal-title":"J Exp Psychol Gen"},{"year":"","key":"B48","article-title":"HealthMeasures"},{"article-title":"Attention is all you need","year":"2017","author":"Vaswani","key":"B49"},{"article-title":"Transformers are RNNs: fast autoregressive transformers with linear attention","year":"2020","author":"Katharopoulos","key":"B50"},{"article-title":"Longformer: the long-document transformer","year":"2020","author":"Beltagy","key":"B51"},{"key":"B52","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1016\/j.aiopen.2022.10.001","article-title":"A survey of transformers","volume":"3","author":"Lin","year":"2022","journal-title":"AI Open"}],"container-title":["Frontiers in Digital Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2025.1585309\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T05:29:42Z","timestamp":1754544582000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2025.1585309\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,7]]},"references-count":52,"alternative-id":["10.3389\/fdgth.2025.1585309"],"URL":"https:\/\/doi.org\/10.3389\/fdgth.2025.1585309","relation":{},"ISSN":["2673-253X"],"issn-type":[{"type":"electronic","value":"2673-253X"}],"subject":[],"published":{"date-parts":[[2025,8,7]]},"article-number":"1585309"}}