{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,17]],"date-time":"2025-12-17T08:32:14Z","timestamp":1765960334827,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2024,7,31]],"date-time":"2024-07-31T00:00:00Z","timestamp":1722384000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Nutrients"],"abstract":"<jats:p>Background: For hospitalized adults, it is important to initiate the early reintroduction of oral food in accordance with nutrition support team guidelines. The aim of this study was to develop and validate a machine learning-based algorithm that predicts the early termination of medical nutritional therapy (the transition to oral feeding). Methods: This retrospective cohort study included consecutive adult patients admitted to the Hacettepe hospital (from 1 January 2018 to 31 December 2022). The outcome of the study was the prediction of an early transition to adequate oral feeding before discharge. The dataset was randomly (70\/30) divided into training and test datasets. We used six ML algorithms with multiple features to construct prediction models. ML model performance was measured according to the accuracy, area under the receiver operating characteristic curve, and F1 score. We used the Boruta Method to determine the important features and interpret the selected features. Results: A total of 2298 adult inpatients who were followed by a nutrition support team for medical nutritional therapy were included. Patients received parenteral nutrition (1471\/2298, 64.01%), enteral nutrition (717\/2298, 31.2%), or supplemental parenteral nutrition (110\/2298, 4.79%). The median (interquartile range) Nutritional Risk Screening (NRS-2002) score was 5 (1). Six prediction algorithms were used, and the artificial neural network and elastic net models achieved the greatest area under the ROC in all outcomes (AUC = 0.770). Ranked by z-value, the 10 most important features in predicting an early transition to oral feeding in the artificial neural network and elastic net algorithms were parenteral nutrition, surgical wards, surgical outcomes, enteral nutrition, age, supplemental parenteral nutrition, digestive system diseases, gastrointestinal complications, NRS-2002, and impaired consciousness. Conclusions: We developed machine learning models for the prediction of an early transition to oral feeding before discharge. Overall, there was no discernible superiority among the models. Nevertheless, the artificial neural network and elastic net methods provided the highest AUC values. Since the machine learning model is interpretable, it can enable clinicians to better comprehend the features underlying the outcomes. Our study could support personalized treatment and nutritional follow-up strategies in clinical decision making for the prediction of an early transition to oral feeding in hospitalized adult patients.<\/jats:p>","DOI":"10.3390\/nu16152492","type":"journal-article","created":{"date-parts":[[2024,7,31]],"date-time":"2024-07-31T10:34:43Z","timestamp":1722422083000},"page":"2492","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A Novel Machine-Learning Algorithm to Predict the Early Termination of Nutrition Support Team Follow-Up in Hospitalized Adults: A Retrospective Cohort Study"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2280-8727","authenticated-orcid":false,"given":"Nadir","family":"Yal\u00e7\u0131n","sequence":"first","affiliation":[{"name":"Department of Clinical Pharmacy, Faculty of Pharmacy, Hacettepe University, 06100 Ankara, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3211-2093","authenticated-orcid":false,"given":"Merve","family":"Ka\u015f\u0131kc\u0131","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, Faculty of Medicine, Hacettepe University, 06100 Ankara, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Burcu","family":"Kelleci-\u00c7ak\u0131r","sequence":"additional","affiliation":[{"name":"Department of Clinical Pharmacy, Faculty of Pharmacy, Hacettepe University, 06100 Ankara, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9921-5105","authenticated-orcid":false,"given":"Karel","family":"Allegaert","sequence":"additional","affiliation":[{"name":"Department of Pharmaceutical and Pharmacological Sciences, KU Leuven, 3000 Leuven, Belgium"},{"name":"Department of Development and Regeneration, KU Leuven, 3000 Leuven, Belgium"},{"name":"Child and Youth Institute, KU Leuven, 3000 Leuven, Belgium"},{"name":"Department of Hospital Pharmacy, Erasmus MC, 3015 GD Rotterdam, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7417-5415","authenticated-orcid":false,"given":"Merve","family":"G\u00fcner-Oytun","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, Division of Geriatrics, Faculty of Medicine, Hacettepe University, 06100 Ankara, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Serdar","family":"Ceylan","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, Division of Geriatrics, Faculty of Medicine, Hacettepe University, 06100 Ankara, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cafer","family":"Balc\u0131","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, Division of Geriatrics, Faculty of Medicine, Hacettepe University, 06100 Ankara, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6427-5826","authenticated-orcid":false,"given":"Kutay","family":"Demirkan","sequence":"additional","affiliation":[{"name":"Department of Clinical Pharmacy, Faculty of Pharmacy, Hacettepe University, 06100 Ankara, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Meltem","family":"Halil","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, Division of Geriatrics, Faculty of Medicine, Hacettepe University, 06100 Ankara, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Osman","family":"Abbaso\u011flu","sequence":"additional","affiliation":[{"name":"Clinical Nutrition Master\u2019s Program, Hacettepe University, 06100 Ankara, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/j.clnu.2006.02.007","article-title":"Introductory to the ESPEN Guidelines on Enteral Nutrition: Terminology, definitions and general topics","volume":"25","author":"Lochs","year":"2006","journal-title":"Clin. Nutr."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1177\/0148607104028004251","article-title":"Does a multidisciplinary total parenteral nutrition team improve patient outcomes? A systematic review","volume":"28","author":"Naylor","year":"2004","journal-title":"JPEN J. Parenter. Enter. Nutr."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1016\/j.nut.2005.08.002","article-title":"Cost savings of an adult hospital nutrition support team","volume":"21","author":"Kennedy","year":"2005","journal-title":"Nutrition"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1177\/0148607116673186","article-title":"Parenteral Nutrition Electrolyte Abnormalities and Associated Factors Before and After Nutrition Support Team Initiation","volume":"42","author":"Braun","year":"2018","journal-title":"JPEN J. Parenter. Enter. Nutr."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1016\/j.clnu.2004.03.006","article-title":"Role of a nutrition support team in reducing the inappropriate use of parenteral nutrition","volume":"23","author":"Piquet","year":"2004","journal-title":"Clin. Nutr."},{"key":"ref_6","first-page":"657","article-title":"Hypophosphatemia in postoperative patients with total parenteral nutrition: Influence of nutritional support teams","volume":"21","author":"Martinez","year":"2006","journal-title":"Nutr. Hosp."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Katagiri, S., Shiba, T., Tohara, H., Yamaguchi, K., Hara, K., Nakagawa, K., Komatsu, K., Watanabe, K., Ohsugi, Y., and Maekawa, S. (2019). Re-initiation of Oral Food Intake Following Enteral Nutrition Alters Oral and Gut Microbiota Communities. Front. Cell Infect. Microbiol., 9.","DOI":"10.3389\/fcimb.2019.00434"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5684","DOI":"10.1016\/j.clnu.2021.09.039","article-title":"ESPEN guideline on hospital nutrition","volume":"40","author":"Thibault","year":"2021","journal-title":"Clin. Nutr."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1054\/clnu.2002.0551","article-title":"Survey on structure and performance of nutrition-support teams in Germany","volume":"21","author":"Senkal","year":"2002","journal-title":"Clin. Nutr."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/S0261-5614(03)00103-1","article-title":"Survey on the current practice of nutritional therapy in Portugal","volume":"23","author":"Ravasco","year":"2004","journal-title":"Clin. Nutr."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1111\/j.1365-277X.2007.00742.x","article-title":"Use of parenteral nutrition in hospitals in the North of England","volume":"20","author":"Hearnshaw","year":"2007","journal-title":"J. Hum. Nutr. Diet."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1294","DOI":"10.1038\/ejcn.2014.186","article-title":"Quality and safety impact on the provision of parenteral nutrition through introduction of a nutrition support team","volume":"68","author":"Hvas","year":"2014","journal-title":"Eur. J. Clin. Nutr."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cho, J., Park, Y.S., Park, D.J., Kim, S., Lee, H., Kim, M., Lee, E., Lee, H.Y., and Lee, E. (2021). Bridging Policy and Service Performance of Hospital-Based Nutrition Support by Healthcare Information Technology. Nutrients, 13.","DOI":"10.3390\/nu13020595"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2573","DOI":"10.1093\/advances\/nmac103","article-title":"Machine Learning in Nutrition Research","volume":"13","author":"Kirk","year":"2022","journal-title":"Adv. Nutr."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1545","DOI":"10.1016\/j.clnu.2023.06.023","article-title":"ESPEN guideline on nutritional support for polymorbid medical inpatients","volume":"42","author":"Wunderle","year":"2023","journal-title":"Clin. Nutr."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1016\/j.clnu.2020.07.027","article-title":"Effects of enteral nutrition and parenteral nutrition on survival in patients with advanced cancer cachexia: Analysis of a multicenter prospective cohort study","volume":"40","author":"Amano","year":"2021","journal-title":"Clin. Nutr."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"112112","DOI":"10.1016\/j.nut.2023.112112","article-title":"Accreditation of nutrition support teams: A new initiative by the Turkish Society of Clinical Enteral & Parenteral Nutrition","volume":"114","author":"Halil","year":"2023","journal-title":"Nutrition"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v036.i11","article-title":"Feature selection with the Boruta package","volume":"36","author":"Kursa","year":"2010","journal-title":"J. Stat. Softw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"020011","DOI":"10.1063\/5.0137150","article-title":"A study in determining indicators of food-insecure households using SHAP and Boruta SHAP","volume":"2720","author":"Mindiyarti","year":"2023","journal-title":"AIP Conf. Proc."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"015022","DOI":"10.1088\/2631-8695\/abe344","article-title":"Using machine learning to predict concrete\u2019s strength: Learning from small datasets","volume":"3","author":"Ouyang","year":"2021","journal-title":"Eng. Res. Express"},{"key":"ref_21","unstructured":"Kuhn, M. (2024, July 05). R Package, Version 6.0-91; Package \u201ccaret\u201d: Classification and Regression Training. Available online: https:\/\/cran.r-project.org\/web\/packages\/caret\/caret.pdf."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"649","DOI":"10.2991\/ijcis.d.190618.001","article-title":"Gmdh2: Binary classification via gmdh-type neural network algorithms-R package and web-based tool","volume":"12","author":"Karabulut","year":"2019","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.C., and Muller, M. (2011). pROC: An open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinform., 12.","DOI":"10.1186\/1471-2105-12-77"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"034568","DOI":"10.1136\/bmjopen-2019-034568","article-title":"Reporting quality of studies using machine learning models for medical diagnosis: A systematic review","volume":"10","author":"Yusuf","year":"2020","journal-title":"BMJ Open"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1002\/ncp.10827","article-title":"Update on use of enteral and parenteral nutrition in hospitalized patients with a diagnosis of malnutrition in the United States","volume":"37","author":"Guenter","year":"2022","journal-title":"Nutr. Clin. Pract."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Salinari, A., Machi, M., Armas Diaz, Y., Cianciosi, D., Qi, Z., Yang, B., Ferreiro Cotorruelo, M.S., Villar, S.G., Dzul Lopez, L.A., and Battino, M. (2023). The Application of Digital Technologies and Artificial Intelligence in Healthcare: An Overview on Nutrition Assessment. Diseases, 11.","DOI":"10.3390\/diseases11030097"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Knights, V., Kolak, M., Markovikj, G., and Gajdo\u0161 Kljusuri\u0107, J. (2023). Modeling and Optimization with Artificial Intelligence in Nutrition. Appl. Sci., 13.","DOI":"10.3390\/app13137835"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/s11894-016-0488-y","article-title":"Can Nutritional Assessment Tools Predict Response to Nutritional Therapy?","volume":"18","author":"Patel","year":"2016","journal-title":"Curr. Gastroenterol. Rep."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4958","DOI":"10.1016\/j.clnu.2021.06.028","article-title":"A fusion decision system to identify and grade malnutrition in cancer patients: Machine learning reveals feasible workflow from representative real-world data","volume":"40","author":"Yin","year":"2021","journal-title":"Clin. Nutr."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"5249","DOI":"10.1016\/j.clnu.2021.08.013","article-title":"Towards personalized nutritional treatment for malnutrition using machine learning-based screening tools","volume":"40","author":"Raphaeli","year":"2021","journal-title":"Clin. Nutr."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1017\/S0029665113000980","article-title":"Designing a national clinical audit of nutritional care in health and social care settings: Consideration and future directions","volume":"72","author":"Parsons","year":"2013","journal-title":"Proc. Nutr. Soc."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1002\/ncp.10204","article-title":"Standards for Nutrition Support: Adult Hospitalized Patients","volume":"33","author":"Ukleja","year":"2018","journal-title":"Nutr. Clin. Pract."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lin, Y.M., Wang, M., Sun, N.X., Liu, Y.Y., Yin, T.F., and Chen, C. (2019). Screening and application of nutritional support in elderly hospitalized patients of a tertiary care hospital in China. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0213076"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1111\/ger.12123","article-title":"Relationships between oral health, dysphagia and undernutrition in hospitalised elderly patients","volume":"33","author":"Poisson","year":"2016","journal-title":"Gerodontology"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1111\/1747-0080.12718","article-title":"Effect of early nutritional initiation on post-cerebral infarction discharge destination: A propensity-matched analysis using machine learning","volume":"79","author":"Ikezawa","year":"2022","journal-title":"Nutr. Diet."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4745","DOI":"10.1016\/j.clnu.2021.03.031","article-title":"ESPEN practical guideline: Clinical nutrition in surgery","volume":"40","author":"Weimann","year":"2021","journal-title":"Clin. Nutr."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3211","DOI":"10.1016\/j.clnu.2020.03.038","article-title":"Perioperative nutrition: Recommendations from the ESPEN expert group","volume":"39","author":"Lobo","year":"2020","journal-title":"Clin. Nutr."}],"container-title":["Nutrients"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-6643\/16\/15\/2492\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:27:13Z","timestamp":1760110033000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-6643\/16\/15\/2492"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,31]]},"references-count":37,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["nu16152492"],"URL":"https:\/\/doi.org\/10.3390\/nu16152492","relation":{},"ISSN":["2072-6643"],"issn-type":[{"type":"electronic","value":"2072-6643"}],"subject":[],"published":{"date-parts":[[2024,7,31]]}}}