{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T06:06:49Z","timestamp":1772518009644,"version":"3.50.1"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"S4","license":[{"start":{"date-parts":[[2024,10,29]],"date-time":"2024-10-29T00:00:00Z","timestamp":1730160000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,10,29]],"date-time":"2024-10-29T00:00:00Z","timestamp":1730160000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100018696","name":"HORIZON EUROPE Health","doi-asserted-by":"publisher","award":["GA01017598"],"award-info":[{"award-number":["GA01017598"]}],"id":[{"id":"10.13039\/100018696","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Amyotrophic lateral sclerosis (ALS) is a progressive neurodegenerative disease that results in death within a short time span (3-5 years). One of the major challenges in treating ALS is its highly heterogeneous disease progression and the lack of effective prognostic tools to forecast it. The main aim of this study was, then, to test the feasibility of predicting relevant clinical outcomes that characterize the progression of ALS with a two-year prediction horizon via artificial intelligence techniques using routine visits data.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Three classification problems were considered: predicting death (binary problem), predicting death or percutaneous endoscopic gastrostomy (PEG) (multiclass problem), and predicting death or non-invasive ventilation (NIV) (multiclass problem). Two supervised learning models, a logistic regression (LR) and a deep learning multilayer perceptron (MLP), were trained ensuring technical robustness and reproducibility. Moreover, to provide insights into model explainability and result interpretability, model coefficients for LR and Shapley values for both LR and MLP were considered to characterize the relationship between each variable and the outcome.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>On the one hand, predicting death was successful as both models yielded F1 scores and accuracy well above 0.7. The model explainability analysis performed for this outcome allowed for the understanding of how different methodological approaches consider the input variables when performing the prediction. On the other hand, predicting death alongside PEG or NIV proved to be much more challenging (F1 scores and accuracy in the 0.4-0.6 interval).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>In conclusion, predicting death due to ALS proved to be feasible. However, predicting PEG or NIV in a multiclass fashion proved to be unfeasible with these data, regardless of the complexity of the methodological approach. The observed results suggest a potential ceiling on the amount of information extractable from the database, e.g., due to the intrinsic difficulty of the prediction tasks at hand, or to the absence of crucial predictors that are, however, not currently collected during routine practice.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-024-02719-5","type":"journal-article","created":{"date-parts":[[2024,10,29]],"date-time":"2024-10-29T16:03:15Z","timestamp":1730217795000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Predicting clinical events characterizing the progression of amyotrophic lateral sclerosis via machine learning approaches using routine visits data: a feasibility study"],"prefix":"10.1186","volume":"24","author":[{"given":"Alessandro","family":"Guazzo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michele","family":"Atzeni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elena","family":"Idi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Isotta","family":"Trescato","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Erica","family":"Tavazzi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Enrico","family":"Longato","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Umberto","family":"Manera","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adriano","family":"Chi\u00f3","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marta","family":"Gromicho","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"In\u00eas","family":"Alves","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mamede","family":"de Carvalho","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martina","family":"Vettoretti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8415-4688","authenticated-orcid":false,"given":"Barbara","family":"Di\u00a0Camillo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,10,29]]},"reference":[{"key":"2719_CR1","doi-asserted-by":"crossref","unstructured":"Brown RH, Al-Chalabi A. Amyotrophic lateral sclerosis. N Engl J Med. 2017.","DOI":"10.1056\/NEJMra1603471"},{"key":"2719_CR2","doi-asserted-by":"crossref","unstructured":"Atassi N, Berry J, Shui A, Zach N, Sherman A, Sinani E, et\u00a0al. The PRO-ACT database: design, initial analyses, and predictive features. Neurology. 2014.","DOI":"10.1212\/WNL.0000000000000951"},{"key":"2719_CR3","unstructured":"Tavazzi E, Daberdaku S, Zandon\u00e1 A, Vasta R, Nefussy B, Lunetta C, et\u00a0al. Predicting functional impairment trajectories in amyotrophic lateral sclerosis: a probabilistic, multifactorial model of disease progression. Neurology. 2022."},{"key":"2719_CR4","doi-asserted-by":"crossref","unstructured":"Martins AS, Gromicho M, Pinto S, de\u00a0Carvalho M, Madeira SC. Learning prognostic models using disease progression patterns: predicting the need for non-invasive ventilation in amyotrophic lateral sclerosis. IEEE\/ACM Trans Comput Biol Bioinforma. 2021.","DOI":"10.1109\/TCBB.2021.3078362"},{"key":"2719_CR5","doi-asserted-by":"crossref","unstructured":"Ackrivo J, Hansen-Flaschen J, Wileyto EP, Schwab RJ, Elman L, Kawut SM. Development of a prognostic model of respiratory insufficiency or death in amyotrophic lateral sclerosis. Eur Respir J. 2019.","DOI":"10.1183\/13993003.02237-2018"},{"key":"2719_CR6","doi-asserted-by":"crossref","unstructured":"Trescato I, Guazzo A, Longato E, Hazizaj E, Roversi C, Tavazzi E, et\u00a0al. Baseline Machine Learning Approaches To Predict Amyotrophic Lateral Sclerosis Disease Progression Notebook for the iDPP Lab on Intelligent Disease Progression Prediction at CLEF 2022. CEUR Workshop Proceedings. 2022.","DOI":"10.1007\/978-3-031-13643-6_25"},{"key":"2719_CR7","doi-asserted-by":"crossref","unstructured":"Ong ML, Tan PF, Holbrook JD. Predicting functional decline and survival in amyotrophic lateral sclerosis. PLoS ONE. 2017.","DOI":"10.1371\/journal.pone.0174925"},{"key":"2719_CR8","doi-asserted-by":"crossref","unstructured":"Ko KD, El-Ghazawi T, Kim D, Morizono H. Predicting the severity of motor neuron disease progression using electronic health record data with a cloud computing Big Data approach. In: 2014 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology. 2014.","DOI":"10.1109\/CIBCB.2014.6845506"},{"key":"2719_CR9","doi-asserted-by":"crossref","unstructured":"Tang M, Gao C, Goutman SA, Kalinin A, Mukherjee B, Guan Y, et\u00a0al. Model-based and Model-free Techniques for Amyotrophic Lateral Sclerosis Diagnostic Prediction and Patient Clustering. Neuroinformatics. 2019.","DOI":"10.1007\/s12021-018-9406-9"},{"key":"2719_CR10","doi-asserted-by":"crossref","unstructured":"Pires S, Gromicho M, Pinto S, Carvalho M, Madeira SC. Predicting Non-invasive Ventilation in ALS Patients Using Stratified Disease Progression Groups. In: 2018 IEEE International Conference on Data Mining Workshops (ICDMW). 2018.","DOI":"10.1109\/ICDMW.2018.00113"},{"key":"2719_CR11","doi-asserted-by":"crossref","unstructured":"Westeneng HJ, Debray TPA, Visser AE, van Eijk RPA, Rooney JPK, Calvo A, et\u00a0al. Prognosis for patients with amyotrophic lateral sclerosis: development and validation of a personalised prediction model. Lancet Neurol. 2018.","DOI":"10.1016\/S1474-4422(18)30089-9"},{"key":"2719_CR12","doi-asserted-by":"crossref","unstructured":"Lunetta C, Lizio A, Melazzini MG, Maestri E, Sansone VA. Amyotrophic Lateral Sclerosis Survival Score (ALS-SS): A simple scoring system for early prediction of patient survival. Amyotroph Lateral Scler Frontotemporal Degeneration. 2015.","DOI":"10.3109\/21678421.2015.1083585"},{"key":"2719_CR13","doi-asserted-by":"crossref","unstructured":"Tavazzi E, Daberdaku S, Vasta R, Calvo A, Chi\u00f3 A, Di\u00a0Camillo B. Exploiting mutual information for the imputation of static and dynamic mixed-type clinical data with an adaptive k-nearest neighbours approach. BMC Med Inform Decis Mak. 2020.","DOI":"10.1186\/s12911-020-01166-2"},{"key":"2719_CR14","doi-asserted-by":"crossref","unstructured":"Tavazzi E, Longato E, Vettoretti M, Aidos H, Trescato I, Roversi C, et\u00a0al. Artificial intelligence and statistical methods for stratification and prediction of progression in amyotrophic lateral sclerosis: A systematic review. Artif Intell Med. 2023.","DOI":"10.1016\/j.artmed.2023.102588"},{"key":"2719_CR15","doi-asserted-by":"crossref","unstructured":"Talbott EO, Malek AM, Lacomis D. The epidemiology of amyotrophic lateral sclerosis. Handb Clin Neurol. 2016.","DOI":"10.1016\/B978-0-12-802973-2.00013-6"},{"key":"2719_CR16","doi-asserted-by":"crossref","unstructured":"Wei QQ, Chen Y, Chen X, Cao B, Ou R, Zhang L, et\u00a0al. Prognostic Nomogram Associated with Longer Survival in Amyotrophic Lateral Sclerosis Patients. Aging Dis. 2018.","DOI":"10.14336\/AD.2017.1016"},{"key":"2719_CR17","unstructured":"Lundberg SM, Lee\u00a0SI. A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems. 2017."},{"key":"2719_CR18","unstructured":"Bringing artificial intelligence home for a better care of amyotrophic lateral sclerosis and multiple sclerosis (BRAINTEASER) Project. https:\/\/brainteaser.health\/. Accessed 1 Aug 2023."},{"key":"2719_CR19","doi-asserted-by":"crossref","unstructured":"Chi\u00f3 A, Mora G, Moglia C, Manera U, Canosa A, Cammarosano S, et\u00a0al. Secular Trends of Amyotrophic Lateral Sclerosis: The Piemonte and Valle d\u2019Aosta Register. JAMA Neurol. 2017.","DOI":"10.1001\/jamaneurol.2017.1387"},{"key":"2719_CR20","doi-asserted-by":"crossref","unstructured":"Wijesekera LC, Nigel\u00a0Leigh P. Amyotrophic lateral sclerosis. Orphanet J Rare Dis. 2009.","DOI":"10.1186\/1750-1172-4-3"},{"key":"2719_CR21","doi-asserted-by":"crossref","unstructured":"Cedarbaum JM, Stambler N, Malta E, Fuller C, Hilt D, Thurmond B, et\u00a0al. The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function. J Neurol Sci. 1999.","DOI":"10.1016\/S0022-510X(99)00210-5"},{"key":"2719_CR22","doi-asserted-by":"crossref","unstructured":"Buuren Sv, Groothuis-Oudshoorn K. mice: Multivariate Imputation by Chained Equations in R. J Stat Softw. 2011.","DOI":"10.18637\/jss.v045.i03"},{"key":"2719_CR23","doi-asserted-by":"crossref","unstructured":"Guazzo A, Trescato I, Longato E, Hazizaj E, Dosso D, Faggioli G, et\u00a0al. Intelligent Disease Progression Prediction: Overview of iDPP@CLEF 2022. In: Experimental IR Meets Multilinguality, Multimodality, and Interaction. 2022.","DOI":"10.1007\/978-3-031-13643-6_25"},{"key":"2719_CR24","unstructured":"shap.DeepExplainer \u2014 SHAP latest documentation. https:\/\/shap-lrjball.readthedocs.io\/en\/latest\/generated\/shap.DeepExplainer.html. Accessed 4 Sept 2023."},{"key":"2719_CR25","unstructured":"shap.summary_plot \u2014 SHAP latest documentation. https:\/\/shap-lrjball.readthedocs.io\/en\/latest\/generated\/shap.summary_plot.html. Accessed 4 Sept 2023."},{"key":"2719_CR26","doi-asserted-by":"crossref","unstructured":"Schober P, Boer C, Schwarte LA. Correlation Coefficients: Appropriate Use and Interpretation. Anesth Analg. 2018.","DOI":"10.1213\/ANE.0000000000002864"},{"key":"2719_CR27","doi-asserted-by":"crossref","unstructured":"Kollewe K, Mauss U, Krampfl K, Petri S, Dengler R, Mohammadi B. ALSFRS-R score and its ratio: A useful predictor for ALS-progression. J Neurol Sci. 2008.","DOI":"10.1016\/j.jns.2008.07.016"},{"key":"2719_CR28","doi-asserted-by":"crossref","unstructured":"Chi\u00f3 A, Calvo A, Moglia C, Mazzini L, Mora G. Phenotypic heterogeneity of amyotrophic lateral sclerosis: a population based study. J Neurol Neurosurg Psychiatry. 2011.","DOI":"10.1136\/jnnp.2010.235952"},{"key":"2719_CR29","doi-asserted-by":"crossref","unstructured":"Calvo A, Moglia C, Lunetta C, Marinou K, Ticozzi N, Ferrante GD, et\u00a0al. Factors predicting survival in ALS: a multicenter Italian study. J Neurol. 2017.","DOI":"10.1007\/s00415-016-8313-y"},{"key":"2719_CR30","doi-asserted-by":"crossref","unstructured":"Pudasaini P, Neupane S, Dhakal B, Rana A, Pathak BD, Dawadi S. Bulbar onset amyotrophic lateral sclerosis: a case report. Ann Med Surg. 2022.","DOI":"10.1016\/j.amsu.2022.104889"},{"key":"2719_CR31","doi-asserted-by":"crossref","unstructured":"Ngo ST, Steyn FJ, McCombe PA. Body mass index and dietary intervention: implications for prognosis of amyotrophic lateral sclerosis. J Neurol Sci. 2014.","DOI":"10.1016\/j.jns.2014.02.035"},{"key":"2719_CR32","doi-asserted-by":"crossref","unstructured":"D\u2019Antona S, Caramenti M, Porro D, Castiglioni I, Cava C. Amyotrophic lateral sclerosis: a diet review. Foods. 2021.","DOI":"10.3390\/foods10123128"},{"key":"2719_CR33","doi-asserted-by":"crossref","unstructured":"Pinto S, de\u00a0Carvalho M. Comparison of slow and forced vital capacities on ability to predict survival in ALS. Amyotroph Lateral Scler Frontotemporal Degeneration. 2017.","DOI":"10.1080\/21678421.2017.1354995"},{"key":"2719_CR34","doi-asserted-by":"crossref","unstructured":"Pinto S, de\u00a0Carvalho M. The R of ALSFRS-R: does it really mirror functional respiratory involvement in amyotrophic lateral sclerosis? Amyotroph Lateral Scler Frontotemporal Degeneration. 2015.","DOI":"10.3109\/21678421.2014.952641"},{"key":"2719_CR35","doi-asserted-by":"crossref","unstructured":"Manera U, Calvo A, Daviddi M, Canosa A, Vasta R, Torrieri MC, et\u00a0al. Regional spreading of symptoms at diagnosis as a prognostic marker in amyotrophic lateral sclerosis: a population-based study. J Neurol Neurosurg Psychiatry. 2020.","DOI":"10.1136\/jnnp-2019-321153"},{"key":"2719_CR36","doi-asserted-by":"crossref","unstructured":"Manera U, D\u2019Ovidio F, Cabras S, Torrieri MC, Canosa A, Vasta R, et\u00a0al. Amyotrophic lateral sclerosis regional progression intervals change according to time of involvement of different body regions. Eur J Neurol. 2023.","DOI":"10.1111\/ene.15674"},{"key":"2719_CR37","doi-asserted-by":"crossref","unstructured":"de\u00a0Jongh AD, van Eijk RPA, Bakker LA, Bunte TM, Beelen A, van\u00a0der Meijden C, et\u00a0al. Development of a Rasch-Built Amyotrophic Lateral Sclerosis Impairment Multidomain Scale to Measure Disease Progression in ALS. Neurology. 2023.","DOI":"10.1212\/WNL.0000000000207483"},{"key":"2719_CR38","unstructured":"Guazzo A, Trescato I, Longato E, Hazizaj E, Dosso D, Faggioli G, et\u00a0al. Overview of iDPP@CLEF 2022: the intelligent disease progression prediction challenge. CEUR Workshop Proceedings. 2022."},{"key":"2719_CR39","doi-asserted-by":"crossref","unstructured":"Khosla R, Rain M, Sharma S, Anand A. Amyotrophic Lateral Sclerosis (ALS) prediction model derived from plasma and CSF biomarkers. PLoS ONE. 2021.","DOI":"10.1371\/journal.pone.0247025"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02719-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-024-02719-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02719-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,29]],"date-time":"2024-10-29T16:04:15Z","timestamp":1730217855000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-024-02719-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,29]]},"references-count":39,"journal-issue":{"issue":"S4","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["2719"],"URL":"https:\/\/doi.org\/10.1186\/s12911-024-02719-5","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,29]]},"assertion":[{"value":"20 February 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 October 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 October 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The BRAINTEASER Project was approved in July 2021 by the Ethics Committees Lisbon Medical Academic Center (Protocol number 162\/2021) and AOU Citt\u00e1 della Salute e della Scienza di Torino (Protocol number 0079511).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"318"}}