{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T20:34:24Z","timestamp":1772138064884,"version":"3.50.1"},"reference-count":53,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2023,11,11]],"date-time":"2023-11-11T00:00:00Z","timestamp":1699660800000},"content-version":"vor","delay-in-days":10,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004794","name":"Centre National de la Recherche Scientifique","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004794","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Motivation<\/jats:title>\n                    <jats:p>Online assessment of tumor characteristics during surgery is important and has the potential to establish an intra-operative surgeon feedback mechanism. With the availability of such feedback, surgeons could decide to be more liberal or conservative regarding the resection of the tumor. While there are methods to perform metabolomics-based tumor pathology prediction, their model complexity predictive performance is limited by the small dataset sizes. Furthermore, the information conveyed by the feedback provided on the tumor tissue could be improved both in terms of content and accuracy.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>In this study, we propose a metabolic pathway-informed deep learning model (PiDeeL) to perform survival analysis and pathology assessment based on metabolite concentrations. We show that incorporating pathway information into the model architecture substantially reduces parameter complexity and achieves better survival analysis and pathological classification performance. With these design decisions, we show that PiDeeL improves tumor pathology prediction performance of the state-of-the-art in terms of the Area Under the ROC Curve by 3.38% and the Area Under the Precision\u2013Recall Curve by 4.06%. Similarly, with respect to the time-dependent concordance index (c-index), PiDeeL achieves better survival analysis performance (improvement of 4.3%) when compared to the state-of-the-art. Moreover, we show that importance analyses performed on input metabolite features as well as pathway-specific neurons of PiDeeL provide insights into tumor metabolism. We foresee that the use of this model in the surgery room will help surgeons adjust the surgery plan on the fly and will result in better prognosis estimates tailored to surgical procedures.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Availability and implementation<\/jats:title>\n                    <jats:p>The code is released at https:\/\/github.com\/ciceklab\/PiDeeL. The data used in this study are released at https:\/\/zenodo.org\/record\/7228791.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btad684","type":"journal-article","created":{"date-parts":[[2023,11,10]],"date-time":"2023-11-10T09:24:24Z","timestamp":1699608264000},"source":"Crossref","is-referenced-by-count":6,"title":["PiDeeL: metabolic pathway-informed deep learning model for survival analysis and pathological classification of gliomas"],"prefix":"10.1093","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-6764-7716","authenticated-orcid":false,"given":"Gun","family":"Kaynar","sequence":"first","affiliation":[{"name":"Computer Engineering Department, Bilkent University , 06800 Ankara, Turkey"}]},{"given":"Doruk","family":"Cakmakci","sequence":"additional","affiliation":[{"name":"School of Computer Science, McGill University , Montreal, QC, H3A 0E9, Canada"}]},{"given":"Caroline","family":"Bund","sequence":"additional","affiliation":[{"name":"MNMS Platform, University Hospitals of Strasbourg , Strasbourg 67098, France"},{"name":"ICube, University of Strasbourg, CNRS UMR, 7357 , Strasbourg 67000, France"},{"name":"Department of Nuclear Medicine and Molecular Imaging, ICANS , Strasbourg 67000, France"}]},{"given":"Julien","family":"Todeschi","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, University Hospitals of Strasbourg , Strasbourg, 67091, France"}]},{"given":"Izzie Jacques","family":"Namer","sequence":"additional","affiliation":[{"name":"MNMS Platform, University Hospitals of Strasbourg , Strasbourg 67098, France"},{"name":"ICube, University of Strasbourg, CNRS UMR, 7357 , Strasbourg 67000, France"},{"name":"Department of Nuclear Medicine and Molecular Imaging, ICANS , Strasbourg 67000, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8613-6619","authenticated-orcid":false,"given":"A Ercument","family":"Cicek","sequence":"additional","affiliation":[{"name":"Computer Engineering Department, Bilkent University , 06800 Ankara, Turkey"},{"name":"Computational Biology Department, Carnegie Mellon University , Pittsburgh, PA 15213, United States"}]}],"member":"286","published-online":{"date-parts":[[2023,11,11]]},"reference":[{"key":"2023112210165200000_btad684-B1","doi-asserted-by":"crossref","first-page":"3927","DOI":"10.1002\/sim.2427","article-title":"A time-dependent discrimination index for survival data","volume":"24","author":"Antolini","year":"2005","journal-title":"Stat Med"},{"key":"2023112210165200000_btad684-B2","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1186\/gm332","article-title":"Cancer detection and biopsy classification using concurrent histopathological and metabolomic analysis of core biopsies","volume":"4","author":"Brown","year":"2012","journal-title":"Genome Med"},{"key":"2023112210165200000_btad684-B3","doi-asserted-by":"crossref","first-page":"1458","DOI":"10.1093\/neuonc\/noz129","article-title":"Molecular profiling of long-term IDH-wildtype glioblastoma survivors","volume":"21","author":"Burgenske","year":"2019","journal-title":"Neuro Oncol"},{"key":"2023112210165200000_btad684-B4","author":"Cakmakci","year":"2020"},{"key":"2023112210165200000_btad684-B5","doi-asserted-by":"crossref","first-page":"e1008184","DOI":"10.1371\/journal.pcbi.1008184","article-title":"Machine learning assisted intraoperative assessment of brain tumor margins using HRMAS NMR spectroscopy","volume":"16","author":"Cakmakci","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"2023112210165200000_btad684-B6","doi-asserted-by":"crossref","first-page":"3238","DOI":"10.1093\/bioinformatics\/btac309","article-title":"Targeted metabolomics analyses for brain tumor margin assessment during surgery","volume":"38","author":"Cakmakci","year":"2022","journal-title":"Bioinformatics"},{"key":"2023112210165200000_btad684-B7","doi-asserted-by":"crossref","first-page":"9978","DOI":"10.1073\/pnas.1423101112","article-title":"Maldi mass spectrometry imaging analysis of pituitary adenomas for near-real-time tumor delineation","volume":"112","author":"Calligaris","year":"2015","journal-title":"Proc Natl Acad Sci USA"},{"key":"2023112210165200000_btad684-B8","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1016\/j.ijms.2014.06.024","article-title":"Molecular typing of meningiomas by desorption electrospray ionization mass spectrometry imaging for surgical decision-making","volume":"377","author":"Calligaris","year":"2015","journal-title":"Int J Mass Spectrom"},{"key":"2023112210165200000_btad684-B9","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1016\/j.asjsur.2017.06.004","article-title":"5-Aminolevulinic acid fluorescence guided resection of malignant glioma: Hong Kong experience","volume":"41","author":"Chan","year":"2018","journal-title":"Asian J Surg"},{"key":"2023112210165200000_btad684-B10","doi-asserted-by":"crossref","first-page":"1471","DOI":"10.1016\/j.jocn.2012.03.009","article-title":"Aminolevulinic acid (ALA)-protoporphyrin IX fluorescence guided tumour resection. part 1: clinical, radiological and pathological studies","volume":"19","author":"Colditz","year":"2012","journal-title":"J Clin Neurosci"},{"key":"2023112210165200000_btad684-B11","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1111\/j.2517-6161.1972.tb00899.x","article-title":"Regression models and life-tables","volume":"34","author":"Cox","year":"1972","journal-title":"J R Stat Soc Ser B (Methodological)"},{"key":"2023112210165200000_btad684-B12","doi-asserted-by":"crossref","first-page":"1611","DOI":"10.1073\/pnas.1215687110","article-title":"Ambient mass spectrometry for the intraoperative molecular diagnosis of human brain tumors","volume":"110","author":"Eberlin","year":"2013","journal-title":"Proc Natl Acad Sci USA"},{"key":"2023112210165200000_btad684-B13","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1038\/s41586-021-03922-4","article-title":"Biologically informed deep neural network for prostate cancer discovery","volume":"598","author":"Elmarakeby","year":"2021","journal-title":"Nature"},{"key":"2023112210165200000_btad684-B14","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1002\/sim.4780140108","article-title":"A neural network model for survival data","volume":"14","author":"Faraggi","year":"1995","journal-title":"Stat Med"},{"key":"2023112210165200000_btad684-B15","doi-asserted-by":"crossref","first-page":"25919","DOI":"10.1038\/srep25919","article-title":"In vivo real-time mass spectrometry for guided surgery application","volume":"6","author":"Fatou","year":"2016","journal-title":"Sci Rep"},{"key":"2023112210165200000_btad684-B16","doi-asserted-by":"crossref","first-page":"507","DOI":"10.3390\/metabo11080507","article-title":"Dysregulated alanine as a potential predictive marker of glioma\u2014an insight from untargeted hrmas-nmr and machine learning data","volume":"11","author":"Firdous","year":"2021","journal-title":"Metabolites"},{"key":"2023112210165200000_btad684-B17","doi-asserted-by":"crossref","first-page":"2173","DOI":"10.1002\/sim.5681","article-title":"Estimating a time-dependent concordance index for survival prediction models with covariate dependent censoring","volume":"32","author":"Gerds","year":"2013","journal-title":"Stat Med"},{"key":"2023112210165200000_btad684-B18","doi-asserted-by":"crossref","first-page":"19","DOI":"10.3390\/metabo9020019","article-title":"HR-MAS NMR based quantitative metabolomics in breast cancer","volume":"9","author":"Gogiashvili","year":"2019","journal-title":"Metabolites"},{"key":"2023112210165200000_btad684-B19","doi-asserted-by":"crossref","first-page":"2543","DOI":"10.1001\/jama.1982.03320430047030","article-title":"Evaluating the yield of medical tests","volume":"247","author":"Harrell","year":"1982","journal-title":"JAMA"},{"key":"2023112210165200000_btad684-B20","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1158\/0008-5472.CAN-17-1974","article-title":"Rapid intraoperative diagnosis of pediatric brain tumors using stimulated raman histology","volume":"78","author":"Hollon","year":"2018","journal-title":"Cancer Res"},{"key":"2023112210165200000_btad684-B21","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1093\/biostatistics\/kxj011","article-title":"Survival ensembles","volume":"7","author":"Hothorn","year":"2006","journal-title":"Biostatistics"},{"key":"2023112210165200000_btad684-B22","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1214\/08-AOAS169","article-title":"Random survival forests","volume":"2","author":"Ishwaran","year":"2008","journal-title":"Ann Appl Stat"},{"key":"2023112210165200000_btad684-B23","doi-asserted-by":"crossref","first-page":"1486","DOI":"10.1073\/pnas.1523306113","article-title":"Lipid and metabolite profiles of human brain tumors by desorption electrospray ionization-MS","volume":"113","author":"Jarmusch","year":"2016","journal-title":"Proc Natl Acad Sci USA"},{"key":"2023112210165200000_btad684-B24","doi-asserted-by":"crossref","first-page":"5129","DOI":"10.1364\/BOE.7.005129","article-title":"Raman spectroscopy detects distant invasive brain cancer cells centimeters beyond MRI capability in humans","volume":"7","author":"Jermyn","year":"2016","journal-title":"Biomed Opt Express"},{"key":"2023112210165200000_btad684-B25","doi-asserted-by":"crossref","first-page":"3942","DOI":"10.1158\/0008-5472.CAN-17-0668","article-title":"Highly accurate detection of cancer in situ with intraoperative, label-free, multimodal optical spectroscopy","volume":"77","author":"Jermyn","year":"2017","journal-title":"Cancer Res"},{"key":"2023112210165200000_btad684-B26","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1109\/TCBB.2019.2920646","article-title":"Predicting carbon spectrum in heteronuclear single quantum coherence spectroscopy for online feedback during surgery","volume":"17","author":"Karakaslar","year":"2020","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform"},{"key":"2023112210165200000_btad684-B27","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1186\/s12874-018-0482-1","article-title":"DeepSurv: personalized treatment recommender system using a cox proportional hazards deep neural network","volume":"18","author":"Katzman","year":"2018","journal-title":"BMC Med Res Methodol"},{"key":"2023112210165200000_btad684-B28","doi-asserted-by":"crossref","first-page":"710","DOI":"10.1007\/s10985-021-09532-6","article-title":"Continuous and discrete-time survival prediction with neural networks","volume":"27","author":"Kvamme","year":"2021","journal-title":"Lifetime Data Anal"},{"key":"2023112210165200000_btad684-B29","doi-asserted-by":"crossref","first-page":"411","DOI":"10.2307\/2532300","article-title":"Relative risk trees for censored survival data","volume":"48","author":"LeBlanc","year":"1992","journal-title":"Biometrics"},{"key":"2023112210165200000_btad684-B30","article-title":"Deephit: a deep learning approach to survival analysis with competing risks","volume":"32","author":"Lee","year":"2018","journal-title":"Proc AAAI Conf Artif Intell"},{"key":"2023112210165200000_btad684-B31","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/j.wneu.2013.06.014","article-title":"Intraoperative fluorescence-guided resection of high-grade gliomas: a comparison of the present techniques and evolution of future strategies","volume":"82","author":"Li","year":"2014","journal-title":"World Neurosurg"},{"key":"2023112210165200000_btad684-B32","author":"Liu","year":"2023"},{"key":"2023112210165200000_btad684-B33","doi-asserted-by":"crossref","first-page":"3451","DOI":"10.1158\/0008-5472.CAN-16-0270","article-title":"Label-free neurosurgical pathology with stimulated Raman imaging","volume":"76","author":"Lu","year":"2016","journal-title":"Cancer Res"},{"key":"2023112210165200000_btad684-B34","first-page":"4765","volume-title":"Advances in Neural Information Processing Systems","author":"Lundberg","year":"2017"},{"key":"2023112210165200000_btad684-B35","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1364\/BOE.4.000548","article-title":"Two-peaked 5-ALA-induced PpIX fluorescence emission spectrum distinguishes glioblastomas from low grade gliomas and infiltrative component of glioblastomas","volume":"4","author":"Montcel","year":"2013","journal-title":"Biomed Opt Express"},{"key":"2023112210165200000_btad684-B36","doi-asserted-by":"crossref","first-page":"i443","DOI":"10.1093\/bioinformatics\/btab285","article-title":"PathCNN: interpretable convolutional neural networks for survival prediction and pathway analysis applied to glioblastoma","volume":"37","author":"Oh","year":"2021","journal-title":"Bioinformatics"},{"key":"2023112210165200000_btad684-B37","doi-asserted-by":"crossref","first-page":"1842","DOI":"10.1001\/jama.2013.280319","article-title":"Glioblastoma and other malignant gliomas: a clinical review","volume":"310","author":"Omuro","year":"2013","journal-title":"JAMA"},{"key":"2023112210165200000_btad684-B38","doi-asserted-by":"crossref","first-page":"0027","DOI":"10.1038\/s41551-016-0027","article-title":"Rapid intraoperative histology of unprocessed surgical specimens via fibre-laser-based stimulated Raman scattering microscopy","volume":"1","author":"Orringer","year":"2017","journal-title":"Nat Biomed Eng"},{"key":"2023112210165200000_btad684-B39","doi-asserted-by":"crossref","first-page":"928","DOI":"10.3174\/ajnr.A7462","article-title":"The 2021 world health organization classification of tumors of the central nervous system: what neuroradiologists need to know","volume":"43","author":"Osborn","year":"2022","journal-title":"AJNR Am J Neuroradiol"},{"key":"2023112210165200000_btad684-B40","doi-asserted-by":"crossref","first-page":"v1","DOI":"10.1093\/neuonc\/nox158","article-title":"Cbtrus statistical report: primary brain and other central nervous system tumors diagnosed in the United States in 2010\u20132014","volume":"19","author":"Ostrom","year":"2017","journal-title":"Neuro Oncol"},{"key":"2023112210165200000_btad684-B41","doi-asserted-by":"crossref","first-page":"6700","DOI":"10.1073\/pnas.1706459114","article-title":"Intraoperative assessment of tumor margins during glioma resection by desorption electrospray ionization-mass spectrometry","volume":"114","author":"Pirro","year":"2017","journal-title":"Proc Natl Acad Sci USA"},{"key":"2023112210165200000_btad684-B42","doi-asserted-by":"crossref","first-page":"11622","DOI":"10.1038\/s41598-020-68011-4","article-title":"Longer-term (\u2265 2 years) survival in patients with glioblastoma in population-based studies pre-and post-2005: a systematic review and meta-analysis","volume":"10","author":"Poon","year":"2020","journal-title":"Sci Rep"},{"key":"2023112210165200000_btad684-B43","doi-asserted-by":"crossref","first-page":"13995","DOI":"10.1038\/s41598-017-14381-1","article-title":"Optical properties, spectral, and lifetime measurements of central nervous system tumors in humans","volume":"7","author":"Poulon","year":"2017","journal-title":"Sci Rep"},{"key":"2023112210165200000_btad684-B44","doi-asserted-by":"crossref","first-page":"11121","DOI":"10.1073\/pnas.1404724111","article-title":"Intraoperative mass spectrometry mapping of an onco-metabolite to guide brain tumor surgery","volume":"111","author":"Santagata","year":"2014","journal-title":"Proc Natl Acad Sci USA"},{"key":"2023112210165200000_btad684-B45","doi-asserted-by":"crossref","first-page":"7729","DOI":"10.1021\/ac201251s","article-title":"Real time analysis of brain tissue by direct combination of ultrasonic surgical aspiration and sonic spray mass spectrometry","volume":"83","author":"Sch\u00e4fer","year":"2011","journal-title":"Anal Chem"},{"key":"2023112210165200000_btad684-B46","doi-asserted-by":"crossref","first-page":"35","DOI":"10.2307\/2531894","article-title":"Regression trees for censored data","volume":"44","author":"Segal","year":"1988","journal-title":"Biometrics"},{"key":"2023112210165200000_btad684-B47","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1016\/S1470-2045(06)70665-9","article-title":"Fluorescence-guided surgery with 5-aminolevulinic acid for resection of malignant glioma: a randomised controlled multicentre phase III trial","volume":"7","author":"Stummer","year":"2006","journal-title":"Lancet Oncol"},{"key":"2023112210165200000_btad684-B48","doi-asserted-by":"crossref","first-page":"1211","DOI":"10.1007\/s00701-011-1001-x","article-title":"Cytoreductive surgery of glioblastoma as the key to successful adjuvant therapies: new arguments in an old discussion","volume":"153","author":"Stummer","year":"2011","journal-title":"Acta Neurochir (Wien)"},{"key":"2023112210165200000_btad684-B49","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.wneu.2011.02.005","article-title":"Impact of the combination of 5-aminolevulinic acid\u2013induced fluorescence with intraoperative magnetic resonance imaging\u2013guided surgery for glioma","volume":"76","author":"Tsugu","year":"2011","journal-title":"World Neurosurg"},{"key":"2023112210165200000_btad684-B50","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1038\/s42003-021-02622-z","article-title":"Gennet framework: interpretable deep learning for predicting phenotypes from genetic data","volume":"4","author":"van Hilten","year":"2021","journal-title":"Commun Biol"},{"key":"2023112210165200000_btad684-B51","doi-asserted-by":"crossref","first-page":"588990","DOI":"10.3389\/fonc.2020.588990","article-title":"Survnet: a novel deep neural network for lung cancer survival analysis with missing values","volume":"10","author":"Wang","year":"2020","journal-title":"Front Oncol"},{"key":"2023112210165200000_btad684-B52","doi-asserted-by":"crossref","first-page":"1352","DOI":"10.1093\/neuonc\/noz174","article-title":"Finding a four-leaf clover\u2014identifying long-term survivors in IDH-wildtype glioblastoma","volume":"21","author":"Wong","year":"2019","journal-title":"Neuro Oncol"},{"key":"2023112210165200000_btad684-B53","doi-asserted-by":"crossref","first-page":"S340","DOI":"10.1055\/s-0038-1660847","article-title":"Fluorescein-guided surgery for pediatric brainstem gliomas: preliminary study and technical notes","volume":"79","author":"Xue","year":"2018","journal-title":"J Neurol Surg B Skull Base"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btad684\/53332925\/btad684.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/39\/11\/btad684\/53674449\/btad684.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/39\/11\/btad684\/53674449\/btad684.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,1]],"date-time":"2024-11-01T16:43:27Z","timestamp":1730479407000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/doi\/10.1093\/bioinformatics\/btad684\/7413171"}},"subtitle":[],"editor":[{"given":"Pier Luigi","family":"Martelli","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2023,11,1]]},"references-count":53,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2023,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btad684","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.10.21.513161","asserted-by":"object"}]},"ISSN":["1367-4811"],"issn-type":[{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,11,1]]},"published":{"date-parts":[[2023,11,1]]},"article-number":"btad684"}}