{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,3]],"date-time":"2026-02-03T21:12:25Z","timestamp":1770153145538,"version":"3.49.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T00:00:00Z","timestamp":1729900800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T00:00:00Z","timestamp":1729900800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"European Union\u2019s Horizon 2020 research and innovation programme","award":["964220"],"award-info":[{"award-number":["964220"]}]},{"DOI":"10.13039\/501100005366","name":"University of Oslo","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005366","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Brain Inf."],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Deep Learning (DL) has the potential to enhance patient outcomes in healthcare by implementing proficient systems for disease detection and diagnosis. However, the complexity and lack of interpretability impede their widespread adoption in critical high-stakes predictions in healthcare. Incorporating uncertainty estimations in DL systems can increase trustworthiness, providing valuable insights into the model\u2019s confidence and improving the explanation of predictions. Additionally, introducing explainability measures, recognized and embraced by healthcare experts, can help address this challenge. In this study, we investigate DL models\u2019 ability to predict sex directly from electroencephalography (EEG) data. While sex prediction have limited direct clinical application, its binary nature makes it a valuable benchmark for optimizing deep learning techniques in EEG data analysis. Furthermore, we explore the use of DL ensembles to improve performance over single models and as an approach to increase interpretability and performance through uncertainty estimation. Lastly, we use a data-driven approach to evaluate the relationship between frequency bands and sex prediction, offering insights into their relative importance. InceptionNetwork, a single DL model, achieved 90.7% accuracy and an AUC of 0.947, and the best-performing ensemble, combining variations of InceptionNetwork and EEGNet, achieved 91.1% accuracy in predicting sex from EEG data using five-fold cross-validation. Uncertainty estimation through deep ensembles led to increased prediction performance, and the models were able to classify sex in all frequency bands, indicating sex-specific features across all bands.<\/jats:p>","DOI":"10.1186\/s40708-024-00239-6","type":"journal-article","created":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T16:01:46Z","timestamp":1729958506000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Advancing EEG prediction with deep learning and uncertainty estimation"],"prefix":"10.1186","volume":"11","author":[{"given":"Mats","family":"Tveter","sequence":"first","affiliation":[]},{"given":"Thomas","family":"Tveitst\u00f8l","sequence":"additional","affiliation":[]},{"given":"Christoffer","family":"Hatlestad-Hall","sequence":"additional","affiliation":[]},{"given":"Ana S.","family":"P\u00e9rez T.","sequence":"additional","affiliation":[]},{"given":"Erik","family":"Taub\u00f8ll","sequence":"additional","affiliation":[]},{"given":"Anis","family":"Yazidi","sequence":"additional","affiliation":[]},{"given":"Hugo L.","family":"Hammer","sequence":"additional","affiliation":[]},{"given":"Ira R. J. Hebold","family":"Haraldsen","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,10,26]]},"reference":[{"key":"239_CR1","doi-asserted-by":"publisher","DOI":"10.1136\/svn-2017-000101","author":"F Jiang","year":"2017","unstructured":"Jiang F, Jiang Y, Zhi H et al (2017) Artificial intelligence in healthcare: past, present and future. Stroke Vasc Neurol. https:\/\/doi.org\/10.1136\/svn-2017-000101","journal-title":"Stroke Vasc Neurol"},{"issue":"1","key":"239_CR2","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1038\/s41591-018-0320-3","volume":"25","author":"B Norgeot","year":"2019","unstructured":"Norgeot B, Glicksberg BS, Butte AJ (2019) A call for deep-learning healthcare. Nat Med 25(1):14\u201315. https:\/\/doi.org\/10.1038\/s41591-018-0320-3","journal-title":"Nat Med"},{"issue":"1","key":"239_CR3","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","volume":"28","author":"P Rajpurkar","year":"2022","unstructured":"Rajpurkar P, Chen E, Banerjee O et al (2022) Ai in health and medicine. Nat Med 28(1):31\u201338. https:\/\/doi.org\/10.1038\/s41591-021-01614-0","journal-title":"Nat Med"},{"key":"239_CR4","unstructured":"Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, http:\/\/www.deeplearningbook.org"},{"issue":"7553","key":"239_CR5","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun Y, Bengio Y, Hinton G (2015) Deep learning. nature 521(7553):436\u2013444. https:\/\/doi.org\/10.1038\/nature14539","journal-title":"nature"},{"issue":"5555\/3295222","key":"239_CR6","first-page":"3295309","volume":"10","author":"A Kendall","year":"2017","unstructured":"Kendall A, Gal Y (2017) What uncertainties do we need in Bayesian deep learning for computer vision? Adv Neural Inf Process Syst 10(5555\/3295222):3295309","journal-title":"Adv Neural Inf Process Syst"},{"key":"239_CR7","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1007\/s10994-021-05946-3","volume":"110","author":"E H\u00fcllermeier","year":"2021","unstructured":"H\u00fcllermeier E, Waegeman W (2021) Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods. Mach Learn 110:457\u2013506. https:\/\/doi.org\/10.1007\/s10994-021-05946-3","journal-title":"Mach Learn"},{"key":"239_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2022.105151","volume":"115","author":"M Ganaie","year":"2022","unstructured":"Ganaie M, Hu M, Malik A et al (2022) Ensemble deep learning: a review. Eng Appl Artif Intell 115:105151. https:\/\/doi.org\/10.1016\/j.engappai.2022.105151","journal-title":"Eng Appl Artif Intell"},{"key":"239_CR9","doi-asserted-by":"publisher","unstructured":"Perrone MP, Cooper LN (1995) When networks disagree: ensemble methods for hybrid neural networks. In: How We Learn; How We Remember: Toward An Understanding Of Brain And Neural Systems: Selected Papers of Leon N Cooper. World Scientific, p 342\u2013358, https:\/\/doi.org\/10.1142\/9789812795885_0025","DOI":"10.1142\/9789812795885_0025"},{"key":"239_CR10","doi-asserted-by":"publisher","DOI":"10.3390\/s19050987","author":"X Jiang","year":"2019","unstructured":"Jiang X, Bian GB, Tian Z (2019) Removal of artifacts from eeg signals: a review. Sensors. https:\/\/doi.org\/10.3390\/s19050987","journal-title":"Sensors"},{"key":"239_CR11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.clinph.2023.03.002","volume":"150","author":"C Hatlestad-Hall","year":"2023","unstructured":"Hatlestad-Hall C, Bru\u00f1a R, Liljestr\u00f6m M et al (2023) Reliable evaluation of functional connectivity and graph theory measures in source-level eeg: How many electrodes are enough? Clin Neurophysiol 150:1\u201316. https:\/\/doi.org\/10.1016\/j.clinph.2023.03.002","journal-title":"Clin Neurophysiol"},{"issue":"5","key":"239_CR12","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/ab260c","volume":"16","author":"Y Roy","year":"2019","unstructured":"Roy Y, Banville H, Albuquerque I et al (2019) Deep learning-based electroencephalography analysis: a systematic review. J Neural Eng 16(5):051001. https:\/\/doi.org\/10.1088\/1741-2552\/ab260c","journal-title":"J Neural Eng"},{"issue":"5","key":"239_CR13","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/aace8c","volume":"15","author":"VJ Lawhern","year":"2018","unstructured":"Lawhern VJ, Solon AJ, Waytowich NR et al (2018) EEGNet: a compact convolutional neural network for EEG-based brain\u2013computer interfaces. J Neural Eng 15(5):056013. https:\/\/doi.org\/10.1088\/1741-2552\/aace8c","journal-title":"J Neural Eng"},{"issue":"6","key":"239_CR14","doi-asserted-by":"publisher","first-page":"1936","DOI":"10.1007\/s10618-020-00710-y","volume":"34","author":"H Ismail Fawaz","year":"2020","unstructured":"Ismail Fawaz H, Lucas B, Forestier G et al (2020) Inceptiontime: finding alexnet for time series classification. Data Min Knowl Disc 34(6):1936\u20131962. https:\/\/doi.org\/10.1007\/s10618-020-00710-y","journal-title":"Data Min Knowl Disc"},{"key":"239_CR15","doi-asserted-by":"publisher","unstructured":"Haraldsen IH, Hatlestad-Hall C, Marra C et al (2024) Intelligent digital tools for screening of brain connectivity and dementia risk estimation in people affected by mild cognitive impairment: the ai-mind clinical study protocol. Front Neurorobot. https:\/\/doi.org\/10.3389\/fnbot.2023.1289406","DOI":"10.3389\/fnbot.2023.1289406"},{"issue":"1","key":"239_CR16","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2017.181","volume":"4","author":"LM Alexander","year":"2017","unstructured":"Alexander LM, Escalera J, Ai L et al (2017) An open resource for transdiagnostic research in pediatric mental health and learning disorders. Sci Data 4(1):170181. https:\/\/doi.org\/10.1038\/sdata.2017.181","journal-title":"Sci Data"},{"issue":"1","key":"239_CR17","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.jneumeth.2003.10.009","volume":"134","author":"A Delorme","year":"2004","unstructured":"Delorme A, Makeig S (2004) Eeglab: An open source toolbox for analysis of single-trial eeg dynamics including independent component analysis. J Neurosci Methods 134(1):9\u201321. https:\/\/doi.org\/10.1016\/j.jneumeth.2003.10.009","journal-title":"J Neurosci Methods"},{"key":"239_CR18","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2019.116356","author":"A de Cheveign\u00e9","year":"2019","unstructured":"de Cheveign\u00e9 A (2019) Zapline: a simple and effective method to remove power line artifacts. Neuroimage. https:\/\/doi.org\/10.1016\/j.neuroimage.2019.116356","journal-title":"Neuroimage"},{"key":"239_CR19","unstructured":"Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Teh YW, Titterington M (eds) Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Proceedings of Machine Learning Research, vol\u00a09. PMLR, Chia Laguna Resort, Sardinia, Italy, pp 249\u2013256, https:\/\/proceedings.mlr.press\/v9\/glorot10a.html"},{"key":"239_CR20","unstructured":"Chollet F, et\u00a0al (2015) Keras. https:\/\/github.com\/fchollet\/keras"},{"issue":"7825","key":"239_CR21","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","volume":"585","author":"CR Harris","year":"2020","unstructured":"Harris CR, Millman KJ, van der Walt SJ et al (2020) Array programming with NumPy. Nature 585(7825):357\u2013362. https:\/\/doi.org\/10.1038\/s41586-020-2649-2","journal-title":"Nature"},{"issue":"267","key":"239_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fnins.2013.00267","volume":"7","author":"A Gramfort","year":"2013","unstructured":"Gramfort A, Luessi M, Larson E et al (2013) MEG and EEG data analysis with MNE-Python. Front Neurosci 7(267):1\u201313. https:\/\/doi.org\/10.3389\/fnins.2013.00267","journal-title":"Front Neurosci"},{"key":"239_CR23","unstructured":"Gal Y, Ghahramani Z (2016) Dropout as a bayesian approximation: representing model uncertainty in deep learning. In: Balcan MF, Weinberger KQ (eds) Proceedings of The 33rd International Conference on Machine Learning, Proceedings of Machine Learning Research, vol\u00a048. PMLR, New York, New York, USA, pp 1050\u20131059, https:\/\/proceedings.mlr.press\/v48\/gal16.html"},{"key":"239_CR24","unstructured":"Kendall A, Badrinarayanan V, Cipolla R (2015) Bayesian segnet: model uncertainty in deep convolutional encoder-decoder architectures for scene understanding. ArXiv abs\/1511.02680"},{"key":"239_CR25","doi-asserted-by":"publisher","first-page":"7241","DOI":"10.3390\/s21217241","volume":"21","author":"D Milan\u00e9s-Hermosilla","year":"2021","unstructured":"Milan\u00e9s-Hermosilla D, Trujillo Codorni\u00fa R, L\u00f3pez-Baracaldo R et al (2021) Monte carlo dropout for uncertainty estimation and motor imagery classification. Sensors 21:7241","journal-title":"Sensors"},{"issue":"1","key":"239_CR26","doi-asserted-by":"publisher","first-page":"3069","DOI":"10.1038\/s41598-018-21495-7","volume":"8","author":"MJAM van Putten","year":"2018","unstructured":"van Putten MJAM, Olbrich S, Arns M (2018) Predicting sex from brain rhythms with deep learning. Sci Rep 8(1):3069. https:\/\/doi.org\/10.1038\/s41598-018-21495-7","journal-title":"Sci Rep"},{"key":"239_CR27","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2020.589303","author":"B Buckov\u00e1","year":"2020","unstructured":"Buckov\u00e1 B, Brunovsk\u00fd M, Bare\u0161 M et al (2020) Predicting sex from eeg: validity and generalizability of deep-learning-based interpretable classifier. Front Neurosci. https:\/\/doi.org\/10.3389\/fnins.2020.589303","journal-title":"Front Neurosci"},{"key":"239_CR28","doi-asserted-by":"publisher","unstructured":"Truong D, Milham M, Makeig S, et\u00a0al (2021) Deep convolutional neural network applied to electroencephalography: Raw data vs spectral features. In: 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pp 1039\u20131042, https:\/\/doi.org\/10.1109\/EMBC46164.2021.9630708","DOI":"10.1109\/EMBC46164.2021.9630708"},{"issue":"14","key":"239_CR29","doi-asserted-by":"publisher","first-page":"4848","DOI":"10.1002\/hbm.26417","volume":"44","author":"T Jochmann","year":"2023","unstructured":"Jochmann T, Seibel MS, Jochmann E et al (2023) Sex-related patterns in the electroencephalogram and their relevance in machine learning classifiers. Hum Brain Mapp 44(14):4848\u20134858. https:\/\/doi.org\/10.1002\/hbm.26417","journal-title":"Hum Brain Mapp"},{"key":"239_CR30","unstructured":"W F, F. V (1979) The sex differences in the normal resting eeg of young adults. EEG EMG Z Elektroenzephalogr Elektromyogr Verwandte Geb"},{"key":"239_CR31","doi-asserted-by":"crossref","unstructured":"Fawaz HI, Forestier G, Weber J, et\u00a0al (2019) Deep neural network ensembles for time series classification. 2019 International Joint Conference on Neural Networks (IJCNN) pp 1\u20136. https:\/\/api.semanticscholar.org\/CorpusID:80628397","DOI":"10.1109\/IJCNN.2019.8852316"},{"key":"239_CR32","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.ijpsycho.2021.01.008","volume":"161","author":"AE Cave","year":"2021","unstructured":"Cave AE, Barry RJ (2021) Sex differences in resting eeg in healthy young adults. Int J Psychophysiol 161:35\u201343. https:\/\/doi.org\/10.1016\/j.ijpsycho.2021.01.008","journal-title":"Int J Psychophysiol"},{"key":"239_CR33","doi-asserted-by":"publisher","first-page":"2076","DOI":"10.1109\/tnsre.2021.3117970","volume":"29","author":"L Fiorillo","year":"2021","unstructured":"Fiorillo L, Favaro P, Faraci FD (2021) DeepSleepNet-lite: a simplified automatic sleep stage scoring model with uncertainty estimates. IEEE Trans Neural Syst Rehabil Eng 29:2076\u20132085. https:\/\/doi.org\/10.1109\/tnsre.2021.3117970","journal-title":"IEEE Trans Neural Syst Rehabil Eng"},{"issue":"2","key":"239_CR34","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1002\/jbmr.2613","volume":"31","author":"EM Lillie","year":"2016","unstructured":"Lillie EM, Urban JE, Lynch SK et al (2016) Evaluation of skull cortical thickness changes with age and sex from computed tomography scans. J Bone Miner Res 31(2):299\u2013307. https:\/\/doi.org\/10.1002\/jbmr.2613","journal-title":"J Bone Miner Res"}],"container-title":["Brain Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40708-024-00239-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40708-024-00239-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40708-024-00239-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T16:03:02Z","timestamp":1729958582000},"score":1,"resource":{"primary":{"URL":"https:\/\/braininformatics.springeropen.com\/articles\/10.1186\/s40708-024-00239-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,26]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["239"],"URL":"https:\/\/doi.org\/10.1186\/s40708-024-00239-6","relation":{},"ISSN":["2198-4018","2198-4026"],"issn-type":[{"value":"2198-4018","type":"print"},{"value":"2198-4026","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,26]]},"assertion":[{"value":"19 April 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 September 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 October 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential Competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"27"}}