{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T16:06:11Z","timestamp":1753891571463,"version":"3.41.2"},"reference-count":85,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T00:00:00Z","timestamp":1678838400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neuroinform."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Multimodal classification is increasingly common in electrophysiology studies. Many studies use deep learning classifiers with raw time-series data, which makes explainability difficult, and has resulted in relatively few studies applying explainability methods. This is concerning because explainability is vital to the development and implementation of clinical classifiers. As such, new multimodal explainability methods are needed.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>In this study, we train a convolutional neural network for automated sleep stage classification with electroencephalogram (EEG), electrooculogram, and electromyogram data. We then present a global explainability approach that is uniquely adapted for electrophysiology analysis and compare it to an existing approach. We present the first two local multimodal explainability approaches. We look for subject-level differences in the local explanations that are obscured by global methods and look for relationships between the explanations and clinical and demographic variables in a novel analysis.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We find a high level of agreement between methods. We find that EEG is globally the most important modality for most sleep stages and that subject-level differences in importance arise in local explanations that are not captured in global explanations. We further show that sex, followed by medication and age, had significant effects upon the patterns learned by the classifier.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Our novel methods enhance explainability for the growing field of multimodal electrophysiology classification, provide avenues for the advancement of personalized medicine, yield unique insights into the effects of demographic and clinical variables upon classifiers, and help pave the way for the implementation of multimodal electrophysiology clinical classifiers.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fninf.2023.1123376","type":"journal-article","created":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T04:51:58Z","timestamp":1678855918000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Novel methods for elucidating modality importance in multimodal electrophysiology classifiers"],"prefix":"10.3389","volume":"17","author":[{"given":"Charles A.","family":"Ellis","sequence":"first","affiliation":[]},{"given":"Mohammad S. E.","family":"Sendi","sequence":"additional","affiliation":[]},{"given":"Rongen","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Darwin A.","family":"Carbajal","sequence":"additional","affiliation":[]},{"given":"May D.","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Robyn L.","family":"Miller","sequence":"additional","affiliation":[]},{"given":"Vince D.","family":"Calhoun","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,3,15]]},"reference":[{"key":"B1","article-title":"TensorFlow: A system for large-scale machine learning","author":"Abadi","year":"2016","journal-title":"Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation"},{"key":"B2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/LISAT.2015.7160185","article-title":"A comparison of different machine learning algorithms using single channel EEG signal for classifying human sleep stages","author":"Aboalayon","year":"2015","journal-title":"Proceedings of the 2015 IEEE Long Island Systems, Applications and Technology Conference, LISAT 2015"},{"key":"B3","first-page":"1","article-title":"INNvestigate neural networks!","volume":"20","author":"Alber","year":"2019","journal-title":"J. Mach. Learn. Res."},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-28954-6_9","article-title":"Towards better understanding of gradient-based attribution methods for deep neural networks","author":"Ancona","year":"2018","journal-title":"Proceedings of the International Conference on Learning Representations"},{"key":"B5","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1053\/smrv.2000.0144","article-title":"Sleep EEG, depression and gender.","volume":"5","author":"Armitage","year":"2001","journal-title":"Sleep Med. Rev."},{"key":"B6","doi-asserted-by":"publisher","first-page":"159","DOI":"10.18653\/v1\/W17-5221","article-title":"Explaining Recurrent Neural Network Predictions in Sentiment Analysis","author":"Arras","year":"2017","journal-title":"Proceedings of the EMNLP 2017 \u2013 8th workshop on computational approaches to subjectivity, sentiment &amp; social media Analysis"},{"key":"B7","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1016\/j.vascn.2014.05.003","article-title":"Effects of amphetamine, diazepam and caffeine on polysomnography (EEG, EMG, EOG)-derived variables measured using telemetry in Cynomolgus monkeys.","volume":"70","author":"Authier","year":"2014","journal-title":"J. Pharmacol. Toxicol. Methods"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0130140","article-title":"On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation.","volume":"10","author":"Bach","year":"2015","journal-title":"PLoS One"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0272167","article-title":"Detection of sleep apnea from single-channel electroencephalogram (EEG) using an explainable convolutional neural network.","volume":"17","author":"Barnes","year":"2021","journal-title":"PLoS One"},{"key":"B10","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1093\/sleep\/26.3.313","article-title":"Sleep EEG power spectra, insomnia, and chronic use of benzodiazepines.","volume":"26","author":"Bastien","year":"2003","journal-title":"Sleep"},{"key":"B11","first-page":"361","article-title":"Effect of age on EEG arousals in normal sleep.","volume":"21","author":"Boselli","year":"1998","journal-title":"Sleep"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2020.589303","article-title":"Predicting sex from EEG: Validity and generalizability of deep-learning-based interpretable classifier.","volume":"14","author":"Bu\u010dkov\u00e1","year":"2020","journal-title":"Front. Neurosci."},{"key":"B13","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1007\/s00213-004-1961-0","article-title":"Comparative effects of duloxetine and desipramine on sleep EEG in healthy subjects.","volume":"177","author":"Chalon","year":"2005","journal-title":"Psychopharmacology"},{"key":"B14","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1109\/TNSRE.2018.2813138","article-title":"A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time series.","volume":"26","author":"Chambon","year":"2018","journal-title":"IEEE Trans. Neural. Syst. Rehabil. Eng."},{"key":"B15","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1109\/TNSRE.2018.2813138","article-title":"A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time series.","volume":"26","author":"Chambon","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"B16","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1109\/TNSRE.2018.2890272","article-title":"Automatic sleep stage classification based on subthalamic local field potentials.","volume":"27","author":"Chen","year":"2019","journal-title":"IEEE Trans. Neural. Syst. Rehabil. Eng."},{"key":"B17","doi-asserted-by":"publisher","first-page":"1037","DOI":"10.1016\/j.sleep.2014.05.007","article-title":"Age-related changes in slow wave activity rise time and NREM sleep EEG with and without zolpidem in healthy young and older adults.","volume":"15","author":"Chinoy Frey","year":"2014","journal-title":"Sleep Med."},{"journal-title":"Keras.","year":"2015","author":"Chollet","key":"B18"},{"key":"B19","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1046\/j.1365-2869.1997.00041.x","article-title":"Slow-wave sleep: Do young adult men and women age differently?","volume":"6","author":"Ehlers","year":"1997","journal-title":"J. Sleep Res."},{"key":"B20","doi-asserted-by":"publisher","first-page":"809","DOI":"10.1109\/TNSRE.2021.3076234","article-title":"An attention-based deep learning approach for sleep stage classification with single-channel EEG.","volume":"29","author":"Eldele","year":"2021","journal-title":"IEEE Trans. Neural. Syst. Rehabil. Eng."},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1101\/2021.05.12.443594","article-title":"An explainable deep learning approach for multimodal electrophysiology classification.","author":"Ellis","year":"","journal-title":"bioRxiv"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1109\/BIBE52308.2021.9635541","article-title":"A novel local ablation approach for explaining multimodal classifiers","author":"Ellis","year":"","journal-title":"Proceedings of the 2021 IEEE 21st international conference on bioinformatics and bioengineering (BIBE)"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1109\/BIBE52308.2021.9635243","article-title":"A novel local explainability approach for spectral insight into raw EEG-based deep learning classifiers","author":"Ellis","year":"","journal-title":"Proceedings of the 21st IEEE international conference on bioinformatics and bioengineering"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1101\/2021.07.14.452360","article-title":"A gradient-based spectral explainability method for EEG deep learning classifiers.","author":"Ellis","year":"","journal-title":"bioRxiv"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1101\/2021.12.16.473028","article-title":"A model visualization-based approach for insight into waveforms and spectra learned by CNNs.","author":"Ellis","year":"","journal-title":"bioRxiv"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1109\/BIBE52308.2021.9635460","article-title":"A gradient-based approach for explaining multimodal deep learning classifiers","author":"Ellis","year":"","journal-title":"Proceedings of the 2021 IEEE 21st international conference on bioinformatics and bioengineering (BIBE)"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1109\/BIBM52615.2021.9669593","article-title":"A novel activation maximization-based approach for insight into electrophysiology classifiers","author":"Ellis","year":"","journal-title":"Proceedings of the 2021 IEEE international conference on bioinformatics and biomedicine (BIBM)"},{"key":"B28","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/NER49283.2021.9441217","article-title":"Hierarchical neural network with layer-wise relevance propagation for interpretable multiclass neural state classification","author":"Ellis","year":"","journal-title":"Proceedings of the 10th international IEEE\/EMBS conference on neural engineering (NER)"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC46164.2021.9630506","article-title":"Explainable Sleep Stage Classification with Multimodal Electrophysiology Time-series","author":"Ellis","year":"","journal-title":"Proceedings of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine &amp; Biology Society (EMBC)"},{"key":"B30","doi-asserted-by":"publisher","first-page":"2458","DOI":"10.1109\/IEMBS.2006.260075","article-title":"EOG and EMG: Two important switches in automatic sleep stage classification.","volume":"2006","author":"Estrada","year":"2006","journal-title":"Conf. Proc. IEEE Eng. Med. Biol. Soc."},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1109\/INDICON49873.2020.9342272","article-title":"Binary state prediction of sleep or wakefulness using EEG and EOG features","author":"Ganesan","year":"2020","journal-title":"Proceedings of the 2020 IEEE 17th India council international conference (INDICON)"},{"key":"B32","doi-asserted-by":"publisher","first-page":"e215","DOI":"10.1161\/01.CIR.101.23.e215","article-title":"PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals.","volume":"101","author":"Goldberger","year":"2000","journal-title":"Circulation"},{"key":"B33","first-page":"214","article-title":"Benzodiazepine pharmacology and central nervous system-mediated effects.","volume":"13","author":"Griffin","year":"2013","journal-title":"Ochsner J."},{"journal-title":"The AASM manual for scoring of sleep and associated events: Rules, terminology, and technical specifications","year":"2007","author":"Iber","key":"B34"},{"key":"B35","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1109\/10.867928","article-title":"Analysis of a sleep-dependent neuronal feedback loop: The slow-wave microcontinuity of the EEG.","volume":"47","author":"Kemp","year":"2000","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"B36","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1016\/j.cmpb.2015.10.013","article-title":"ISRUC-Sleep: A comprehensive public dataset for sleep researchers.","volume":"124","author":"Khalighi","year":"2016","journal-title":"Comput. Methods Programs Biomed."},{"key":"B37","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1109\/ICUFN.2018.8436712","article-title":"\u201cAutomatic Sleep Stage Classification Using EEG and EMG Signal,\u201d","author":"Kim","year":"2018","journal-title":"Proceedings of the 2018 tenth international conference on ubiquitous and future networks (ICUFN)"},{"key":"B38","article-title":"Adam: A method for stochastic optimization","author":"Kingma","year":"2015","journal-title":"Proceedings of the 3rd international conference on learning representations (ICLR)"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.3390\/s18051383","article-title":"Electroencephalography based fusion two-dimensional (2D)-convolution neural networks (CNN) model for emotion recognition system.","volume":"18","author":"Kwon","year":"2018","journal-title":"Sensors"},{"key":"B40","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1016\/j.jneumeth.2015.01.022","article-title":"Learning machines and sleeping brains: Automatic sleep stage classification using decision-tree multi-class support vector machines.","volume":"250","author":"Lajnef","year":"2015","journal-title":"J. Neurosci. Methods"},{"key":"B41","doi-asserted-by":"publisher","first-page":"369","DOI":"10.1016\/S1388-2457(00)00542-3","article-title":"Age-dependent changes in sleep EEG topography.","volume":"112","author":"Landolt","year":"2001","journal-title":"Clin. Neurophysiol."},{"journal-title":"Automatic sleep stage classification based on two-channel EOG and one-channel EMG.","year":"2021","author":"Li","key":"B42"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3358160","article-title":"An explainable deep fusion network for affect recognition using physiological signals","author":"Lin","year":"2019","journal-title":"Proceedings of the 28th ACM international conference on information and knowledge management"},{"key":"B44","doi-asserted-by":"publisher","first-page":"482","DOI":"10.3109\/07853890.2015.1074271","article-title":"Age and gender variations of sleep in subjects without sleep disorders.","volume":"47","author":"Luca","year":"2015","journal-title":"Ann. Med."},{"key":"B45","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.bpsc.2019.07.007","article-title":"Machine learning models identify multimodal measurements highly predictive of transdiagnostic symptom severity for mood, anhedonia, and anxiety.","volume":"5","author":"Mellem","year":"2020","journal-title":"Biol. Psychiatry Cogn. Neurosci. Neuroimaging"},{"key":"B46","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.compbiomed.2019.01.013","article-title":"Cascaded LSTM recurrent neural network for automated sleep stage classification using single-channel EEG signals.","volume":"106","author":"Michielli","year":"2019","journal-title":"Comput. Biol. Med."},{"journal-title":"Interpretable machine learning. A guide for making black box models explainable.","year":"2018","author":"Molnar","key":"B47"},{"key":"B48","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.dsp.2017.10.011","article-title":"Methods for interpreting and understanding deep neural networks.","volume":"73","author":"Montavon","year":"2018","journal-title":"Digit. Signal. Process A Rev. J."},{"key":"B49","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1093\/sleep\/18.7.557","article-title":"Age and gender affect different characteristics of slow waves in the sleep EEG.","volume":"18","author":"Mourtazaev","year":"1995","journal-title":"Sleep"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0216456","article-title":"SleepEEGNet: Automated sleep stage scoring with sequence to sequence deep learning approach.","volume":"14","author":"Mousavi","year":"2019","journal-title":"PLoS One"},{"key":"B51","doi-asserted-by":"publisher","first-page":"2398","DOI":"10.1145\/3394486.3403289","article-title":"Easy perturbation EEG algorithm for spectral importance (easyPEASI): A simple method to identify important spectral features of EEG in deep learning models","author":"Nahmias","year":"2020","journal-title":"Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery &amp; Data Mining"},{"key":"B52","first-page":"1","article-title":"Sleep stage classification based on EEG, EOG, and CNN-GRU deep learning model","author":"Niroshana","year":"2019","journal-title":"Proceedings of the 2019 IEEE 10th international conference on awareness science and technology (iCAST)"},{"key":"B53","doi-asserted-by":"publisher","first-page":"118","DOI":"10.4088\/PCC.v03n0303","article-title":"Medications for the treatment of sleep disorders: An overview.","volume":"3","author":"Pagel","year":"2001","journal-title":"Prim. Care Companion J. Clin. Psychiatry"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2021.102038","article-title":"STQS: Interpretable multi-modal spatial-temporal-sequential model for automatic sleep scoring.","volume":"114","author":"Pathak","year":"2021","journal-title":"Artif. Intell. Med."},{"key":"B55","article-title":"RisE: Randomized input sampling for explanation of black-box models","author":"Petsiuk","year":"2018","journal-title":"Proceedings of the British machine vision conference 2018"},{"key":"B56","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/jsr.12755","article-title":"Saccadic eye movements estimate prolonged time awake.","volume":"28","author":"Pettersson","year":"2019","journal-title":"J. Sleep Res."},{"key":"B57","doi-asserted-by":"publisher","first-page":"1285","DOI":"10.1109\/TBME.2018.2872652","article-title":"Joint classification and prediction CNN framework for automatic sleep stage classification.","volume":"66","author":"Phan","year":"2019","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"B58","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-019-56927-5","article-title":"Precision medicine and artificial intelligence: A pilot study on deep learning for hypoglycemic events detection based on ECG.","volume":"10","author":"Porumb","year":"2020","journal-title":"Sci Rep."},{"key":"B59","first-page":"1077","article-title":"The sleep heart health study: Design, rationale, and methods.","volume":"20","author":"Quan","year":"1997","journal-title":"Sleep"},{"key":"B60","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1016\/j.compbiomed.2018.08.022","article-title":"Sleep stage classification using single-channel EOG.","volume":"102","author":"Rahman","year":"2018","journal-title":"Comput. Biol. Med."},{"journal-title":"A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects.","year":"1968","author":"Rechtschaffen","key":"B61"},{"key":"B62","doi-asserted-by":"publisher","first-page":"1135","DOI":"10.1145\/2939672.2939778","article-title":"\u201cWhy should i trust you?\u201d Explaining the predictions of any classifier","author":"Ribeiro","year":"2016","journal-title":"Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining"},{"key":"B63","article-title":"Deep learning using EEG data in time and frequency domains for sleep stage classification","author":"Rojas","year":"2017","journal-title":"Proceedings of the IWANN 2017 advances in computational intelligence"},{"key":"B64","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2019.00806","article-title":"Deep learning with EEG spectrograms in rapid eye movement behavior disorder.","volume":"10","author":"Ruffini","year":"2019","journal-title":"Front. Neurol."},{"key":"B65","doi-asserted-by":"publisher","first-page":"2660","DOI":"10.1109\/TNNLS.2016.2599820","article-title":"Evaluating the visualization of what a deep neural network has learned.","volume":"28","author":"Samek","year":"","journal-title":"IEEE Trans. Neural. Netw. Learn. Syst."},{"key":"B66","article-title":"Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models.","author":"Samek","year":"","journal-title":"arXiv"},{"key":"B67","doi-asserted-by":"publisher","first-page":"336","DOI":"10.1007\/s11263-019-01228-7","article-title":"Grad-CAM: Visual explanations from deep networks via gradient-based localization.","volume":"128","author":"Selvaraju","year":"2020","journal-title":"Int. J. Comput. Vis."},{"journal-title":"Deep inside convolutional networks: Visualizing image classification models and saliency maps.","year":"2013","author":"Simonyan","key":"B68"},{"key":"B69","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1016\/j.bspc.2017.12.001","article-title":"A convolutional neural network for sleep stage scoring from raw single-channel EEG.","volume":"42","author":"Sors","year":"2018","journal-title":"Biomed. Signal. Process. Control"},{"key":"B70","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1016\/j.jneumeth.2016.10.008","article-title":"Interpretable deep neural networks for single-trial EEG classification.","volume":"274","author":"Sturm","year":"2016","journal-title":"J. Neurosci. Methods"},{"key":"B71","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1001\/amajethics.2019.160","article-title":"Are current tort liability doctrines adequate for addressing injury caused by AI?","volume":"21","author":"Sullivan","year":"2019","journal-title":"AMA J. Ethics"},{"key":"B72","doi-asserted-by":"publisher","first-page":"1998","DOI":"10.1109\/TNSRE.2017.2721116","article-title":"DeepSleepNet: A model for automatic sleep stage scoring based on raw single-channel EEG.","volume":"25","author":"Supratak","year":"2017","journal-title":"IEEE Trans. Neural. Syst. Rehabil. Eng."},{"journal-title":"Analyzing neuroimaging data through recurrent deep learning models.","year":"2018","author":"Thomas","key":"B73"},{"key":"B74","doi-asserted-by":"publisher","DOI":"10.1101\/2022.11.17.516913","article-title":"Sleep deprivation measured by voice analysis.","author":"Thoret","year":"2022","journal-title":"bioRxiv"},{"key":"B75","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2021.109297","article-title":"Probing machine-learning classifiers using noise, bubbles, and reverse correlation.","volume":"362","author":"Thoret","year":"2021","journal-title":"J Neurosci Methods."},{"key":"B76","doi-asserted-by":"publisher","first-page":"1587","DOI":"10.1007\/s10439-015-1444-y","article-title":"Automatic sleep stage scoring using time-frequency analysis and stacked sparse autoencoders.","volume":"44","author":"Tsinalis","year":"","journal-title":"Ann. Biomed. Eng."},{"key":"B77","article-title":"Automatic sleep stage scoring with single-channel EEG using convolutional neural networks.","author":"Tsinalis","year":"","journal-title":"arXiv"},{"key":"B78","doi-asserted-by":"publisher","first-page":"444","DOI":"10.1016\/S0009-9236(97)90123-5","article-title":"Pharmacodynamics of temazepam in primary insomnia: Assessment of the value of quantitative electrocephalography and saccadic eye movements in predicting improvement of sleep.","volume":"62","author":"Tuk","year":"1997","journal-title":"Clin. Pharmacol. Ther."},{"key":"B79","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1093\/sleep\/13.3.279","article-title":"Alternative electrode placement in (automatic) sleep scoring (F(pz)-C(z)\/P(z)-O(z) versus C(4)-A(1)).","volume":"13","author":"Van Sweden","year":"1990","journal-title":"Sleep"},{"key":"B80","doi-asserted-by":"publisher","DOI":"10.1109\/MLSP.2017.8168133","article-title":"Deep convolutional neural networks for interpretable analysis of EEG sleep stage scoring","author":"Vilamala","year":"2017","journal-title":"Proceedings of the IEEE 2017 international workshop on machine learning for signal processing"},{"key":"B81","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1109\/ICTC49870.2020.9289335","article-title":"An ensemble deep learning approach for sleep stage classification via single-channel EEG and EOG","author":"Wang","year":"2020","journal-title":"Proceedings of the 11th international conference on ICT convergence: Data, network, and AI in the age of Untact"},{"key":"B82","doi-asserted-by":"publisher","DOI":"10.1109\/MLSP.2017.8168179","article-title":"Discriminating schizophrenia from normal controls using resting state functional network connectivity: A deep neural network and layer-wise relevance propagation method","author":"Yan","year":"2017","journal-title":"Proceedings of the IEEE international workshop on machine learning for signal processing"},{"journal-title":"CVxTz\/EEG\\_classification: v1.0.","year":"2020","author":"Youness","key":"B83"},{"key":"B84","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3397325","article-title":"Making sense of sleep: Multimodal sleep stage classification in a large, diverse population using movement and cardiac sensing.","volume":"4","author":"Zhai","year":"2020","journal-title":"Proc. ACM Interact. Mobile Wearable Ubiquitous Technol."},{"key":"B85","doi-asserted-by":"publisher","first-page":"856","DOI":"10.1016\/j.neuroimage.2011.01.008","article-title":"Multimodal classification of Alzheimer\u2019s disease and mild cognitive impairment.","volume":"55","author":"Zhang","year":"2011","journal-title":"Neuroimage"}],"container-title":["Frontiers in Neuroinformatics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fninf.2023.1123376\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T04:52:23Z","timestamp":1678855943000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fninf.2023.1123376\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,15]]},"references-count":85,"alternative-id":["10.3389\/fninf.2023.1123376"],"URL":"https:\/\/doi.org\/10.3389\/fninf.2023.1123376","relation":{},"ISSN":["1662-5196"],"issn-type":[{"type":"electronic","value":"1662-5196"}],"subject":[],"published":{"date-parts":[[2023,3,15]]},"article-number":"1123376"}}