{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T11:49:10Z","timestamp":1790768950561,"version":"4.1.0"},"reference-count":64,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T00:00:00Z","timestamp":1614729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61401518"],"award-info":[{"award-number":["61401518"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["11974231"],"award-info":[{"award-number":["11974231"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Physiol."],"abstract":"<jats:p>This study centers on automatic sleep staging with a single channel electroencephalography (EEG), with some significant findings for sleep staging. In this study, we proposed a deep learning-based network by integrating attention mechanism and bidirectional long short-term memory neural network (AT-BiLSTM) to classify wakefulness, rapid eye movement (REM) sleep and non-REM (NREM) sleep stages N1, N2 and N3. The AT-BiLSTM network outperformed five other networks and achieved an accuracy of 83.78%, a Cohen\u2019s kappa coefficient of 0.766 and a macro F1-score of 82.14% on the PhysioNet Sleep-EDF Expanded dataset, and an accuracy of 81.72%, a Cohen\u2019s kappa coefficient of 0.751 and a macro F1-score of 80.74% on the DREAMS Subjects dataset. The proposed AT-BiLSTM network even achieved a higher accuracy than the existing methods based on traditional feature extraction. Moreover, better performance was obtained by the AT-BiLSTM network with the frontal EEG derivations than with EEG channels located at the central, occipital or parietal lobe. As EEG signal can be easily acquired using dry electrodes on the forehead, our findings might provide a promising solution for automatic sleep scoring without feature extraction and may prove very useful for the screening of sleep disorders.<\/jats:p>","DOI":"10.3389\/fphys.2021.628502","type":"journal-article","created":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T04:35:19Z","timestamp":1614746119000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":65,"title":["Deep Learning in Automatic Sleep Staging With a Single Channel Electroencephalography"],"prefix":"10.3389","volume":"12","author":[{"given":"Mingyu","family":"Fu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yitian","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zixin","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jin","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fengguo","family":"Xu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinyu","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fengzhen","family":"Hou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2021,3,3]]},"reference":[{"key":"B1","article-title":"Tensorflow: large-scale machine learning on heterogeneous distributed systems.","author":"Abadi","year":"2016","journal-title":"arXiv"},{"key":"B2","doi-asserted-by":"publisher","first-page":"978","DOI":"10.1109\/LISAT.2014.6845193","article-title":"Efficient sleep stage classification based on EEG signals.","volume":"2014","author":"Aboalayon","year":"2014","journal-title":"IEEE LISAT"},{"key":"B3","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1007\/s10479-005-5724-z","article-title":"A tutorial on the cross-entropy method.","volume":"134","author":"Boer","year":"2005","journal-title":"Ann. Operat. Res."},{"key":"B4","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/j.cmpb.2016.12.004","article-title":"A comparative review on sleep stage classification methods in patients and healthy individuals.","volume":"140","author":"Boostani","year":"2017","journal-title":"Comput. Methods Prog. Biomed."},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2018.00085","article-title":"Recurrent deep neural networks for real-time sleep stage classification from single channel EEG.","volume":"12","author":"Bresch","year":"2018","journal-title":"Front. Comput. Neurosci."},{"key":"B6","doi-asserted-by":"publisher","first-page":"758","DOI":"10.1109\/TNSRE.2018.2813138","article-title":"A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time series.","volume":"26","author":"Chambon","year":"2018","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"B7","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales.","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/9248410","article-title":"Automatic sleep stage classification based on convolutional neural network and fine-grained segments.","volume":"2018","author":"Cui","year":"2018","journal-title":"Complexity"},{"key":"B9","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1109\/Trustcom.2015.524","article-title":"Duration, timing and quality of sleep are each vital for health, performance and safety.","volume":"1","author":"Czeisler","year":"2015","journal-title":"Sleep Health"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.2650142","author":"Devuyst","year":"2005","journal-title":"The DREAMS Databases and Assessment Algorithm."},{"key":"B11","doi-asserted-by":"publisher","first-page":"324","DOI":"10.1109\/TNSRE.2017.2733220","article-title":"Mixed neural network approach for temporal sleep stage classification.","volume":"26","author":"Dong","year":"2016","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"B12","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/0364-0213(90)90002-E","article-title":"Finding structure in time.","volume":"14","author":"Elman","year":"1990","journal-title":"Trends Cogn. Sci."},{"key":"B13","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1111\/j.1365-2869.2011.00981.x","article-title":"A new quantitative automatic method for the measurement of non-rapid eye movement sleep electroencephalographic amplitude variability.","volume":"21","author":"Ferri","year":"2012","journal-title":"J. Sleep Res."},{"key":"B14","doi-asserted-by":"publisher","first-page":"101204","DOI":"10.1016\/j.smrv.2019.07.007","article-title":"Automated sleep scoring: a review of the latest approaches.","volume":"48","author":"Fiorillo","year":"2019","journal-title":"Sleep Med. Rev."},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2019.108320","article-title":"An automatic single-channel EEG-based sleep stage scoring method based on hidden Markov model.","volume":"324","author":"Ghimatgar","year":"2019","journal-title":"J. Neurosci. Methods"},{"key":"B16","doi-asserted-by":"publisher","first-page":"E215","DOI":"10.1161\/01.cir.101.23.e215","article-title":"PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals.","volume":"101","author":"Goldberger","year":"2000","journal-title":"Circulation"},{"key":"B17","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1016\/j.jneumeth.2016.07.012","article-title":"A decision support system for automatic sleep staging from EEG signals using tunable Q-factor wavelet transform and spectral features.","volume":"271","author":"Hassan","year":"","journal-title":"J. Neurosci. Methods"},{"key":"B18","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1016\/j.bbe.2015.11.001","article-title":"Automatic sleep scoring using statistical features in the EMD domain and ensemble methods.","volume":"1","author":"Hassan","year":"","journal-title":"Biocybern. Biomed. Eng."},{"key":"B19","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1016\/j.cmpb.2016.12.015","article-title":"Automated identification of sleep states from EEG signals by means of ensemble empirical mode decomposition and random under sampling boosting.","volume":"140","author":"Hassan","year":"2017","journal-title":"Comput. Methods Prog. Biomed."},{"key":"B20","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1016\/j.knosys.2017.05.005","article-title":"A decision support system for automated identification of sleep stages from single-channel EEG signals.","volume":"128","author":"Hassan","year":"2017","journal-title":"Knowl. Based Syst."},{"key":"B21","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory.","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"B22","article-title":"A comparison of LSTMs and attention mechanisms for forecasting financial time series.","author":"Hollis","year":"2018","journal-title":"arXiv [Preprint]."},{"key":"B23","doi-asserted-by":"publisher","first-page":"105","DOI":"10.5555\/2438096.2438127","article-title":"Automatic sleep stage recurrent neural classifier using energy features of EEG signals.","volume":"104","author":"Hsu","year":"2013","journal-title":"Neurocomputing"},{"key":"B24","author":"Iber","year":"2007","journal-title":"The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications."},{"key":"B25","doi-asserted-by":"publisher","first-page":"629","DOI":"10.1016\/j.compbiomed.2010.04.007","article-title":"Genetic fuzzy classifier for sleep stage identification.","volume":"40","author":"Jo","year":"2010","journal-title":"Comput. Biol. Med."},{"key":"B26","article-title":"Deep visual-semantic alignments for generating image descriptions.","author":"Karpathy","year":"2014","journal-title":"arXiv [Preprint]."},{"key":"B27","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1109\/10.867928","article-title":"Analysis of a sleep-dependent neuronal feedback loop: The slow-wave microcontinuity of the EEG.","volume":"47","author":"Kemp","year":"2000","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6579\/aaf4a9","article-title":"Time domain characterization forsleep apnea in oronasal airflow signal: a dynamic threshold classification approach.","volume":"40","author":"Kim","year":"2019","journal-title":"Physiol. Meas."},{"key":"B29","article-title":"Adam: a method for stochastic optimization.","author":"Kingma","year":"2017","journal-title":"arXiv [Preprint]."},{"key":"B30","author":"Lecun","year":"1997","journal-title":"Convolutional Networks for Images, Speech, and Time-Series."},{"key":"B31","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning.","volume":"521","author":"Lecun","year":"2015","journal-title":"Nature"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1649","DOI":"10.1109\/TIM.2012.2187242","article-title":"Automatic stage scoring of single-channel sleep EEG by using multiscale entropy and autoregressive models.","volume":"61","author":"Liang","year":"2012","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"B33","doi-asserted-by":"publisher","first-page":"3797","DOI":"10.1007\/s10489-018-1176-4","article-title":"Recurrent networks with attention and convolutional networks for sentence representation and classification.","volume":"48","author":"Liu","year":"2018","journal-title":"Appl. Intell."},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-017-0468-7","article-title":"Entity recognition from clinical texts via recurrent neural network.","volume":"17","author":"Liu","year":"2017","journal-title":"BMC Med. Inform. Decis."},{"key":"B35","article-title":"A deep learning approach with an attention mechanism for automatic sleep stage classification.","author":"Lngkvist","year":"2018","journal-title":"arXiv [Preprint]."},{"key":"B36","article-title":"Effective approaches to attention-based neural machine translation.","author":"Luong","year":"2015","journal-title":"arXiv [Preprint]."},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2018.00781","article-title":"Automatic human sleep stage scoring using deep neural networks.","volume":"12","author":"Malafeev","year":"2018","journal-title":"Front. Neurosci."},{"key":"B38","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1038\/383163a0","article-title":"Functional neuroanatomy of human rapid-eye-movement sleep and dreaming.","volume":"383","author":"Maquet","year":"1996","journal-title":"Nature"},{"key":"B39","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1053\/smrv.2002.0186","article-title":"Epidemiology of insomnia: what we know and what we still need to learn.","volume":"6","author":"Ohayon","year":"2002","journal-title":"Sleep Med. Rev."},{"key":"B40","doi-asserted-by":"publisher","first-page":"1285","DOI":"10.1109\/TBME.2018.2872652","article-title":"Joint classification and prediction CNN framework for automatic sleep stage classification.","volume":"66","author":"Phan","year":"2019","journal-title":"IEEE Trans. Bio Med. Eng."},{"key":"B41","article-title":"Audio scene classification with deep recurrent neural networks.","author":"Phan","year":"2017","journal-title":"arXiv [preprint]."},{"key":"B42","doi-asserted-by":"publisher","first-page":"1876","DOI":"10.1109\/EMBC.2014.6943976","article-title":"Comparison of feature and classifier algorithms for online automatic sleep staging based on a single EEG signal.","volume":"2014","author":"Radha","year":"2014","journal-title":"IEEE EMB"},{"key":"B43","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1016\/j.smrv.2011.06.003","article-title":"Sleep scoring using artificial neural networks.","volume":"16","author":"Ronzhina","year":"2012","journal-title":"Sleep Med. Rev."},{"key":"B44","doi-asserted-by":"publisher","first-page":"2673","DOI":"10.1109\/78.650093","article-title":"Bidirectional recurrent neural networks.","volume":"45","author":"Schuster","year":"1997","journal-title":"IEEE Trans. Signal. Process."},{"key":"B45","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1016\/j.eswa.2018.03.020","article-title":"A new automatic sleep staging system based on statistical behavior of local extrema using single channel EEG signal.","volume":"104","author":"Seifpour","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"B46","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/ACCESS.2019.2939038","article-title":"An accurate sleep stages classification method based on state space model.","volume":"4","author":"Shen","year":"2019","journal-title":"IEEE Access."},{"key":"B47","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1007\/s11517-016-1519-4","article-title":"Single-channel EEG sleep stage classification based on a streamlined set of statistical features in wavelet domain.","volume":"55","author":"Silveira","year":"2017","journal-title":"Med. Biol. Eng. Comput."},{"key":"B48","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1016\/j.bspc.2017.12.001","article-title":"A convolutional neural network for sleep stage scoring from raw single-channel EEG.","volume":"42","author":"Sors","year":"2018","journal-title":"Biomed. Signal. Proces."},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-018-07229-3","article-title":"Neural network analysis of sleep stages enables efficient diagnosis of narcolepsy.","volume":"9","author":"Stephansen","year":"2018","journal-title":"Nat. Commun."},{"key":"B50","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1109\/TNSRE.2017.2721116","article-title":"DeepSleepNet: a model for automatic sleep stage scoring based on raw single-channel EEG","author":"Supratak","year":"2017","journal-title":"IEEE Transactions on Neural Systems and Rehabilitation Engineering"},{"key":"B51","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1016\/j.bbe.2017.01.005","article-title":"A hierarchical classification method for automatic sleep scoring using multiscale entropy features and proportion information of sleep architecture.","volume":"37","author":"Tian","year":"2017","journal-title":"Biocybern. Biomed. Eng."},{"key":"B52","doi-asserted-by":"publisher","first-page":"890","DOI":"10.1016\/j.bbe.2018.05.005","article-title":"Use of features from RR-time series and EEG signals for automated classification of sleep stages in deep neural network framework.","volume":"38","author":"Tripathy","year":"2018","journal-title":"Biocybern. Biomed. Eng."},{"key":"B53","doi-asserted-by":"publisher","first-page":"1587","DOI":"10.1007\/s10439-015-1444-y","article-title":"Automatic sleep stage scoring using time-frequency analysis and stacked sparse autoencoders.","volume":"44","author":"Tsinalis","year":"2015","journal-title":"Ann. Biomed. Eng."},{"key":"B54","article-title":"Automatic sleep stage scoring with single-channel EEG using convolutional neural networks.","author":"Tsinalis","year":"2016","journal-title":"arXiv [Preprint]."},{"key":"B55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3115432","article-title":"Image captioning with deep bidirectional LSTMs and multi-task learning.","volume":"14","author":"Wang","year":"2018","journal-title":"ACM Trans. Multim. Comput."},{"key":"B56","doi-asserted-by":"publisher","first-page":"101","DOI":"10.2147\/NSS.S77888","article-title":"Evaluation of an automated single-channel sleep staging algorithm.","volume":"7","author":"Wang","year":"2015","journal-title":"Nat. Sci. Sleep"},{"key":"B57","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1016\/j.otohns.2004.11.001","article-title":"Polysomnography indexes are discordant with quality of life, symptoms, and reaction times in sleep apnea patients.","volume":"132","author":"Weaver","year":"2005","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"B58","doi-asserted-by":"publisher","first-page":"599","DOI":"10.3390\/ijerph16040599","article-title":"A deep learning model for automated sleep stages classification using PSG signals.","volume":"16","author":"Yildirim","year":"2019","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.1186\/s41606-016-0005-0","article-title":"The case for using digital EEG analysis in clinical sleep medicine.","volume":"1","author":"Younes","year":"2017","journal-title":"Sleep Sci. Prac."},{"key":"B60","doi-asserted-by":"publisher","first-page":"1097","DOI":"10.1109\/TBCAS.2017.2719631","article-title":"A new method for automatic sleep stage classification.","volume":"5","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"B61","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/j.cmpb.2018.07.015","article-title":"Complex-valued unsupervised convolutional neural networks for sleep stage classification.","volume":"164","author":"Zhang","year":"2018","journal-title":"Comput. Methods Prog. Biomed."},{"key":"B62","doi-asserted-by":"publisher","DOI":"10.1088\/1757-899X\/569\/5\/052037","article-title":"AT-LSTM: an attention-based LSTM model for financial time series prediction.","volume":"569","author":"Zhang","year":"2019","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"B63","doi-asserted-by":"publisher","first-page":"1813","DOI":"10.1109\/JBHI.2014.2303991","article-title":"Analysis and classification of sleep stages based on difference visibility graphs from a single-channel EEG signal.","volume":"18","author":"Zhu","year":"2014","journal-title":"IEEE J. Biomed. Health"},{"key":"B64","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1093\/clinchem\/39.4.561","article-title":"Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine.","volume":"39","author":"Zweig","year":"1993","journal-title":"Clin. Chem."}],"container-title":["Frontiers in Physiology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fphys.2021.628502\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T04:35:30Z","timestamp":1614746130000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fphys.2021.628502\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,3]]},"references-count":64,"alternative-id":["10.3389\/fphys.2021.628502"],"URL":"https:\/\/doi.org\/10.3389\/fphys.2021.628502","relation":{},"ISSN":["1664-042X"],"issn-type":[{"value":"1664-042X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,3]]},"article-number":"628502"}}