{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,13]],"date-time":"2025-12-13T23:08:43Z","timestamp":1765667323063,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2020,11,18]],"date-time":"2020-11-18T00:00:00Z","timestamp":1605657600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Automatic sleep stage classification of multi-channel sleep signals can help clinicians efficiently evaluate an individual\u2019s sleep quality and assist in diagnosing a possible sleep disorder. To obtain accurate sleep classification results, the processing flow of results from signal preprocessing and machine-learning-based classification is typically employed. These classification results are refined based on sleep transition rules. Neural networks\u2014i.e., machine learning algorithms\u2014are powerful at solving classification problems. Some methods apply them to the first two processes above; however, the refinement process continues to be based on traditional methods. In this study, the sleep stage refinement process was incorporated into the neural network model to form real end-to-end processing. In addition, for multi-channel signals, the multi-branch convolutional neural network was combined with a proposed residual attention method. This approach further improved the model classification accuracy. The proposed method was evaluated on the Sleep-EDF Expanded Database (Sleep-EDFx) and University College Dublin Sleep Apnea Database (UCDDB). It achieved respective accuracy rates of 85.7% and 79.4%. The results also showed that sleep stage refinement based on a neural network is more effective than the traditional refinement method. Moreover, the proposed residual attention method was determined to have a more robust channel\u2013information fusion ability than the respective average and concatenation methods.<\/jats:p>","DOI":"10.3390\/s20226592","type":"journal-article","created":{"date-parts":[[2020,11,18]],"date-time":"2020-11-18T07:41:00Z","timestamp":1605685260000},"page":"6592","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Multi-Branch Convolutional Neural Network for Automatic Sleep Stage Classification with Embedded Stage Refinement and Residual Attention Channel Fusion"],"prefix":"10.3390","volume":"20","author":[{"given":"Tianqi","family":"Zhu","sequence":"first","affiliation":[{"name":"College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou 310027, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5768-0586","authenticated-orcid":false,"given":"Wei","family":"Luo","sequence":"additional","affiliation":[{"name":"College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou 310027, China"}]},{"given":"Feng","family":"Yu","sequence":"additional","affiliation":[{"name":"College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou 310027, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.jns.2011.04.020","article-title":"Sleep\u2013wake disturbances in common neurodegenerative diseases: A closer look at selected aspects of the neural circuitry","volume":"307","author":"Zhong","year":"2011","journal-title":"J. Neurol. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"9","DOI":"10.5665\/sleep.3298","article-title":"Sleep Health: Can We Define It? Does It Matter?","volume":"37","author":"Buysse","year":"2014","journal-title":"Sleep"},{"key":"ref_3","unstructured":"Iber, C., Ancoli-Israel, S., Chesson, A.L., and Quan, S.F. (2007). The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specification, American Academy of Sleep Medicine."},{"key":"ref_4","unstructured":"Noviyanto, A., Isa, S., Wasito, I., Arymurthy, A.M., and Barat, J. (2011). Selecting Features of Single Lead ECG Signal for Automatic Sleep Stages Classification using Correlation-based Feature Subset Selection. IJCSI Int. J. Comput. Sci. Issues, 8."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/0013-4694(82)90112-2","article-title":"Transformations towards the normal distribution of broad band spectral parameters of the EEG","volume":"53","author":"Gasser","year":"1982","journal-title":"Electroencephalogr. Clin. Neurophysiol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/S0304-3940(98)00435-2","article-title":"Nonlinear behaviour of human EEG: Fractal exponent versus correlation dimension in awake and sleep stages","volume":"250","author":"Pereda","year":"1998","journal-title":"Neurosci. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1088\/0967-3334\/32\/3\/002","article-title":"Automated detection of sleep apnea from electrocardiogram signals using nonlinear parameters","volume":"32","author":"Acharya","year":"2011","journal-title":"Physiol. Meas."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_9","first-page":"315","article-title":"Deep Sparse Rectifier Neural Networks","volume":"Volume 15","author":"Yoshua","year":"2011","journal-title":"Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics"},{"key":"ref_10","unstructured":"Pereira, F., Burges, C.J.C., Bottou, L., and Weinberger, K.Q. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems 25, Curran Associates, Inc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103719","DOI":"10.1016\/j.compbiomed.2020.103719","article-title":"A multistage deep neural network model for blood pressure estimation using photoplethysmogram signals","volume":"120","author":"Esmaelpoor","year":"2020","journal-title":"Comput. Biol. Med."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1109\/TBME.2015.2468589","article-title":"Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks","volume":"63","author":"Kiranyaz","year":"2016","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3816","DOI":"10.1038\/s41598-018-22181-4","article-title":"AxonDeepSeg: Automatic axon and myelin segmentation from microscopy data using convolutional neural networks","volume":"8","author":"Zaimi","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/TBME.2016.2539421","article-title":"High-Performance Personalized Heartbeat Classification Model for Long-Term ECG Signal","volume":"64","author":"Li","year":"2017","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1016\/j.compbiomed.2017.09.017","article-title":"Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals","volume":"100","author":"Acharya","year":"2018","journal-title":"Comput. Biol. Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1109\/TNSRE.2019.2915621","article-title":"A Channel-Projection Mixed-Scale Convolutional Neural Network for Motor Imagery EEG Decoding","volume":"27","author":"Li","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1998","DOI":"10.1109\/TNSRE.2017.2721116","article-title":"DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG","volume":"25","author":"Supratak","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.jneumeth.2015.07.006","article-title":"Multi-channel EEG-based sleep stage classification with joint collaborative representation and multiple kernel learning","volume":"254","author":"Shi","year":"2015","journal-title":"J. Neurosci. Methods"},{"key":"ref_20","first-page":"1452","article-title":"Automatic Sleep Stage Classification Using Single-Channel EEG: Learning Sequential Features with Attention-Based Recurrent Neural Networks","volume":"2018","author":"Phan","year":"2018","journal-title":"Conf. Proc. IEEE Eng. Med. Biol. Soc."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1109\/TNSRE.2017.2776149","article-title":"A Novel Multi-Class EEG-Based Sleep Stage Classification System","volume":"26","author":"Memar","year":"2018","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.jneumeth.2011.12.022","article-title":"A rule-based automatic sleep staging method","volume":"205","author":"Liang","year":"2012","journal-title":"J. Neurosci. Methods"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.eswa.2018.12.023","article-title":"Robust sleep stage classification with single-channel EEG signals using multimodal decomposition and HMM-based refinement","volume":"121","author":"Jiang","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, X., Xu, M., Li, Y., Su, M., Xu, Z., Wang, C., Kang, D., Li, H., Mu, X., and Ding, X. (2020). Automated multi-model deep neural network for sleep stage scoring with unfiltered clinical data. Sleep Breath.","DOI":"10.1007\/s11325-019-02008-w"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1109\/TBME.2018.2872652","article-title":"Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification","volume":"66","author":"Phan","year":"2019","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1109\/TNSRE.2018.2813138","article-title":"A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series","volume":"26","author":"Chambon","year":"2018","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_27","first-page":"171","article-title":"Multichannel Sleep Stage Classification and Transfer Learning using Convolutional Neural Networks","volume":"2018","author":"Andreotti","year":"2018","journal-title":"Conf. Proc. IEEE Eng. Med. Biol. Soc."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1109\/TNSRE.2019.2896659","article-title":"SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging","volume":"27","author":"Phan","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_29","unstructured":"Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017). Attention is All you Need. Advances in Neural Information Processing Systems 30, Curran Associates, Inc."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1185","DOI":"10.1109\/10.867928","article-title":"Analysis of a sleep-dependent neuronal feedback loop: The slow-wave microcontinuity of the EEG","volume":"47","author":"Kemp","year":"2000","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Goldberger, A.L., Amaral, L.A.N., Glass, L., Hausdorff, J.M., Ivanov, P.C., Mark, R.G., Mietus, J.E., Moody, G.B., Peng, C.-K., and Stanley, H.E. (2000). PhysioBank, PhysioToolkit, and PhysioNet: Components of a New Research Resource for Complex Physiologic Signals. Circulation, 101.","DOI":"10.1161\/01.CIR.101.23.e215"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1001\/archpsyc.1969.01740140118016","article-title":"A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects","volume":"20","author":"Wolpert","year":"1969","journal-title":"Arch. Gen. Psychiatry"},{"key":"ref_33","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv."},{"key":"ref_34","unstructured":"Vinod, N., and Geoffrey, E.H. (2010, January 21\u201324). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the ICML, Haifa, Israel."},{"key":"ref_35","unstructured":"Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1587","DOI":"10.1007\/s10439-015-1444-y","article-title":"Automatic Sleep Stage Scoring Using Time-Frequency Analysis and Stacked Sparse Autoencoders","volume":"44","author":"Tsinalis","year":"2016","journal-title":"Ann. Biomed. Eng."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhu, T., Luo, W., and Yu, F. (2020). Convolution-and Attention-Based Neural Network for Automated Sleep Stage Classification. Int. J. Environ. Res. Public Health, 17.","DOI":"10.3390\/ijerph17114152"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Mousavi, S., Afghah, F., and Acharya, U.R. (2019). SleepEEGNet: Automated sleep stage scoring with sequence to sequence deep learning approach. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0216456"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2012\/107046","article-title":"Sleep Stage Classification Using Unsupervised Feature Learning","volume":"2012","author":"Karlsson","year":"2012","journal-title":"Adv. Artif. Neural Syst."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Yuan, Y., Jia, K., Ma, F., Xun, G., Wang, Y., Su, L., and Zhang, A. (2019). A hybrid self-attention deep learning framework for multivariate sleep stage classification. BMC Bioinform, 20.","DOI":"10.1186\/s12859-019-3075-z"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Cen, L., Yu, Z.L., Tang, Y., Shi, W., Kluge, T., and Ser, W. (2017). Deep Learning Method for Sleep Stage Classification. Neural Inf. Process., 796\u2013802.","DOI":"10.1007\/978-3-319-70096-0_81"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1109\/TIT.1967.1054010","article-title":"Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm","volume":"13","author":"Viterbi","year":"1967","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1111\/j.1365-2869.2008.00700.x","article-title":"Interrater reliability for sleep scoring according to the Rechtschaffen & Kales and the new AASM standard","volume":"18","author":"Anderer","year":"2009","journal-title":"J. Sleep Res."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/22\/6592\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:33:47Z","timestamp":1760178827000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/22\/6592"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,18]]},"references-count":43,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["s20226592"],"URL":"https:\/\/doi.org\/10.3390\/s20226592","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,11,18]]}}}