{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T23:00:08Z","timestamp":1773097208679,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T00:00:00Z","timestamp":1662595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea (NRF)","doi-asserted-by":"publisher","award":["2021R1C1C1009436"],"award-info":[{"award-number":["2021R1C1C1009436"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea (NRF)","doi-asserted-by":"publisher","award":["2017-0-00655"],"award-info":[{"award-number":["2017-0-00655"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Institute for Information and Communications Technology Promotion (IITP)","award":["2021R1C1C1009436"],"award-info":[{"award-number":["2021R1C1C1009436"]}]},{"name":"Institute for Information and Communications Technology Promotion (IITP)","award":["2017-0-00655"],"award-info":[{"award-number":["2017-0-00655"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Deep learning-based emotion recognition using EEG has received increasing attention in recent years. The existing studies on emotion recognition show great variability in their employed methods including the choice of deep learning approaches and the type of input features. Although deep learning models for EEG-based emotion recognition can deliver superior accuracy, it comes at the cost of high computational complexity. Here, we propose a novel 3D convolutional neural network with a channel bottleneck module (CNN-BN) model for EEG-based emotion recognition, with the aim of accelerating the CNN computation without a significant loss in classification accuracy. To this end, we constructed a 3D spatiotemporal representation of EEG signals as the input of our proposed model. Our CNN-BN model extracts spatiotemporal EEG features, which effectively utilize the spatial and temporal information in EEG. We evaluated the performance of the CNN-BN model in the valence and arousal classification tasks. Our proposed CNN-BN model achieved an average accuracy of 99.1% and 99.5% for valence and arousal, respectively, on the DEAP dataset, while significantly reducing the number of parameters by 93.08% and FLOPs by 94.94%. The CNN-BN model with fewer parameters based on 3D EEG spatiotemporal representation outperforms the state-of-the-art models. Our proposed CNN-BN model with a better parameter efficiency has excellent potential for accelerating CNN-based emotion recognition without losing classification performance.<\/jats:p>","DOI":"10.3390\/s22186813","type":"journal-article","created":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T09:51:09Z","timestamp":1662630669000},"page":"6813","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Accelerating 3D Convolutional Neural Network with Channel Bottleneck Module for EEG-Based Emotion Recognition"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9216-0882","authenticated-orcid":false,"given":"Sungkyu","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Software Convergence, Kyung Hee University, Yongin 17104, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tae-Seong","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Kyung Hee University, Yongin 17104, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Won Hee","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Software Convergence, Kyung Hee University, Yongin 17104, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1093\/mind\/os-IX.34.188","article-title":"What is an Emotion?","volume":"9","author":"James","year":"1884","journal-title":"Mind"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.paid.2010.09.034","article-title":"Differential assessment of emotions and moods: Development and validation of the Emotion and Mood Components of Anxiety Questionnaire","volume":"50","author":"Beedie","year":"2011","journal-title":"Personal. Individ. Differ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.inffus.2017.02.003","article-title":"A review of affective computing: From unimodal analysis to multimodal fusion","volume":"37","author":"Poria","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.procs.2016.04.068","article-title":"Measurement of Cognitive Load in HCI Systems Using EEG Power Spectrum: An Experimental Study","volume":"84","author":"Kumar","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1007\/s10548-009-0083-8","article-title":"Combining TMS and EEG offers new prospects in cognitive neuroscience","volume":"22","author":"Miniussi","year":"2010","journal-title":"Brain Topogr."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1038\/372669a0","article-title":"Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala","volume":"372","author":"Adolphs","year":"1994","journal-title":"Nature"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Marin-Morales, J., Llinares, C., Guixeres, J., and Alcaniz, M. (2020). Emotion Recognition in Immersive Virtual Reality: From Statistics to Affective Computing. Sensors, 20.","DOI":"10.3390\/s20185163"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rattanyu, K., Ohkura, M., and Mizukawa, M. (2010, January 27\u201330). Emotion Monitoring from Physiological Signals for Service Robots in the Living Space. Proceedings of the ICCAS 2010, Goyang, Gyeonggi-do, Korea.","DOI":"10.1109\/ICCAS.2010.5669914"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.cviu.2015.09.015","article-title":"Multi-modal emotion analysis from facial expressions and electroencephalogram","volume":"147","author":"Huang","year":"2016","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.heares.2014.10.003","article-title":"Voice emotion recognition by cochlear-implanted children and their normally-hearing peers","volume":"322","author":"Chatterjee","year":"2015","journal-title":"Hear. Res."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ross, P.D., Polson, L., and Grosbras, M.H. (2012). Developmental changes in emotion recognition from full-light and point-light displays of body movement. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0044815"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wu, G., Liu, G., and Hao, M. (2010, January 28\u201329). The Analysis of Emotion Recognition from GSR Based on PSO. Proceedings of the 2010 International Symposium on Intelligence Information Processing and Trusted Computing, Huanggang, China.","DOI":"10.1109\/IPTC.2010.60"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/j.bj.2017.11.001","article-title":"An accurate emotion recognition system using ECG and GSR signals and matching pursuit method","volume":"40","author":"Goshvarpour","year":"2017","journal-title":"Biomed. J."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Abadi, M.K., Kia, M., Subramanian, R., Avesani, P., and Sebe, N. (2013, January 22\u201326). Decoding Affect in Videos Employing the MEG Brain Signal. Proceedings of the 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Shanghai, China.","DOI":"10.1109\/FG.2013.6553809"},{"key":"ref_15","first-page":"355","article-title":"Emotion recognition based on EEG using LSTM recurrent neural network","volume":"8","author":"Alhagry","year":"2017","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, F., Wu, S., Zhang, W., Xu, Z., Zhang, Y., Wu, C., and Coleman, S. (2020). Emotion recognition with convolutional neural network and EEG-based EFDMs. Neuropsychologia, 146.","DOI":"10.1016\/j.neuropsychologia.2020.107506"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.cmpb.2016.12.005","article-title":"Recognition of emotions using multimodal physiological signals and an ensemble deep learning model","volume":"140","author":"Yin","year":"2017","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fang, Y., Yang, H., Zhang, X., Liu, H., and Tao, B. (2020). Multi-Feature Input Deep Forest for EEG-Based Emotion Recognition. Front. Neurorobot., 14.","DOI":"10.3389\/fnbot.2020.617531"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Sharma, R., Pachori, R.B., and Sircar, P. (2020). Automated emotion recognition based on higher order statistics and deep learning algorithm. Biomed. Signal Process. Control., 58.","DOI":"10.1016\/j.bspc.2020.101867"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"An, Y., Hu, S., Duan, X., Zhao, L., Xie, C., and Zhao, Y. (2021). Electroencephalogram Emotion Recognition Based on 3D Feature Fusion and Convolutional Autoencoder. Front. Comput. Neurosci., 15.","DOI":"10.3389\/fncom.2021.743426"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Islam, M.R., Islam, M.M., Rahman, M.M., Mondal, C., Singha, S.K., Ahmad, M., Awal, A., Islam, M.S., and Moni, M.A. (2021). EEG Channel Correlation Based Model for Emotion Recognition. Comput. Biol. Med., 136.","DOI":"10.1016\/j.compbiomed.2021.104757"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Liu, Y., Ding, Y., Li, C., Cheng, J., Song, R., Wan, F., and Chen, X. (2020). Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network. Comput. Biol. Med., 123.","DOI":"10.1016\/j.compbiomed.2020.103927"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sartipi, S., Torkamani-Azar, M., and Cetin, M. (2021, January 1\u20135). EEG Emotion Recognition via Graph-based Spatio-Temporal Attention Neural Networks. Proceedings of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Mexico.","DOI":"10.1109\/EMBC46164.2021.9629628"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yin, Y., Zheng, X., Hu, B., Zhang, Y., and Cui, X. (2021). EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM. Appl. Soft Comput., 100.","DOI":"10.1016\/j.asoc.2020.106954"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ding, Y., Robinson, N., Zhang, S., Zeng, Q., and Guan, C. (2022). TSception: Capturing Temporal Dynamics and Spatial Asymmetry from EEG for Emotion Recognition. arXiv.","DOI":"10.1109\/TAFFC.2022.3169001"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Chao, H., Dong, L., Liu, Y., and Lu, B. (2019). Emotion Recognition from Multiband EEG Signals Using CapsNet. Sensors, 19.","DOI":"10.3390\/s19092212"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Jia, Z., Lin, Y., Wang, J., Feng, Z., Xie, X., and Chen, C. (2021, January 20\u201324). HetEmotionNet. Proceedings of the 29th ACM International Conference on Multimedia, Chengdu, China.","DOI":"10.1145\/3474085.3475583"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1109\/TAFFC.2017.2714671","article-title":"Emotions Recognition Using EEG Signals: A Survey","volume":"10","author":"Alarcao","year":"2019","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Liu, H., Zhang, Y., Li, Y., and Kong, X. (2021). Review on Emotion Recognition Based on Electroencephalography. Front. Comput. Neurosci., 15.","DOI":"10.3389\/fncom.2021.758212"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Jia, Z., Lin, Y., Cai, X., Chen, H., Gou, H., and Wang, J. (2020, January 12\u201316). SST-EmotionNet: Spatial-Spectral-Temporal Based Attention 3D Dense Network for EEG Emotion Recognition. Proceedings of the 28th ACM International Conference on Multimedia, Seattle, WA, USA.","DOI":"10.1145\/3394171.3413724"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Cai, J., Xiao, R., Cui, W., Zhang, S., and Liu, G. (2021). Application of Electroencephalography-Based Machine Learning in Emotion Recognition: A Review. Front. Syst. Neurosci., 15.","DOI":"10.3389\/fnsys.2021.729707"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1109\/TAFFC.2014.2339834","article-title":"Feature Extraction and Selection for Emotion Recognition from EEG","volume":"5","author":"Jenke","year":"2014","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ma, J., Tang, H., Zheng, W.-L., and Lu, B.-L. (2019, January 21\u201325). Emotion Recognition Using Multimodal Residual LSTM Network. Proceedings of the 27th ACM International Conference on Multimedia, Nice, France.","DOI":"10.1145\/3343031.3350871"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1007\/s12559-017-9533-x","article-title":"Hierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition","volume":"10","author":"Li","year":"2018","journal-title":"Cogn. Comput."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Conneau, A., and Essid, S. (2014, January 4\u20139). Assessment of New Spectral Features for Eeg-Based Emotion Recognition. Proceedings of the 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy.","DOI":"10.1109\/ICASSP.2014.6854493"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/T-AFFC.2011.15","article-title":"DEAP: A Database for Emotion Analysis Using Physiological Signals","volume":"3","author":"Koelstra","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Tran, D., Bourdev, L., Fergus, R., Torresani, L., and Paluri, M. (2015). Learning spatiotemporal features with 3d convolutional networks. arXiv.","DOI":"10.1109\/ICCV.2015.510"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1109\/72.363467","article-title":"Artificial neural networks for feature extraction and multivariate data projection","volume":"6","author":"Mao","year":"1995","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1142\/S0129065794000372","article-title":"Neural networks, a comprehensive foundation","volume":"5","author":"Haykin","year":"1994","journal-title":"Int. J. Neural Syst."},{"key":"ref_41","unstructured":"Gonzalez, R.C., Woods, R.E., and Eddins, S.L. (2020). Digital Image Processing Using MATLAB, Gatesmark Publishing. [3rd ed.]."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","article-title":"A circumplex model of affect","volume":"39","author":"Russell","year":"1980","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/s10479-005-5724-z","article-title":"A tutorial on the cross-entropy method","volume":"134","author":"Kroese","year":"2005","journal-title":"Ann. Oper. Res."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015). Going deeper with convolutions. arXiv.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep residual learning for image recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017). Densely connected convolutional networks. arXiv.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015). Fully convolutional networks for semantic segmentation. arXiv.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. arXiv.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_49","unstructured":"Badrinarayanan, V., Kendall, A., and SegNet, R.C. (2015). A deep convolutional encoder-decoder architecture for image segmentation. arXiv."},{"key":"ref_50","unstructured":"Paszke, A., Chaurasia, A., Kim, S., and Culurciello, E. (2016). Enet: A deep neural network architecture for real-time semantic segmentation. arXiv."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/6813\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:27:42Z","timestamp":1760142462000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/6813"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,8]]},"references-count":51,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["s22186813"],"URL":"https:\/\/doi.org\/10.3390\/s22186813","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,8]]}}}