{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T17:58:50Z","timestamp":1770227930231,"version":"3.49.0"},"reference-count":44,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,5,24]],"date-time":"2024-05-24T00:00:00Z","timestamp":1716508800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Epilepsy is a common neurological disorder, and its diagnosis mainly relies on the analysis of electroencephalogram (EEG) signals. However, the raw EEG signals contain limited recognizable features, and in order to increase the recognizable features in the input of the network, the differential features of the signals, the amplitude spectrum and the phase spectrum in the frequency domain are extracted to form a two-dimensional feature vector. In order to solve the problem of recognizing multimodal features, a neural network model based on a multimodal dual-stream network is proposed, which uses a mixture of one-dimensional convolution, two-dimensional convolution and LSTM neural networks to extract the spatial features of the EEG two-dimensional vectors and the temporal features of the signals, respectively, and combines the advantages of the two networks, using the hybrid neural network to extract both the temporal and spatial features of the signals at the same time. In addition, a channel attention module was used to focus the model on features related to seizures. Finally, multiple sets of experiments were conducted on the Bonn and New Delhi data sets, and the highest accuracy rates of 99.69% and 97.5% were obtained on the test set, respectively, verifying the superiority of the proposed model in the task of epileptic seizure detection.<\/jats:p>","DOI":"10.3390\/s24113360","type":"journal-article","created":{"date-parts":[[2024,5,24]],"date-time":"2024-05-24T03:46:56Z","timestamp":1716522416000},"page":"3360","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Detection Method of Epileptic Seizures Using a Neural Network Model Based on Multimodal Dual-Stream Networks"],"prefix":"10.3390","volume":"24","author":[{"given":"Baiyang","family":"Wang","sequence":"first","affiliation":[{"name":"School of Information Science and Engineering, Shandong University, Qingdao 266237, China"}]},{"given":"Yidong","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Shandong University, Qingdao 266237, China"}]},{"given":"Siyu","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Changji University, Changji Hui Autonomous Prefecture, Changji 831100, China"}]},{"given":"Hongjun","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Shandong University, Qingdao 266237, China"}]},{"given":"Fang","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Changji University, Changji Hui Autonomous Prefecture, Changji 831100, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,24]]},"reference":[{"key":"ref_1","first-page":"687","article-title":"Computer Aided Automatic Detection and Classification of EEG Signals for Screening Epilepsy Disorder","volume":"34","author":"Deivasigamani","year":"2018","journal-title":"J. Inf. Sci. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lasefr, Z., Elleithy, K., Reddy, R.R., Abdelfattah, E., and Faezipour, M. (2023). An Epileptic Seizure Detection Technique Using EEG Signals with Mobile Application Development. Appl. Sci., 13.","DOI":"10.3390\/app13179571"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Fatma, N., Singh, P., and Siddiqui, M.K. (2023). Survey on Epileptic Seizure Detection on Varied Machine Learning Algorithms. Int. J. Image Graph., 2550013.","DOI":"10.1142\/S0219467825500135"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6304","DOI":"10.1080\/03772063.2021.1987997","article-title":"Extreme Learning Machine (ELM) based Performance Analysis and Epilepsy Identification from EEG Signals","volume":"69","author":"Harikumar","year":"2021","journal-title":"Iete J. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.bbe.2017.08.006","article-title":"Electroencephalography (EEG) signal processing for epilepsy and autism spectrum disorder diagnosis","volume":"38","author":"Ibrahim","year":"2018","journal-title":"Biocybern. Biomed. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"151682","DOI":"10.1109\/ACCESS.2019.2948231","article-title":"A Seizure-Based Power Reduction SoC for Wearable EEG in Epilepsy","volume":"7","author":"Iranmanesh","year":"2019","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"112895","DOI":"10.1016\/j.eswa.2019.112895","article-title":"A hybrid Local Binary Pattern and wavelets based approach for EEG classification for diagnosing epilepsy","volume":"140","author":"Khan","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s13246-022-01111-9","article-title":"An intelligent epilepsy seizure detection system using adaptive mode decomposition of EEG signals","volume":"45","author":"Kumar","year":"2022","journal-title":"Phys. Eng. Sci. Med."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Murariu, M.G., Dorobantu, F.R., and Tarniceriu, D. (2023). A Novel Automated Empirical Mode Decomposition (EMD) Based Method and Spectral Feature Extraction for Epilepsy EEG Signals Classification. Electronics, 12.","DOI":"10.3390\/electronics12091958"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1016\/j.bspc.2017.12.006","article-title":"Epilepsy and seizure characterisation by multifractal analysis of EEG subbands","volume":"41","author":"Sikdar","year":"2018","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_11","first-page":"9591","article-title":"Gradient boosting machines fusion for automatic epilepsy detection from EEG signals based on wavelet features","volume":"34","author":"Sunaryono","year":"2022","journal-title":"J. King Saud Univ.-Comput. Inf. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"105810","DOI":"10.1016\/j.mejo.2023.105810","article-title":"Convolutional neural network-based lightweight hardware IP core design for EEG epilepsy prediction","volume":"137","author":"Ai","year":"2023","journal-title":"Microelectron. J."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ficici, C., Telatar, Z., and Erogul, O. (2022). Automated temporal lobe epilepsy and psychogenic nonepileptic seizure patient discrimination from multichannel EEG recordings using DWT based analysis. Biomed. Signal Process. Control, 77.","DOI":"10.1016\/j.bspc.2022.103755"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Gangstad, S.W., Mikkelsen, K.B., Kidmose, P., Tabar, Y.R., Weisdorf, S., Lauritzen, M.H., Hemmsen, M.C., Hansen, L.K., Kjaer, T.W., and Duun-Henriksen, J. (2019). Automatic sleep stage classification based on subcutaneous EEG in patients with epilepsy. Biomed. Eng. Online, 18.","DOI":"10.1186\/s12938-019-0725-3"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ghazali, S.M., Alizadeh, M., Mazloum, J., and Baleghi, Y. (2022). Modified binary salp swarm algorithm in EEG signal classification for epilepsy seizure detection. Biomed. Signal Process. Control, 78.","DOI":"10.1016\/j.bspc.2022.103858"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Gu, Y., Cleeren, E., Dan, J., Claes, K., Van Paesschen, W., Van Huffel, S., and Hunyadi, B. (2018). Comparison between Scalp EEG and Behind-the-Ear EEG for Development of a Wearable Seizure Detection System for Patients with Focal Epilepsy. Sensors, 18.","DOI":"10.3390\/s18010029"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gaurav, G., Shukla, R., Singh, G., and Sahani, A.K. (2022). A Machine Learning Approach to the Smartwatch-based Epileptic Seizure Detection System. IETE J. Res., 1\u201313.","DOI":"10.1080\/03772063.2022.2108918"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1504\/IJBET.2020.108990","article-title":"Epileptic seizure detection in EEG using improved entropy","volume":"33","author":"Gini","year":"2020","journal-title":"Int. J. Biomed. Eng. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.eswa.2018.03.022","article-title":"Robust detection of epileptic seizures based on L1-penalized robust regression of EEG signals","volume":"104","author":"Hussein","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"6780","DOI":"10.1007\/s00034-023-02423-1","article-title":"Epilepsy Detection with Multi-channel EEG Signals Utilizing AlexNet","volume":"42","author":"Majzoub","year":"2023","journal-title":"Circuits Syst. Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"47","DOI":"10.4316\/AECE.2023.02006","article-title":"Epilepsy Seizure Prediction from EEG Signal Using Machine Learning Techniques","volume":"23","author":"Sidaoui","year":"2023","journal-title":"Adv. Electr. Comput. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1301","DOI":"10.1166\/jmihi.2019.2713","article-title":"EEG Signal Analysis for Automated Epilepsy Seizure Detection Using Wavelet Transform and Artificial Neural Network","volume":"9","author":"Vani","year":"2019","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_23","first-page":"5601","article-title":"Fuzzy-Based Automatic Epileptic Seizure Detection Framework","volume":"70","author":"Aayesh","year":"2022","journal-title":"CMC-Comput. Mater. Contin."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"6065","DOI":"10.1007\/s00521-020-05384-7","article-title":"AHW-BGOA-DNN: A novel deep learning model for epileptic seizure detection","volume":"33","author":"Glory","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"20080","DOI":"10.1109\/ACCESS.2020.2969055","article-title":"A Unified Framework and Method for EEG-Based Early Epileptic Seizure Detection and Epilepsy Diagnosis","volume":"8","author":"Chen","year":"2020","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"27651","DOI":"10.1109\/JSEN.2021.3119411","article-title":"Studying Multi-Frequency Multilayer Brain Network via Deep Learning for EEG-Based Epilepsy Detection","volume":"21","author":"Dang","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"17391","DOI":"10.1007\/s11042-022-13947-0","article-title":"Epilepsy-Net: Attention-based 1D-inception network model for epilepsy detection using one-channel and multi-channel EEG signals","volume":"82","author":"Lebal","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/j.bspc.2016.09.008","article-title":"Classification of epilepsy EEG signals using DWT-based envelope analysis and neural network ensemble","volume":"31","author":"Li","year":"2017","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"061907","DOI":"10.1103\/PhysRevE.64.061907","article-title":"Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: Dependence on recording region and brain state","volume":"64","author":"Andrzejak","year":"2001","journal-title":"Phys. Rev. E"},{"key":"ref_30","unstructured":"Swami, P., Panigrahi, B., Nara, S., Bhatia, M., and Gandhi, T. (2024, February 28). EEG Epilepsy Datasets. Available online: https:\/\/www.researchgate.net\/publication\/308719109_EEG_Epilepsy_Datasets."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1186\/s13634-019-0606-8","article-title":"Spectral information of EEG signals with respect to epilepsy classification","volume":"2019","author":"Tsipouras","year":"2019","journal-title":"Eurasip J. Adv. Signal Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.jneumeth.2012.10.018","article-title":"Advantages and limitations of brain imaging methods in the research of absence epilepsy in humans and animal models","volume":"212","author":"Lenkov","year":"2013","journal-title":"J. Neurosci. Methods"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hussain, I., Hossain, M.A., Jany, R., Bari, M.A., Uddin, M., Kamal, A.R.M., Ku, Y., and Kim, J.S. (2022). Quantitative evaluation of EEG-biomarkers for prediction of sleep stages. Sensors, 22.","DOI":"10.3390\/s22083079"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1109\/TBME.2014.2360101","article-title":"Epileptic Seizure Classification of EEG Time-Series Using Rational Discrete Short-Time Fourier Transform","volume":"62","author":"Samiee","year":"2015","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.compbiomed.2019.04.031","article-title":"Classification of epileptic EEG recordings using signal transforms and convolutional neural networks","volume":"109","author":"Pardo","year":"2019","journal-title":"Comput. Biol. Med."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"19","DOI":"10.5755\/j02.eie.34433","article-title":"Classification of Resampled Pediatric Epilepsy EEG Data Using Artificial Neural Networks with Discrete Fourier Transforms","volume":"29","author":"Sonmezocak","year":"2023","journal-title":"Elektron. Ir Elektrotechnika"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Shayeste, H., and Asl, B.M. (2023). Automatic seizure detection based on Gray Level Co-occurrence Matrix of STFT imaged-EEG. Biomed. Signal Process. Control, 79.","DOI":"10.1016\/j.bspc.2022.104109"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"53497","DOI":"10.1007\/s11042-023-17653-3","article-title":"Emotion detection using convolutional neural network and long short-term memory: A deep multimodal framework","volume":"83","author":"Tahir","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Do, N.T., Kim, S.H., Yang, H.J., Lee, G.S., and Yeom, S. (2021). Context-Aware Emotion Recognition in the Wild Using Spatio-Temporal and Temporal-Pyramid Models. Sensors, 21.","DOI":"10.3390\/s21072344"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Graves, A., and Graves, A. (2012). Supervised Sequence Labelling with Recurrent Neural Networks, Springer.","DOI":"10.1007\/978-3-642-24797-2"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"450842","DOI":"10.3389\/fimmu.2019.01305","article-title":"Differential dynamics of the maternal immune system in healthy pregnancy and preeclampsia","volume":"10","author":"Han","year":"2019","journal-title":"Front. Immunol."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Riccio, C., Martone, A., Zazzaro, G., and Pavone, L. (2024). Training Datasets for Epilepsy Analysis: Preprocessing and Feature Extraction from Electroencephalography Time Series. Data, 9.","DOI":"10.3390\/data9050061"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Shen, M., Wen, P., Song, B., and Li, Y. (2022). An EEG based real-time epilepsy seizure detection approach using discrete wavelet transform and machine learning methods. Biomed. Signal Process. Control, 77.","DOI":"10.1016\/j.bspc.2022.103820"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"578126","DOI":"10.3389\/fnins.2020.578126","article-title":"A One-Dimensional CNN-LSTM Model for Epileptic Seizure Recognition Using EEG Signal Analysis","volume":"14","author":"Xu","year":"2020","journal-title":"Front. Neurosci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3360\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:47:45Z","timestamp":1760107665000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3360"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,24]]},"references-count":44,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["s24113360"],"URL":"https:\/\/doi.org\/10.3390\/s24113360","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,24]]}}}