{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,5]],"date-time":"2026-09-05T16:27:41Z","timestamp":1788625661235,"version":"build-2803163510"},"reference-count":65,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,5,25]],"date-time":"2021-05-25T00:00:00Z","timestamp":1621900800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010221","name":"Higher Education Commision, Pakistan","doi-asserted-by":"publisher","award":["--"],"award-info":[{"award-number":["--"]}],"id":[{"id":"10.13039\/501100010221","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Brain Sciences"],"abstract":"<jats:p>Most electroencephalography (EEG)-based emotion recognition systems rely on a single stimulus to evoke emotions. These systems make use of videos, sounds, and images as stimuli. Few studies have been found for self-induced emotions. The question \u201cif different stimulus presentation paradigms for same emotion, produce any subject and stimulus independent neural correlates\u201d remains unanswered. Furthermore, we found that there are publicly available datasets that are used in a large number of studies targeting EEG-based human emotional state recognition. Since one of the major concerns and contributions of this work is towards classifying emotions while subjects experience different stimulus-presentation paradigms, we need to perform new experiments. This paper presents a novel experimental study that recorded EEG data for three different human emotional states evoked with four different stimuli presentation paradigms. Fear, neutral, and joy have been considered as three emotional states. In this work, features were extracted with common spatial pattern (CSP) from recorded EEG data and classified through linear discriminant analysis (LDA). The considered emotion-evoking paradigms included emotional imagery, pictures, sounds, and audio\u2013video movie clips. Experiments were conducted with twenty-five participants. Classification performance in different paradigms was evaluated, considering different spectral bands. With a few exceptions, all paradigms showed the best emotion recognition for higher frequency spectral ranges. Interestingly, joy emotions were classified more strongly as compared to fear. The average neural patterns for fear vs. joy emotional states are presented with topographical maps based on spatial filters obtained with CSP for averaged band power changes for all four paradigms. With respect to the spectral bands, beta and alpha oscillation responses produced the highest number of significant results for the paradigms under consideration. With respect to brain region, the frontal lobe produced the most significant results irrespective of paradigms and spectral bands. The temporal site also played an effective role in generating statistically significant findings. To the best of our knowledge, no study has been conducted for EEG emotion recognition while considering four different stimuli paradigms. This work provides a good contribution towards designing EEG-based system for human emotion recognition that could work effectively in different real-time scenarios.<\/jats:p>","DOI":"10.3390\/brainsci11060696","type":"journal-article","created":{"date-parts":[[2021,5,25]],"date-time":"2021-05-25T13:14:21Z","timestamp":1621948461000},"page":"696","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Comparing Neural Correlates of Human Emotions across Multiple Stimulus Presentation Paradigms"],"prefix":"10.3390","volume":"11","author":[{"given":"Naveen","family":"Masood","sequence":"first","affiliation":[{"name":"Electrical Engineering Department, Bahria University, Karachi 75260, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Humera","family":"Farooq","sequence":"additional","affiliation":[{"name":"Computer Science Department, Bahria University, Karachi 44000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,25]]},"reference":[{"key":"ref_1","unstructured":"Hockenbury, D.H., and Hockenbury, S.E. (2010). Discovering Psychology, Macmillan."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.inffus.2017.02.003","article-title":"A review of affective computing: From unimodal analysis to multimodal fusion","volume":"37","author":"Poria","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.neunet.2017.02.014","article-title":"Weighted spatial based geometric scheme as an efficient algorithm for analyzing single-trial EEGS to improve cue-based BCI classification","volume":"92","author":"Alimardani","year":"2017","journal-title":"Neural Netw."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Gao, Z., Cui, X., Wan, W., and Gu, Z. (2019). Recognition of Emotional States using Multiscale Information Analysis of High Frequency EEG Oscillations. Entropy, 21.","DOI":"10.3390\/e21060609"},{"key":"ref_5","unstructured":"Ekman, P.E., and Davidson, R.J. (1994). The Nature of Emotion: Fundamental Questions, Oxford University Press."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1080\/0144929X.2018.1485745","article-title":"Towards EEG-based BCI driven by emotions for addressing BCI-Illiteracy: A meta-analytic review","volume":"37","author":"Spezialetti","year":"2018","journal-title":"Behav. Inf. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1196\/annals.1301.004","article-title":"Social engagement and attachment","volume":"1008","author":"Porges","year":"2003","journal-title":"Ann. N. Y. Acad. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhuang, N., Zeng, Y., Yang, K., Zhang, C., Tong, L., and Yan, B. (2018). Investigating patterns for self-induced emotion recognition from EEG signals. Sensors, 18.","DOI":"10.3390\/s18030841"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1016\/j.ijhcs.2009.03.005","article-title":"Short-term emotion assessment in a recall paradigm","volume":"67","author":"Chanel","year":"2009","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kothe, C.A., Makeig, S., and Onton, J.A. (2013, January 2\u20135). Emotion recognition from EEG during self-paced emotional imagery. Proceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII), Geneva, Switzerland.","DOI":"10.1109\/ACII.2013.160"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3171","DOI":"10.1109\/TCYB.2015.2498974","article-title":"A classification algorithm for electroencephalography signals by self-induced emotional stimuli","volume":"46","author":"Iacoviello","year":"2016","journal-title":"IEEE Trans. Cybern."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1007\/s12559-017-9533-x","article-title":"Hierarchical convolutional neural networks for EEG-based emotion recognition","volume":"10","author":"Li","year":"2018","journal-title":"Cogn. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/s12559-013-9225-0","article-title":"EEG correlates of voice and face emotional judgments in the human brain","volume":"7","author":"Kawasaki","year":"2015","journal-title":"Cogn. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"26","DOI":"10.3389\/fnhum.2017.00026","article-title":"EEG correlates of ten positive emotions","volume":"11","author":"Hu","year":"2017","journal-title":"Front. Hum. Neurosci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1109\/TAFFC.2017.2714671","article-title":"Emotions recognition using EEG signals: A survey","volume":"10","author":"Alarcao","year":"2017","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_16","unstructured":"Wang, Z.-M., Zhou, R., He, Y., and Guo, X.-M. (2020). Functional Integration and Separation of Brain Network Based on Phase Locking Value During Emotion Processing. IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Djemal, R., Bazyed, A.G., Belwafi, K., Gannouni, S., and Kaaniche, W. (2016). Three-class EEG-based motor imagery classification using phase-space reconstruction technique. Brain Sci., 6.","DOI":"10.3390\/brainsci6030036"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/TBME.2004.827088","article-title":"Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms","volume":"51","author":"Dornhege","year":"2004","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ruiz-G\u00f3mez, S.J., G\u00f3mez, C., Poza, J., Guti\u00e9rrez-Tobal, G.C., Tola-Arribas, M.A., Cano, M., and Hornero, R. (2018). Automated multiclass classification of spontaneous EEG activity in Alzheimer\u2019s disease and mild cognitive impairment. Entropy, 20.","DOI":"10.3390\/e20010035"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13638-019-1497-y","article-title":"Multiclass EEG motor-imagery classification with sub-band common spatial patterns","volume":"2019","author":"Khan","year":"2019","journal-title":"EURASIP J. Wirel. Commun. Netw."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1109\/TAFFC.2018.2817622","article-title":"EEG emotion recognition using dynamical graph convolutional neural networks","volume":"11","author":"Song","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.eswa.2017.09.062","article-title":"Evolutionary computation algorithms for feature selection of EEG-based emotion recognition using mobile sensors","volume":"93","author":"Nakisa","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1109\/TAFFC.2018.2840973","article-title":"A mutual information based adaptive windowing of informative EEG for emotion recognition","volume":"11","author":"Piho","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"40144","DOI":"10.1109\/ACCESS.2019.2904400","article-title":"Internal emotion classification using eeg signal with sparse discriminative ensemble","volume":"7","author":"Ullah","year":"2019","journal-title":"IEEE Access"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Eijlers, E., Smidts, A., and Boksem, M.A. (2019). Implicit measurement of emotional experience and its dynamics. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0211496"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"107200","DOI":"10.1109\/ACCESS.2020.3000788","article-title":"Frontal EEG Asymmetry of Emotion for the Same Auditory Stimulus","volume":"8","author":"Lee","year":"2020","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"616","DOI":"10.3389\/fpsyg.2016.00616","article-title":"EEG oscillation evidences of enhanced susceptibility to emotional stimuli during adolescence","volume":"7","author":"Meng","year":"2016","journal-title":"Front. Psychol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1606","DOI":"10.1111\/psyp.12904","article-title":"The two faces of avoidance: Time-frequency correlates of motivational disposition in blood phobia","volume":"54","author":"Mennella","year":"2017","journal-title":"Psychophysiology"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.ijpsycho.2007.03.009","article-title":"Brain oscillations are highly influenced by gender differences","volume":"65","year":"2007","journal-title":"Int. J. Psychophysiol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.ijpsycho.2013.04.020","article-title":"EEG alpha and cortical inhibition in affective attention","volume":"89","author":"Uusberg","year":"2013","journal-title":"Int. J. Psychophysiol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.neuropsychologia.2014.03.014","article-title":"A review of brain oscillations in perception of faces and emotional pictures","volume":"58","year":"2014","journal-title":"Neuropsychologia"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1016\/j.ijpsycho.2012.09.005","article-title":"Individual brain-frequency responses to self-selected music","volume":"86","author":"Thomschewski","year":"2012","journal-title":"Int. J. Psychophysiol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"116665","DOI":"10.1016\/j.neuroimage.2020.116665","article-title":"Fronto-temporal theta phase-synchronization underlies music-evoked pleasantness","volume":"212","author":"Ara","year":"2020","journal-title":"NeuroImage"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.neulet.2005.09.004","article-title":"EEG correlates (event-related desynchronization) of emotional face elaboration: A temporal analysis","volume":"392","author":"Balconi","year":"2006","journal-title":"Neurosci. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhang, D., Wang, L., Luo, Y., and Luo, Y. (2012). Individual differences in detecting rapidly presented fearful faces. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0049517"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1588","DOI":"10.1016\/j.neuroscience.2009.09.057","article-title":"Event-related delta and theta synchronization during explicit and implicit emotion processing","volume":"164","author":"Knyazev","year":"2009","journal-title":"Neuroscience"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/j.neulet.2010.08.002","article-title":"Event-related beta oscillations are affected by emotional eliciting stimuli","volume":"483","year":"2010","journal-title":"Neurosci. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/S0304-3940(01)02246-7","article-title":"Parietal electroencephalogram beta asymmetry and selective attention to angry facial expressions in healthy human subjects","volume":"314","author":"Schutter","year":"2001","journal-title":"Neurosci. Lett."},{"key":"ref_39","unstructured":"Li, M., and Lu, B.-L. (2009, January 2\u20136). Emotion classification based on gamma-band EEG. Proceedings of the 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, St. Paul, MN, USA."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2869","DOI":"10.1109\/TBME.2019.2897651","article-title":"EEG based emotion recognition by combining functional connectivity network and local activations","volume":"66","author":"Li","year":"2019","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zhang, J., Chen, M., Zhao, S., Hu, S., Shi, Z., and Cao, Y. (2016). ReliefF-based EEG sensor selection methods for emotion recognition. Sensors, 16.","DOI":"10.3390\/s16101558"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Jatupaiboon, N., Pan-ngum, S., and Israsena, P. (2013, January 29\u201331). Emotion classification using minimal EEG channels and frequency bands. Proceedings of the 2013 10th International Joint Conference on Computer Science and Software Engineering (JCSSE), Khon Kaen, Thailand.","DOI":"10.1109\/JCSSE.2013.6567313"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1109\/TAMD.2015.2431497","article-title":"Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks","volume":"7","author":"Zheng","year":"2015","journal-title":"IEEE Trans. Auton. Ment. Dev."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/j.chb.2016.01.005","article-title":"Toward automatic detection of brain responses to emotional music through analysis of EEG effective connectivity","volume":"58","author":"Shahabi","year":"2016","journal-title":"Comput. Hum. Behav."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.neulet.2006.06.039","article-title":"EEG phase synchronization during emotional response to positive and negative film stimuli","volume":"406","author":"Costa","year":"2006","journal-title":"Neurosci. Lett."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Lee, Y.-Y., and Hsieh, S. (2014). Classifying different emotional states by means of EEG-based functional connectivity patterns. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0095415"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1080\/00207450590897969","article-title":"Impact of regular meditation practice on EEG activity at rest and during evoked negative emotions","volume":"115","author":"Aftanas","year":"2005","journal-title":"Int. J. Neurosci."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Masood, N., and Farooq, H. (2019). Investigating EEG patterns for dual-stimuli induced human fear emotional state. Sensors, 19.","DOI":"10.3390\/s19030522"},{"key":"ref_49","unstructured":"Lang, P.J. (2005). International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual, University of Florida. Technical report."},{"key":"ref_50","unstructured":"Bradley, M.M., and Lang, P.J. (2007). The International Affective Digitized Sounds (IADS-2): Affective Ratings of Sounds and Instruction Manual, University of Florida."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"509","DOI":"10.3233\/THC-174836","article-title":"Emotion recognition from multichannel EEG signals using K-nearest neighbor classification","volume":"26","author":"Li","year":"2018","journal-title":"Technol. Health Care"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1080\/17470919.2013.855660","article-title":"Humiliation as an intense emotional experience: Evidence from the electro-encephalogram","volume":"9","author":"Otten","year":"2014","journal-title":"Soc. Neurosci."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"e13386","DOI":"10.1111\/psyp.13386","article-title":"Affective picture processing: Alpha-and lower beta-band desynchronization reflects emotional arousal","volume":"56","author":"Schubring","year":"2019","journal-title":"Psychophysiology"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1016\/j.neuropsychologia.2010.12.025","article-title":"Rapid amygdala gamma oscillations in response to fearful facial expressions","volume":"49","author":"Sato","year":"2011","journal-title":"Neuropsychologia"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.ijpsycho.2010.09.014","article-title":"Intracerebral gamma modulations reveal interaction between emotional processing and action outcome evaluation in the human orbitofrontal cortex","volume":"79","author":"Jung","year":"2011","journal-title":"Int. J. Psychophysiol."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"89","DOI":"10.3389\/fnhum.2020.00089","article-title":"High Gamma Band EEG Closely Related to Emotion: Evidence from Functional Network","volume":"14","author":"Yang","year":"2020","journal-title":"Front. Hum. Neurosci."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.jneumeth.2003.10.009","article-title":"EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis","volume":"134","author":"Delorme","year":"2004","journal-title":"J. Neurosci. Methods"},{"key":"ref_58","unstructured":"Heunis, C. (2021, May 25). Export and Analysis of Emotiv Insight EEG Data via EEGLAB. Available online: https:\/\/www.researchgate.net\/profile\/Christoff-Heunis\/publication\/303810882_Export_and_Analysis_of_Emotiv_Insight_EEG_Data_via_EEGLAB\/links\/57547bd808ae10d9337a3e01\/Export-and-Analysis-of-Emotiv-Insight-EEG-Data-via-EEGLAB.pdf."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1109\/TBME.2010.2082539","article-title":"Regularizing common spatial patterns to improve BCI designs: Unified theory and new algorithms","volume":"58","author":"Lotte","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_60","unstructured":"Lan, Z. (2018). EEG-Based Emotion Recognition Using Machine Learning Techniques. [Ph.D. Thesis, Nanyang Technological University]."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1007\/s00371-015-1183-y","article-title":"Real-time EEG-based emotion monitoring using stable features","volume":"32","author":"Lan","year":"2016","journal-title":"Vis. Comput."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"6","DOI":"10.3389\/fnhum.2017.00006","article-title":"Comparison of the working memory load in n-back and working memory span tasks by means of EEG frequency band power and P300 amplitude","volume":"11","author":"Scharinger","year":"2017","journal-title":"Front. Hum. Neurosci."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"814","DOI":"10.1016\/j.neuroimage.2010.06.048","article-title":"Single-trial analysis and classification of ERP components\u2014A tutorial","volume":"56","author":"Blankertz","year":"2011","journal-title":"NeuroImage"},{"key":"ref_64","first-page":"1","article-title":"Fisher discriminant analysis with kernels","volume":"1","author":"Scholkopft","year":"1999","journal-title":"Neural Netw. Signal Process. IX"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.brainres.2010.09.102","article-title":"Cross-regional cortical synchronization during affective image viewing","volume":"1362","author":"Miskovic","year":"2010","journal-title":"Brain Res."}],"container-title":["Brain Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3425\/11\/6\/696\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:07:38Z","timestamp":1760162858000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3425\/11\/6\/696"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,25]]},"references-count":65,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["brainsci11060696"],"URL":"https:\/\/doi.org\/10.3390\/brainsci11060696","relation":{},"ISSN":["2076-3425"],"issn-type":[{"value":"2076-3425","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,25]]}}}