{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T14:41:46Z","timestamp":1776091306721,"version":"3.50.1"},"reference-count":30,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T00:00:00Z","timestamp":1685318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Electronics and Telecommunications Research Institute (ETRI)","award":["23ZS1100"],"award-info":[{"award-number":["23ZS1100"]}]},{"name":"Electronics and Telecommunications Research Institute (ETRI)","award":["NRF-2022R1I1A1A01066657"],"award-info":[{"award-number":["NRF-2022R1I1A1A01066657"]}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea (NRF)","doi-asserted-by":"publisher","award":["23ZS1100"],"award-info":[{"award-number":["23ZS1100"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea (NRF)","doi-asserted-by":"publisher","award":["NRF-2022R1I1A1A01066657"],"award-info":[{"award-number":["NRF-2022R1I1A1A01066657"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the era of user-generated content (UGC) and virtual interactions within the metaverse, empathic digital content has become increasingly important. This study aimed to quantify human empathy levels when exposed to digital media. To assess empathy, we analyzed brain wave activity and eye movements in response to emotional videos. Forty-seven participants watched eight emotional videos, and we collected their brain activity and eye movement data during the viewing. After each video session, participants provided subjective evaluations. Our analysis focused on the relationship between brain activity and eye movement in recognizing empathy. The findings revealed the following: (1) Participants were more inclined to empathize with videos depicting pleasant-arousal and unpleasant-relaxed emotions. (2) Saccades and fixation, key components of eye movement, occurred simultaneously with specific channels in the prefrontal and temporal lobes. (3) Eigenvalues of brain activity and pupil changes showed synchronization between the right pupil and certain channels in the prefrontal, parietal, and temporal lobes during empathic responses. These results suggest that eye movement characteristics can serve as an indicator of the cognitive empathic process when engaging with digital content. Furthermore, the observed changes in pupil size result from a combination of emotional and cognitive empathy elicited by the videos.<\/jats:p>","DOI":"10.3390\/s23115162","type":"journal-article","created":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T03:39:36Z","timestamp":1685331576000},"page":"5162","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Recognition of Empathy from Synchronization between Brain Activity and Eye Movement"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5230-6285","authenticated-orcid":false,"given":"Jing","family":"Zhang","sequence":"first","affiliation":[{"name":"International Research Center of Architecture and Emotion, Hebei University of Engineering, Handan 056009, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1242-9264","authenticated-orcid":false,"given":"Sung","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Emotion Engineering, Sangmyung University, Seoul 03016, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0035-3853","authenticated-orcid":false,"given":"Ayoung","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Emotion Engineering, Sangmyung University, Seoul 03016, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4301-9089","authenticated-orcid":false,"given":"Mincheol","family":"Whang","sequence":"additional","affiliation":[{"name":"Department of Human-Centered Artificial Intelligence, Sangmyung University, Seoul 03016, Republic of Korea"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1257\/000282805774670103","article-title":"The neuroeconomics of mind reading and empathy","volume":"95","author":"Singer","year":"2005","journal-title":"Am. Econ. Rev."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/S0140525X02000018","article-title":"Empathy: Its ultimate and proximate bases","volume":"25","author":"Preston","year":"2002","journal-title":"Behav. Brain Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1159\/000317771","article-title":"The neurodevelopment of empathy in humans","volume":"32","author":"Decety","year":"2010","journal-title":"Dev. Neurosci."},{"key":"ref_4","unstructured":"Pineda, J.A., Moore, A.R., Elfenbeinand, H., and Cox, R. (2009). Mirror Neuron Systems: The Role of Mirroring Processes in Social Cognition, Springer."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1016\/j.neubiorev.2009.11.007","article-title":"Where do mirror neurons come from?","volume":"34","author":"Heyes","year":"2010","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1017\/S0140525X13000903","article-title":"Mirror neurons: From origin to function","volume":"37","author":"Cook","year":"2014","journal-title":"Behav. Brain Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"R1057","DOI":"10.1016\/j.cub.2013.10.051","article-title":"What we know currently about mirror neurons","volume":"23","author":"Kilner","year":"2013","journal-title":"Curr. Biol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1038\/nrn3476","article-title":"Top-down influences on visual processing","volume":"14","author":"Gilbert","year":"2013","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.pneurobio.2008.09.001","article-title":"The orbitofrontal cortex and beyond: From affect to decision-making","volume":"86","author":"Rolls","year":"2008","journal-title":"Prog. Neurobiol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1126\/science.1254126","article-title":"Long-range and local circuits for top-down modulation of visual cortex processing","volume":"345","author":"Zhang","year":"2014","journal-title":"Science"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"55","DOI":"10.2478\/v10053-008-0090-4","article-title":"Neuro-cognitive mechanisms of conscious and unconscious visual perception: From a plethora of phenomena to general principles","volume":"7","author":"Kiefer","year":"2011","journal-title":"Adv. Cogn. Psychol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1017\/S0140525X00068229","article-title":"Time and the observer: The where and when of consciousness in the brain","volume":"15","author":"Dennett","year":"1992","journal-title":"Behav. Brain Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"828","DOI":"10.1016\/j.neuroimage.2010.02.042","article-title":"The role of early visual cortex (V1\/V2) in conscious and unconscious visual perception","volume":"51","author":"Koivisto","year":"2010","journal-title":"Neuroimage"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1016\/j.conb.2005.10.015","article-title":"Motor functions of the parietal lobe","volume":"15","author":"Fogassi","year":"2005","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1556","DOI":"10.1136\/bjo.2006.104844","article-title":"Visual attention as an important visual function: An outline of manifestations, diagnosis and management of impaired visual attention","volume":"91","author":"Das","year":"2007","journal-title":"Br. J. Ophthalmol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1016\/0166-2236(83)90190-X","article-title":"Object vision and spatial vision: Two cortical pathways","volume":"6","author":"Mishkin","year":"1983","journal-title":"Trends Neurosci."},{"key":"ref_17","unstructured":"Cornsweet, T. (2012). Visual Perception, Academic Press."},{"key":"ref_18","unstructured":"Zheng, W.-L., Dong, B.-N., and Lu, B.-L. (2014, January 26\u201330). Multimodal emotion recognition using EEG and eye tracking data. Proceedings of the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA."},{"key":"ref_19","unstructured":"Lu, Y., Zheng, W.-L., Li, B., and Lu, B.-L. (2015, January 25\u201331). Combining eye movements and EEG to enhance emotion recognition. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1167\/8.8.1","article-title":"The contribution of different facial regions to the recognition of conversational expressions","volume":"8","author":"Nusseck","year":"2008","journal-title":"J. Vis."},{"key":"ref_21","unstructured":"Ekman, P., and Friesen, W.V. (2003). Unmasking the Face: A Guide to Recognizing Emotions from Facial Clues, Ishk."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1177\/014662168801200410","article-title":"Set correlation and contingency tables","volume":"12","author":"Cohen","year":"1988","journal-title":"Appl. Psychol. Meas."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Moffa, A.H., Nikolin, S., Martin, D., Loo, C., and Boonstra, T.W. (2021). Assessing neuromodulation effects of theta burst stimulation to the prefrontal cortex using TMS-evoked potentials. bioRxiv.","DOI":"10.1101\/2021.06.21.449219"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, J., Park, S., Cho, A., and Whang, M. (2022). Recognition of Emotion by Brain Connectivity and Eye Movement. Sensors, 22.","DOI":"10.3390\/s22186736"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"133","DOI":"10.5392\/JKCA.2014.14.11.133","article-title":"Measuring consumer empathic response to advertising drama","volume":"14","author":"Soh","year":"2014","journal-title":"J. Korea Contents Assoc."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s12144-017-9599-3","article-title":"Cognitive empathy in intercultural interactions: The roles of lay theories of multiculturalism and polyculturalism","volume":"38","author":"Salanga","year":"2019","journal-title":"Curr. Psychol."},{"key":"ref_27","first-page":"1002","article-title":"Cross-validation of the Spanish HP-version of the jefferson scale of empathy confirmed with some cross-cultural differences","volume":"7","author":"Roig","year":"2016","journal-title":"Front. Psychol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1109\/TCIAIG.2013.2260340","article-title":"Electroencephalogram and physiological signal analysis for assessing flow in games","volume":"5","author":"Berta","year":"2013","journal-title":"IEEE Trans. Comput. Intell. AI Games"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1007\/BF00280119","article-title":"Effects of loratadine and cetirizine on actual driving and psychometric test performance, and EEG during driving","volume":"42","author":"Ramaekers","year":"1992","journal-title":"Eur. J. Clin. Pharmacol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1400","DOI":"10.3389\/fphys.2018.01400","article-title":"Infrared camera-based non-contact measurement of brain activity from pupillary rhythms","volume":"9","author":"Park","year":"2018","journal-title":"Front. Physiol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/5162\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:44:12Z","timestamp":1760125452000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/5162"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,29]]},"references-count":30,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["s23115162"],"URL":"https:\/\/doi.org\/10.3390\/s23115162","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,29]]}}}