{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T14:59:43Z","timestamp":1775228383028,"version":"3.50.1"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"1s","license":[{"start":{"date-parts":[[2019,1,24]],"date-time":"2019-01-24T00:00:00Z","timestamp":1548288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2017YFC011300"],"award-info":[{"award-number":["2017YFC011300"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Berkeley Deep Drive"},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61701273, 61571269, 61671267"],"award-info":[{"award-number":["61701273, 61571269, 61671267"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Royal Society Newton Mobility Grant","award":["IE150997"],"award-info":[{"award-number":["IE150997"]}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"crossref","award":["2018T110100, 2017M610897"],"award-info":[{"award-number":["2018T110100, 2017M610897"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2019,1,31]]},"abstract":"<jats:p>Due to the subjective responses of different subjects to physical stimuli, emotion recognition methodologies from physiological signals are increasingly becoming personalized. Existing works mainly focused on modeling the involved physiological corpus of each subject, without considering the psychological factors, such as interest and personality. The latent correlation among different subjects has also been rarely examined. In this article, we propose to investigate the influence of personality on emotional behavior in a hypergraph learning framework. Assuming that each vertex is a compound tuple (subject, stimuli), multi-modal hypergraphs can be constructed based on the personality correlation among different subjects and on the physiological correlation among corresponding stimuli. To reveal the different importance of vertices, hyperedges, and modalities, we learn the weights for each of them. As the hypergraphs connect different subjects on the compound vertices, the emotions of multiple subjects can be simultaneously recognized. In this way, the constructed hypergraphs are vertex-weighted multi-modal multi-task ones. The estimated factors, referred to as emotion relevance, are employed for emotion recognition. We carry out extensive experiments on the ASCERTAIN dataset and the results demonstrate the superiority of the proposed method, as compared to the state-of-the-art emotion recognition approaches.<\/jats:p>","DOI":"10.1145\/3233184","type":"journal-article","created":{"date-parts":[[2019,1,28]],"date-time":"2019-01-28T14:01:39Z","timestamp":1548684099000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":50,"title":["Personalized Emotion Recognition by Personality-Aware High-Order Learning of Physiological Signals"],"prefix":"10.1145","volume":"15","author":[{"given":"Sicheng","family":"Zhao","sequence":"first","affiliation":[{"name":"Tsinghua University, China and University of California Berkeley, Berkeley"}]},{"given":"Amir","family":"Gholaminejad","sequence":"additional","affiliation":[{"name":"University of California Berkeley, Berkeley"}]},{"given":"Guiguang","family":"Ding","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}]},{"given":"Yue","family":"Gao","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}]},{"given":"Jungong","family":"Han","sequence":"additional","affiliation":[{"name":"Lancaster University, Lancaster, UK"}]},{"given":"Kurt","family":"Keutzer","sequence":"additional","affiliation":[{"name":"University of California Berkeley, Berkeley"}]}],"member":"320","published-online":{"date-parts":[[2019,1,24]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2015.7163100"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2015.2392932"},{"key":"e_1_2_1_3_1","volume-title":"Falk","author":"Osman Hussein Al","year":"2017","unstructured":"Hussein Al Osman and Tiago H . Falk . 2017 . Multimodal affect recognition: Current approaches and challenges. In Emotion and Attention Recognition Based on Biological Signals and Images. InTech . Hussein Al Osman and Tiago H. Falk. 2017. Multimodal affect recognition: Current approaches and challenges. In Emotion and Attention Recognition Based on Biological Signals and Images. InTech."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.566"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-010-0182-0"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2015.2396531"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874005"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2017.8273621"},{"key":"e_1_2_1_9_1","volume-title":"MacCrae","author":"Costa Paul T.","year":"1992","unstructured":"Paul T. Costa and Robert R . MacCrae . 1992 . Revised NEO Personality Inventory (NEO PI-R) and NEO Five-factor Inventory (NEO-FFI): Professional Manual . Psychological Assessment Resources, Incorporated . Paul T. Costa and Robert R. MacCrae. 1992. Revised NEO Personality Inventory (NEO PI-R) and NEO Five-factor Inventory (NEO-FFI): Professional Manual. Psychological Assessment Resources, Incorporated."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2682899"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74889-2_43"},{"key":"e_1_2_1_12_1","volume-title":"The Emotions","author":"Frijda Nico H.","unstructured":"Nico H. Frijda . 1986. The Emotions . Cambridge University Press . Nico H. Frijda. 1986. The Emotions. Cambridge University Press."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2012.2199502"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2012.2202676"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2938640"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSMC.2005.1571679"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","first-page":"e0138198","DOI":"10.1371\/journal.pone.0138198","article-title":"Predicting the valence of a scene from observers\u0105\u0155 eye movements","volume":"10","author":"Hamed R.","year":"2015","unstructured":"R. Hamed , Adham Atyabi , Antti Rantanen , Seppo J. Laukka , Samia Nefti-Meziani , Janne Heikkil\u00e4 , and others. 2015 . Predicting the valence of a scene from observers\u0105\u0155 eye movements . PloS One 10 , 9 (2015), e0138198 . R. Hamed, Adham Atyabi, Antti Rantanen, Seppo J. Laukka, Samia Nefti-Meziani, Janne Heikkil\u00e4, and others. 2015. Predicting the valence of a scene from observers\u0105\u0155 eye movements. PloS One 10, 9 (2015), e0138198.","journal-title":"PloS One"},{"key":"e_1_2_1_18_1","volume-title":"International Conference on Physiological Computing Systems. 75--82","author":"Henriques Rui","year":"2014","unstructured":"Rui Henriques and Ana Paiva . 2014 . Seven principles to mine flexible behavior from physiological signals for effective emotion recognition and description in affective interactions . In International Conference on Physiological Computing Systems. 75--82 . Rui Henriques and Ana Paiva. 2014. Seven principles to mine flexible behavior from physiological signals for effective emotion recognition and description in affective interactions. In International Conference on Physiological Computing Systems. 75--82."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2013.14"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5540012"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-010-0632-x"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2011.941851"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1080\/0929821042000317813"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1093\/scan\/nsr059"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.26"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2808204"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.15"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2813524.2813527"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1155\/S1110865704406192"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2013.2247823"},{"key":"e_1_2_1_31_1","volume-title":"Nicu Sebe, and Ioannis Patras.","author":"Miranda-Correa Juan Abdon","year":"2017","unstructured":"Juan Abdon Miranda-Correa , Mojtaba Khomami Abadi , Nicu Sebe, and Ioannis Patras. 2017 . AMIGOS : A dataset for Mood, personality, and affect research on Individuals and GrOupS. Arxiv Preprint Arxiv :1702.02510 (2017). Juan Abdon Miranda-Correa, Mojtaba Khomami Abadi, Nicu Sebe, and Ioannis Patras. 2017. AMIGOS: A dataset for Mood, personality, and affect research on Individuals and GrOupS. Arxiv Preprint Arxiv:1702.02510 (2017)."},{"key":"e_1_2_1_32_1","volume-title":"International Conference on Machine Learning. 689--696","author":"Ngiam Jiquan","unstructured":"Jiquan Ngiam , Aditya Khosla , Mingyu Kim , Juhan Nam , Honglak Lee , and Andrew Y. Ng . 2011. Multimodal deep learning . In International Conference on Machine Learning. 689--696 . Jiquan Ngiam, Aditya Khosla, Mingyu Kim, Juhan Nam, Honglak Lee, and Andrew Y. Ng. 2011. Multimodal deep learning. In International Conference on Machine Learning. 689--696."},{"key":"e_1_2_1_33_1","volume-title":"Analyzing personality related adjectives from an eticemic perspective: The big five marker scales (BFMS) and the Italian AB5C taxonomy. Big Five Assessment","author":"Perugini Marco","year":"2002","unstructured":"Marco Perugini and Lisa Di Blas . 2002. Analyzing personality related adjectives from an eticemic perspective: The big five marker scales (BFMS) and the Italian AB5C taxonomy. Big Five Assessment ( 2002 ), 281--304. Marco Perugini and Lisa Di Blas. 2002. Analyzing personality related adjectives from an eticemic perspective: The big five marker scales (BFMS) and the Italian AB5C taxonomy. Big Five Assessment (2002), 281--304."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2017.02.003"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2614980"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2017.7952681"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1101149.1101236"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.25"},{"key":"e_1_2_1_39_1","volume-title":"The passions: Emotions and the Meaning of Life","author":"Solomon Robert C.","unstructured":"Robert C. Solomon . 1993. The passions: Emotions and the Meaning of Life . Hackett Publishing . Robert C. Solomon. 1993. The passions: Emotions and the Meaning of Life. Hackett Publishing."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/3172077.3172276"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1167\/14.3.31"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2016.2625250"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ITW.2010.5593337"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2011.6032007"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2330816"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.12"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/1641661.1641671"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2015.2432791"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.167"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0272-7358(97)00057-3"},{"key":"e_1_2_1_51_1","volume-title":"AAAI Conference on Artificial Intelligence. 306--312","author":"Yang Yang","year":"2014","unstructured":"Yang Yang , Jia Jia , Shumei Zhang , Boya Wu , Qicong Chen , Juanzi Li , Chunxiao Xing , and Jie Tang . 2014 . How do your friends on social media disclose your emotions? In AAAI Conference on Artificial Intelligence. 306--312 . Yang Yang, Jia Jia, Shumei Zhang, Boya Wu, Qicong Chen, Juanzi Li, Chunxiao Xing, and Jie Tang. 2014. How do your friends on social media disclose your emotions? In AAAI Conference on Artificial Intelligence. 306--312."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168752.2168754"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2017.8273608"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2016.2594145"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2964284.2964288"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/3171837.3171940"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123266.3130858"},{"key":"e_1_2_1_58_1","volume-title":"Discrete probability distribution prediction of image emotions with shared sparse learning","author":"Zhao Sicheng","year":"2018","unstructured":"Sicheng Zhao , Guiguang Ding , Yue Gao , Xin Zhao , Youbao Tang , Jungong Han , Hongxun Yao , and Qingming Huang . 2018. Discrete probability distribution prediction of image emotions with shared sparse learning . IEEE Transactions on Affective Computing ( 2018 ). Sicheng Zhao, Guiguang Ding, Yue Gao, Xin Zhao, Youbao Tang, Jungong Han, Hongxun Yao, and Qingming Huang. 2018. Discrete probability distribution prediction of image emotions with shared sparse learning. IEEE Transactions on Affective Computing (2018)."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.5555\/3304415.3304651"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2017.2762344"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654930"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2016.2628787"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2016.2617741"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2964284.2964289"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2655035"},{"key":"e_1_2_1_66_1","doi-asserted-by":"crossref","unstructured":"Dengyong Zhou Jiayuan Huang and Bernhard Sch\u00f6lkopf. 2006. Learning with hypergraphs: Clustering classification and embedding. In Advances in Neural Information Processing Systems. 1601--1608. Dengyong Zhou Jiayuan Huang and Bernhard Sch\u00f6lkopf. 2006. Learning with hypergraphs: Clustering classification and embedding. In Advances in Neural Information Processing Systems. 1601--1608.","DOI":"10.7551\/mitpress\/7503.003.0205"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3233184","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3233184","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:07:55Z","timestamp":1750212475000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3233184"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,24]]},"references-count":66,"journal-issue":{"issue":"1s","published-print":{"date-parts":[[2019,1,31]]}},"alternative-id":["10.1145\/3233184"],"URL":"https:\/\/doi.org\/10.1145\/3233184","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,24]]},"assertion":[{"value":"2017-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}