{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T05:11:50Z","timestamp":1780636310774,"version":"3.54.1"},"publisher-location":"New York, NY, USA","reference-count":47,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,6,27]],"date-time":"2022-06-27T00:00:00Z","timestamp":1656288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["DP190102627"],"award-info":[{"award-number":["DP190102627"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,6,27]]},"DOI":"10.1145\/3512527.3531385","type":"proceedings-article","created":{"date-parts":[[2022,6,23]],"date-time":"2022-06-23T22:23:32Z","timestamp":1656023012000},"page":"562-570","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":29,"title":["Mobile Emotion Recognition via Multiple Physiological Signals using Convolution-augmented Transformer"],"prefix":"10.1145","author":[{"given":"Kangning","family":"Yang","sequence":"first","affiliation":[{"name":"The University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Tag","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yue","family":"Gu","sequence":"additional","affiliation":[{"name":"Rutgers University, New Brunswick, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chaofan","family":"Wang","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tilman","family":"Dingler","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Greg","family":"Wadley","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jorge","family":"Goncalves","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,6,27]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological science in the public interest 20, 1","author":"Barrett Lisa Feldman","year":"2019","unstructured":"Lisa Feldman Barrett , Ralph Adolphs , Stacy Marsella , Aleix M Martinez , and Seth D Pollak . 2019. Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological science in the public interest 20, 1 ( 2019 ), 1--68. Lisa Feldman Barrett, Ralph Adolphs, Stacy Marsella, Aleix M Martinez, and Seth D Pollak. 2019. Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological science in the public interest 20, 1 (2019), 1--68."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3460421.3480427"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00338"},{"key":"e_1_3_2_2_4_1","volume-title":"et al","author":"Cohen Ira","year":"2000","unstructured":"Ira Cohen , Ashutosh Garg , Thomas S Huang , et al . 2000 . Emotion recognition from facial expressions using multilevel HMM. In Neural information processing systems, Vol. 2 . Citeseer . Ira Cohen, Ashutosh Garg, Thomas S Huang, et al . 2000. Emotion recognition from facial expressions using multilevel HMM. In Neural information processing systems, Vol. 2. Citeseer."},{"key":"e_1_3_2_2_5_1","volume-title":"A fascinating but risky case of reverse inference: From measures to emotions! Food Quality and Preference","author":"Delplanque Sylvain","year":"2020","unstructured":"Sylvain Delplanque and David Sander . 2021. A fascinating but risky case of reverse inference: From measures to emotions! Food Quality and Preference November 2020 (2021), 104183. Sylvain Delplanque and David Sander. 2021. A fascinating but risky case of reverse inference: From measures to emotions! Food Quality and Preference November 2020 (2021), 104183."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3329189.3329216"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2682899"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2636067"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3012900"},{"key":"e_1_3_2_2_11_1","volume-title":"Conformer: Convolution-augmented transformer for speech recognition. arXiv preprint arXiv:2005.08100","author":"Gulati Anmol","year":"2020","unstructured":"Anmol Gulati , James Qin , Chung-Cheng Chiu , Niki Parmar , Yu Zhang , Jiahui Yu , Wei Han , Shibo Wang , Zhengdong Zhang , Yonghui Wu , 2020 . Conformer: Convolution-augmented transformer for speech recognition. arXiv preprint arXiv:2005.08100 (2020). Anmol Gulati, James Qin, Chung-Cheng Chiu, Niki Parmar, Yu Zhang, Jiahui Yu, Wei Han, Shibo Wang, Zhengdong Zhang, Yonghui Wu, et al. 2020. Conformer: Convolution-augmented transformer for speech recognition. arXiv preprint arXiv:2005.08100 (2020)."},{"key":"e_1_3_2_2_12_1","volume-title":"International conference on machine learning. PMLR, 448--456","author":"Ioffe Sergey","year":"2015","unstructured":"Sergey Ioffe and Christian Szegedy . 2015 . Batch normalization: Accelerating deep network training by reducing internal covariate shift . In International conference on machine learning. PMLR, 448--456 . Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International conference on machine learning. PMLR, 448--456."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1177\/1745691620966791"},{"key":"e_1_3_2_2_14_1","volume-title":"Deap: A database for emotion analysis","author":"Koelstra Sander","year":"2011","unstructured":"Sander Koelstra , Christian Muhl , Mohammad Soleymani , Jong-Seok Lee , Ashkan Yazdani , Touradj Ebrahimi , Thierry Pun , Anton Nijholt , and Ioannis Patras . 2011 . Deap: A database for emotion analysis ; using physiological signals. IEEE transactions on affective computing 3, 1 (2011), 18--31. Sander Koelstra, Christian Muhl, Mohammad Soleymani, Jong-Seok Lee, Ashkan Yazdani, Touradj Ebrahimi, Thierry Pun, Anton Nijholt, and Ioannis Patras. 2011. Deap: A database for emotion analysis; using physiological signals. IEEE transactions on affective computing 3, 1 (2011), 18--31."},{"key":"e_1_3_2_2_15_1","volume-title":"Comparison of blood","author":"Kushki Azadeh","year":"2011","unstructured":"Azadeh Kushki , Jillian Fairley , Satyam Merja , Gillian King , and Tom Chau . 2011. Comparison of blood volume pulse and skin conductance responses to mental and affective stimuli at different anatomical sites. Physiological measurement 32 , 10 ( 2011 ), 1529. Azadeh Kushki, Jillian Fairley, Satyam Merja, Gillian King, and Tom Chau. 2011. Comparison of blood volume pulse and skin conductance responses to mental and affective stimuli at different anatomical sites. Physiological measurement 32, 10 (2011), 1529."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.324"},{"key":"e_1_3_2_2_17_1","volume-title":"Michal Muszynski, Ryo Ishii, David Brent, Randy Auerbach, Nicholas Allen, and Louis-Philippe Morency.","author":"Liu Terrance","year":"2020","unstructured":"Terrance Liu , Paul Pu Liang , Michal Muszynski, Ryo Ishii, David Brent, Randy Auerbach, Nicholas Allen, and Louis-Philippe Morency. 2020 . Multimodal privacy- preserving mood prediction from mobile data: A preliminary study. arXiv preprint arXiv:2012.02359 (2020). Terrance Liu, Paul Pu Liang, Michal Muszynski, Ryo Ishii, David Brent, Randy Auerbach, Nicholas Allen, and Louis-Philippe Morency. 2020. Multimodal privacy- preserving mood prediction from mobile data: A preliminary study. arXiv preprint arXiv:2012.02359 (2020)."},{"key":"e_1_3_2_2_18_1","volume-title":"Mood instability and psychosis: analyses of British national survey data. Schizophrenia bulletin 40, 2","author":"Marwaha Steven","year":"2014","unstructured":"Steven Marwaha , Matthew R Broome , Paul E Bebbington , Elizabeth Kuipers , and Daniel Freeman . 2014. Mood instability and psychosis: analyses of British national survey data. Schizophrenia bulletin 40, 2 ( 2014 ), 269--277. Steven Marwaha, Matthew R Broome, Paul E Bebbington, Elizabeth Kuipers, and Daniel Freeman. 2014. Mood instability and psychosis: analyses of British national survey data. Schizophrenia bulletin 40, 2 (2014), 269--277."},{"key":"e_1_3_2_2_19_1","volume-title":"Say Wei Foo, and Liyanage C De Silva","author":"Nwe Tin Lay","year":"2003","unstructured":"Tin Lay Nwe , Say Wei Foo, and Liyanage C De Silva . 2003 . Speech emotion recognition using hidden Markov models. Speech communication 41, 4 (2003), 603--623. Tin Lay Nwe, Say Wei Foo, and Liyanage C De Silva. 2003. Speech emotion recognition using hidden Markov models. Speech communication 41, 4 (2003), 603--623."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2015.7178964"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-020-00630-y"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2017.02.003"},{"key":"e_1_3_2_2_23_1","volume-title":"The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and psychopathology 17, 3","author":"Posner Jonathan","year":"2005","unstructured":"Jonathan Posner , James A Russell , and Bradley S Peterson . 2005. The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and psychopathology 17, 3 ( 2005 ), 715--734. Jonathan Posner, James A Russell, and Bradley S Peterson. 2005. The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and psychopathology 17, 3 (2005), 715--734."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21165317"},{"key":"e_1_3_2_2_25_1","volume-title":"Smartphones: An emerging tool for social scientists. Sociological methods & research 37, 3","author":"Raento Mika","year":"2009","unstructured":"Mika Raento , Antti Oulasvirta , and Nathan Eagle . 2009 . Smartphones: An emerging tool for social scientists. Sociological methods & research 37, 3 (2009), 426--454. Mika Raento, Antti Oulasvirta, and Nathan Eagle. 2009. Smartphones: An emerging tool for social scientists. Sociological methods & research 37, 3 (2009), 426--454."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699939408408938"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0077714"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCSP.2014.6949798"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376163"},{"key":"e_1_3_2_2_30_1","volume-title":"Smile for the camera: privacy and policy implications of emotion AI. arXiv preprint arXiv:1709.00396","author":"Sedenberg Elaine","year":"2017","unstructured":"Elaine Sedenberg and John Chuang . 2017. Smile for the camera: privacy and policy implications of emotion AI. arXiv preprint arXiv:1709.00396 ( 2017 ). Elaine Sedenberg and John Chuang. 2017. Smile for the camera: privacy and policy implications of emotion AI. arXiv preprint arXiv:1709.00396 (2017)."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.3390\/s18072074"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2017.7952681"},{"key":"e_1_3_2_2_33_1","volume-title":"A multimodal database for affect recognition and implicit tagging","author":"Soleymani Mohammad","year":"2011","unstructured":"Mohammad Soleymani , Jeroen Lichtenauer , Thierry Pun , and Maja Pantic . 2011. A multimodal database for affect recognition and implicit tagging . IEEE transactions on affective computing 3, 1 ( 2011 ), 42--55. Mohammad Soleymani, Jeroen Lichtenauer, Thierry Pun, and Maja Pantic. 2011. A multimodal database for affect recognition and implicit tagging. IEEE transactions on affective computing 3, 1 (2011), 42--55."},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.hlpt.2020.11.006"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2016.2625250"},{"key":"e_1_3_2_2_36_1","article-title":"Visualizing data using t-SNE","volume":"9","author":"der Maaten Laurens Van","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton . 2008 . Visualizing data using t-SNE . Journal of machine learning research 9 , 11 (2008). Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9, 11 (2008).","journal-title":"Journal of machine learning research"},{"key":"e_1_3_2_2_37_1","volume-title":"Attention is all you need. arXiv preprint arXiv:1706.03762","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , Lukasz Kaiser , and Illia Polosukhin . 2017. Attention is all you need. arXiv preprint arXiv:1706.03762 ( 2017 ). Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. arXiv preprint arXiv:1706.03762 (2017)."},{"key":"e_1_3_2_2_38_1","volume-title":"Arrhythmia Classification with Heartbeat-Aware Transformer. In ICASSP 2021--2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1025--1029","author":"Wang Bin","year":"2021","unstructured":"Bin Wang , Chang Liu , Chuanyan Hu , Xudong Liu , and Jun Cao . 2021 . Arrhythmia Classification with Heartbeat-Aware Transformer. In ICASSP 2021--2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1025--1029 . Bin Wang, Chang Liu, Chuanyan Hu, Xudong Liu, and Jun Cao. 2021. Arrhythmia Classification with Heartbeat-Aware Transformer. In ICASSP 2021--2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1025--1029."},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2018.8489715"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3384394","article-title":"EmotionSense: An Adaptive Emotion Recognition System Based on Wearable Smart Devices","volume":"1","author":"Wang Zhu","year":"2020","unstructured":"Zhu Wang , Zhiwen Yu , Bobo Zhao , Bin Guo , Chao Chen , and Zhiyong Yu . 2020 . EmotionSense: An Adaptive Emotion Recognition System Based on Wearable Smart Devices . ACM Transactions on Computing for Healthcare 1 , 4 (2020), 1 -- 17 . Zhu Wang, Zhiwen Yu, Bobo Zhao, Bin Guo, Chao Chen, and Zhiyong Yu. 2020. EmotionSense: An Adaptive Emotion Recognition System Based on Wearable Smart Devices. ACM Transactions on Computing for Healthcare 1, 4 (2020), 1--17.","journal-title":"ACM Transactions on Computing for Healthcare"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/IMBIOC.2019.8777843"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2021.3100868"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-020-01881-x"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"crossref","unstructured":"Bobo Zhao Zhu Wang Zhiwen Yu and Bin Guo. 2018. EmotionSense: Emotion recognition based on wearable wristband. In 2018 IEEE SmartWorld Ubiquitous Intelligence & Computing Advanced & Trusted Computing Scalable Computing & Communications Cloud & Big Data Computing Internet of People and Smart City Innovation (SmartWorld\/SCALCOM\/UIC\/ATC\/CBDCom\/IOP\/SCI). IEEE 346--355.  Bobo Zhao Zhu Wang Zhiwen Yu and Bin Guo. 2018. EmotionSense: Emotion recognition based on wearable wristband. In 2018 IEEE SmartWorld Ubiquitous Intelligence & Computing Advanced & Trusted Computing Scalable Computing & Communications Cloud & Big Data Computing Internet of People and Smart City Innovation (SmartWorld\/SCALCOM\/UIC\/ATC\/CBDCom\/IOP\/SCI). IEEE 346--355.","DOI":"10.1109\/SmartWorld.2018.00091"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"crossref","unstructured":"Sicheng Zhao Guiguang Ding Jungong Han and Yue Gao. 2018. Personality-Aware Personalized Emotion Recognition from Physiological Signals.. In IJCAI. 1660--1667.  Sicheng Zhao Guiguang Ding Jungong Han and Yue Gao. 2018. Personality-Aware Personalized Emotion Recognition from Physiological Signals.. In IJCAI. 1660--1667.","DOI":"10.24963\/ijcai.2018\/230"},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3332374"},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC46164.2021.9630252"}],"event":{"name":"ICMR '22: International Conference on Multimedia Retrieval","location":"Newark NJ USA","acronym":"ICMR '22","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["Proceedings of the 2022 International Conference on Multimedia Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3512527.3531385","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3512527.3531385","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:12Z","timestamp":1750188612000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3512527.3531385"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,27]]},"references-count":47,"alternative-id":["10.1145\/3512527.3531385","10.1145\/3512527"],"URL":"https:\/\/doi.org\/10.1145\/3512527.3531385","relation":{},"subject":[],"published":{"date-parts":[[2022,6,27]]},"assertion":[{"value":"2022-06-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}