{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T17:47:00Z","timestamp":1782409620836,"version":"3.54.5"},"reference-count":93,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T00:00:00Z","timestamp":1732147200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2024,11,21]]},"abstract":"<jats:p>Understanding human affective states such as emotion and stress is crucial for both practical applications and theoretical research, driving advancements in the field of affective computing. While traditional approaches often rely on generalized models trained on aggregated data, recent studies highlight the importance of personalized models that account for individual differences in affective responses. However, there remains a significant gap in research regarding the comparative evaluation of various personalization techniques across multiple datasets. In this study, we address this gap by systematically evaluating widely-used deep learning-based personalization techniques for affect recognition across five open datasets (i.e., AMIGOS, ASCERTAIN, WESAD, CASE, and K-EmoCon). Our analysis focuses on realistic scenarios where models must adapt to new, unseen users with limited available data, reflecting real-world conditions. We emphasize the principles of reproducibility by utilizing open datasets and making our evaluation models and codebase publicly available. Our findings provide critical insights into the generalizability of personalization techniques, the data requirements for effective personalization, and the relative performance of different approaches. This work offers valuable contributions to the development of personalized affect recognition systems, fostering advancements in both methodology and practical application.<\/jats:p>","DOI":"10.1145\/3699724","type":"journal-article","created":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T12:23:32Z","timestamp":1732191812000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Systematic Evaluation of Personalized Deep Learning Models for Affect Recognition"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8981-1293","authenticated-orcid":false,"given":"Yunjo","family":"Han","sequence":"first","affiliation":[{"name":"KAIST, Daejeon, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7014-6940","authenticated-orcid":false,"given":"Panyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"KAIST, Daejeon, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-8612-1219","authenticated-orcid":false,"given":"Minseo","family":"Park","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University, Suwon, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1888-1569","authenticated-orcid":false,"given":"Uichin","family":"Lee","sequence":"additional","affiliation":[{"name":"KAIST, Daejeon, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,11,21]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2015.2392932"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0266516"},{"key":"e_1_2_1_3_1","volume-title":"Reproducibility of Machine Learning: Terminology, Recommendations and Open Issues. arXiv preprint arXiv:2302.12691","author":"Albertoni Riccardo","year":"2023","unstructured":"Riccardo Albertoni, Sara Colantonio, Piotr Skrzypczy\u0144ski, and Jerzy Stefanowski. 2023. Reproducibility of Machine Learning: Terminology, Recommendations and Open Issues. arXiv preprint arXiv:2302.12691 (2023)."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3678569"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1521\/jscp.2008.27.10.1045"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neulet.2017.07.045"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3460421.3480427"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2944001"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2975351"},{"key":"e_1_2_1_10_1","volume-title":"Multitask learning. Machine learning 28","author":"Caruana Rich","year":"1997","unstructured":"Rich Caruana. 1997. Multitask learning. Machine learning 28 (1997), 41--75."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3380985"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2021.106207"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185517"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20226535"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcs.2019.04.009"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2973425"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Rebecca A Ferrer and Wendy Berry Mendes. 2018. Emotion health decision making and health behaviour. 16 pages.","DOI":"10.1080\/08870446.2017.1385787"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3254134"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3085502"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3356250.3360020"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11503"},{"key":"e_1_2_1_22_1","volume-title":"Individual differences in emotion processing. Current opinion in neurobiology 14, 2","author":"Hamann Stephan","year":"2004","unstructured":"Stephan Hamann and Turhan Canli. 2004. Individual differences in emotion processing. Current opinion in neurobiology 14, 2 (2004), 233--238."},{"key":"e_1_2_1_23_1","unstructured":"Jennifer Healey and Rosalind Picard. 2002. Driver Stress Data. https:\/\/www.media.mit.edu\/groups\/affective-computing\/data\/"},{"key":"e_1_2_1_24_1","volume-title":"International journal of data mining & knowledge management process 5, 2","author":"Hossin Mohammad","year":"2015","unstructured":"Mohammad Hossin and Md Nasir Sulaiman. 2015. A review on evaluation metrics for data classification evaluations. International journal of data mining & knowledge management process 5, 2 (2015), 1."},{"key":"e_1_2_1_25_1","volume-title":"Deep learning for time series classification: a review. Data mining and knowledge discovery 33, 4","author":"Fawaz Hassan Ismail","year":"2019","unstructured":"Hassan Ismail Fawaz, Germain Forestier, Jonathan Weber, Lhassane Idoumghar, and Pierre-Alain Muller. 2019. Deep learning for time series classification: a review. Data mining and knowledge discovery 33, 4 (2019), 917--963."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642766"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2014.02.057"},{"key":"e_1_2_1_28_1","volume-title":"Narae Cha, Auk Kim, Ahsan Habib Khandoker, Leontios Hadjileontiadis, Heepyung Kim, Yong Jeong, and Uichin Lee.","author":"Kang Soowon","year":"2023","unstructured":"Soowon Kang, Woohyeok Choi, Cheul Young Park, Narae Cha, Auk Kim, Ahsan Habib Khandoker, Leontios Hadjileontiadis, Heepyung Kim, Yong Jeong, and Uichin Lee. 2023. K-emophone: A mobile and wearable dataset with in-situ emotion, stress, and attention labels. Scientific data 10, 1 (2023), 351."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2022.964582"},{"key":"e_1_2_1_30_1","volume-title":"DREAMER: A database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices","author":"Katsigiannis Stamos","year":"2017","unstructured":"Stamos Katsigiannis and Naeem Ramzan. 2017. DREAMER: A database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices. IEEE journal of biomedical and health informatics 22, 1 (2017), 98--107."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.26"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351249"},{"key":"e_1_2_1_33_1","volume-title":"Deap: A database for emotion analysis","author":"Koelstra Sander","year":"2011","unstructured":"Sander Koelstra, Christian Muhl, Mohammad Soleymani, Jong-Seok Lee, Ashkan Yazdani, Touradj Ebrahimi, Thierry Pun, Anton Nijholt, and Ioannis Patras. 2011. Deap: A database for emotion analysis; using physiological signals. IEEE transactions on affective computing 3, 1 (2011), 18--31."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2663204.2663257"},{"key":"e_1_2_1_35_1","volume-title":"An introduction to domain adaptation and transfer learning. arXiv preprint arXiv:1812.11806","author":"Kouw Wouter M","year":"2018","unstructured":"Wouter M Kouw and Marco Loog. 2018. An introduction to domain adaptation and transfer learning. arXiv preprint arXiv:1812.11806 (2018)."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.biopsycho.2010.03.010"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642832"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.adhoc.2018.08.021"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397318"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11596"},{"key":"e_1_2_1_41_1","volume-title":"A survey on personalized affective computing in human-machine interaction. arXiv preprint arXiv:2304.00377","author":"Li Jialin","year":"2023","unstructured":"Jialin Li, Alia Waleed, and Hanan Salam. 2023. A survey on personalized affective computing in human-machine interaction. arXiv preprint arXiv:2304.00377 (2023)."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450439.3451870"},{"key":"e_1_2_1_43_1","volume-title":"Murugappan Murugappan, Yashas Chakole, and U Rajendra Acharya.","author":"Maithri M","year":"2022","unstructured":"M Maithri, U Raghavendra, Anjan Gudigar, Jyothi Samanth, Prabal Datta Barua, Murugappan Murugappan, Yashas Chakole, and U Rajendra Acharya. 2022. Automated emotion recognition: Current trends and future perspectives. Computer methods and programs in biomedicine 215 (2022), 106646."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3299041"},{"key":"e_1_2_1_45_1","volume-title":"Reproducibility in machine learning for health research: Still a ways to go. Science Translational Medicine 13, 586","author":"McDermott Matthew BA","year":"2021","unstructured":"Matthew BA McDermott, Shirly Wang, Nikki Marinsek, Rajesh Ranganath, Luca Foschini, and Marzyeh Ghassemi. 2021. Reproducibility in machine learning for health research: Still a ways to go. Science Translational Medicine 13, 586 (2021), eabb1655."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3569483"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3659591"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448120"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.13441"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2018.2884461"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3267537"},{"key":"e_1_2_1_52_1","volume-title":"Continuous detection of physiological stress with commodity hardware. ACM transactions on computing for healthcare 1, 2","author":"Mishra Varun","year":"2020","unstructured":"Varun Mishra, Gunnar Pope, Sarah Lord, Stephanie Lewia, Byron Lowens, Kelly Caine, Sougata Sen, Ryan Halter, and David Kotz. 2020. Continuous detection of physiological stress with commodity hardware. ACM transactions on computing for healthcare 1, 2 (2020), 1--30."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432220"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6501\/ac3aae"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3027026"},{"key":"e_1_2_1_56_1","volume-title":"Evolutionary explanations of emotions. Human nature 1","author":"Nesse Randolph M","year":"1990","unstructured":"Randolph M Nesse. 1990. Evolutionary explanations of emotions. Human nature 1 (1990), 261--289."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642662"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-020-00630-y"},{"key":"e_1_2_1_59_1","volume-title":"Analyzing personality related adjectives from an eticemic perspective: the big five marker scales (BFMS) and the Italian AB5C taxonomy. Big Five Assessment","author":"Perugini Marco","year":"2002","unstructured":"Marco Perugini and Lisa Di Blas. 2002. Analyzing personality related adjectives from an eticemic perspective: the big five marker scales (BFMS) and the Italian AB5C taxonomy. Big Five Assessment (2002), 281--304."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/265013"},{"key":"e_1_2_1_61_1","volume-title":"Shkurta Gashi, Emanuela Piciucco, Silvia Santini, and Martin Gjoreski.","author":"Pogliaghi Alessandro","year":"2022","unstructured":"Alessandro Pogliaghi, Elena Di Lascio, Shkurta Gashi, Emanuela Piciucco, Silvia Santini, and Martin Gjoreski. 2022. Multi-task Learning for Stress Recognition. In Adjunct Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 ACM International Symposium on Wearable Computers. 202--206."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1002\/da.22822"},{"key":"e_1_2_1_63_1","volume-title":"Emotion recognition using smart watch sensor data: Mixed-design study. JMIR mental health 5, 3","author":"Quiroz Juan Carlos","year":"2018","unstructured":"Juan Carlos Quiroz, Elena Geangu, and Min Hooi Yong. 2018. Emotion recognition using smart watch sensor data: Mixed-design study. JMIR mental health 5, 3 (2018), e10153."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.37.3.345"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSAA.2018.00031"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.9410"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3242985"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-658-32182-6_14"},{"key":"e_1_2_1_69_1","volume-title":"A dataset of continuous affect annotations and physiological signals for emotion analysis. Scientific data 6, 1","author":"Sharma Karan","year":"2019","unstructured":"Karan Sharma, Claudio Castellini, Egon L van den Broek, Alin Albu-Schaeffer, and Friedhelm Schwenker. 2019. A dataset of continuous affect annotations and physiological signals for emotion analysis. Scientific data 6, 1 (2019), 196."},{"key":"e_1_2_1_70_1","volume-title":"International symposium on quality of life technology. 28--29","author":"Shi Yuan","year":"2010","unstructured":"Yuan Shi, Minh Hoai Nguyen, Patrick Blitz, Brian French, Scott Fisk, Fernando De la Torre, Asim Smailagic, Daniel P Siewiorek, Mustafa Al'Absi, Emre Ertin, et al. 2010. Personalized stress detection from physiological measurements. In International symposium on quality of life technology. 28--29."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.3390\/s18072074"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2016.2625250"},{"key":"e_1_2_1_73_1","volume-title":"A multimodal dataset for various forms of distracted driving. Scientific data 4, 1","author":"Taamneh Salah","year":"2017","unstructured":"Salah Taamneh, Panagiotis Tsiamyrtzis, Malcolm Dcosta, Pradeep Buddharaju, Ashik Khatri, Michael Manser, Thomas Ferris, Robert Wunderlich, and Ioannis Pavlidis. 2017. A multimodal dataset for various forms of distracted driving. Scientific data 4, 1 (2017), 1--21."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2017.2784832"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3580252.3586979"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC46164.2021.9630224"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2020.103935"},{"key":"e_1_2_1_78_1","volume-title":"Article 93 (dec","author":"van Berkel Niels","year":"2017","unstructured":"Niels van Berkel, Denzil Ferreira, and Vassilis Kostakos. 2017. The Experience Sampling Method on Mobile Devices. ACM Comput. Surv. 50, 6, Article 93 (dec 2017), 40 pages."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2023.105026"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971740"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2632054"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2022.03.009"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3569485"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512527.3531385"},{"key":"e_1_2_1_85_1","volume-title":"How transferable are features in deep neural networks? Advances in neural information processing systems 27","author":"Yosinski Jason","year":"2014","unstructured":"Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson. 2014. How transferable are features in deep neural networks? Advances in neural information processing systems 27 (2014)."},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1109\/BHI.2019.8834456"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC44109.2020.9176242"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOMW.2016.7457166"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/3678578"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2022.3165715"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21010052"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2023.3239305"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2022.3225330"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3699724","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3699724","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T16:24:54Z","timestamp":1758817494000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3699724"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,21]]},"references-count":93,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,11,21]]}},"alternative-id":["10.1145\/3699724"],"URL":"https:\/\/doi.org\/10.1145\/3699724","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,21]]},"assertion":[{"value":"2024-11-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}