{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,26]],"date-time":"2025-03-26T17:14:05Z","timestamp":1743009245961,"version":"3.40.3"},"publisher-location":"Cham","reference-count":35,"publisher":"Springer Nature Switzerland","isbn-type":[{"type":"print","value":"9783031264375"},{"type":"electronic","value":"9783031264382"}],"license":[{"start":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T00:00:00Z","timestamp":1672531200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,2,23]],"date-time":"2023-02-23T00:00:00Z","timestamp":1677110400000},"content-version":"vor","delay-in-days":53,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Psychophysiology investigates the causal relationship of physiological changes resulting from psychological states. There are significant challenges with machine learning-based momentary assessments of physiology due to varying data collection methods, physiological differences, data availability and the requirement for expertly annotated data. Advances in wearable technology have significantly increased the scale, sensitivity and accuracy of devices for recording physiological signals, enabling large-scale unobtrusive physiological data gathering. This work contributes an empirical evaluation of signal variances acquired from wearables and their associated impact on the classification of affective states by (i) assessing differences occurring in features representative of affective states extracted from electrocardiograms and photoplethysmography, (ii) investigating the disparity in feature importance between signals to determine signal-specific features, and (iii) investigating the disparity in feature importance between affective states to determine affect-specific features. Results demonstrate that the degree of feature variance between ECG and PPG in a dataset is reflected in the classification performance of that dataset. Additionally, beats-per-minute, inter-beat-interval and breathing rate are identified as common best-performing features across both signals. Finally feature variance per-affective state identifies hard-to-distinguish affective states requiring one-versus-rest or additional features to enable accurate classification.<\/jats:p>","DOI":"10.1007\/978-3-031-26438-2_1","type":"book-chapter","created":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T06:32:56Z","timestamp":1677047576000},"page":"3-17","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Inter and\u00a0Intra Signal Variance in\u00a0Feature Extraction and\u00a0Classification of\u00a0Affective State"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0203-0396","authenticated-orcid":false,"given":"Zachary","family":"Dair","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0804-8362","authenticated-orcid":false,"given":"Samantha","family":"Dockray","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7990-3461","authenticated-orcid":false,"given":"Ruairi","family":"O\u2019Reilly","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,2,23]]},"reference":[{"issue":"1","key":"1_CR1","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1109\/T-AFFC.2011.28","volume":"3","author":"F Agrafioti","year":"2012","unstructured":"Agrafioti, F., et al.: ECG pattern analysis for emotion detection. IEEE Trans. Affect. Comput. 3(1), 102\u2013115 (2012). https:\/\/doi.org\/10.1109\/T-AFFC.2011.28","journal-title":"IEEE Trans. Affect. Comput."},{"key":"1_CR2","doi-asserted-by":"publisher","DOI":"10.3791\/3238","author":"MA Birkett","year":"2011","unstructured":"Birkett, M.A.: The trier social stress test protocol for inducing psychological stress. J. Vis. Exp. (2011). https:\/\/doi.org\/10.3791\/3238","journal-title":"J. Vis. Exp."},{"issue":"8","key":"1_CR3","doi-asserted-by":"publisher","first-page":"1849","DOI":"10.3390\/s19081849","volume":"19","author":"YS Can","year":"2019","unstructured":"Can, Y.S., Chalabianloo, N., Ekiz, D., Ersoy, C.: Continuous stress detection using wearable sensors in real life: algorithmic programming contest case study. Sensors 19(8), 1849 (2019). https:\/\/doi.org\/10.3390\/s19081849","journal-title":"Sensors"},{"key":"1_CR4","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1016\/j.bspc.2018.12.028","volume":"49","author":"A Cheema","year":"2019","unstructured":"Cheema, A., Singh, M.: Psychological stress detection using phonocardiography signal: an empirical mode decomposition approach. Biomed. Signal Process. Control 49, 493\u2013505 (2019). https:\/\/doi.org\/10.1016\/j.bspc.2018.12.028","journal-title":"Biomed. Signal Process. Control"},{"key":"1_CR5","doi-asserted-by":"publisher","unstructured":"Cinaz, B., Arnrich, B., La Marca, R., Tr\u00f6ster, G.: Monitoring of mental workload levels during an everyday life office-work scenario. Pers. Ubiquit. Comput. 17 (2013). https:\/\/doi.org\/10.1007\/s00779-011-0466-1","DOI":"10.1007\/s00779-011-0466-1"},{"key":"1_CR6","doi-asserted-by":"publisher","unstructured":"Dissanayake, T., Rajapaksha, Y., Ragel, R., Nawinne, I.: An ensemble learning approach for electrocardiogram sensor based human emotion recognition. Sensors 19(20) (2019). https:\/\/doi.org\/10.3390\/s19204495","DOI":"10.3390\/s19204495"},{"issue":"3","key":"1_CR7","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1111\/jora.12473","volume":"29","author":"S Dockray","year":"2019","unstructured":"Dockray, S., O\u2019Neill, S., Jump, O.: Measuring the psychobiological correlates of daily experience in adolescents. J. Res. Adolesc. 29(3), 595\u2013612 (2019). https:\/\/doi.org\/10.1111\/jora.12473","journal-title":"J. Res. Adolesc."},{"key":"1_CR8","doi-asserted-by":"publisher","unstructured":"Dzedzickis, A., Kaklauskas, A., Bucinskas, V.: Human emotion recognition: review of sensors and methods. Sensors 20(3) (2020). https:\/\/doi.org\/10.3390\/s20030592","DOI":"10.3390\/s20030592"},{"key":"1_CR9","doi-asserted-by":"publisher","unstructured":"Filippini, C., et al.: Automated affective computing based on bio-signals analysis and deep learning approach. Sensors 22(5) (2022). https:\/\/doi.org\/10.3390\/s22051789","DOI":"10.3390\/s22051789"},{"key":"1_CR10","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1016\/j.chaos.2018.07.035","volume":"114","author":"A Goshvarpour","year":"2018","unstructured":"Goshvarpour, A., Goshvarpour, A.: Poincar\u00e9\u2019s section analysis for PPG-based automatic emotion recognition. Chaos Solitons Fractals 114, 400\u2013407 (2018). https:\/\/doi.org\/10.1016\/j.chaos.2018.07.035","journal-title":"Chaos Solitons Fractals"},{"issue":"3","key":"1_CR11","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1007\/s40846-020-00526-7","volume":"40","author":"A Goshvarpour","year":"2020","unstructured":"Goshvarpour, A., Goshvarpour, A.: Evaluation of novel entropy-based complex wavelet sub-bands measures of PPG in an emotion recognition system. J. Med. Biol. Eng. 40(3), 451\u2013461 (2020). https:\/\/doi.org\/10.1007\/s40846-020-00526-7","journal-title":"J. Med. Biol. Eng."},{"issue":"1","key":"1_CR12","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1109\/TAFFC.2017.2781732","volume":"11","author":"YL Hsu","year":"2020","unstructured":"Hsu, Y.L., Wang, J.S., Chiang, W.C., Hung, C.H.: Automatic ECG-based emotion recognition in music listening. IEEE Trans. Affect. Comput. 11(1), 85\u201399 (2020). https:\/\/doi.org\/10.1109\/TAFFC.2017.2781732","journal-title":"IEEE Trans. Affect. Comput."},{"key":"1_CR13","doi-asserted-by":"publisher","unstructured":"Jing, C., Liu, G., Hao, M.: The research on emotion recognition from ECG signal. In: 2009 International Conference on Information Technology and Computer Science, vol. 1, pp. 497\u2013500 (2009). https:\/\/doi.org\/10.1109\/ITCS.2009.108","DOI":"10.1109\/ITCS.2009.108"},{"key":"1_CR14","doi-asserted-by":"publisher","unstructured":"Kalra, P., Sharma, V.: Mental stress assessment using PPG signal a deep neural network approach. IETE J. Res. 1\u20137 (2020). https:\/\/doi.org\/10.1080\/03772063.2020.1844068","DOI":"10.1080\/03772063.2020.1844068"},{"key":"1_CR15","doi-asserted-by":"publisher","unstructured":"Katsigiannis, S., Ramzan, N.: Dreamer: a database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices. IEEE J. Biomed. Health inform. (2018). https:\/\/doi.org\/10.1109\/JBHI.2017.2688239","DOI":"10.1109\/JBHI.2017.2688239"},{"issue":"12","key":"1_CR16","doi-asserted-by":"publisher","first-page":"2067","DOI":"10.1109\/TPAMI.2008.26","volume":"30","author":"J Kim","year":"2008","unstructured":"Kim, J., Andr\u00e9, E.: Emotion recognition based on physiological changes in music listening. IEEE PAMI 30(12), 2067\u20132083 (2008). https:\/\/doi.org\/10.1109\/TPAMI.2008.26","journal-title":"IEEE PAMI"},{"issue":"1","key":"1_CR17","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/T-AFFC.2011.15","volume":"3","author":"S Koelstra","year":"2012","unstructured":"Koelstra, S., et al.: Deap: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18\u201331 (2012). https:\/\/doi.org\/10.1109\/T-AFFC.2011.15","journal-title":"IEEE Trans. Affect. Comput."},{"key":"1_CR18","doi-asserted-by":"publisher","unstructured":"Koldijk, S., Sappelli, M., Verberne, S., Neerincx, M.A., Kraaij, W.: The SWELL knowledge work dataset for stress and user modeling research. In: ICMI, pp. 291\u2013298. ACM (2014). https:\/\/doi.org\/10.1145\/2663204.2663257","DOI":"10.1145\/2663204.2663257"},{"key":"1_CR19","doi-asserted-by":"publisher","unstructured":"Lee, M.S., Lee, Y.K., Pae, D.S., Lim, M.T., Kim, D.W., Kang, T.K.: Fast emotion recognition based on single pulse PPG signal with convolutional neural network. Appl. Sci. 9(16) (2019). https:\/\/doi.org\/10.3390\/app9163355","DOI":"10.3390\/app9163355"},{"issue":"7","key":"1_CR20","doi-asserted-by":"publisher","first-page":"2074","DOI":"10.3390\/s18072074","volume":"18","author":"S Lin","year":"2018","unstructured":"Lin, S., et al.: A review of emotion recognition using physiological signals. Sensors 18(7), 2074 (2018). https:\/\/doi.org\/10.3390\/s18072074","journal-title":"Sensors"},{"key":"1_CR21","series-title":"Lecture Notes in Computer Science (Lecture Notes in Artificial Intelligence)","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1007\/978-3-030-77211-6_8","volume-title":"Artificial Intelligence in Medicine","author":"A Lisowska","year":"2021","unstructured":"Lisowska, A., Wilk, S., Peleg, M.: Catching patient\u2019s attention at the right time to help them undergo behavioural change: stress classification experiment from blood volume pulse. In: Tucker, A., Henriques Abreu, P., Cardoso, J., Pereira Rodrigues, P., Ria\u00f1o, D. (eds.) AIME 2021. LNCS (LNAI), vol. 12721, pp. 72\u201382. Springer, Cham (2021). https:\/\/doi.org\/10.1007\/978-3-030-77211-6_8"},{"key":"1_CR22","doi-asserted-by":"publisher","unstructured":"Mahdiani, S., et al.: Is 50 Hz high enough ECG sampling frequency for accurate HRV analysis? In: EMBC, pp. 5948\u20135951 (2015). https:\/\/doi.org\/10.1109\/EMBC.2015.7319746","DOI":"10.1109\/EMBC.2015.7319746"},{"key":"1_CR23","unstructured":"Molnar, C.: Interpretable Machine Learning. Lulu.com (2022). https:\/\/christophm.github.io\/interpretable-ml-book\/"},{"issue":"4","key":"1_CR24","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6501\/ac3aae","volume":"33","author":"N Mukherjee","year":"2022","unstructured":"Mukherjee, N., et al.: Real-time mental stress detection technique using neural networks towards a wearable health monitor. Meas. Sci. Technol. 33(4), 044003 (2022). https:\/\/doi.org\/10.1088\/1361-6501\/ac3aae","journal-title":"Meas. Sci. Technol."},{"key":"1_CR25","doi-asserted-by":"publisher","DOI":"10.1016\/j.cvdhj.2020.07.002","author":"S Nabeel","year":"2020","unstructured":"Nabeel, S., et al.: A comparison of manual electrocardiographic interval and waveform analysis in lead 1 of 12-lead ECG and apple watch ECG: a validation study. Cardiovasc. Digit. Health J. (2020). https:\/\/doi.org\/10.1016\/j.cvdhj.2020.07.002","journal-title":"Cardiovasc. Digit. Health J."},{"issue":"4","key":"1_CR26","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1109\/TAFFC.2015.2432810","volume":"6","author":"M Nardelli","year":"2015","unstructured":"Nardelli, M., Valenza, G., Greco, A., Lanata, A., Scilingo, P.: Recognizing emotions induced by affective sounds through heart rate variability. IEEE Trans. Affect. Comput. 6(4), 385\u2013394 (2015). https:\/\/doi.org\/10.1109\/TAFFC.2015.2432810","journal-title":"IEEE Trans. Affect. Comput."},{"issue":"1","key":"1_CR27","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1016\/S1071-5819(03)00052-1","volume":"59","author":"RW Picard","year":"2003","unstructured":"Picard, R.W.: Affective computing: challenges. Int. J. Hum Comput Stud. 59(1), 55\u201364 (2003). https:\/\/doi.org\/10.1016\/S1071-5819(03)00052-1","journal-title":"Int. J. Hum Comput Stud."},{"issue":"Suppl. 2","key":"1_CR28","doi-asserted-by":"publisher","first-page":"S86","DOI":"10.3949\/ccjm.76.s2.17","volume":"76","author":"SW Porges","year":"2009","unstructured":"Porges, S.W.: The polyvagal theory: new insights into adaptive reactions of the autonomic nervous system. Clevel. Clin. J. Med. 76(Suppl. 2), S86\u2013S90 (2009). https:\/\/doi.org\/10.3949\/ccjm.76.s2.17","journal-title":"Clevel. Clin. J. Med."},{"key":"1_CR29","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1016\/j.cmpb.2015.12.008","volume":"127","author":"S da Jos\u00e9","year":"2016","unstructured":"da Jos\u00e9, S., Luz, E., et al.: ECG-based heartbeat classification for arrhythmia detection: a survey. CMPB 127, 144\u2013164 (2016). https:\/\/doi.org\/10.1016\/j.cmpb.2015.12.008","journal-title":"CMPB"},{"issue":"2\u20133","key":"1_CR30","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1111\/j.1540-5834.1994.tb01283.x","volume":"59","author":"SW Porges","year":"1994","unstructured":"Porges, S.W., et al.: Vagal tone and the physiological regulation of emotion. Monogr. Soc. Res. Child Dev. 59(2\u20133), 167\u2013186 (1994)","journal-title":"Monogr. Soc. Res. Child Dev."},{"key":"1_CR31","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2020.3014842","author":"P Sarkar","year":"2021","unstructured":"Sarkar, P., Etemad, A.: Self-supervised ECG representation learning for emotion recognition. IEEE Trans. Affect. Comput. (2021). https:\/\/doi.org\/10.1109\/TAFFC.2020.3014842","journal-title":"IEEE Trans. Affect. Comput."},{"key":"1_CR32","doi-asserted-by":"publisher","unstructured":"Sayed Ismail, S.N.M., Ab. Aziz, N.A., Ibrahim, S.Z.: A comparison of emotion recognition system using electrocardiogram (ECG) and photoplethysmogram (PPG). J. King Saud Univ. - Comput. Inf. Sci. 34(6, Part B), 3539\u20133558 (2022). https:\/\/doi.org\/10.1016\/j.jksuci.2022.04.012","DOI":"10.1016\/j.jksuci.2022.04.012"},{"key":"1_CR33","doi-asserted-by":"publisher","unstructured":"Schmidt, P., et al.: Introducing wesad, a multimodal dataset for wearable stress and affect detection. In: ICMI 20. ACM (2018). https:\/\/doi.org\/10.1145\/3242969.3242985","DOI":"10.1145\/3242969.3242985"},{"key":"1_CR34","doi-asserted-by":"publisher","unstructured":"Sharma, K., et al.: A dataset of continuous affect annotations and physiological signals for emotion analysis (2018). https:\/\/doi.org\/10.48550\/ARXIV.1812.02782","DOI":"10.48550\/ARXIV.1812.02782"},{"key":"1_CR35","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1016\/j.trf.2019.09.015","volume":"66","author":"P van Gent","year":"2019","unstructured":"van Gent, P., et al.: HeartPy: a novel heart rate algorithm for the analysis of noisy signals. Transp. Res. F: Traffic Psychol. Behav. 66, 368\u2013378 (2019). https:\/\/doi.org\/10.1016\/j.trf.2019.09.015","journal-title":"Transp. Res. F: Traffic Psychol. Behav."}],"container-title":["Communications in Computer and Information Science","Artificial Intelligence and Cognitive Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-26438-2_1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T06:33:31Z","timestamp":1677047611000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-26438-2_1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"ISBN":["9783031264375","9783031264382"],"references-count":35,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-26438-2_1","relation":{},"ISSN":["1865-0929","1865-0937"],"issn-type":[{"type":"print","value":"1865-0929"},{"type":"electronic","value":"1865-0937"}],"subject":[],"published":{"date-parts":[[2023]]},"assertion":[{"value":"23 February 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"AICS","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Irish Conference on Artificial Intelligence and Cognitive Science","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Munster","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Ireland","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2022","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"8 December 2022","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"9 December 2022","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"30","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"aics2022","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/aics2022.mtu.ie\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Single-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"102","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"41","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"0","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"40% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"No","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}