{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,3]],"date-time":"2025-10-03T08:52:27Z","timestamp":1759481547112,"version":"3.41.0"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2012,3,1]],"date-time":"2012-03-01T00:00:00Z","timestamp":1330560000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004963","name":"Seventh Framework Programme","doi-asserted-by":"publisher","award":["216444"],"award-info":[{"award-number":["216444"]}],"id":[{"id":"10.13039\/501100004963","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2012,3]]},"abstract":"<jats:p>Assessing emotional states of users evoked during their multimedia consumption has received a great deal of attention with recent advances in multimedia content distribution technologies and increasing interest in personalized content delivery. Physiological signals such as the electroencephalogram (EEG) and peripheral physiological signals have been less considered for emotion recognition in comparison to other modalities such as facial expression and speech, although they have a potential interest as alternative or supplementary channels. This article presents our work on: (1) constructing a dataset containing EEG and peripheral physiological signals acquired during presentation of music video clips, which is made publicly available, and (2) conducting binary classification of induced positive\/negative valence, high\/low arousal, and like\/dislike by using the aforementioned signals. The procedure for the dataset acquisition, including stimuli selection, signal acquisition, self-assessment, and signal processing is described in detail. Especially, we propose a novel asymmetry index based on relative wavelet entropy for measuring the asymmetry in the energy distribution of EEG signals, which is used for EEG feature extraction. Then, the classification systems based on EEG and peripheral physiological signals are presented. Single-trial and single-run classification results indicate that, on average, the performance of the EEG-based classification outperforms that of the peripheral physiological signals. However, the peripheral physiological signals can be considered as a good alternative to EEG signals in the case of assessing a user's preference for a given music video clip (like\/dislike) since they have a comparable performance to EEG signals while being more easily measured.<\/jats:p>","DOI":"10.1145\/2133366.2133373","type":"journal-article","created":{"date-parts":[[2012,6,1]],"date-time":"2012-06-01T15:51:28Z","timestamp":1338565888000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":36,"title":["Affect recognition based on physiological changes during the watching of music videos"],"prefix":"10.1145","volume":"2","author":[{"given":"Ashkan","family":"Yazdani","sequence":"first","affiliation":[{"name":"Ecole Polytechnique F\u00e9d\u00e9rale de Lausanne, Switzerland"}]},{"given":"Jong-Seok","family":"Lee","sequence":"additional","affiliation":[{"name":"Yonsei University, Korea"}]},{"given":"Jean-Marc","family":"Vesin","sequence":"additional","affiliation":[{"name":"Ecole Polytechnique F\u00e9d\u00e9rale de Lausanne, Switzerland"}]},{"given":"Touradj","family":"Ebrahimi","sequence":"additional","affiliation":[{"name":"Ecole Polytechnique F\u00e9d\u00e9rale de Lausanne, Switzerland"}]}],"member":"320","published-online":{"date-parts":[[2012,3,20]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"859","article-title":"Analysis of evoked EEG synchronization and desynchronization in conditions of emotional activation in humans: Temporal and topographic characteristics. Neurosci","volume":"34","author":"Aftanas L.","year":"2004","journal-title":"Behav. Physiol."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.57.932"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2009.03.005"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/11848035_70"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.biopsycho.2004.03.002"},{"volume-title":"Emotion-Oriented Systems: The Humaine Handbook","author":"Cowie R.","key":"e_1_2_1_6_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-15184-2"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/79.911197"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.53.4.712"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.6612338"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.03.006"},{"volume-title":"Proceedings of the International Conference Acoustics, Speech and Signal Processing. 532--535","author":"Gillick L.","key":"e_1_2_1_11_1"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1543834.1543860"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2004.840618"},{"volume":"5","volume-title":"Proceedings of the IEEE International Conference Systems, Man and Cybernetics.","author":"Ishino K.","key":"e_1_2_1_15_1"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2006.10.019"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.26"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02344719"},{"volume-title":"Proceedings of the International Conference Brain Informatics. Springer, 89--100","author":"Koelstra S.","key":"e_1_2_1_19_1"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001756-199705260-00050"},{"key":"e_1_2_1_21_1","first-page":"340","article-title":"Frequency characteristics of EEG spectra in the emotions. Neurosci","volume":"26","author":"Kostyunina M.","year":"1996","journal-title":"Behav. Physiol."},{"key":"e_1_2_1_22_1","first-page":"9","article-title":"Relative electroencephalographic desynchronization and synchronization in humans to emotional film content: An analysis of the 4-6, 6-8, 8-10 and 10-12 Hz frequency bands. Neurosci","volume":"286","author":"Krause C.","year":"2000","journal-title":"Lett."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.50.5.372"},{"key":"e_1_2_1_24_1","unstructured":"Lang P. Bradley M. and Cuthbert B. 2008. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Tech. rep. A-8 University of Florida Gainesville FL.  Lang P. Bradley M. and Cuthbert B. 2008. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Tech. rep. A-8 University of Florida Gainesville FL."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-8986.1993.tb03352.x"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2010.2048568"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1155\/S1110865704406192"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00999346"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02295996"},{"key":"e_1_2_1_30_1","first-page":"63","article-title":"SAM: the self-assessment manikin. An efficient cross-cultural measurement of emotional response","volume":"35","author":"Morris J. D.","year":"1995","journal-title":"J. Advertis. Res."},{"volume-title":"Proceedings of the Computer Vision and Pattern Recognition Workshop. 49--49","author":"Mota S.","key":"e_1_2_1_31_1"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITB.2009.2034649"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.954607"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1511\/2001.4.344"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-0270(00)00356-3"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0077714"},{"volume-title":"Proceedings of the eNTERFACE 2006 Workshop.","author":"Savran A.","key":"e_1_2_1_37_1"},{"volume-title":"Proceedings of the International Conference Affective Computing and Intelligent Interaction and Workshops. 1--6.","author":"Schaaff K.","key":"e_1_2_1_38_1"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2006.489"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/584091.584093"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.1997.tb00413.x"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/79.799930"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2006.04.003"},{"volume-title":"Proceedings of the International Conference Pattern Recognition. 1--4.","author":"Wang J.","key":"e_1_2_1_44_1"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.2307\/3001968"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1631144.1631160"},{"volume-title":"Proceedings of the IEEE Annual International Conference on Engineering in Medicine and Biology Society (EMBC), IEEE, 1646--1649","author":"Yazdani A.","key":"e_1_2_1_47_1"},{"volume-title":"Proceedings of the 17th IEEE International Conference on Image Processing (ICIP). IEEE, 3169--3172","author":"Yazdani A.","key":"e_1_2_1_48_1"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2006.870737"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-0270(02)00095-X"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.52"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2133366.2133373","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2133366.2133373","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T10:06:05Z","timestamp":1750241165000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2133366.2133373"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,3]]},"references-count":50,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,3]]}},"alternative-id":["10.1145\/2133366.2133373"],"URL":"https:\/\/doi.org\/10.1145\/2133366.2133373","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"type":"print","value":"2160-6455"},{"type":"electronic","value":"2160-6463"}],"subject":[],"published":{"date-parts":[[2012,3]]},"assertion":[{"value":"2010-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-03-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}