{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T16:32:08Z","timestamp":1772814728402,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,1,24]],"date-time":"2020-01-24T00:00:00Z","timestamp":1579824000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The increasing interest in the effects of emotion on cognitive, social, and neural processes creates a constant need for efficient and reliable techniques for emotion elicitation. Emotions are important in many areas, especially in advertising design and video production. The impact of emotions on the audience plays an important role. This paper analyzes the physical elements in a two-dimensional emotion map by extracting the physical elements of a video (color, light intensity, sound, etc.). We used k-nearest neighbors (K-NN), support vector machine (SVM), and multilayer perceptron (MLP) classifiers in the machine learning method to accurately predict the four dimensions that express emotions, as well as summarize the relationship between the two-dimensional emotion space and physical elements when designing and producing video.<\/jats:p>","DOI":"10.3390\/s20030649","type":"journal-article","created":{"date-parts":[[2020,1,24]],"date-time":"2020-01-24T11:01:00Z","timestamp":1579863660000},"page":"649","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Recognition of Emotion According to the Physical Elements of the Video"],"prefix":"10.3390","volume":"20","author":[{"given":"Jing","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Emotion Engineering, University of Sangmyung, Seoul 03016, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xingyu","family":"Wen","sequence":"additional","affiliation":[{"name":"Department of Emotion Engineering, University of Sangmyung, Seoul 03016, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mincheol","family":"Whang","sequence":"additional","affiliation":[{"name":"Department of Human-Centered Artificial Intelligence, University of Sangmyung, Seoul 03016, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1016\/j.physbeh.2011.10.031","article-title":"Gender differences in emotional responses: A psychophysiological study","volume":"105","author":"Bianchin","year":"2012","journal-title":"Physiol. Behav."},{"key":"ref_2","first-page":"E2016","article-title":"A higher-order theory of emotional consciousness","volume":"114","author":"LeDoux","year":"2017","journal-title":"PNAC"},{"key":"ref_3","first-page":"w13786","article-title":"The impact of emotion on perception, attention, memory, and decision-making","volume":"143","author":"Brosch","year":"2013","journal-title":"Swiss Med. Weekly"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Smith, G.M. (2003). Film structure and the emotion system. Cambridge University Press.","DOI":"10.1017\/CBO9780511497759"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/93.959093","article-title":"Computational media aesthetics: Finding meaning beautiful","volume":"8","author":"Nack","year":"2001","journal-title":"IEEE Multimed."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1037\/1528-3542.3.3.270","article-title":"Consequences of specific processing of emotional information: Impact of general versus specific autobiographical memory priming on emotion elicitation","volume":"3","author":"Philippot","year":"2003","journal-title":"Emotion"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.neucom.2015.01.095","article-title":"Fusing audio, visual and textual clues for sentiment analysis from multimodal content","volume":"174","author":"Poria","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/MIS.2016.31","article-title":"Affective computing and sentiment analysis","volume":"31","author":"Cambria","year":"2016","journal-title":"IEEE Intell. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/MIS.2017.4531228","article-title":"Sentiment analysis is a big suitcase","volume":"32","author":"Cambria","year":"2017","journal-title":"IEEE Intell. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/MIS.2013.9","article-title":"Multimodal sentiment analysis of spanish online videos","volume":"28","author":"Rosas","year":"2013","journal-title":"IEEE Intell. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1080\/02699930903274322","article-title":"Assessing the effectiveness of a large database of emotion-eliciting films: A new tool for emotion researchers","volume":"24","author":"Schaefer","year":"2010","journal-title":"Cogn. Emot."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1111\/j.1460-2466.1992.tb00776.x","article-title":"The evening\u2019s bad news: Effects of compelling negative television news images on memory","volume":"42","author":"Newhagen","year":"1992","journal-title":"J. Commun."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.neucom.2018.02.052","article-title":"A novel feature set for video emotion recognition","volume":"291","author":"Mo","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_14","first-page":"175","article-title":"Emotions and adaptation: Conceptual and empirical relations","volume":"16","author":"Lazarus","year":"1968","journal-title":"Neb. Symp. Motiv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1037\/0022-3514.53.4.712","article-title":"Universals and cultural differences in the judgments of facial expressions of emotion","volume":"53","author":"Paul","year":"1987","journal-title":"J. Per. Soc. Psychol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1037\/h0055778","article-title":"The description of facial expressions in terms of two dimensions","volume":"44","author":"Schlosberg","year":"1952","journal-title":"J. Exp. Psychol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1037\/0278-7393.18.2.379","article-title":"Remembering pictures: Pleasure and arousal in memory","volume":"18","author":"Bradley","year":"1992","journal-title":"J. Exp. Psychol. Learn. Mem. Cogn."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1037\/0033-2909.98.2.219","article-title":"Toward a consensual structure of mood","volume":"98","author":"Watson","year":"1985","journal-title":"Psychol. Bull."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lertsuksakda, R., Netisopakul, P., and Pasupa, K. (2014, January 30\u201331). Thai sentiment terms construction using the Hourglass of Emotions. Proceedings of the 2014 6th International Conference on Knowledge and Smart Technology (KST), Chonburi, Thailand.","DOI":"10.1109\/KST.2014.6775392"},{"key":"ref_20","unstructured":"Mehrabian, A. (1980). Basic dimensions for a general psychological theory: Implications for personality, social, environmental, and developmental studies. Oelgeschlager, Gunn & Hain."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1016\/j.mehy.2011.11.016","article-title":"A new three-dimensional model for emotions and monoamine neurotransmitters","volume":"78","year":"2012","journal-title":"Med. Hypotheses"},{"key":"ref_22","unstructured":"Osgood, C.E., Suci, G.J., and Tannenbaum, P. (1957). The Measurement of Meaning, University of Illinois Press."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1111\/j.1469-8986.1993.tb03352.x","article-title":"Looking at pictures: Affective, facial, visceral, and behavioral reactions","volume":"30","author":"Lang","year":"1993","journal-title":"Psychophysiology"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","article-title":"A circumplex model of affect","volume":"39","author":"Russell","year":"1980","journal-title":"J. Pers. Soc. Psychol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1037\/h0054570","article-title":"Three dimensions of emotion","volume":"61","author":"Schlosberg","year":"1954","journal-title":"Psychological Rev."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/0005-7916(94)90063-9","article-title":"Measuring emotion: The self-assessment manikin and the semantic differential","volume":"25","author":"Bradley","year":"1994","journal-title":"J. Behav. Ther. Exp. Psychiatry"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chanel, G., Kronegg, J., Grandjean, D., and Pun, T. (2006). Emotion assessment: Arousal evaluation using EEG\u2019s and peripheral physiological signals. Multimedia Content Representation, Classification and Security, Springer.","DOI":"10.1007\/11848035_70"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1111\/j.1469-8986.1979.tb01511.x","article-title":"A bio-informational theory of emotional imagery","volume":"16","author":"Lang","year":"1979","journal-title":"Psychophysiology"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1248","DOI":"10.1016\/S0006-3223(98)00275-3","article-title":"Emotion, motivation, and anxiety: Brain mechanisms and psychophysiology","volume":"44","author":"Lang","year":"1998","journal-title":"Biol. Psychiatry"},{"key":"ref_30","unstructured":"Joshi, N.A., and Fass, J.N. (2019, October 20). Sickle: A sliding-window, adaptive, quality-based trimming tool for FastQ files (Version 1.33). Available online: https:\/\/github.com\/najoshi\/sickle."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1111\/j.1745-6916.2007.00044.x","article-title":"Basic emotions, natural kinds, emotion schemas, and a new paradigm","volume":"2","author":"Izard","year":"2007","journal-title":"Perspect. Psychol. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Machajdik, J., and Allan, H. (2010, January 25\u201329). Affective image classification using features inspired by psychology and art theory. Proceedings of the 18th ACM international conference on Multimedia, Firenze, Italy.","DOI":"10.1145\/1873951.1873965"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"eaaw4358","DOI":"10.1126\/sciadv.aaw4358","article-title":"Emotion schemas are embedded in the human visual system","volume":"5","author":"Kragel","year":"2019","journal-title":"Sci. Adv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhao, S., Gao, Y., Jiang, X., Yao, H., Chua, T.S., and Sun, X. (2014, January 3\u20137). Exploring principles-of-art features for image emotion recognition. Proceedings of the 22nd ACM international conference on Multimedia, Orlando, FL, USA.","DOI":"10.1145\/2647868.2654930"},{"key":"ref_35","unstructured":"Tuuri, K., Mustonen, M.S., and Pirhonen, A. (2007, January 27\u201328). Same sound\u2013different meanings: A novel scheme for modes of listening. Proceedings of the Audio Mostly, Ilmenau, Germany."},{"key":"ref_36","unstructured":"Ward, M. (2015). Art in noise: An embodied simulation account of cinematic sound design. Embodied Cognition and Cinema, Leuven University Press."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3058","DOI":"10.1121\/1.5108601","article-title":"The time course of emotion recognition in speech and music","volume":"145","author":"Laukka","year":"2019","journal-title":"J. Acoust. Soc. Am."},{"key":"ref_38","unstructured":"Forrester, M.A. (2019, October 20). Auditory perception and sound as event: Theorising sound imagery in psychology. Available online: https:\/\/theearoftheduck.wordpress.com\/2012\/10\/15\/auditory-perception-and-sound-as-event-theorising-sound-imagery-in-psychology\/."},{"key":"ref_39","unstructured":"Cabredo, R., Legaspi, R., Inventado, P.S., and Numao, M. (2019, October 20). An Emotion Model for Music Using Brain Waves. Available online: file:\/\/\/C:\/Users\/mdpi\/Downloads\/e82afc279aa8479631eff5abeb491f51710a.pdf."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Schuller, B., Hantke, S., Weninger, F., Han, W., Zhang, Z., and Narayanan, S. (2012, January 25\u221230). Automatic recognition of emotion evoked by general sound events. Proceedings of the 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Kyoto, Japan.","DOI":"10.1109\/ICASSP.2012.6287886"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Juslin, P.N., and Sloboda, J.A. (2001). Music and Emotion: Theory and Research, Oxford University Press.","DOI":"10.1093\/oso\/9780192631886.001.0001"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1080\/08838159609364369","article-title":"Negative video as structure: Emotion, attention, capacity, and memory","volume":"40","author":"Lang","year":"1996","journal-title":"J. Broadcast. Electron. Media"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1080\/02699930903205698","article-title":"The effects of emotion on attention: A review of attentional processing of emotional information","volume":"24","author":"Yiend","year":"2010","journal-title":"Cognition Emotion"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1509\/jmr.10.0207","article-title":"Emotion-induced engagement in internet video advertisements","volume":"49","author":"Teixeira","year":"2012","journal-title":"J. Mark. Res."},{"key":"ref_45","unstructured":"Monaco, J. (2000). How to Read a Film: Movies, Media, Multimedia, Oxford University Press."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1109\/TCSVT.2006.873781","article-title":"Affective understanding in film","volume":"16","author":"Wang","year":"2006","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1109\/TMM.2010.2059634","article-title":"Affective visualization and retrieval for music video","volume":"12","author":"Zhang","year":"2010","journal-title":"IEEE Trans. Multimed."},{"key":"ref_48","unstructured":"Zhang, S., Tian, Q., Jiang, S., Huang, Q., and Gao, W. (2008, January 23\u201326). Affective MTV analysis based on arousal and valence features. Proceedings of the 2008 IEEE International Conference on Multimedia and Expo, Hannover, Germany."},{"key":"ref_49","unstructured":"Suk, H.J., and Irtel, H. (2019, October 20). Emotional response to color across media. Available online: https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1002\/col.20554."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Jing, P. (2017, January 29\u201330). Application of Color and Musical Language in Chinese Contemporary Animation Film. Proceedings of the 3rd International Conference on Arts, Design and Contemporary Education (ICADCE 2017), Moscow, Russia.","DOI":"10.2991\/icadce-17.2017.13"},{"key":"ref_51","unstructured":"Li, M. (2019, October 20). Perfect interpretation of the influence of color background on animation art in my neighbor Totoro directed by Miyazaki Hayao. DEStech Transactions on Social Science. Available online: http:\/\/www.dpi-proceedings.com\/index.php\/dtssehs\/article\/view\/9392."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/649\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:08:28Z","timestamp":1760364508000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/649"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,24]]},"references-count":51,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["s20030649"],"URL":"https:\/\/doi.org\/10.3390\/s20030649","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,24]]}}}