{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,5]],"date-time":"2026-04-05T20:44:08Z","timestamp":1775421848919,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":43,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,21]],"date-time":"2020-10-21T00:00:00Z","timestamp":1603238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,21]]},"DOI":"10.1145\/3382507.3417970","type":"proceedings-article","created":{"date-parts":[[2020,10,22]],"date-time":"2020-10-22T10:04:34Z","timestamp":1603361074000},"page":"849-857","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Recognizing Emotion in the Wild using Multimodal Data"],"prefix":"10.1145","author":[{"given":"Shivam","family":"Srivastava","sequence":"first","affiliation":[{"name":"University of South Florida, Tampa, FL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saandeep Aathreya SIdhapur","family":"Lakshminarayan","sequence":"additional","affiliation":[{"name":"University of South Florida, Tampa, FL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saurabh","family":"Hinduja","sequence":"additional","affiliation":[{"name":"University of South Florida, Tampa, FL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sk Rahatul","family":"Jannat","sequence":"additional","affiliation":[{"name":"University of South Florida, Tampa, FL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hamza","family":"Elhamdadi","sequence":"additional","affiliation":[{"name":"University of South Florida, Tampa, FL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shaun","family":"Canavan","sequence":"additional","affiliation":[{"name":"University of South Florida, Tampa, FL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,10,22]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.14569\/IJACSA.2016.071157"},{"key":"e_1_3_2_2_2_1","unstructured":"Peter A Anderson and Laura K Guerrero. 1998. The handbook of communication and emotion.  Peter A Anderson and Laura K Guerrero. 1998. The handbook of communication and emotion."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2018.00019"},{"key":"e_1_3_2_2_4_1","volume-title":"Random forests. Machine learning","author":"Breiman Leo","year":"2001","unstructured":"Leo Breiman . 2001. Random forests. Machine learning , Vol. 45 , 1 ( 2001 ), 5--32. Leo Breiman. 2001. Random forests. Machine learning, Vol. 45, 1 (2001), 5--32."},{"key":"e_1_3_2_2_5_1","unstructured":"Z. Cao G. Hidalgo Martinez T. Simon S. Wei and Y. A. Sheikh. 2019. OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (2019).  Z. Cao G. Hidalgo Martinez T. Simon S. Wei and Y. A. Sheikh. 2019. OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (2019)."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.195"},{"key":"e_1_3_2_2_7_1","volume-title":"Histograms of oriented gradients for human detection. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05)","author":"Dalal Navneet","unstructured":"Navneet Dalal and Bill Triggs . 2005. Histograms of oriented gradients for human detection. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05) , Vol. 1 . IEEE , 886--893. Navneet Dalal and Bill Triggs. 2005. Histograms of oriented gradients for human detection. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05), Vol. 1. IEEE, 886--893."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2019.2915540"},{"key":"e_1_3_2_2_9_1","unstructured":"Abhinav Dhall Roland Goecke Simon Lucey and Tom Gedeon. 2011. Acted facial expressions in the wild database. (2011).  Abhinav Dhall Roland Goecke Simon Lucey and Tom Gedeon. 2011. Acted facial expressions in the wild database. (2011)."},{"key":"e_1_3_2_2_10_1","volume-title":"What the face reveals: Basic and app studies of spon exp using the Facial Action Coding System (FACS)","author":"Ekman P.","year":"1997","unstructured":"P. Ekman . 1997. What the face reveals: Basic and app studies of spon exp using the Facial Action Coding System (FACS) . Ox Uni Press ( 1997 ). P. Ekman. 1997. What the face reveals: Basic and app studies of spon exp using the Facial Action Coding System (FACS). Ox Uni Press (1997)."},{"key":"e_1_3_2_2_11_1","volume-title":"mbox","author":"D. Fabiano","year":"2018","unstructured":"D. Fabiano et al mbox . 2018 . Spontaneous and non-spontaneous 3D facial expression recognition using a statistical model with global and local constraints. ICIP ( 2018). D. Fabiano et almbox. 2018. Spontaneous and non-spontaneous 3D facial expression recognition using a statistical model with global and local constraints. ICIP (2018)."},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"crossref","unstructured":"Diego Fabiano and Shaun Canavan. 2019. Emotion Recognition Using Fused Physiological Signals. In ACII) .  Diego Fabiano and Shaun Canavan. 2019. Emotion Recognition Using Fused Physiological Signals. In ACII) .","DOI":"10.1109\/ACII.2019.8925486"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.09.013"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISBI.2018.8363576"},{"key":"e_1_3_2_2_15_1","volume-title":"Speak2Label: Using Domain Knowledge for Creating a Large Scale Driver Gaze Zone Estimation Dataset. arXiv preprint arXiv:2004.05973","author":"Ghosh Shreya","year":"2020","unstructured":"Shreya Ghosh , Abhinav Dhall , Garima Sharma , Sarthak Gupta , and Nicu Sebe . 2020. Speak2Label: Using Domain Knowledge for Creating a Large Scale Driver Gaze Zone Estimation Dataset. arXiv preprint arXiv:2004.05973 ( 2020 ). Shreya Ghosh, Abhinav Dhall, Garima Sharma, Sarthak Gupta, and Nicu Sebe. 2020. Speak2Label: Using Domain Knowledge for Creating a Large Scale Driver Gaze Zone Estimation Dataset. arXiv preprint arXiv:2004.05973 (2020)."},{"key":"e_1_3_2_2_16_1","unstructured":"Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672--2680.  Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672--2680."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3264985"},{"key":"e_1_3_2_2_18_1","volume-title":"Multimodal Fusion of Physiological Signals and Facial Action Units for Pain Recognition. In 15th IEEE International Conference on Automatic Face and Gesture Recognition. 387--391","author":"Hinduja S","year":"2020","unstructured":"S Hinduja , S Canavan , and G Kaur . 2020 . Multimodal Fusion of Physiological Signals and Facial Action Units for Pain Recognition. In 15th IEEE International Conference on Automatic Face and Gesture Recognition. 387--391 . S Hinduja, S Canavan, and G Kaur. 2020. Multimodal Fusion of Physiological Signals and Facial Action Units for Pain Recognition. In 15th IEEE International Conference on Automatic Face and Gesture Recognition. 387--391."},{"key":"e_1_3_2_2_19_1","volume-title":"mbox","author":"L. Jeni","year":"2013","unstructured":"L. Jeni et al mbox . 2013 . Facing imbalanced data--recommendations for the use of performance metrics. In ACII. L. Jeni et almbox. 2013. Facing imbalanced data--recommendations for the use of performance metrics. In ACII."},{"key":"e_1_3_2_2_20_1","volume-title":"Prediction and localization of student engagement in the wild. In 2018 Digital Image Computing: Techniques and Applications (DICTA)","author":"Kaur Amanjot","unstructured":"Amanjot Kaur , Aamir Mustafa , Love Mehta , and Abhinav Dhall . 2018. Prediction and localization of student engagement in the wild. In 2018 Digital Image Computing: Techniques and Applications (DICTA) . IEEE , 1--8. Amanjot Kaur, Aamir Mustafa, Love Mehta, and Abhinav Dhall. 2018. Prediction and localization of student engagement in the wild. In 2018 Digital Image Computing: Techniques and Applications (DICTA). IEEE, 1--8."},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/1577069.1755843"},{"key":"e_1_3_2_2_22_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma et al. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_3_2_2_23_1","volume-title":"Deap: A database for emotion analysis","author":"Koelstra Sander","year":"2011","unstructured":"Sander Koelstra , Christian Muhl , Mohammad Soleymani , Jong-Seok Lee , Ashkan Yazdani , Touradj Ebrahimi , Thierry Pun , Anton Nijholt , and Ioannis Patras . 2011 . Deap: A database for emotion analysis ; using physiological signals. IEEE transactions on affective computing, Vol. 3 , 1 (2011), 18--31. Sander Koelstra, Christian Muhl, Mohammad Soleymani, Jong-Seok Lee, Ashkan Yazdani, Touradj Ebrahimi, Thierry Pun, Anton Nijholt, and Ioannis Patras. 2011. Deap: A database for emotion analysis; using physiological signals. IEEE transactions on affective computing, Vol. 3, 1 (2011), 18--31."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_2_2_25_1","volume-title":"Emotion Recognition Through Observer's Physiological Signals. arXiv preprint arXiv:2002.08034","author":"Liu Yang","year":"2020","unstructured":"Yang Liu , Tom Gedeon , Sabrina Caldwell , Shouxu Lin , and Zi Jin . 2020. Emotion Recognition Through Observer's Physiological Signals. arXiv preprint arXiv:2002.08034 ( 2020 ). Yang Liu, Tom Gedeon, Sabrina Caldwell, Shouxu Lin, and Zi Jin. 2020. Emotion Recognition Through Observer's Physiological Signals. arXiv preprint arXiv:2002.08034 (2020)."},{"key":"e_1_3_2_2_26_1","unstructured":"Bruce D Lucas Takeo Kanade etal 1981. An iterative image registration technique with an application to stereo vision. (1981).  Bruce D Lucas Takeo Kanade et al. 1981. An iterative image registration technique with an application to stereo vision. (1981)."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2014.2319591"},{"key":"e_1_3_2_2_28_1","volume-title":"Communicating emotion: Social, moral, and cultural processes","author":"Planalp Sally","unstructured":"Sally Planalp . 1999. Communicating emotion: Social, moral, and cultural processes . Cambridge University Press . Sally Planalp. 1999. Communicating emotion: Social, moral, and cultural processes .Cambridge University Press."},{"key":"e_1_3_2_2_29_1","volume-title":"Automatic Group Level Affect and Cohesion Prediction in Videos. In International Conference on Affective Computing and Intelligent Interaction Workshops and Demo. 161--167","author":"Sharma Garima","year":"2019","unstructured":"Garima Sharma , Shreya Ghosh , and Abhinav Dhall . 2019 . Automatic Group Level Affect and Cohesion Prediction in Videos. In International Conference on Affective Computing and Intelligent Interaction Workshops and Demo. 161--167 . Garima Sharma, Shreya Ghosh, and Abhinav Dhall. 2019. Automatic Group Level Affect and Cohesion Prediction in Videos. In International Conference on Affective Computing and Intelligent Interaction Workshops and Demo. 161--167."},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2018.8461368"},{"key":"e_1_3_2_2_31_1","volume-title":"1994 Proceedings of IEEE conference on computer vision and pattern recognition. IEEE, 593--600","author":"Jianbo","unstructured":"Jianbo Shi et al. 1994. Good features to track . In 1994 Proceedings of IEEE conference on computer vision and pattern recognition. IEEE, 593--600 . Jianbo Shi et al. 1994. Good features to track. In 1994 Proceedings of IEEE conference on computer vision and pattern recognition. IEEE, 593--600."},{"key":"e_1_3_2_2_32_1","volume-title":"Cross-Cultural and Cultural-Specific Production and Perception of Facial Expressions of Emotion in the Wild","author":"Srinivasan Ramprakash","year":"2018","unstructured":"Ramprakash Srinivasan and Aleix M Martinez . 2018. Cross-Cultural and Cultural-Specific Production and Perception of Facial Expressions of Emotion in the Wild . IEEE Transactions on Affective Computing ( 2018 ). Ramprakash Srinivasan and Aleix M Martinez. 2018. Cross-Cultural and Cultural-Specific Production and Perception of Facial Expressions of Emotion in the Wild. IEEE Transactions on Affective Computing (2018)."},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.308"},{"key":"e_1_3_2_2_34_1","first-page":"1","volume-title":"IEEE Winter Conference on. IEEE","author":"Tadas Baltru\u0161aitis Peter Robinson","year":"2016","unstructured":"Peter Robinson Tadas Baltru\u0161aitis and Louis-Philippe Morency . 2016 . Openface:an open source facial behavior analysis toolkit. Applications of Computer Vision (WACV) , IEEE Winter Conference on. IEEE , pp. 1 -- 10 , 2016 (2016). Peter Robinson Tadas Baltru\u0161aitis and Louis-Philippe Morency. 2016. Openface:an open source facial behavior analysis toolkit. Applications of Computer Vision (WACV), IEEE Winter Conference on. IEEE, pp. 1--10, 2016 (2016)."},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3139513.3139514"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.141"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699931.2015.1081349"},{"key":"e_1_3_2_2_38_1","volume-title":"Computer Science and Emerging Research Journal","volume":"2","author":"Veenendaal Anne","year":"2014","unstructured":"Anne Veenendaal , Elliot Daly , Eddie Jones , Zhao Gang , Sumalini Vartak , and Rahul S Patwardhan . 2014 . Group emotion detection using edge detecttion mesh analysis . Computer Science and Emerging Research Journal , Vol. 2 (2014). Anne Veenendaal, Elliot Daly, Eddie Jones, Zhao Gang, Sumalini Vartak, and Rahul S Patwardhan. 2014. Group emotion detection using edge detecttion mesh analysis. Computer Science and Emerging Research Journal, Vol. 2 (2014)."},{"key":"e_1_3_2_2_39_1","volume-title":"2017 IEEE International Conference on Big Data and Smart Computing (BigComp). IEEE, 42--46","author":"Wang Yafei","year":"2017","unstructured":"Yafei Wang , Tongtong Zhao , Xueyan Ding , Jiming Bian , and Xianping Fu . 2017 . Head pose-free eye gaze prediction for driver attention study . In 2017 IEEE International Conference on Big Data and Smart Computing (BigComp). IEEE, 42--46 . Yafei Wang, Tongtong Zhao, Xueyan Ding, Jiming Bian, and Xianping Fu. 2017. Head pose-free eye gaze prediction for driver attention study. In 2017 IEEE International Conference on Big Data and Smart Computing (BigComp). IEEE, 42--46."},{"key":"e_1_3_2_2_40_1","volume-title":"mbox","author":"Ghada Zamzmi","year":"2016","unstructured":"Ghada Zamzmi et al mbox . 2016 . Machine-based multimodal pain assessment tool for infants: a review. arXiv preprint arXiv:1607.00331 (2016). Ghada Zamzmi et almbox. 2016. Machine-based multimodal pain assessment tool for infants: a review. arXiv preprint arXiv:1607.00331 (2016)."},{"key":"e_1_3_2_2_41_1","volume-title":"A comprehensive and context-sensitive neonatal pain assessment using computer vision","author":"Zamzmi Ghada","year":"2019","unstructured":"Ghada Zamzmi , Pai Chih-Yun , Dmitry Goldgof , R Kasturi , Terri Ashmeade , and Yu Sun . 2019. A comprehensive and context-sensitive neonatal pain assessment using computer vision . IEEE Transactions on Affective Computing ( 2019 ). Ghada Zamzmi, Pai Chih-Yun, Dmitry Goldgof, R Kasturi, Terri Ashmeade, and Yu Sun. 2019. A comprehensive and context-sensitive neonatal pain assessment using computer vision. IEEE Transactions on Affective Computing (2019)."},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1110"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"crossref","unstructured":"Z. Zheng et al. 2016. Multimodal spontaneous emotion corpus for human behavior analysis. In CVPR .  Z. Zheng et al. 2016. Multimodal spontaneous emotion corpus for human behavior analysis. In CVPR .","DOI":"10.1109\/CVPR.2016.374"}],"event":{"name":"ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","location":"Virtual Event Netherlands","acronym":"ICMI '20","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2020 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3417970","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3382507.3417970","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:27Z","timestamp":1750199907000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3417970"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,21]]},"references-count":43,"alternative-id":["10.1145\/3382507.3417970","10.1145\/3382507"],"URL":"https:\/\/doi.org\/10.1145\/3382507.3417970","relation":{},"subject":[],"published":{"date-parts":[[2020,10,21]]},"assertion":[{"value":"2020-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}