{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,8,26]],"date-time":"2022-08-26T21:10:29Z","timestamp":1661548229083},"reference-count":40,"publisher":"Institute of Electronics, Information and Communications Engineers (IEICE)","issue":"7","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Inf. & Syst."],"published-print":{"date-parts":[[2018,7,1]]},"DOI":"10.1587\/transinf.2017edl8264","type":"journal-article","created":{"date-parts":[[2018,6,30]],"date-time":"2018-06-30T22:28:47Z","timestamp":1530397727000},"page":"1976-1979","source":"Crossref","is-referenced-by-count":0,"title":["A Novel Bimodal Emotion Database from Physiological Signals and Facial Expression"],"prefix":"10.1587","volume":"E101.D","author":[{"given":"Jingjie","family":"YAN","sequence":"first","affiliation":[{"name":"Jiangsu Provincial Key Laboratory of Image Processing and Image Communication, College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bei","family":"WANG","sequence":"additional","affiliation":[{"name":"Key Laboratory of Child Development and Learning Science (Ministry of Education), Research Center for Learning Science, Southeast University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruiyu","family":"LIANG","sequence":"additional","affiliation":[{"name":"School of Communication Engineering, Nanjing Institute of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"532","reference":[{"key":"1","doi-asserted-by":"publisher","unstructured":"[1] M.H. Siddiqi, R. Ali, A.M. Khan, Y.-T. Park, and S. Lee, \u201cHuman facial expression recognition using stepwise linear discriminant analysis and hidden conditional random fields,\u201d IEEE Trans. Image Process., vol.24, no.4, pp.1386-1398, 2015. 10.1109\/tip.2015.2405346","DOI":"10.1109\/TIP.2015.2405346"},{"key":"2","doi-asserted-by":"publisher","unstructured":"[2] J. Yan, W. Zheng, M. Xin, and Y. Yan, \u201cFacial expression recognition based on sparse locality preserving projection,\u201d IEICE Trans. Fundamentals, vol.E97-A, no.7, pp.1650-1653, 2014. 10.1587\/transfun.e97.a.1650","DOI":"10.1587\/transfun.E97.A.1650"},{"key":"3","doi-asserted-by":"publisher","unstructured":"[3] M.E. Ayadi, M.S. Kamel, and F. Karray, \u201cSurvey on speech emotion recognition: Features, classification schemes, and databases,\u201d Pattern Recognition, vol.44, no.3, pp.572-587, 2011. 10.1016\/j.patcog.2010.09.020","DOI":"10.1016\/j.patcog.2010.09.020"},{"key":"4","doi-asserted-by":"crossref","unstructured":"[4] S. Jerritta, M. Murugappan, R. Nagarajan, and K. Wan, \u201cPhysiological signals based human emotion recognition: a review,\u201d In: Proceedings of the 7th IEEE International Colloquium on Signal Processing and its Applications (CSPA), pp.410-415, 2011. 10.1109\/cspa.2011.5759912","DOI":"10.1109\/CSPA.2011.5759912"},{"key":"5","unstructured":"[5] H. Gunes, M. Piccardi, and M. Pantic, \u201cFrom the lab to the real world: affect recognition using multiple cues and modalities,\u201d Affective Computing: Focus on Emotion Expression, Synthesis, and Recognition, pp.185-218, Vienna: InTech Education and Publishing, 2008."},{"key":"6","doi-asserted-by":"publisher","unstructured":"[6] Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang, \u201cA survey of affect recognition methods: audio, visual, and spontaneous expressions,\u201d IEEE Trans. Pattern Anal. Mach. Intell., vol.31, no.1, pp.39-58, 2009. 10.1109\/tpami.2008.52","DOI":"10.1109\/TPAMI.2008.52"},{"key":"7","doi-asserted-by":"publisher","unstructured":"[7] Z. Zeng, J. Tu, M. Liu, T.S. Huang, B. Pianfetti, D. Roth, and S. Levinson, \u201cAudio-visual affect recognition,\u201d IEEE Trans. Multimedia, vol.9, no.2, pp.424-428, 2007. 10.1109\/tmm.2006.886310","DOI":"10.1109\/TMM.2006.886310"},{"key":"8","doi-asserted-by":"publisher","unstructured":"[8] G.K. Verma and U.S. Tiwary, \u201cMultimodal fusion framework: A multiresolution approach for emotion classification and recognition from physiological signals,\u201d NeuroImage, vol.102, pp.162-172, 2014. 10.1016\/j.neuroimage.2013.11.007","DOI":"10.1016\/j.neuroimage.2013.11.007"},{"key":"9","unstructured":"[9] J. Yan, G. Lu, and H. Li, \u201cA Novel Supervised Bimodal Emotion Recognition Approach Based on Facial Expression and Body Gesture,\u201d submitted to Mathematical Problems in Engineering, 2017."},{"key":"10","doi-asserted-by":"publisher","unstructured":"[10] J. Yan, W. Zheng, Q. Xu, G. Lu, H. Li, and B. Wang, \u201cSparse kernel reduced-rank regression for bimodal emotion recognition from facial expression and speech,\u201d IEEE Transactions on and Multi Media, vol.18, no.7, pp.1319-1329, 2016. 10.1109\/tmm.2016.2557721","DOI":"10.1109\/TMM.2016.2557721"},{"key":"11","doi-asserted-by":"publisher","unstructured":"[11] S. Poria, E. Cambria, R. Bajpai, and A. Hussain, \u201cA review of affective computing: From unimodal analysis to multimodal fusion,\u201d Information Fusion, vol.37, pp.98-125, 2017. 10.1016\/j.inffus.2017.02.003","DOI":"10.1016\/j.inffus.2017.02.003"},{"key":"12","doi-asserted-by":"publisher","unstructured":"[12] R.W. Picard, E. Vyzas, and J. Healey, \u201cToward machine emotional intelligence: Analysis of affective physiological state,\u201d IEEE Trans. Pattern Anal. Mach. Intell., vol.23, no.10, pp.1175-1191, 2001. 10.1109\/34.954607","DOI":"10.1109\/34.954607"},{"key":"13","doi-asserted-by":"publisher","unstructured":"[13] J. Yan, W. Zheng, M. Xin, and J. Yan, \u201cIntegrating facial expression and body gesture in videos for emotion recognition,\u201d IEICE Trans. Inf. & Syst., vol.E97-D, no.3, pp.610-613, 2014. 10.1587\/transinf.e97.d.610","DOI":"10.1587\/transinf.E97.D.610"},{"key":"14","unstructured":"[14] B. Wang, A Study of Bimodal Emotion Recognition Based on Facial Expression and Biological Signals, Master's thesis, Southeast University, Nanjing, China, 2014."},{"key":"15","doi-asserted-by":"crossref","unstructured":"[15] W. Zheng, X. Zhou, C. Zou, and L. Zhao, \u201cFacial expression recognition using kernel canonical correlation analysis (KCCA),\u201d IEEE Trans. Neural Netw., vol.17, no.1, pp.233-238, 2006. 10.1109\/tnn.2005.860849","DOI":"10.1109\/TNN.2005.860849"},{"key":"16","doi-asserted-by":"publisher","unstructured":"[16] M. Lyons, J. Budynek, and S. Akamatsu, \u201cAutomatic classification of single facial images,\u201d IEEE Trans. Pattern Anal. Mach. Intell., vol.21, no.12, pp.1357-1362, 1999. 10.1109\/34.817413","DOI":"10.1109\/34.817413"},{"key":"17","doi-asserted-by":"crossref","unstructured":"[17] F. Burkhardt, A. Paeschke, M. Rolfes, W. Sendlmeier, and B. Weiss, \u201cA Database of German Emotional Speech,\u201d Interspeech, pp.4-8, 2005.","DOI":"10.21437\/Interspeech.2005-446"},{"key":"18","doi-asserted-by":"crossref","unstructured":"[18] J. Yan, X. Wang, W. Gu, and L. Ma, \u201cSpeech emotion recognition based on sparse representation,\u201d Archives of Acoustics, vol.38, no.4, pp.465-470, 2013. 10.2478\/aoa-2013-0055","DOI":"10.2478\/aoa-2013-0055"},{"key":"19","doi-asserted-by":"publisher","unstructured":"[19] R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, \u201cMulti-PIE,\u201d Image and Vision Computng, vol.28, no.5, pp.807-813, 2010. 10.1016\/j.imavis.2009.08.002","DOI":"10.1016\/j.imavis.2009.08.002"},{"key":"20","doi-asserted-by":"publisher","unstructured":"[20] W. Zheng, \u201cMulti-view Facial expression recognition based on group sparse reduced-rank regression,\u201d IEEE Transactions on Affective Computing, vol.5, no.1, pp.71-85, 2014. 10.1109\/taffc.2014.2304712","DOI":"10.1109\/TAFFC.2014.2304712"},{"key":"21","doi-asserted-by":"crossref","unstructured":"[21] S. Lalitha, A. Madhavan, B. Bhushan, and S. Saketh, \u201cSpeech emotion recognition,\u201d In: Proceedings of the IEEE International Conference on Advances in Electronics, Computers and Communications, pp.1-4, 2014. 10.1109\/icaecc.2014.7002390","DOI":"10.1109\/ICAECC.2014.7002390"},{"key":"22","doi-asserted-by":"publisher","unstructured":"[22] K.H. Kim, S.W. Bang, and S.R. Kim, \u201cEmotion recognition system using short-term monitoring of physiological signals,\u201d Medical and biological engineering and computing, vol.42, no.3, pp.419-427, 2004. 10.1007\/bf02344719","DOI":"10.1007\/BF02344719"},{"key":"23","doi-asserted-by":"publisher","unstructured":"[23] J. Kim and E. Andr\u00e9, \u201cEmotion recognition based on physiological changes in music listening,\u201d IEEE Trans. Pattern Anal. Mach. Intell., vol.30, no.12, pp.2067-2083, 2008. 10.1109\/tpami.2008.26","DOI":"10.1109\/TPAMI.2008.26"},{"key":"24","doi-asserted-by":"publisher","unstructured":"[24] W. Wen, G. Liu, N. Cheng, J. Wei, P. Shangguan, and W. Huang, \u201cEmotion recognition based on multi-variant correlation of physiological signals,\u201d IEEE Transactions on Affective Computing, vol.5, no.2, pp.126-140, 2014. 10.1109\/taffc.2014.2327617","DOI":"10.1109\/TAFFC.2014.2327617"},{"key":"25","doi-asserted-by":"crossref","unstructured":"[25] S. Wioleta, \u201cUsing physiological signals for emotion recognition,\u201d In: Proceedings of the 6th IEEE International Conference on Human System Interaction (HSI), pp.556-561, 2013. 10.1109\/hsi.2013.6577880","DOI":"10.1109\/HSI.2013.6577880"},{"key":"26","doi-asserted-by":"crossref","unstructured":"[26] H. Gunes and M. Piccardi, \u201cA bimodal face and body gesture database for automatic analysis of human nonverbal affective behavior,\u201d ICPR, pp.1148-1153, 2006. 10.1109\/icpr.2006.39","DOI":"10.1109\/ICPR.2006.39"},{"key":"27","doi-asserted-by":"publisher","unstructured":"[27] H. Gunes and M. Piccardi, \u201cBi-modal emotion recognition from expressive face and body gestures,\u201d J. Netw. Comput. Applicat., vol.30, no.4, pp.1334-1345, 2007. 10.1016\/j.jnca.2006.09.007","DOI":"10.1016\/j.jnca.2006.09.007"},{"key":"28","doi-asserted-by":"publisher","unstructured":"[28] Y. Wang and L. Guan, \u201cRecognizing Human Emotional State From Audiovisual Signals,\u201d IEEE Trans. Multimedia, vol.10, no.5, pp.936-946, 2008. 10.1109\/tmm.2008.927665","DOI":"10.1109\/TMM.2008.927665"},{"key":"29","doi-asserted-by":"crossref","unstructured":"[29] O. Martin, I. Kotsia, B. Macq, and I. Pitas, \u201cThe eNTERFACE 05 Audio-Visual Emotion Database,\u201d In: Proceedings of the IEEE International Conference on Data Engineering Workshops, pp.1-8, 2006. 10.1109\/icdew.2006.145","DOI":"10.1109\/ICDEW.2006.145"},{"key":"30","doi-asserted-by":"publisher","unstructured":"[30] S. Koelstra, C. Muhl, M. Soleymani, J.-S. Lee, A. Yazdani, T. Ebrahimi, T. Pun, A. Nijholt, and I. Patras, \u201cDEAP: A Database for Emotion Analysis ;Using Physiological Signals,\u201d IEEE Transactions on Affective Computing, vol.3, no.1, pp.18-31, 2012. 10.1109\/t-affc.2011.15","DOI":"10.1109\/T-AFFC.2011.15"},{"key":"31","doi-asserted-by":"publisher","unstructured":"[31] M. Soleymani, J. Lichtenauer, T. Pun, and M. Pantic, \u201cA Multimodal Database for Affect Recognition and Implicit Tagging,\u201d IEEE Transactions on Affective Computing, vol.3, no.1, pp.42-55, 2012. 10.1109\/t-affc.2011.25","DOI":"10.1109\/T-AFFC.2011.25"},{"key":"32","doi-asserted-by":"crossref","unstructured":"[32] A. Dhall, R. Goecke, J. Joshi, J. Hoey, and T. Gedeon, \u201cEmotiW 2016: video and group-level emotion recognition challenges,\u201d In: Proceedings of the ACM International Conference on Multimodal Interaction, pp.427-432, 2016. 10.1145\/2993148.2997638","DOI":"10.1145\/2993148.2997638"},{"key":"33","unstructured":"[33] T. Banziger and K.R. Scherer, \u201cIntroducing the Geneva Multimodal Emotion Portrayal (GEMEP) corpus,\u201d A. Blueprint for Affective Computing A Sourcebook and Manual, 2010."},{"key":"34","doi-asserted-by":"crossref","unstructured":"[34] F. Ringeval, B. Schuller, M. Valstar, S. Jaiswal, E. Marchi, D. Lalanne, R. Cowie, and M. Pantic, \u201cAV+EC 2015: The First Affect Recognition Challenge Bridging Across Audio, Video, and Physiological Data,\u201d In: Proceedings of the ACM International Workshop on Audio\/visual Emotion Challenge, pp.3-8, 2015. 10.1145\/2808196.2811642","DOI":"10.1145\/2808196.2811642"},{"key":"35","unstructured":"[35] Reference Manual: MP System Hardware Guide, http:\/\/www.biopac.com."},{"key":"36","unstructured":"[36] Reference Manual: AcqKnowledge Software Guide, http:\/\/www.biopac.com."},{"key":"37","unstructured":"[37] Kinect for Windows, http:\/\/msdn.microsoft.com\/zh-tw\/hh367958."},{"key":"38","unstructured":"[38] Kinect for Windows SDK, http:\/\/msdn.microsoft.com\/en-us\/library\/hh855347.aspx."},{"key":"39","doi-asserted-by":"crossref","unstructured":"[39] J.J. Gross and R.W. Levenson, \u201cEmotion elicitation using films,\u201d Cognition and Emotion, vol.9, no.1, pp.87-108, 1995. 10.1080\/02699939508408966","DOI":"10.1080\/02699939508408966"},{"key":"40","doi-asserted-by":"crossref","unstructured":"[40] J. Wagner, J. Kim, and E. Andr\u00e9, \u201cFrom physiological signals to emotions: Implementing and comparing selected methods for feature extraction and classification,\u201d In: Proceedings of the IEEE International Conference on Multimedia and Expo, pp.940-943, 2005. 10.1109\/icme.2005.1521579","DOI":"10.1109\/ICME.2005.1521579"}],"container-title":["IEICE Transactions on Information and Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E101.D\/7\/E101.D_2017EDL8264\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,26]],"date-time":"2022-08-26T20:36:33Z","timestamp":1661546193000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E101.D\/7\/E101.D_2017EDL8264\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,1]]},"references-count":40,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2018]]}},"URL":"https:\/\/doi.org\/10.1587\/transinf.2017edl8264","relation":{},"ISSN":["0916-8532","1745-1361"],"issn-type":[{"value":"0916-8532","type":"print"},{"value":"1745-1361","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,1]]}}}