{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T00:19:49Z","timestamp":1768349989201,"version":"3.49.0"},"reference-count":28,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2017,7,24]],"date-time":"2017-07-24T00:00:00Z","timestamp":1500854400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Accurate emotion recognition from speech is important for applications like smart health care, smart entertainment, and other smart services. High accuracy emotion recognition from Chinese speech is challenging due to the complexities of the Chinese language. In this paper, we explore how to improve the accuracy of speech emotion recognition, including speech signal feature extraction and emotion classification methods. Five types of features are extracted from a speech sample: mel frequency cepstrum coefficient (MFCC), pitch, formant, short-term zero-crossing rate and short-term energy. By comparing statistical features with deep features extracted by a Deep Belief Network (DBN), we attempt to find the best features to identify the emotion status for speech. We propose a novel classification method that combines DBN and SVM (support vector machine) instead of using only one of them. In addition, a conjugate gradient method is applied to train DBN in order to speed up the training process. Gender-dependent experiments are conducted using an emotional speech database created by the Chinese Academy of Sciences. The results show that DBN features can reflect emotion status better than artificial features, and our new classification approach achieves an accuracy of 95.8%, which is higher than using either DBN or SVM separately. Results also show that DBN can work very well for small training databases if it is properly designed.<\/jats:p>","DOI":"10.3390\/s17071694","type":"journal-article","created":{"date-parts":[[2017,7,24]],"date-time":"2017-07-24T10:04:13Z","timestamp":1500890653000},"page":"1694","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":116,"title":["Emotion Recognition from Chinese Speech for Smart Affective Services Using a Combination of SVM and DBN"],"prefix":"10.3390","volume":"17","author":[{"given":"Lianzhang","family":"Zhu","sequence":"first","affiliation":[{"name":"Department of Software Engineering, China University of Petroleum, No. 66 Changjiang West Road, Qingdao 266031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7701-6313","authenticated-orcid":false,"given":"Leiming","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, China University of Petroleum, No. 66 Changjiang West Road, Qingdao 266031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dehai","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, China University of Petroleum, No. 66 Changjiang West Road, Qingdao 266031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4026-1649","authenticated-orcid":false,"given":"Jiehan","family":"Zhou","sequence":"additional","affiliation":[{"name":"Department of Information Processing Science, University of Oulu, Oulu FI-91004, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9800-1068","authenticated-orcid":false,"given":"Weishan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, China University of Petroleum, No. 66 Changjiang West Road, Qingdao 266031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,7,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lee, J., and Tashev, I. (2015, January 6\u201310). High-level Feature Representation using Recurrent Neural Network for Speech Emotion Recognition. Proceedings of the Sixteenth Annual Conference of the International Speech Communication Association, Dresden, Germany.","DOI":"10.21437\/Interspeech.2015-336"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Jin, Q., Li, C., Chen, S., and Wu, H. (2015, January 19\u201324). Speech emotion recognition with acoustic and lexical features. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, Australia.","DOI":"10.1109\/ICASSP.2015.7178872"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1458","DOI":"10.3390\/s150101458","article-title":"Time-Frequency Feature Representation Using Multi-Resolution Texture Analysis and Acoustic Activity Detector for Real-Life Speech Emotion Recognition","volume":"15","author":"Wang","year":"2015","journal-title":"Sensors"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Li, Y., Chao, L., Liu, Y., Bao, W., and Tao, J. (2015, January 21\u201324). From simulated speech to natural speech, what are the robust features for emotion recognition?. Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), Xi\u2019an, China.","DOI":"10.1109\/ACII.2015.7344597"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Samantaray, A.K., Mahapatra, K., Kabi, B., and Routray, A. (2015, January 9\u201311). A novel approach of speech emotion recognition with prosody, quality and derived features using SVM classifier for a class of North-Eastern Languages. Proceedings of the 2015 IEEE 2nd International Conference on Recent Trends in Information Systems (ReTIS), Kolkata, India.","DOI":"10.1109\/ReTIS.2015.7232907"},{"key":"ref_6","first-page":"422","article-title":"Emotion Recognition through Speech Using Neural Network","volume":"5","author":"Rawat","year":"2015","journal-title":"Int. J."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/j.csl.2014.01.003","article-title":"Speaker-sensitive emotion recognition via ranking: Studies on acted and spontaneous speech","volume":"29","author":"Cao","year":"2015","journal-title":"Comput. Speech Lang."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.bspc.2014.10.008","article-title":"Weighted spectral features based on local Hu moments for speech emotion recognition","volume":"18","author":"Sun","year":"2015","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Huang, Z., Epps, J., and Ambikairajah, E. (2015, January 6\u201310). An Investigation of Emotion Change Detection from Speech. Proceedings of the Sixteenth Annual Conference of the International Speech Communication Association, Dresden, Germany.","DOI":"10.21437\/Interspeech.2015-330"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"777","DOI":"10.1016\/j.im.2015.02.003","article-title":"Emotion recognition and affective computing on vocal social media","volume":"52","author":"Dai","year":"2015","journal-title":"Inf. Manag."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Abdelwahab, M., and Busso, C. (2015, January 19\u201324). Supervised domain adaptation for emotion recognition from speech. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, Australia.","DOI":"10.1109\/ICASSP.2015.7178934"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.procs.2015.08.032","article-title":"Detection and analysis of emotion from speech signals","volume":"58","author":"Davletcharova","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1109\/TAFFC.2015.2392101","article-title":"Speech emotion recognition using fourier parameters","volume":"6","author":"Wang","year":"2015","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Muller, P.M., Amin, S., Verma, P., Andriluka, M., and Bulling, A. (2015, January 21\u201324). Emotion recognition from embedded bodily expressions and speech during dyadic interactions. Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), Xi\u2019an, China.","DOI":"10.1109\/ACII.2015.7344640"},{"key":"ref_15","first-page":"20","article-title":"Speech emotion recognition in emotional feedbackfor Human-Robot Interaction","volume":"4","author":"Sundgren","year":"2015","journal-title":"Int. J. Adv. Res. Artif. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.patrec.2014.10.015","article-title":"Emotion recognition from speech signals via a probabilistic echo-state network","volume":"66","author":"Trentin","year":"2015","journal-title":"Pattern Recognit. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Campbell, W.M. (2014, January 14\u201318). Using deep belief networks for vector-based speaker recognition. Proceedings of the 15th Annual Conference of the International Speech Communication Association (INTERSPEECH), Singapore.","DOI":"10.21437\/Interspeech.2014-170"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Cai, X., Hu, S., and Lin, X. (2012, January 25\u201327). Feature extraction using restricted Boltzmann machine for stock price prediction. Proceedings of the 2012 IEEE International Conference on Computer Science and Automation Engineering (CSAE), Zhangjiajie, China.","DOI":"10.1109\/CSAE.2012.6272913"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1002\/spe.2487","article-title":"Deep learning and SVM-based emotion recognition from Chinese speech for smart affective services","volume":"47","author":"Zhang","year":"2017","journal-title":"Softw. Pract. Exp."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1023\/A:1018628609742","article-title":"Least squares support vector machine classifiers","volume":"9","author":"Suykens","year":"1999","journal-title":"Neural Process. Lett."},{"key":"ref_21","unstructured":"Vapnik, V. (2013). The Nature of Statistical Learning Theory, Springer Science & Business Media."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.ress.2013.02.022","article-title":"Failure diagnosis using deep belief learning based health state classification","volume":"115","author":"Tamilselvan","year":"2013","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Burkhardt, F., Paeschke, A., Rolfes, M., Sendlmeier, W.F., and Weiss, B. (2005, January 4\u20138). A database of German emotional speech. Proceedings of the 9th European Conference on Speech Communication and Technology (Interspeech), Lisbon, Portugal.","DOI":"10.21437\/Interspeech.2005-446"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1007\/s10579-008-9076-6","article-title":"IEMOCAP: Interactive emotional dyadic motion capture database","volume":"42","author":"Busso","year":"2008","journal-title":"Lang. Resour. Eval."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Pribil, J., and Pribilova, A. (2012, January 3\u20134). Formant features statistical analysis of male and female emotional speech in Czech and Slovak. Proceedings of the 2012 35th International Conference on Telecommunications and Signal Processing (TSP), Prague, Czech Republic.","DOI":"10.1109\/TSP.2012.6256329"},{"key":"ref_26","first-page":"115","article-title":"Cooperative learning and its application to emotion recognition from speech","volume":"23","author":"Zhang","year":"2015","journal-title":"IEEE ACM Trans. Audio Speech Lang. Process."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Poria, S., Chaturvedi, I., Cambria, E., and Hussain, A. (2016, January 12\u201315). Convolutional MKL based multimodal emotion recognition and sentiment analysis. Proceedings of the 2016 IEEE 16th International Conference on Data Mining (ICDM), Barcelona, Spain.","DOI":"10.1109\/ICDM.2016.0055"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, W., Meng, X., Lu, Q., Rao, Y., and Zhou, J. (2013, January 20\u201323). A Hybrid Emotion Recognition on Android Smart Phones. Proceedings of the 2013 IEEE International Conference on Green Computing and Communications (GreenCom) and IEEE Internet of Things (iThings) and IEEE Cyber, Physical and Social Computing (CPSCom), Beijing, China.","DOI":"10.1109\/GreenCom-iThings-CPSCom.2013.228"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/7\/1694\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:43:45Z","timestamp":1760208225000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/7\/1694"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,7,24]]},"references-count":28,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2017,7]]}},"alternative-id":["s17071694"],"URL":"https:\/\/doi.org\/10.3390\/s17071694","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,7,24]]}}}