{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T10:58:48Z","timestamp":1780484328241,"version":"3.54.1"},"reference-count":45,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2013,6,14]],"date-time":"2013-06-14T00:00:00Z","timestamp":1371168000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Facial expressions are widely used in the behavioral interpretation of emotions, cognitive science, and social interactions. In this paper, we present a novel method for fully automatic facial expression recognition in facial image sequences. As the facial expression evolves over time facial landmarks are automatically tracked in consecutive video frames, using displacements based on elastic bunch graph matching displacement estimation. Feature vectors from individual landmarks, as well as pairs of landmarks tracking results are extracted, and normalized, with respect to the first frame in the sequence. The prototypical expression sequence for each class of facial expression is formed, by taking the median of the landmark tracking results from the training facial expression sequences. Multi-class AdaBoost with dynamic time warping similarity distance between the feature vector of input facial expression and prototypical facial expression, is used as a weak classifier to select the subset of discriminative feature vectors. Finally, two methods for facial expression recognition are presented, either by using multi-class AdaBoost with dynamic time warping, or by using support vector machine on the boosted feature vectors. The results on the Cohn-Kanade (CK+) facial expression database show a recognition accuracy of 95.17% and 97.35% using multi-class AdaBoost and support vector  machines, respectively.<\/jats:p>","DOI":"10.3390\/s130607714","type":"journal-article","created":{"date-parts":[[2013,6,14]],"date-time":"2013-06-14T11:47:47Z","timestamp":1371210467000},"page":"7714-7734","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":234,"title":["Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector Machines"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8940-8739","authenticated-orcid":false,"given":"Deepak","family":"Ghimire","sequence":"first","affiliation":[{"name":"Division of Computer Engineering, Chonbuk National University, Jeonju-si, Jeollabuk-do 561-756, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joonwhoan","family":"Lee","sequence":"additional","affiliation":[{"name":"Division of Computer Engineering, Chonbuk National University, Jeonju-si, Jeollabuk-do 561-756, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2013,6,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1109\/TSMCB.2012.2200675","article-title":"Meta-analysis of the first facial expression recognition challenge","volume":"42","author":"Valstar","year":"2012","journal-title":"IEEE Trans. Syst. Man. Cybern. B Cybern."},{"key":"ref_2","first-page":"53","article-title":"Communication without words","volume":"2","author":"Mehrabian","year":"1968","journal-title":"Psychol. Today"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1037\/0033-2909.115.2.268","article-title":"Strong evidence of universal in facial expressions: A reply to Russell's mistaken critique","volume":"115","author":"Ekman","year":"1994","journal-title":"Psychol. Bull."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/0031-3203(92)90007-6","article-title":"Automatic recognition and analysis of human faces and facial expressions: A survey","volume":"25","author":"Samal","year":"1992","journal-title":"Pattern Recognit."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1424","DOI":"10.1109\/34.895976","article-title":"Automatic analysis of facial expressions: The state of the art","volume":"22","author":"Pantic","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/S0031-3203(02)00052-3","article-title":"Automatic facial expression analysis: A survey","volume":"36","author":"Fasel","year":"2003","journal-title":"Pattern Recognit."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1109\/TPAMI.2007.1110","article-title":"Dynamic texture recognition using local binary patterns with an application to facial expressions","volume":"29","author":"Zhao","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1016\/j.imavis.2008.08.005","article-title":"Facial expression recognition based on local binary patterns: A compressive study","volume":"27","author":"Shan","year":"2009","journal-title":"Image Vision Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"9573","DOI":"10.3390\/s111009573","article-title":"Facial expression recognition based on local binary patterns and kernel discriminant isomap","volume":"11","author":"Zhao","year":"2011","journal-title":"Sensors"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1016\/j.cviu.2010.12.001","article-title":"Local binary patterns for multi-view facial expression recognition","volume":"115","author":"Moore","year":"2011","journal-title":"Comput. Vision Image Underst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1016\/j.imavis.2011.07.002","article-title":"Facial expression recognition from near-infrared videos","volume":"11","author":"Zhao","year":"2011","journal-title":"Image Vision Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1166\/asl.2012.4257","article-title":"Histogram of orientation gradient feature-based facial expression classification using bagging with extreme learning machine","volume":"17","author":"Ghimire","year":"2012","journal-title":"Adv. Sci. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Dhall, A., Asthana, A., Goecke, R., and Gedeon, T. (2011, January 21\u201325). Emotion Recognition Using PHOG and LPQ Features. Santa Barbara, CA, USA.","DOI":"10.1109\/FG.2011.5771366"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"784","DOI":"10.4218\/etrij.10.1510.0132","article-title":"Robust facial expression recognition based on local directional pattern","volume":"32","author":"Jabid","year":"2010","journal-title":"ETRI J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/TSMCB.2010.2044788","article-title":"Graph-preserving sparse nonnegative matrix factorization with application to facial expression recognition","volume":"41","author":"Zhi","year":"2011","journal-title":"IEEE Trans. Syst. Man Cybernet.-Part. B Cybernet."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1016\/j.imavis.2007.11.004","article-title":"An analysis of facial expression recognition under partial facial image occlusion","volume":"26","author":"Kotsia","year":"2008","journal-title":"Image Vision Comput."},{"key":"ref_17","first-page":"1033","article-title":"Facial expression classification using PCA and hierarchical radial basic function network","volume":"22","author":"Lin","year":"2006","journal-title":"J. Inf. Sci. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wang, Z., and Ruan, Q. (2010, January 24\u201328). Facial Expression Recognition Based Orthogonal Local Fisher Discriminant Analysis. Beijing, China.","DOI":"10.1109\/ICOSP.2010.5656884"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1016\/j.imavis.2005.09.011","article-title":"Dynamics of facial expression extracted automatically from video","volume":"24","author":"Littlewort","year":"2006","journal-title":"Image Vision Comput."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Choi, H.-C., and Oh, S.-Y. (2006, January 18\u201321). Realtime Facial Expression Recognition Using Active Appearance Model and Multilayer Perceptron. Busan, Korea.","DOI":"10.1109\/SICE.2006.315594"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Asthana, A., Saragih, J., Wagner, M., and Goecke, R. (2009, January 10\u201312). Evaluating AAM Fitting Methods for Facial Expression Recognition. Amsterdam, The Netherlands.","DOI":"10.1109\/ACII.2009.5349489"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/TIP.2006.884954","article-title":"Facial expression recognition in image sequence using geometric deformation features and support vector machines","volume":"16","author":"Kotsia","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1856","DOI":"10.1016\/j.imavis.2005.12.021","article-title":"Authentic facial expression analysis","volume":"25","author":"Sebe","year":"2007","journal-title":"Image Vision Comput."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1313","DOI":"10.1016\/j.imavis.2008.11.010","article-title":"Real-time facial expression recognition using STAAM and layered GDA classifiers","volume":"27","author":"Sung","year":"2009","journal-title":"Image Vision Comput."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/j.imavis.2005.08.006","article-title":"Manifold based analysis of facial expression","volume":"24","author":"Chang","year":"2006","journal-title":"Image Vision Comput."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sandbach, G., Zafeiriou, S., Pantic, M., and Rueckert, D. (2012). Recognition of 3D facial expressions dynamics. Image Vision Comput, 762\u2013773.","DOI":"10.1016\/j.imavis.2012.01.006"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1357","DOI":"10.1109\/TPAMI.2012.233","article-title":"Coupled Gaussian processes for pose-invariant facial expression recognition","volume":"35","author":"Rudovic","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","unstructured":"Lyons, M., and Skamatsu, S. (1998, January 14\u201316). Coding Facial Expressions with Gabor Wavelets. Nara, Japan."},{"key":"ref_29","unstructured":"Zhang, Z., Lyons, M., Schuster, M., and Skamatsu, S. (1998, January 14\u201316). Comparison between Geometric-Based and Gabor-Wavelets-Based Facial Expression Recognition Using Multi-Layer Perceptron. Nara, Japan."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Huang, X., Zhao, G., Pietik\u00e4inen, M., and Zheng, W. (2010, January 13\u201316). Dynamic Facial Expression Recognition Using Boosted Component-Based Spatiotemporal Features and Multi-Classifier Fusion. Sydney, Australia.","DOI":"10.1007\/978-3-642-17691-3_29"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/TASSP.1978.1163055","article-title":"Dynamic programming algorithm optimization for spoken word recognition","volume":"26","author":"Sakoe","year":"1978","journal-title":"IEEE Trans. Acoust. Speech Signal. Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2169","DOI":"10.1016\/j.patcog.2008.11.030","article-title":"Faster retrieval with a two-pass dynamic-time-warping lower bound","volume":"42","author":"Lemire","year":"2009","journal-title":"Pattern Recognit."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1109\/12.210173","article-title":"Distortion invariant object recognition in the dynamic link architecture","volume":"42","author":"Lades","year":"1993","journal-title":"IEEE Trans. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1109\/34.598235","article-title":"Face recognition by elastic bunch graph matching","volume":"19","author":"Wiskott","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","unstructured":"Blome, D.S. (2003). Elastic Bunch Graph Matching. [M.Sc. Thesis, Colorado State University]."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust real-time face detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vision"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A decision-theoretic generalization of on-line learning and an application to boosting","volume":"55","author":"Freund","year":"1997","journal-title":"J. Comput. Syst. Sci."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Silapachote, P., Karuppiah, D.R., and Hanson, A.R. (2004, January 6\u20138). Feature Selection Using AdaBoost for Face Expression Recognition. Marbella, Spain.","DOI":"10.21236\/ADA438800"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Lajevardi, S.M., and Lech, M. (2008, January 26\u201328). Facial Expression Recognition from Image Sequence Using Optimized Feature Selection. Christchurch, New Zealand.","DOI":"10.1109\/IVCNZ.2008.4762113"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"349","DOI":"10.4310\/SII.2009.v2.n3.a8","article-title":"Multi-class AdaBoost","volume":"2","author":"Zhu","year":"2009","journal-title":"Stat Interface"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., and Ambadar, Z. (2010, January 13\u201318). The Extended Cohn-Kanade Dataset (CK+): A Complete Dataset for Action Unit and Emotion-Specified Expression. San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"ref_42","unstructured":"Chang, C.-C., and Lin, C.-J. Available online: http:\/\/www.csie.ntu.edu.tw\/\u223ccjlin\/libsvm."},{"key":"ref_43","unstructured":"Hsu, C.-W., Chang, C.-C., and Lin, C.-J. (2010). A Practical Guide to Support Vector Classification; Technical Report, Department of Computer Science, National Taiwan University."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1528","DOI":"10.1109\/TMM.2008.2007292","article-title":"Discriminant graph structures for facial expression recognition","volume":"10","author":"Zafeiriou","year":"2008","journal-title":"IEEE Trans. Multimed."},{"key":"ref_45","first-page":"3748","article-title":"Robust facial expression recognition via compressive sensing","volume":"12","author":"Zhang","year":"2012","journal-title":"Sensors"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/13\/6\/7714\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:47:21Z","timestamp":1760219241000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/13\/6\/7714"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,6,14]]},"references-count":45,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2013,6]]}},"alternative-id":["s130607714"],"URL":"https:\/\/doi.org\/10.3390\/s130607714","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,6,14]]}}}