{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T01:01:16Z","timestamp":1773882076827,"version":"3.50.1"},"reference-count":57,"publisher":"Wiley","license":[{"start":{"date-parts":[[2021,9,17]],"date-time":"2021-09-17T00:00:00Z","timestamp":1631836800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Computational Intelligence and Soft Computing"],"published-print":{"date-parts":[[2021,9,17]]},"abstract":"<jats:p>Facial expression is an important form of nonverbal communication, as it is noted that 55% of what humans communicate is expressed in facial expressions. There are several applications of facial expressions in diverse fields including medicine, security, gaming, and even business enterprises. Thus, currently, automatic facial expression recognition is a hotbed research area that attracts lots of grants and therefore the need to understand the trends very well. This study, as a result, aims to review selected published works in the domain of study and conduct valuable analysis to determine the most common and useful algorithms employed in the study. We selected published works from 2010 to 2021 and extracted, analyzed, and summarized the findings based on the most used techniques in feature extraction, feature selection, validation, databases, and classification. The result of the study indicates strongly that local binary pattern (LBP), principal component analysis (PCA), saturated vector machine (SVM), CK+, and 10-fold cross-validation are the most widely used feature extraction, feature selection, classifier, database, and validation method used, respectively. Therefore, in line with our findings, this study provides recommendations for research specifically for new researchers with little or no background as to which methods they can employ and strive to improve.<\/jats:p>","DOI":"10.1155\/2021\/9917246","type":"journal-article","created":{"date-parts":[[2021,9,18]],"date-time":"2021-09-18T17:50:08Z","timestamp":1631987408000},"page":"1-20","source":"Crossref","is-referenced-by-count":9,"title":["On Facial Expression Recognition Benchmarks"],"prefix":"10.1155","volume":"2021","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4670-1342","authenticated-orcid":true,"given":"Ebenezer","family":"Owusu","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Ghana, Accra, Ghana"}]},{"given":"Jacqueline Asor","family":"Kumi","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Ghana, Accra, Ghana"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2798-4524","authenticated-orcid":true,"given":"Justice Kwame","family":"Appati","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Ghana, Accra, Ghana"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"crossref","DOI":"10.1037\/10001-000","volume-title":"The Expression of the Emotions in Man and Animals","author":"C. Darwin","year":"1872"},{"key":"2","doi-asserted-by":"crossref","article-title":"Emotion recognition in speech signal: experimental study, development, and application","author":"V. A. Petrushin","DOI":"10.21437\/ICSLP.2000-791"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1541\/ieejjournal.125.641"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.2307\/3424476"},{"issue":"3","key":"5","first-page":"279","article-title":"Assessment & measurement of anger in behavioral and social sciences: a systematic review of literature","volume":"2","author":"A. M. Shahsavarani","year":"2015","journal-title":"International Journal of Medical Reviews"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2019.101646"},{"key":"7","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-28099-8_495-1"},{"key":"8","first-page":"104","article-title":"Emotion classification of news headlines using SVM","volume":"5","author":"D. K. Kirange","year":"2012","journal-title":"Asian Journal of Computer Science and Information Technology"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1109\/ICEECCOT.2016.7955211"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-6916.2007.00044.x"},{"key":"11","doi-asserted-by":"crossref","DOI":"10.1016\/B978-0-12-803637-2.00011-7","volume-title":"A Review of Emotion-Aware Systems for E-Learning in Virtual Environments","author":"M. Feidakis","year":"2016"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2018.2797176"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1109\/ICCES45898.2019.9002175"},{"key":"14","first-page":"203","article-title":"Some referents and measures of nonverbal behavior","volume-title":"Behavior Research Methods and Instrumentation","author":"A. Mehrabian","year":"1968"},{"key":"15","article-title":"Human computing and machine understanding of human behaviour","author":"M. Pantic","year":"2007"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1016\/b978-0-12-804490-2.00006-3"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2015.2498174"},{"key":"18","volume-title":"Affect Measurement: A Roadmap Through Approaches, Technologies and Data Analysis","author":"J. Gonzalez-sanchez","year":"2017"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1109\/CONFLUENCE.2016.7508167"},{"key":"20","doi-asserted-by":"publisher","DOI":"10.1109\/ICIINFS.2015.7399039"},{"key":"21","doi-asserted-by":"crossref","DOI":"10.5772\/4847","volume-title":"Machine Analysis of Facial Expressions","author":"M. Pantic","year":"2007"},{"issue":"3","key":"22","first-page":"1","article-title":"Geometric and appearance feature analysis for facial expression recognition","volume":"5","author":"S. Dhall","year":"2014","journal-title":"International Journal of Advances in Engineering & Technology"},{"key":"23","first-page":"151","article-title":"Universal-facial-expressions-of-emotions","volume":"8","author":"P. Ekman","year":"1970","journal-title":"California Mental Health Research Digest"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295x.97.3.315"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.1007\/BF00354055"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.38.2.311"},{"key":"27"},{"key":"28","article-title":"Machine audition: principles, algorithms and systems, chapter 8","author":"S. Haq","year":"2010"},{"key":"29","volume-title":"Facial Expression","author":"P. Ekman","year":"1977"},{"key":"30","volume-title":"Automatic Facial Expression Recognition","author":"H. G. Valero","year":"2016"},{"key":"31","unstructured":"KitchenhamB.Procedures for performing systematic literature reviews2004Keele, UKKeele UniversityTechnical report"},{"issue":"7","key":"32","first-page":"171","article-title":"A comprehensive survey on human facial expression detection","volume":"7","author":"A. Verma","year":"2013","journal-title":"International Journal of Image Processing"},{"issue":"12","key":"33","first-page":"4647","article-title":"A survey on facial expression analysis for emotion recognition","volume":"2","author":"A. Lonare","year":"2013","journal-title":"International Journal of Advanced Research in Computer and Communication Engineering"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.3390\/sym11101189"},{"key":"35","doi-asserted-by":"publisher","DOI":"10.1080\/02564602.2015.1117403"},{"key":"36","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAS.2019.8703619"},{"key":"37","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAS.2019.8703521"},{"key":"38","doi-asserted-by":"publisher","DOI":"10.5121\/ijcses.2014.5203"},{"key":"39","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.08.011"},{"key":"40","doi-asserted-by":"publisher","DOI":"10.14257\/ijsip.2016.9.6.13"},{"key":"41","doi-asserted-by":"publisher","DOI":"10.1016\/j.jksuci.2018.09.002"},{"issue":"12","key":"42","first-page":"1336","article-title":"Facial expression recognition and analysis techniques","volume":"8","author":"V. Mokaya","year":"2018","journal-title":"International Journal of Management, Technology and Engineering"},{"key":"43","doi-asserted-by":"publisher","DOI":"10.3390\/app9214678"},{"key":"44","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2011.09.002"},{"key":"45","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2007.1001"},{"key":"46","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2008.01.006"},{"key":"47","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2014.11.023"},{"key":"48","doi-asserted-by":"publisher","DOI":"10.3390\/healthcare6020054"},{"key":"49","doi-asserted-by":"publisher","DOI":"10.1109\/ICMCS.2016.7905642"},{"key":"50","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2008.08.005"},{"key":"51","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.07.074"},{"key":"52","doi-asserted-by":"publisher","DOI":"10.1016\/0031-3203(95)00067-4"},{"key":"53","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2019.103375"},{"key":"54","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2016.12.002"},{"key":"55","doi-asserted-by":"publisher","DOI":"10.1109\/ICCMC.2017.8282636"},{"key":"56","first-page":"13","article-title":"Cross-validation","volume-title":"Australasian Institute of Mining and Metallurgy Publication Series","author":"P. Refaeilzadeh","year":"2005"},{"key":"57","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7496.003.0016"}],"container-title":["Applied Computational Intelligence and Soft Computing"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/acisc\/2021\/9917246.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/acisc\/2021\/9917246.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/acisc\/2021\/9917246.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,9]],"date-time":"2023-01-09T17:05:32Z","timestamp":1673283932000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/acisc\/2021\/9917246\/"}},"subtitle":[],"editor":[{"given":"Ridha","family":"Ejbali","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2021,9,17]]},"references-count":57,"alternative-id":["9917246","9917246"],"URL":"https:\/\/doi.org\/10.1155\/2021\/9917246","relation":{},"ISSN":["1687-9732","1687-9724"],"issn-type":[{"value":"1687-9732","type":"electronic"},{"value":"1687-9724","type":"print"}],"subject":[],"published":{"date-parts":[[2021,9,17]]}}}