{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T22:29:39Z","timestamp":1779402579161,"version":"3.53.1"},"reference-count":49,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2021,1,12]],"date-time":"2021-01-12T00:00:00Z","timestamp":1610409600000},"content-version":"vor","delay-in-days":11,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012221","name":"Jinling Institute of Technology","doi-asserted-by":"publisher","award":["jit-b-201704"],"award-info":[{"award-number":["jit-b-201704"]}],"id":[{"id":"10.13039\/501100012221","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["31700993"],"award-info":[{"award-number":["31700993"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U1733122"],"award-info":[{"award-number":["U1733122"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Computational Intelligence and Neuroscience"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>Emotion plays an important role in communication. For human\u2013computer interaction, facial expression recognition has become an indispensable part. Recently, deep neural networks (DNNs) are widely used in this field and they overcome the limitations of conventional approaches. However, application of DNNs is very limited due to excessive hardware specifications requirement. Considering low hardware specifications used in real\u2010life conditions, to gain better results without DNNs, in this paper, we propose an algorithm with the combination of the oriented FAST and rotated BRIEF (ORB) features and Local Binary Patterns (LBP) features extracted from facial expression. First of all, every image is passed through face detection algorithm to extract more effective features. Second, in order to increase computational speed, the ORB and LBP features are extracted from the face region; specifically, region division is innovatively employed in the traditional ORB to avoid the concentration of the features. The features are invariant to scale and grayscale as well as rotation changes. Finally, the combined features are classified by Support Vector Machine (SVM). The proposed method is evaluated on several challenging databases such as Cohn\u2010Kanade database (CK+), Japanese Female Facial Expressions database (JAFFE), and MMI database; experimental results of seven emotion state (neutral, joy, sadness, surprise, anger, fear, and disgust) show that the proposed framework is effective and accurate.<\/jats:p>","DOI":"10.1155\/2021\/8828245","type":"journal-article","created":{"date-parts":[[2021,1,13]],"date-time":"2021-01-13T04:05:06Z","timestamp":1610510706000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":84,"title":["Facial Expression Recognition with LBP and ORB Features"],"prefix":"10.1155","volume":"2021","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6802-1826","authenticated-orcid":false,"given":"Ben","family":"Niu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenxing","family":"Gao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bingbing","family":"Guo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2021,1,12]]},"reference":[{"key":"e_1_2_10_1_2","first-page":"53","article-title":"Communication without words","volume":"2","author":"Mehrabian A.","year":"1968","journal-title":"Psychology Today"},{"key":"e_1_2_10_2_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0032321"},{"key":"e_1_2_10_3_2","doi-asserted-by":"crossref","unstructured":"DornaikaF.andRaducanuB. Efficient facial expression recognition for human robot interaction Proceedings of the 9th International Work-Conference onArtificial Networks on Computational and Ambient Intelligence June 2007 San Sebasti\u00e1n Spain 700\u2013708.","DOI":"10.1007\/978-3-540-73007-1_84"},{"key":"e_1_2_10_4_2","doi-asserted-by":"crossref","unstructured":"BartneckC.andLyonsM. J. HCI and the face: towards an art of the soluble Proceedings of the International Comference on Human-Computer Interaction: Interaction Design and Usability July 2017 Beijing China 20\u201329.","DOI":"10.1007\/978-3-540-73105-4_3"},{"key":"e_1_2_10_5_2","unstructured":"HicksonS. DufourN. SudA. KwatraV. andEssaI. A. Eyemotion: classifying facial expressions in VR using eye-tracking cameras 2017 https:\/\/arxiv.org\/abs\/1707.07204."},{"key":"e_1_2_10_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ridd.2014.10.015"},{"key":"e_1_2_10_7_2","doi-asserted-by":"crossref","unstructured":"AssariM. A.andRahmatiM. Driver drowsiness detection using face expression recognition Proceedings of the IEEE International Conference on Signal and Image Processing Applications November 2011 Kuala Lumpur Malaysia 337\u2013341.","DOI":"10.1109\/ICSIPA.2011.6144162"},{"key":"e_1_2_10_8_2","doi-asserted-by":"publisher","DOI":"10.1155\/2008\/542918"},{"key":"e_1_2_10_9_2","doi-asserted-by":"crossref","unstructured":"Mour\u00e1oA.andMagalh\u00e1esJ. Competitive affective gaming: winning with a smile Proceedings of the ACM International Conference on Multimedia October 2013 Barcelona Spain 83\u201392.","DOI":"10.1145\/2502081.2502115"},{"key":"e_1_2_10_10_2","doi-asserted-by":"crossref","unstructured":"ZhaoK. ChuW. S. andZhangH. Deep region and multi-label learning for facial action unit detection Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) June 2016 Las Vegas NV USA 3391\u20133339.","DOI":"10.1109\/CVPR.2016.369"},{"key":"e_1_2_10_11_2","doi-asserted-by":"publisher","DOI":"10.1023\/b:visi.0000013087.49260.fb"},{"key":"e_1_2_10_12_2","unstructured":"KahouS. E. MichalskiV. andKondaK. Recurrent neural networks for emotion recognition in video Proceedings of the ACM on International Conference Multimodal Interaction November 2015 Seattle WA USA 467\u2013474."},{"key":"e_1_2_10_13_2","doi-asserted-by":"crossref","unstructured":"WaleckiR. RudovicO. PavlovicV. andSchullerB. Deep structured learning for facial expression intensity estimation 259 Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) July 2017 Honolulu HI USA 143\u2013154.","DOI":"10.1109\/CVPR.2017.605"},{"key":"e_1_2_10_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/access.2018.2858278"},{"key":"e_1_2_10_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/tifs.2020.3007327"},{"key":"e_1_2_10_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/tip.2020.2972114"},{"key":"e_1_2_10_17_2","doi-asserted-by":"publisher","DOI":"10.1049\/iet-ipr.2018.5683"},{"key":"e_1_2_10_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-017-2634-3"},{"key":"e_1_2_10_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/taffc.2016.2593719"},{"key":"e_1_2_10_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/tip.2017.2726010"},{"key":"e_1_2_10_21_2","doi-asserted-by":"publisher","DOI":"10.3390\/s17040712"},{"key":"e_1_2_10_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-3418-y"},{"key":"e_1_2_10_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-018-6040-3"},{"key":"e_1_2_10_24_2","doi-asserted-by":"publisher","DOI":"10.1049\/iet-ipr.2015.0519"},{"key":"e_1_2_10_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2018.05.024"},{"key":"e_1_2_10_26_2","doi-asserted-by":"publisher","DOI":"10.1049\/iet-ipr.2018.6235"},{"key":"e_1_2_10_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11760-019-01547-9"},{"key":"e_1_2_10_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04138-4"},{"key":"e_1_2_10_29_2","doi-asserted-by":"crossref","unstructured":"DongJ. ZhengH. andLianL. Dynamic facial expression recognition based on convolutional neural networks with dense connections Proceedings of the International Conference on Pattern Recognition 2018 Stockholm Sweden 3433\u20133438.","DOI":"10.1109\/ICPR.2018.8545596"},{"key":"e_1_2_10_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2019.106966"},{"key":"e_1_2_10_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2020.01.016"},{"key":"e_1_2_10_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/tmm.2020.2966858"},{"key":"e_1_2_10_33_2","doi-asserted-by":"crossref","unstructured":"WangK. PengX. YangJ. LuS. andQiaoY. Suppressing uncertainties for large-scale facial expression recognition 2020 https:\/\/arxiv.org\/abs\/2002.10392.","DOI":"10.1109\/CVPR42600.2020.00693"},{"key":"e_1_2_10_34_2","first-page":"1755","article-title":"Dlib-ml: a machine learning toolkit","volume":"10","author":"King D. E.","year":"2009","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_10_35_2","doi-asserted-by":"crossref","unstructured":"KazemiV.andSullivanJ. One millisecond face alignment with an ensemble of regression trees Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition June 2014 Columbus OH USA 1867\u20131874.","DOI":"10.1109\/CVPR.2014.241"},{"key":"e_1_2_10_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/0031-3203(95)00067-4"},{"key":"e_1_2_10_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2002.1017623"},{"key":"e_1_2_10_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2000.903698"},{"key":"e_1_2_10_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2008.08.005"},{"key":"e_1_2_10_40_2","doi-asserted-by":"crossref","unstructured":"RubleeE. RabaudV. andKonoligeK. ORB: an efficient alternative to SIFT or SURF Proceedings of the International Conference of Computer Vision November 2011 Barcelona Spain 2564\u20132571.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"e_1_2_10_41_2","unstructured":"LyonsM. AkemastuS. andKamachiM. Coding facial expressions with gabor wavelets Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition April 1998 Nara Japan 200\u2013205."},{"key":"e_1_2_10_42_2","unstructured":"KanadeT. CohnJ. F. andTianY. Comprehensive database for facial expression analysis Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition March 2000 Grenoble France 46\u201353."},{"key":"e_1_2_10_43_2","doi-asserted-by":"crossref","unstructured":"LuceyP. CohnF. andKanadeT. The Extended Cohn-Kanade Dataset (CK+): a complete expression dataset for action unit and emotion-specified expression Proceedings of the Third International Workshop on CVPR for Human Communicative Behavior Analysis (CVPR4HB 2010) 2010 San Francisco CA USA 94\u2013101.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"e_1_2_10_44_2","unstructured":"PanticM. ValstarM. andRademakerR. Web-based database for facial expression analysis Proceedings of the IEEE International Conference on Multimedia & Expo (ICME) 2005 Amsterdam Netherlands."},{"key":"e_1_2_10_45_2","unstructured":"ValstarM.andPanticM. Induced disgust happiness and surprise: an addition to the mmi facial expression database Proceedings of the Third International Workshop on EMOTION (Satellite of LREC): Corpora for Research on Emotion and Affect May 2010 Valletta Malta."},{"key":"e_1_2_10_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"e_1_2_10_47_2","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/3587036"},{"key":"e_1_2_10_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2019.01.002"},{"key":"e_1_2_10_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.12.037"}],"container-title":["Computational Intelligence and Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2021\/8828245.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2021\/8828245.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2021\/8828245","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T11:38:14Z","timestamp":1722944294000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2021\/8828245"}},"subtitle":[],"editor":[{"given":"Jos\u00e9 Alfredo","family":"Hern\u00e1ndez-P\u00e9rez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":49,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1155\/2021\/8828245"],"URL":"https:\/\/doi.org\/10.1155\/2021\/8828245","archive":["Portico"],"relation":{},"ISSN":["1687-5265","1687-5273"],"issn-type":[{"value":"1687-5265","type":"print"},{"value":"1687-5273","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1]]},"assertion":[{"value":"2020-05-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-12-31","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-01-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"8828245"}}