{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T21:02:20Z","timestamp":1790197340489,"version":"4.1.0"},"reference-count":44,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,11,30]],"date-time":"2020-11-30T00:00:00Z","timestamp":1606694400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Several studies on micro-expression recognition have contributed mainly to accuracy improvement. However, the computational complexity receives lesser attention comparatively and therefore increases the cost of micro-expression recognition for real-time application. In addition, majority of the existing approaches required at least two frames (i.e., onset and apex frames) to compute features of every sample. This paper puts forward new facial graph features based on 68-point landmarks using Facial Action Coding System (FACS). The proposed feature extraction technique (FACS-based graph features) utilizes facial landmark points to compute graph for different Action Units (AUs), where the measured distance and gradient of every segment within an AU graph is presented as feature. Moreover, the proposed technique processes ME recognition based on single input frame sample. Results indicate that the proposed FACS-baed graph features achieve up to 87.33% of recognition accuracy with F1-score of 0.87 using leave one subject out cross-validation on SAMM datasets. Besides, the proposed technique computes features at the speed of 2 ms per sample on Xeon Processor E5-2650 machine.<\/jats:p>","DOI":"10.3390\/jimaging6120130","type":"journal-article","created":{"date-parts":[[2020,11,30]],"date-time":"2020-11-30T10:26:12Z","timestamp":1606731972000},"page":"130","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["FACS-Based Graph Features for Real-Time Micro-Expression Recognition"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7494-9820","authenticated-orcid":false,"given":"Adamu Muhammad","family":"Buhari","sequence":"first","affiliation":[{"name":"Faculty of Engineering, Multimedia University, Persiaran Multimedia, Cyberjaya 63100, Selangor, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2868-8866","authenticated-orcid":false,"given":"Chee-Pun","family":"Ooi","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Multimedia University, Persiaran Multimedia, Cyberjaya 63100, Selangor, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6809-5817","authenticated-orcid":false,"given":"Vishnu Monn","family":"Baskaran","sequence":"additional","affiliation":[{"name":"School of Information Technology, Monash University Malaysia, Subang Jaya 47500, Selangor, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7448-4595","authenticated-orcid":false,"given":"Rapha\u00ebl C. W.","family":"Phan","sequence":"additional","affiliation":[{"name":"School of Information Technology, Monash University Malaysia, Subang Jaya 47500, Selangor, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4893-2291","authenticated-orcid":false,"given":"KokSheik","family":"Wong","sequence":"additional","affiliation":[{"name":"School of Information Technology, Monash University Malaysia, Subang Jaya 47500, Selangor, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0436-0391","authenticated-orcid":false,"given":"Wooi-Haw","family":"Tan","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Multimedia University, Persiaran Multimedia, Cyberjaya 63100, Selangor, Malaysia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,30]]},"reference":[{"key":"ref_1","unstructured":"Ekman, P. (2012). Emotions Revealed: Understanding Faces and Feelings, Hachette."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1007\/s10979-008-9166-4","article-title":"Police lie detection accuracy: The effect of lie scenario","volume":"33","author":"Frank","year":"2009","journal-title":"Law Hum. Behav."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, X., Pfister, T., Huang, X., Zhao, G., and Pietik\u00e4inen, M. (2013, January 22\u201326). A spontaneous micro-expression database: Inducement, collection and baseline. Proceedings of the 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Shanghai, China.","DOI":"10.1109\/FG.2013.6553717"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Davison, A.K., Yap, M.H., and Lansley, C. (2015, January 9\u201312). Micro-facial movement detection using individualised baselines and histogram-based descriptors. Proceedings of the 2015 IEEE International Conference on Systems, Man, and Cybernetics, Hong Kong, China.","DOI":"10.1109\/SMC.2015.326"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Chaudhry, R., Ravichandran, A., Hager, G., and Vidal, R. (2009, January 20\u201325). Histograms of oriented optical flow and binet-cauchy kernels on nonlinear dynamical systems for the recognition of human actions. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206821"},{"key":"ref_6","first-page":"89","article-title":"Comparison of 2D and 3D local binary pattern in lung cancer diagnosis","volume":"3","author":"Arai","year":"2012","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_7","unstructured":"Hong, X., Xu, Y., and Zhao, G. (2016). Lbp-top: A tensor unfolding revisit. Asian Conference on Computer Vision, Springer."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Soh, X.R., Baskaran, V.M., Buhari, A.M., and Phan, R.C.W. (2017, January 12\u201315). A real time micro-expression detection system with LBP-TOP on a many-core processor. Proceedings of the 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Kuala Lumpur, Malaysia.","DOI":"10.1109\/APSIPA.2017.8282041"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Polikovsky, S., Kameda, Y., and Ohta, Y. (2009, January 3). Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor. Proceedings of the 3rd International Conference on Imaging for Crime Detection and Prevention (ICDP 2009), London, UK.","DOI":"10.1049\/ic.2009.0244"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ekman, P., and Friesen, W.V. (1978). Facial Action Coding System: Investigator\u2019s Guide, Consulting Psychologists Press.","DOI":"10.1037\/t27734-000"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Davison, A., Merghani, W., Lansley, C., Ng, C.C., and Yap, M.H. (2018, January 15\u201319). Objective micro-facial movement detection using facs-based regions and baseline evaluation. Proceedings of the 2018 13th IEEE international conference on automatic face & gesture recognition (FG 2018), Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00101"},{"key":"ref_12","first-page":"1719","article-title":"Fast Calculation of Histogram of Oriented Gradient Feature by Removing Redundancy in Overlapping Block","volume":"30","author":"Kim","year":"2014","journal-title":"J. Inf. Sci. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.image.2017.11.006","article-title":"Less is more: Micro-expression recognition from video using apex frame","volume":"62","author":"Liong","year":"2018","journal-title":"Signal Process. Image Commun."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, S., Feng, B., Chen, Z., and Huang, X. (2017, January 4\u20136). Micro-expression recognition by aggregating local spatio-temporal patterns. Proceedings of the International Conference on Multimedia Modeling, Reykjavik, Iceland.","DOI":"10.1007\/978-3-319-51811-4_52"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.image.2019.02.005","article-title":"OFF-ApexNet on micro-expression recognition system","volume":"74","author":"Gan","year":"2019","journal-title":"Signal Process. Image Commun."},{"key":"ref_16","unstructured":"Davison, A.K. (2016). Micro-Facial Movement Detection Using Spatio-Temporal Features. [Ph.D. Thesis, Manchester Metropolitan University]."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Datta, S., Sen, D., and Balasubramanian, R. (2017, January 11\u201315). Integrating geometric and textural features for facial emotion classification using SVM frameworks. Proceedings of the International Conference on Computer Vision and Image, Catania, Italy.","DOI":"10.1007\/978-981-10-2104-6_55"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jeong, M., and Ko, B.C. (2018). Driver\u2019s Facial Expression Recognition in Real-Time for Safe Driving. Sensors, 18.","DOI":"10.3390\/s18124270"},{"key":"ref_19","unstructured":"Suja, P., and Tripathi, S. (2016, January 11\u201312). Real-time emotion recognition from facial images using Raspberry Pi II. Proceedings of the 2016 3rd International Conference on Signal Processing and Integrated Networks (SPIN), Noida, India."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1128","DOI":"10.3389\/fpsyg.2018.01128","article-title":"A Survey of Automatic Facial Micro-expression Analysis: Databases, Methods and Challenges","volume":"9","author":"Oh","year":"2018","journal-title":"Front. Psychol."},{"key":"ref_21","unstructured":"Chavali, G.K., Bhavaraju, S.K.N., Adusumilli, T., and Puripanda, V. (2020, January 25). Micro-Expression Extraction For Lie Detection Using Eulerian Video (Motion and Color) Magnication. Available online: https:\/\/www.diva-portal.org\/smash\/record.jsf?pid=diva2%3A830774&dswid=5070."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Liong, S.T., Phan, R.C.W., See, J., Oh, Y.H., and Wong, K. (2014, January 1\u20134). Optical strain based recognition of subtle emotions. Proceedings of the 2014 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), Kuching, Malaysia.","DOI":"10.1109\/ISPACS.2014.7024448"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Le Ngo, A.C., Oh, Y.H., Phan, R.C.W., and See, J. (2016, January 20\u201325). Eulerian emotion magnification for subtle expression recognition. Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China.","DOI":"10.1109\/ICASSP.2016.7471875"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Davison, A.K., Merghani, W., and Yap, M.H. (2018). Objective classes for micro-facial expression recognition. J. Imaging, 4.","DOI":"10.3390\/jimaging4100119"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tian, Y.l., Kanade, T., and Colin, J.F. (2002). Recognizing action units for facial expression analysis. Multimodal Interface for Human-Machine Communication, World Scientific.","DOI":"10.1142\/9789812778543_0002"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Tanchotsrinon, C., Phimoltares, S., and Maneeroj, S. (2011, January 17\u201318). Facial expression recognition using graph-based features and artificial neural networks. Proceedings of the 2011 IEEE International Conference on Imaging Systems and Techniques, Batu Ferringhi, Malaysia.","DOI":"10.1109\/IST.2011.5962229"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hsu, F.S., Lin, W.Y., and Tsai, T.W. (November, January 29). Automatic facial expression recognition for affective computing based on bag of distances. Proceedings of the 2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, Kaohsiung, Taiwan.","DOI":"10.1109\/APSIPA.2013.6694238"},{"key":"ref_28","unstructured":"Liong, S.T., See, J., Phan, R.C.W., Le Ngo, A.C., Oh, Y.H., and Wong, K. (2014). Subtle expression recognition using optical strain weighted features. Asian Conference on Computer Vision, Springer."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/TMM.2019.2931351","article-title":"Spatiotemporal recurrent convolutional networks for recognizing spontaneous micro-expressions","volume":"22","author":"Xia","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liong, S.T., Gan, Y., See, J., Khor, H.Q., and Huang, Y.C. (2019, January 14\u201318). Shallow triple stream three-dimensional cnn (ststnet) for micro-expression recognition. Proceedings of the 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019), Lille, France.","DOI":"10.1109\/FG.2019.8756567"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1007\/s11633-014-0835-0","article-title":"Feature representation for facial expression recognition based on FACS and LBP","volume":"11","author":"Wang","year":"2014","journal-title":"Int. J. Autom. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jvcir.2019.04.009","article-title":"Facial expression recognition via region-based convolutional fusion network","volume":"62","author":"Ye","year":"2019","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_33","first-page":"1755","article-title":"Dlib-ml: A machine learning toolkit","volume":"10","author":"King","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Feng, Z.H., Kittler, J., Awais, M., Huber, P., and Wu, X.J. (2017, January 21\u201326). Face detection, bounding box aggregation and pose estimation for robust facial landmark localisation in the wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.262"},{"key":"ref_35","unstructured":"Yan, W.J., Wu, Q., Liu, Y.J., Wang, S.J., and Fu, X. (2013, January 22\u201326). CASME database: A dataset of spontaneous micro-expressions collected from neutralized faces. Proceedings of the 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Shanghai, China."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Yan, W.J., Li, X., Wang, S.J., Zhao, G., Liu, Y.J., Chen, Y.H., and Fu, X. (2014). CASME II: An improved spontaneous micro-expression database and the baseline evaluation. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0086041"},{"key":"ref_37","unstructured":"Merghani, W., Davison, A.K., and Yap, M.H. (2018). A Review on Facial Micro-Expressions Analysis: Datasets, Features and Metrics. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1109\/TAFFC.2016.2573832","article-title":"Samm: A spontaneous micro-facial movement dataset","volume":"9","author":"Davison","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1109\/TAFFC.2017.2654440","article-title":"CAS(ME)2: A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition","volume":"9","author":"Qu","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1109\/TAFFC.2016.2518162","article-title":"Microexpression identification and categorization using a facial dynamics map","volume":"8","author":"Xu","year":"2017","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1016\/j.neucom.2015.10.096","article-title":"Spontaneous facial micro-expression analysis using spatiotemporal completed local quantized patterns","volume":"175","author":"Huang","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Liong, S.T., and Wong, K. (2017, January 12\u201315). Micro-expression recognition using apex frame with phase information. Proceedings of the 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Kuala Lumpur, Malaysia.","DOI":"10.1109\/APSIPA.2017.8282090"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1007\/s11265-017-1276-0","article-title":"Hybrid facial regions extraction for micro-expression recognition system","volume":"90","author":"Liong","year":"2018","journal-title":"J. Signal Process. Syst."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Danescu, R., Borza, D., and Itu, R. (2018). Detecting Micro-Expressions in Real Time Using High-Speed Video Sequences. Intelligent Video Surveillance, IntechOpen.","DOI":"10.5772\/intechopen.76155"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/6\/12\/130\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:39:44Z","timestamp":1760179184000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/6\/12\/130"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,30]]},"references-count":44,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["jimaging6120130"],"URL":"https:\/\/doi.org\/10.3390\/jimaging6120130","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,30]]}}}