{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T03:24:27Z","timestamp":1769570667144,"version":"3.49.0"},"reference-count":34,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2018,6,26]],"date-time":"2018-06-26T00:00:00Z","timestamp":1529971200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Facial palsy caused by nerve damage results in loss of facial symmetry and expression. A reliable palsy grading system for large-scale applications is still missing in the literature. Although numerous approaches have been reported on facial palsy quantification and grading, most employ hand-crafted features on relatively smaller datasets which limit the classification accuracy due to non-optimal face representation. In contrast, convolutional neural networks (CNNs) automatically learn the discriminative features facilitating the accurate classification of underlying tasks. In this paper, we propose to apply a typical deep network on a large dataset to extract palsy-specific features from face images. To prevent the inherent limitation of overfitting frequently occurring in CNNs, a generative adversial network (GAN) is applied to augment the training dataset. The deeply learned features are then used to classify the palsy disease into five benchmarked grades. The experimental results show that the proposed approach offers superior palsy grading performance compared to some existing methods. Such an approach is useful for palsy grading at large scale, such as primary health care.<\/jats:p>","DOI":"10.3390\/sym10070242","type":"journal-article","created":{"date-parts":[[2018,6,26]],"date-time":"2018-06-26T10:40:50Z","timestamp":1530009650000},"page":"242","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":47,"title":["Automatic Grading of Palsy Using Asymmetrical Facial Features: A Study Complemented by New Solutions"],"prefix":"10.3390","volume":"10","author":[{"given":"Muhammad","family":"Sajid","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, Mirpur University of Science and Technology (MUST), Mirpur 10250 (AJK), Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tamoor","family":"Shafique","sequence":"additional","affiliation":[{"name":"Faculty of Computing, Engineering and Science, Staffordshire University, Stoke-on-Trent ST4 2DE, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mirza Jabbar Aziz","family":"Baig","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering (Power), Mirpur University of Science and Technology, Mirpur 10250 (AJK), Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Imran","family":"Riaz","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Mirpur University of Science and Technology (MUST), Mirpur 10250 (AJK), Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shahid","family":"Amin","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Mirpur University of Science and Technology (MUST), Mirpur 10250 (AJK), Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9880-6090","authenticated-orcid":false,"given":"Sohaib","family":"Manzoor","sequence":"additional","affiliation":[{"name":"School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,6,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"26757","DOI":"10.3390\/s151026756","article-title":"A smartphone-based automatic diagnosis system for facial nerve palsy","volume":"15","author":"Kim","year":"2015","journal-title":"Sensors"},{"key":"ref_2","first-page":"2751","article-title":"Automatic recognition of facial movement for paralyzed face","volume":"24","author":"Wang","year":"2014","journal-title":"Biomed. Mater. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1864","DOI":"10.1109\/TBME.2009.2017508","article-title":"Quantitative analysis of facial paralysis using local binary patterns in biomedical videos","volume":"56","author":"He","year":"2009","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Delannoy, J.R., and Ward, T.E. (2010, January 23\u201324). A preliminary investigation into the use of machine vision techniques for automating facial paralysis rehabilitation therapy. Proceedings of the IET Irish Signals and Systems Conference (ISSC 2010), Cork, Ireland.","DOI":"10.1049\/cp.2010.0517"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1016\/S0140-6736(08)61409-9","article-title":"Primary health care: Making Alma-Ata a reality","volume":"372","author":"Walley","year":"2008","journal-title":"Lancet"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.procs.2015.03.090","article-title":"Segmentation and classification of skin lesions for disease diagnosis","volume":"45","author":"Sumithra","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1017","DOI":"10.1016\/j.patcog.2008.09.006","article-title":"A narrow band graph partitioning method for skin lesion segmentation","volume":"42","author":"Yuan","year":"2009","journal-title":"Pattern Recognit."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Manoorkar, P.B., Kamat, D.K., and Patil, P.M. (2016, January 9\u201310). Analysis and classification of human skin diseases. Proceedings of the 2016 International Conference on Automatic Control and Dynamic Optimization Techniques (ICACDOT), Pune, India.","DOI":"10.1109\/ICACDOT.2016.7877750"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"648","DOI":"10.3844\/jcssp.2010.648.652","article-title":"Psoriasis detection using skin color and texture features","volume":"6","author":"Dahir","year":"2010","journal-title":"J. Comput. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ciregan, D., Meier, U., and Schmidhuber, J. (2012, January 16\u201321). Multi-column deep neural networks for image classification. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248110"},{"key":"ref_11","unstructured":"Sermanet, P., Chintala, S., and LeCun, Y. (2012, January 11\u201315). Convolutional neural networks applied to house numbers digit classification. Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), Tsukuba, Japan."},{"key":"ref_12","unstructured":"McGrenary, S., O\u2019Reilly, B.F., and Soraghan, J.J. (2005, January 23\u201324). Objective grading of facial paralysis using artificial intelligence analysis of video data. Proceedings of the 18th IEEE Symposium on Computer-Based Medical Systems, Dublin, Ireland."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1186\/s13637-016-0048-7","article-title":"Detecting visually observable disease symptoms from faces","volume":"2016","author":"Wang","year":"2016","journal-title":"EURASIP J. Bioinf. Syst. Biol."},{"key":"ref_14","unstructured":"Liao, H., Li, Y., and Luo, J. (2016, January 4\u20138). Skin disease classification versus skin lesion characterization: Achieving robust diagnosis using multi-label deep neural networks. Proceedings of the International Conference on Pattern Recognition, Cancun, Mexico."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ge, Z., Demyanov, S., Bozorgtabar, B., Abedini, M., Chakravorty, R., Bowling, A., and Garnavi, R. (2017, January 18\u201321). Exploiting local and generic features for accurate skin lesions classification using clinical and dermoscopy imaging. Proceedings of the 14th International Symposium on Biomedical Imaging, Melbourne, VIC, Australia.","DOI":"10.1109\/ISBI.2017.7950681"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5839","DOI":"10.1038\/s41598-018-24204-6","article-title":"An automatic diagnosis method of facial acne ulgaris based on convolutional neural network","volume":"8","author":"Shen","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_17","unstructured":"Goldberg, C., and Catalog of Clinical Images (2018, May 25). UCSD School of Medicine and VA Medical Center. Available online: http:\/\/meded.ucsd.edu\/clinicalimg\/."},{"key":"ref_18","unstructured":"(2018, May 20). The Primary Care Dermatology Society (PCDS). Available online: http:\/\/www.pcds.org.uk."},{"key":"ref_19","unstructured":"Wang, K., and Luo, J. (2018, May 20). Clinical Images for Symptoms on Face, University of Rochester. Available online: http:\/\/tinyurl.com\/h77ty86."},{"key":"ref_20","unstructured":"Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R.R. (arXiv, 2012). Improving neural networks by preventing co-adaptation of feature detectors, arXiv."},{"key":"ref_21","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201313). Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.123"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1177\/019459988509300202","article-title":"Facial nerve grading system","volume":"93","author":"House","year":"1985","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"ref_24","first-page":"2672","article-title":"Generative Adversarial Nets","volume":"27","author":"Goodfellow","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1148","DOI":"10.1109\/TPAMI.2014.2362759","article-title":"Demographic estimation from face images: Human vs. machine performance","volume":"37","author":"Han","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","unstructured":"Chollet, F. (2018, April 08). Keras. Available online: https:\/\/github.com\/fchollet\/keras."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5858","DOI":"10.1109\/ACCESS.2017.2696121","article-title":"Smart augmentation learning an optimal data augmentation strategy","volume":"5","author":"Lemley","year":"2017","journal-title":"IEEE Access"},{"key":"ref_28","unstructured":"Simonyan, K., and Zisserman, A. (arXiv, 2014). A Very deep convolutional networks for large-scale image recognition, arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"Imagenet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Brachmann, A., and Redies, C. (2016). Using convolutional neural network filters to measure left-right mirror symmetry in images. Symmetry, 8.","DOI":"10.3390\/sym8120144"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"11","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.engappai.2016.10.008","article-title":"Feature selection for high dimensional imbalanced class data using harmony search","volume":"57","author":"Moayedikia","year":"2017","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_33","first-page":"37","article-title":"Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation","volume":"2","author":"Powers","year":"2011","journal-title":"J. Mach. Learn. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"41","DOI":"10.2478\/jaiscr-2014-0004","article-title":"Profiling Bell\u2019s Palsy based on House-BrackMann score","volume":"3","author":"Song","year":"2013","journal-title":"J. Artif. Intell. Soft Comput. Res."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/10\/7\/242\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:10:16Z","timestamp":1760195416000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/10\/7\/242"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,26]]},"references-count":34,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2018,7]]}},"alternative-id":["sym10070242"],"URL":"https:\/\/doi.org\/10.3390\/sym10070242","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,6,26]]}}}