{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T21:52:23Z","timestamp":1768341143675,"version":"3.49.0"},"reference-count":24,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,8,15]],"date-time":"2024-08-15T00:00:00Z","timestamp":1723680000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Facial palsy causes the face to droop due to sudden weakness in the muscles on one side of the face. Computer-added assistance systems for the automatic recognition of palsy faces present a promising solution to recognizing the paralysis of faces at an early stage. A few research studies have already been performed to handle this research issue using an automatic deep feature extraction by deep learning approach and handcrafted machine learning approach. This empirical research work designed a multi-model facial palsy framework which is a combination of two convolutional models\u2014a multi-task cascaded convolutional network (MTCNN) for face and landmark detection and a hyperparameter tuned and parametric setting convolution neural network model for facial palsy classification. Using the proposed multi-model facial palsy framework, we presented results on a dataset of YouTube videos featuring patients with palsy. The results indicate that the proposed framework can detect facial palsy efficiently. Furthermore, the achieved accuracy, precision, recall, and F1-score values of the proposed framework for facial palsy detection are 97%, 94%, 90%, and 97%, respectively, for the training dataset. For the validation dataset, the accuracy achieved is 95%, precision is 90%, recall is 75.6%, and F-score is 76%. As a result, this framework can easily be used for facial palsy detection.<\/jats:p>","DOI":"10.3390\/computers13080200","type":"journal-article","created":{"date-parts":[[2024,8,15]],"date-time":"2024-08-15T09:29:41Z","timestamp":1723714181000},"page":"200","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A Deep Learning Approach for Early Detection of Facial Palsy in Video Using Convolutional Neural Networks: A Computational Study"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5215-1300","authenticated-orcid":false,"given":"Anuja","family":"Arora","sequence":"first","affiliation":[{"name":"Jaypee Institute of Information Technology, Noida 201014, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9538-135X","authenticated-orcid":false,"given":"Jasir Mohammad","family":"Zaeem","sequence":"additional","affiliation":[{"name":"Jaypee Institute of Information Technology, Noida 201014, India"}]},{"given":"Vibhor","family":"Garg","sequence":"additional","affiliation":[{"name":"Jaypee Institute of Information Technology, Noida 201014, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9936-5311","authenticated-orcid":false,"given":"Ambikesh","family":"Jayal","sequence":"additional","affiliation":[{"name":"School of Engineering and Technology, CQU University, Brisbane, QLD 883155, Australia"}]},{"given":"Zahid","family":"Akhtar","sequence":"additional","affiliation":[{"name":"Department of Network and Computer Security, State University of New York Polytechnic Institute, Utica, NY 13502, USA"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1855","DOI":"10.1007\/s00405-020-05949-1","article-title":"Facial nerve electrodiagnostics for patients with facial palsy: A clinical practice guideline","volume":"277","author":"Volk","year":"2020","journal-title":"Eur. Arch. Otorhinolaryngol."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Vrochidou, E., Papi\u0107, V., Kalampokas, T., and Papakostas, G.A. (2023). Automatic Facial Palsy Detection\u2014From Mathematical Modeling to Deep Learning. Axioms, 12.","DOI":"10.3390\/axioms12121091"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1055\/s-0043-1769805","article-title":"Deep Learning for the Assessment of Facial Nerve Palsy: Opportunities and Challenges","volume":"39","author":"Boochoon","year":"2023","journal-title":"Facial Plast. Surg."},{"key":"ref_4","unstructured":"Oo, N.H.Y., Lee, M.H., and Lim, J.H. (2024). Exploring a Multimodal Fusion-Based Deep Learning Network for Detecting Facial Palsy. arXiv."},{"key":"ref_5","first-page":"997","article-title":"Bell\u2019s Palsy: Diagnosis and Management","volume":"76","author":"Tiemstra","year":"2007","journal-title":"Am. Fam. Physician"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hsu, G.S.J., Huang, W.F., and Kang, J.H. (2018, January 18\u201322). Hierarchical Network for Facial Palsy Detection. Proceedings of the CVPR Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00100"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"121655","DOI":"10.1109\/ACCESS.2019.2937285","article-title":"3DPalsyNet: A facial palsy grading and motion recognition framework using fully 3D convolutional neural networks","volume":"7","author":"Storey","year":"2019","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Sajid, M., Shafique, T., Baig, M.J.A., Riaz, I., Amin, S., and Manzoor, S. (2018). Automatic grading of palsy using asymmetrical facial features: A study complemented by new solutions. Symmetry, 10.","DOI":"10.3390\/sym10070242"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Miko\u0142ajczyk, A., and Grochowski, M. (2018, January 9\u201312). Data augmentation for improving deep learning in image classification problem. Proceedings of the 2018 International Interdisciplinary PhD Workshop (IIPhDW), Swinoujscie, Poland.","DOI":"10.1109\/IIPHDW.2018.8388338"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative adversarial networks","volume":"63","author":"Goodfellow","year":"2020","journal-title":"Commun. ACM"},{"key":"ref_11","first-page":"2672","article-title":"Generative Adversarial Nets","volume":"27","author":"Goodfellow","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1017\/S002221510011093X","article-title":"Reliability of the House and Brackmann grading system for facial palsy","volume":"103","author":"Evans","year":"1989","journal-title":"J. Laryngol. Otol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"26756","DOI":"10.3390\/s151026756","article-title":"A smartphone-based automatic diagnosis system for facial nerve palsy","volume":"15","author":"Kim","year":"2015","journal-title":"Sensors"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Song, I., Yen, N.Y., Vong, J., Diederich, J., and Yellowlees, P. (2013, January 16\u201319). Profiling bell\u2019s palsy based on House-Brackmann score. Proceedings of the 2013 IEEE Symposium on Computational Intelligence in Healthcare and E-Health (CICARE), Singapore.","DOI":"10.1109\/CICARE.2013.6583060"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Amsalam, A.S., Al-Naji, A., and Daeef, A.Y. (2024, January 22\u201323). Facial palsy detection using pre-trained deep learning models: A comparative study. Proceedings of the AIP Conference Proceedings, Jaipur, India.","DOI":"10.1063\/5.0209928"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ikezawa, N., Okamoto, T., Yoshida, Y., Kurihara, S., Takahashi, N., Nakada, T.A., and Haneishi, H. (2024). Toward an application of automatic evaluation system for central facial palsy using two simple evaluation indices in emergency medicine. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-53815-5"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2398542","DOI":"10.1155\/2020\/2398542","article-title":"Automatic facial paralysis assessment via computational image analysis","volume":"2020","author":"Jiang","year":"2020","journal-title":"J. Healthc. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"297","DOI":"10.2307\/1932409","article-title":"Measures of the amount of ecological association between species","volume":"26","author":"Dice","year":"1945","journal-title":"Ecology"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1499","DOI":"10.1109\/LSP.2016.2603342","article-title":"Joint face detection and alignment using multitask cascaded convolutional networks","volume":"23","author":"Zhang","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_20","first-page":"1","article-title":"Virtual Personal Trainer: Fitness Video Reognition Using Convolution Neural Network and Bidirectional LSTM","volume":"12","author":"Arora","year":"2021","journal-title":"IJKSS"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Arora, A., Jayal, A., Gupta, M., Mittal, P., and Satapathy, S.C. (2021). Brain tumor segmentation of mri images using processed image driven u-net architecture. Computers, 10.","DOI":"10.3390\/computers10110139"},{"key":"ref_22","first-page":"1307","article-title":"Image classification using convolutional neural networks","volume":"119","author":"Ramprasath","year":"2018","journal-title":"Int. J. Pure Appl. Math."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.procs.2018.05.198","article-title":"An analysis of convolutional neural networks for image classification","volume":"132","author":"Sharma","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Arora, A., Sinha, A., Bhansali, K., Goel, R., Sharma, I., and Jayal, A. (2022, January 4\u20136). SVM and Logistic Regression for Facial Palsy Detection Utilizing Facial Landmark Features. Proceedings of the 2022 Fourteenth International Conference on Contemporary Computing, Noida, India.","DOI":"10.1145\/3549206.3549216"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/13\/8\/200\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:37:10Z","timestamp":1760110630000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/13\/8\/200"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,15]]},"references-count":24,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["computers13080200"],"URL":"https:\/\/doi.org\/10.3390\/computers13080200","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,15]]}}}