{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T03:42:48Z","timestamp":1784691768890,"version":"3.55.0"},"reference-count":38,"publisher":"IOP Publishing","issue":"6","license":[{"start":{"date-parts":[[2024,10,9]],"date-time":"2024-10-09T00:00:00Z","timestamp":1728432000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/page\/copyright"},{"start":{"date-parts":[[2024,10,9]],"date-time":"2024-10-09T00:00:00Z","timestamp":1728432000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Biomed. Phys. Eng. Express"],"published-print":{"date-parts":[[2024,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Facial paralysis (FP) is a condition characterized by the inability to move some or all of the muscles on one or both sides of the face. Diagnosing FP presents challenges due to the limitations of traditional methods, which are time-consuming, uncomfortable for patients, and require specialized clinicians. Additionally, more advanced tools are often uncommonly available to all healthcare providers. Early and accurate detection of FP is crucial, as timely intervention can prevent long-term complications and improve patient outcomes. To address these challenges, our research introduces Facia-Fix, a mobile application for Bell\u2019s palsy diagnosis, integrating computer vision and deep learning techniques to provide real-time analysis of facial landmarks. The classification algorithms are trained on the publicly available YouTube FP (YFP) dataset, which is labeled using the House-Brackmann (HB) method, a standardized system for assessing the severity of FP. Different deep learning models were employed to classify the FP severity, such as MobileNet, CNN, MLP, VGG16, and Vision Transformer. The MobileNet model which uses transfer learning, achieved the highest performance (Accuracy: 0.9812, Precision: 0.9753, Recall: 0.9727, F1 Score: 0.974), establishing it as the optimal choice among the evaluated models. The innovation of this approach lies in its use of advanced deep learning models to provide accurate, objective, non-invasive and real-time comprehensive quantitative assessment of FP severity. Preliminary results highlight the potential of Facia-Fix to significantly improve the diagnostic and follow-up experiences for both clinicians and patients.<\/jats:p>","DOI":"10.1088\/2057-1976\/ad8094","type":"journal-article","created":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T22:48:18Z","timestamp":1727477298000},"page":"065034","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Facia-fix: mobile application for bell\u2019s palsy diagnosis and assessment using computer vision and deep learning"],"prefix":"10.1088","volume":"10","author":[{"given":"Amira","family":"Mohamed","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6967-3071","authenticated-orcid":false,"given":"Doha","family":"Eid","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-9007-9294","authenticated-orcid":true,"given":"Mariam M","family":"Ezzat","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-6969-7151","authenticated-orcid":true,"given":"Mayar","family":"Ehab","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6363-0598","authenticated-orcid":true,"given":"Maye","family":"Khaled","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Gaber","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3380-645X","authenticated-orcid":true,"given":"Amira","family":"Gaber","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2024,10,9]]},"reference":[{"key":"bpexad8094bib1","doi-asserted-by":"publisher","first-page":"1014","DOI":"10.1097\/00129492-200411000-00026","article-title":"Expression of emotion and quality of life after facial nerve paralysis","volume":"25","author":"Coulson","year":"2004","journal-title":"Otol Neurotol."},{"key":"bpexad8094bib2","doi-asserted-by":"publisher","first-page":"1356","DOI":"10.1136\/jnnp-2014-309563","article-title":"Bell\u2019s palsy: aetiology, clinical features and multidisciplinary care","volume":"86","author":"Eviston","year":"2015","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"bpexad8094bib3","article-title":"Bell\u2019s Palsy"},{"key":"bpexad8094bib4","article-title":"Bell Palsy","author":"Warner","year":"2024"},{"key":"bpexad8094bib5","article-title":"Facial nerve palsy","author":"Rubin","year":"2023"},{"key":"bpexad8094bib6","doi-asserted-by":"crossref","DOI":"10.1109\/ICVR.2015.7358577","article-title":"Automated grading of facial paralysis using the Kinect v2: a proof of concept study","author":"Gaber","year":"2015"},{"key":"bpexad8094bib7","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1111\/psyp.12676","article-title":"Reliability of surface facial electromyography","volume":"54","author":"Hess","year":"2017","journal-title":"Psychophysiology"},{"key":"bpexad8094bib8","doi-asserted-by":"publisher","first-page":"809","DOI":"10.1080\/09638280400018650","article-title":"Usefulness of BFB\/EMG in facial palsy rehabilitation","volume":"27","author":"Toffola","year":"2005","journal-title":"Disability and Rehabilitation"},{"key":"bpexad8094bib9","doi-asserted-by":"publisher","first-page":"8","DOI":"10.7874\/jao.2016.20.1.8","article-title":"Clinical efficacy of electroneurography in acute facial paralysis","volume":"20","author":"Lee","year":"2016","journal-title":"J. Audiol. Otol."},{"key":"bpexad8094bib10","doi-asserted-by":"publisher","first-page":"1855","DOI":"10.1007\/s00405-020-05949-1","article-title":"Facial nerve electrodiagnostics for patients with facial palsy: a clinical practice guideline","volume":"277","author":"Guntinas-Lichius","year":"2020","journal-title":"European Archives of Oto-Rhino-Laryngology"},{"key":"bpexad8094bib11","doi-asserted-by":"publisher","first-page":"516","DOI":"10.1177\/019459988509300409","article-title":"Facial electroneurography: clinical and experimental investigations","volume":"93","author":"Kartush","year":"1985","journal-title":"Otolaryngology\u2014Head and Neck Surgery"},{"key":"bpexad8094bib12","doi-asserted-by":"crossref","DOI":"10.1109\/NILES56402.2022.9942399","article-title":"A pilot study on facial functions grading based on electromyogram","author":"Gaber","year":"2022"},{"key":"bpexad8094bib13","doi-asserted-by":"publisher","first-page":"26756","DOI":"10.3390\/s151026756","article-title":"A smartphone-based automatic diagnosis system for facial nerve palsy","volume":"15","author":"Kim","year":"2015","journal-title":"Sensors"},{"key":"bpexad8094bib14","doi-asserted-by":"publisher","DOI":"10.1186\/s13640-018-0324-4","article-title":"A review of image-based automatic facial landmark identification techniques","volume":"86","author":"Johnston","year":"2018","journal-title":"EURASIP Journal on Image and Video Processing"},{"key":"bpexad8094bib15","doi-asserted-by":"publisher","DOI":"10.1088\/2057-1976\/ac107c","article-title":"SVM classification of facial functions based on facial landmarks and animation Units","volume":"7","author":"Gaber","year":"2021","journal-title":"Biomed. Phys. Eng. Express"},{"key":"bpexad8094bib16","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0277297","article-title":"Comprehensive assessment of facial paralysis based on facial animation units","volume":"17","author":"Gaber","year":"2022","journal-title":"PLoS One"},{"key":"bpexad8094bib17","doi-asserted-by":"publisher","DOI":"10.3390\/fi10110111","article-title":"Neurologist standard classification of facial nerve paralysis with deep neural networks","volume":"10","author":"Song","year":"2018","journal-title":"Future Internet"},{"key":"bpexad8094bib18","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1097\/PRS.0000000000007572","article-title":"The auto-eFACE: machine learning-enhanced program yields automated facial palsy assessment tool","volume":"147","author":"Miller","year":"2021","journal-title":"Plast Reconstr Surg"},{"key":"bpexad8094bib19","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1007\/978-3-030-52791-4_20","article-title":"Automatic and objective facial palsy grading index prediction using deep feature regression","volume":"1248","author":"Raj","year":"2020","journal-title":"Medical Image Understanding and Analysis"},{"key":"bpexad8094bib20","doi-asserted-by":"publisher","DOI":"10.3390\/s22176636","article-title":"Numerical approach to facial palsy using a novel registration method with 3D facial landmark","volume":"22","author":"Kim","year":"2022","journal-title":"Sensors"},{"key":"bpexad8094bib21","doi-asserted-by":"publisher","first-page":"455","DOI":"10.3390\/biomedinformatics3020031","article-title":"Automatic facial palsy, age and gender detection using a raspberry Pi","volume":"3","author":"Amsalam","year":"2023","journal-title":"BioMedInformatics"},{"key":"bpexad8094bib22","article-title":"Mobile application for diagnosis of facial palsy","author":"Azoulay","year":"2014"},{"key":"bpexad8094bib23","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-020-01605-7","article-title":"Cloud computing mobile application for remote monitoring of bell\u2019s palsy","volume":"44","author":"Watts","year":"2020","journal-title":"J. Med. Syst."},{"key":"bpexad8094bib24","doi-asserted-by":"publisher","DOI":"10.1016\/j.adoms.2022.100356","article-title":"Development of an application for mobile phones (App) capable to predict the improvement of the degree House Brackmann scale in patients suffering from iatrogenic facial palsy","volume":"8","author":"Boschetti","year":"2022","journal-title":"Advances in Oral and Maxillofacial Surgery"},{"key":"bpexad8094bib25","article-title":"Ethnicity and gender alteration on CLF and UTKface dataset.","author":"Chandaliya","year":"2019"},{"key":"bpexad8094bib26","doi-asserted-by":"crossref","DOI":"10.1109\/ICIC50835.2020.9288560","article-title":"The facial emotion recognition (FER-2013) dataset for prediction system of micro-expressions face using the convolutional neural network (CNN) algorithm based Raspberry Pi","author":"Zahara","year":"2020"},{"key":"bpexad8094bib27","doi-asserted-by":"publisher","first-page":"4833","DOI":"10.1109\/ACCESS.2018.2884969","article-title":"Deep hierarchical network with line segment learning for quantitative analysis of facial palsy","volume":"7","author":"Hsu","year":"2019","journal-title":"IEEE Access"},{"key":"bpexad8094bib28","article-title":"YFP_Dataset_Updated","author":"Eid","year":"2024"},{"key":"bpexad8094bib29","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1177\/019459988509300202","article-title":"Facial nerve grading system","volume":"93","author":"House","year":"1985","journal-title":"Otolaryngol Head Neck Surg."},{"key":"bpexad8094bib30","article-title":"MediaPipe: a framework for real-time multimedia applications","author":"Kshirsagar","year":"2023"},{"key":"bpexad8094bib31","article-title":"Face landmark detection guide","author":"Google","year":"2024"},{"key":"bpexad8094bib32","article-title":"Django REST framework","year":"2011"},{"key":"bpexad8094bib33","article-title":"React native","author":"Native","year":"2024"},{"key":"bpexad8094bib34","article-title":"Redux-toolkit","author":"Abramov","year":"2024"},{"key":"bpexad8094bib35","article-title":"Android Developer","author":"Developers"},{"key":"bpexad8094bib36","doi-asserted-by":"crossref","DOI":"10.1109\/CVPRW.2010.5543262","article-title":"The extended cohn-kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression","author":"Lucey","year":"2010"},{"key":"bpexad8094bib37","article-title":"Facial_Droop_and_Facial_Paralysis_image","author":"Mehta","year":"2019"},{"key":"bpexad8094bib38","first-page":"1755","article-title":"Dlib-ml: a machine learning toolkit. journal of machine learning research","volume":"10","author":"King","year":"2009","journal-title":"Journal of Machine Learning Research"}],"container-title":["Biomedical Physics &amp; Engineering Express"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad8094","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad8094\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad8094","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad8094\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad8094\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad8094\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad8094\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad8094\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,9]],"date-time":"2024-10-09T18:34:21Z","timestamp":1728498861000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ad8094"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,9]]},"references-count":38,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,10,9]]},"published-print":{"date-parts":[[2024,11,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2057-1976\/ad8094","relation":{},"ISSN":["2057-1976"],"issn-type":[{"value":"2057-1976","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,9]]},"assertion":[{"value":"Facia-fix: mobile application for bell\u2019s palsy diagnosis and assessment using computer vision and deep learning","name":"article_title","label":"Article Title"},{"value":"Biomedical Physics & Engineering Express","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.","name":"copyright_information","label":"Copyright Information"},{"value":"2024-06-23","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-09-27","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-10-09","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}