{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,18]],"date-time":"2026-11-18T10:52:17Z","timestamp":1794999137705,"version":"4.9.1"},"reference-count":46,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"2","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,2]]},"abstract":"<jats:sec>\n            <jats:title>Background:<\/jats:title>\n            <jats:p>Facial palsy assessment is nonstandardized. Clinician-graded scales are limited by subjectivity and observer bias. Computer-aided grading would be desirable to achieve conformity in facial palsy assessment and to compare the effectiveness of treatments. This research compares the clinician-graded eFACE scale to machine learning\u2013derived automated assessments (auto-eFACE).<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods:<\/jats:title>\n            <jats:p>The Massachusetts Eye and Ear Infirmary Standard Facial Palsy Dataset was employed. Clinician-graded eFACE assessment was performed on 160 photographs. A Python script was used to automatically generate auto-eFACE scores on the same photographs. eFACE and auto-eFACE scores were compared for normal, flaccidly paralyzed, and synkinetic faces.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results:<\/jats:title>\n            <jats:p>Auto-eFACE and eFACE scores differentiated normal faces from those with facial palsy. Auto-eFACE produced significantly lower scores than eFACE for normal faces (93.83 \u00b1 4.37 versus 100.00 \u00b1 1.58; p = 0.01). Review of photographs revealed minor facial asymmetries in normal faces that clinicians tend to disregard. Auto-eFACE reported better facial symmetry in patients with flaccid paralysis (59.96 \u00b1 5.80) and severe synkinesis (62.35 \u00b1 9.35) than clinician-graded eFACE (52.20 \u00b1 3.39 and 54.22 \u00b1 5.35, respectively; p = 0.080 and p = 0.080, respectively); this result trended toward significance.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions:<\/jats:title>\n            <jats:p>Auto-eFACE scores can be obtained automatically using a freely available machine learning\u2013based computer software. Automated scores predicted more asymmetry in normal patients, and less asymmetry in patients with flaccid palsy and synkinesis, compared to clinician grading. Auto-eFACE is a quick and easy-to-use assessment tool that holds promise for standardization of facial palsy outcome measures and may eliminate observer bias seen in clinician-graded scales.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>CLINICAL QUESTION\/LEVEL OF EVIDENCE:<\/jats:title>\n            <jats:p>Diagnostic, III.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1097\/prs.0000000000007572","type":"journal-article","created":{"date-parts":[[2020,11,25]],"date-time":"2020-11-25T00:46:22Z","timestamp":1606265182000},"page":"467-474","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":71,"title":["The Auto-eFACE: Machine Learning\u2013Enhanced Program Yields Automated Facial Palsy Assessment Tool"],"prefix":"10.1097","volume":"147","author":[{"given":"Matthew Q.","family":"Miller","sequence":"first","affiliation":[{"name":"From the Massachusetts Eye and Ear Infirmary, Harvard Medical School; and the Biomedical Engineering Program, Florida Institute of Technology."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tessa A.","family":"Hadlock","sequence":"additional","affiliation":[{"name":"From the Massachusetts Eye and Ear Infirmary, Harvard Medical School; and the Biomedical Engineering Program, Florida Institute of Technology."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily","family":"Fortier","sequence":"additional","affiliation":[{"name":"From the Massachusetts Eye and Ear Infirmary, Harvard Medical School; and the Biomedical Engineering Program, Florida Institute of Technology."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diego L.","family":"Guarin","sequence":"additional","affiliation":[{"name":"From the Massachusetts Eye and Ear Infirmary, Harvard Medical School; and the Biomedical Engineering Program, Florida Institute of Technology."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2020,11,24]]},"reference":[{"key":"R1-20250501","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1097\/PRS.0000000000000905","article-title":"Facial nerve grading instruments: Systematic review of the literature and suggestion for uniformity.","volume":"135","author":"Fattah","year":"2015","journal-title":"Plast Reconstr Surg"},{"key":"R2-20250501","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1177\/019459988509300202","article-title":"Facial nerve grading system.","volume":"93","author":"House","year":"1985","journal-title":"Otolaryngol Head Neck Surg"},{"key":"R3-20250501","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1016\/j.otohns.2006.05.748","article-title":"Sunnybrook and House-Brackmann facial grading systems: Intrarater repeatability and interrater agreement.","volume":"135","author":"Kanerva","year":"2006","journal-title":"Otolaryngol Head Neck Surg"},{"key":"R4-20250501","first-page":"240","article-title":"Grading facial nerve function: House-Brackmann versus Burres-Fisch methods.","volume":"11","author":"Croxson","year":"1990","journal-title":"Am J Otol"},{"key":"R5-20250501","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1016\/S0194-59989670206-1","article-title":"Development of a sensitive clinical facial grading system.","volume":"114","author":"Ross","year":"1996","journal-title":"Otolaryngol Head Neck Surg"},{"key":"R6-20250501","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1002\/lary.21163","article-title":"Good correlation between original and modified House Brackmann facial grading systems.","volume":"121","author":"Henstrom","year":"2011","journal-title":"Laryngoscope"},{"key":"R7-20250501","doi-asserted-by":"crossref","first-page":"223e","DOI":"10.1097\/PRS.0000000000001447","article-title":"Clinician-graded electronic facial paralysis assessment: The eFACE.","volume":"136","author":"Banks","year":"2015","journal-title":"Plast Reconstr Surg"},{"key":"R8-20250501","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1001\/jamafacial.2016.1620","article-title":"Test-retest reliability and agreement between in-person and video assessment of facial mimetic function using the eFACE facial grading system.","volume":"19","author":"Banks","year":"2017","journal-title":"JAMA Facial Plast Surg"},{"key":"R9-20250501","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1001\/jamafacial.2016.0025","article-title":"Emerging vs time-tested methods of facial grading among patients with facial paralysis.","volume":"18","author":"Gaudin","year":"2016","journal-title":"JAMA Facial Plast Surg"},{"key":"R10-20250501","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1001\/jamafacial.2016.0226","article-title":"Weighting of facial grading variables to disfigurement in facial palsy.","volume":"18","author":"Banks","year":"2016","journal-title":"JAMA Facial Plast Surg"},{"key":"R11-20250501","doi-asserted-by":"crossref","first-page":"1033","DOI":"10.1016\/j.otc.2018.07.003","article-title":"Outcome tracking in facial palsy.","volume":"51","author":"Dusseldorp","year":"2018","journal-title":"Otolaryngol Clin North Am"},{"key":"R12-20250501","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1001\/archfaci.2012.111","article-title":"Toward a universal, automated facial measurement tool in facial reanimation.","volume":"14","author":"Hadlock","year":"2012","journal-title":"Arch Facial Plast Surg"},{"key":"R13-20250501","doi-asserted-by":"crossref","first-page":"1334","DOI":"10.1097\/00006534-199406000-00002","article-title":"Development of a new documentation system for facial movements as a basis for the international registry for neuromuscular reconstruction in the face.","volume":"93","author":"Frey","year":"1994","journal-title":"Plast Reconstr Surg"},{"key":"R14-20250501","doi-asserted-by":"crossref","first-page":"2032","DOI":"10.1097\/00006534-199912000-00013","article-title":"Three-dimensional video analysis of facial movements: A new method to assess the quantity and quality of the smile.","volume":"104","author":"Frey","year":"1999","journal-title":"Plast Reconstr Surg"},{"key":"R15-20250501","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.bjps.2007.03.037","article-title":"Automatic three-dimensional quantitative analysis for evaluation of facial movement.","volume":"61","author":"Hontanilla","year":"2008","journal-title":"J Plast Reconstr Aesthet Surg"},{"key":"R16-20250501","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1016\/j.jcms.2009.10.018","article-title":"A three-dimensional study of facial mimicry in healthy young adults.","volume":"38","author":"Sforza","year":"2010","journal-title":"J Craniomaxillofac Surg"},{"key":"R18-20250501","first-page":"1755","article-title":"Dlib-ml: A machine learning toolkit.","volume":"10","author":"King","year":"2009","journal-title":"JMLR"},{"key":"R20-20250501","doi-asserted-by":"crossref","first-page":"1424","DOI":"10.1109\/34.895976","article-title":"Automatic analysis of facial expressions: The state of the art.","volume":"22","author":"Pantic","year":"2000","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"R21-20250501","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1001\/jamafacial.2018.0030","article-title":"A machine learning approach for automated facial measurements in facial palsy.","volume":"20","author":"Guarin","year":"2018","journal-title":"JAMA Facial Plast Surg"},{"key":"R22-20250501","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1001\/jamafacial.2019.0086","article-title":"Clinician and automated assessments of facial function following eyelid weight placement.","volume":"21","author":"Greene","year":"2019","journal-title":"JAMA Facial Plast Surg"},{"key":"R23-20250501","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1097\/SAP.0000000000001545","article-title":"Surgical refinement following free gracilis transfer for smile reanimation.","volume":"81","author":"Greene","year":"2018","journal-title":"Ann Plast Surg"},{"key":"R24-20250501","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1089\/fpsam.2019.29000.gua","article-title":"Toward an automatic system for computer-aided assessment in facial palsy.","volume":"22","author":"Guarin","year":"2020","journal-title":"Facial Plast Surg Aesthet Med"},{"key":"R25-20250501","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1001\/jamafacial.2019.0224","article-title":"An international collaborative standardizing patient-centered outcome measures in pediatric facial palsy.","volume":"21","author":"Butler","year":"2019","journal-title":"JAMA Facial Plast Surg"},{"key":"R26-20250501","doi-asserted-by":"crossref","first-page":"491e","DOI":"10.1097\/PRS.0000000000002954","article-title":"Worldwide testing of the eFACE facial nerve clinician-graded scale.","volume":"139","author":"Banks","year":"2017","journal-title":"Plast Reconstr Surg"},{"key":"R27-20250501","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1002\/lary.27986","article-title":"The spectrum of facial palsy: The MEEI facial palsy photo and video standard set.","volume":"130","author":"Greene","year":"2020","journal-title":"Laryngoscope"},{"key":"R28-20250501","first-page":"80","article-title":"The result of intratemporal treatment of facial palsy.","volume":"17","author":"Botman","year":"1955","journal-title":"Pract Otorhinolaryngol (Basel)"},{"key":"R29-20250501","doi-asserted-by":"crossref","first-page":"2247","DOI":"10.1002\/lary.24636","article-title":"Survey of methods of facial palsy documentation in use by members of the Sir Charles Bell Society.","volume":"124","author":"Fattah","year":"2014","journal-title":"Laryngoscope"},{"key":"R30-20250501","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1288\/00005537-198308000-00016","article-title":"Facial nerve grading systems.","volume":"93","author":"House","year":"1983","journal-title":"Laryngoscope"},{"key":"R31-20250501","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.otohns.2008.11.021","article-title":"Significance and reliability of the House-Brackmann grading system for regional facial nerve function.","volume":"140","author":"Reitzen","year":"2009","journal-title":"Otolaryngol Head Neck Surg"},{"key":"R32-20250501","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1097\/SAP.0b013e31826acb2c","article-title":"A comparison of facial nerve grading systems.","volume":"70","author":"Lee","year":"2013","journal-title":"Ann Plast Surg"},{"key":"R33-20250501","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1002\/lary.25324","article-title":"The social distraction of facial paralysis: Objective measurement of social attention using eye-tracking.","volume":"126","author":"Ishii","year":"2016","journal-title":"Laryngoscope"},{"key":"R34-20250501","doi-asserted-by":"crossref","first-page":"946","DOI":"10.1016\/j.bjps.2019.03.011","article-title":"Facial synkinesis outcome measures: A systematic review of the available grading systems and a Delphi study to identify the steps towards a consensus.","volume":"72","author":"Berner","year":"2019","journal-title":"J Plast Reconstr Aesthet Surg"},{"key":"R35-20250501","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1016\/j.jcms.2016.07.017","article-title":"Quantification of facial asymmetry: A comparative study of landmark-based and surface-based registrations.","volume":"44","author":"Verhoeven","year":"2016","journal-title":"J Craniomaxillofac Surg"},{"key":"R36-20250501","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.jcms.2016.11.003","article-title":"Facial thirds-based evaluation of facial asymmetry using stereophotogrammetric devices: Application to facial palsy subjects.","volume":"45","author":"Codari","year":"2017","journal-title":"J Craniomaxillofac Surg"},{"key":"R37-20250501","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1097\/MAO.0b013e318206fdde","article-title":"Audiometric outcomes for acoustic neuroma patients after single versus multiple fraction stereotactic irradiation.","volume":"32","author":"McWilliams","year":"2011","journal-title":"Otol Neurotol"},{"key":"R38-20250501","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1001\/jama.2018.8102","article-title":"Effect of a home-based wearable continuous ECG monitoring patch on detection of undiagnosed atrial fibrillation: The mSToPS randomized clinical trial.","volume":"320","author":"Steinhubl","year":"2018","journal-title":"JAMA"},{"key":"R39-20250501","doi-asserted-by":"crossref","first-page":"1851","DOI":"10.1161\/CIRCULATIONAHA.116.026693","article-title":"Screening for atrial fibrillation: A report of the AF-SCREEN International Collaboration.","volume":"135","author":"Freedman","year":"2017","journal-title":"Circulation"},{"key":"R40-20250501","doi-asserted-by":"crossref","first-page":"2766","DOI":"10.1162\/jocn.2011.21616","article-title":"Task-invariant brain responses to the social value of faces.","volume":"23","author":"Todorov","year":"2011","journal-title":"J Cogn Neurosci"},{"key":"R41-20250501","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1093\/scan\/nsn009","article-title":"Evaluating face trustworthiness: A model based approach.","volume":"3","author":"Todorov","year":"2008","journal-title":"Soc Cogn Affect Neurosci"},{"key":"R42-20250501","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1037\/a0027950","article-title":"Unconscious evaluation of faces on social dimensions.","volume":"141","author":"Stewart","year":"2012","journal-title":"J Exp Psychol Gen"},{"key":"R43-20250501","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1037\/0033-2909.126.3.390","article-title":"Maxims or myths of beauty? A meta-analytic and theoretical review.","volume":"126","author":"Langlois","year":"2000","journal-title":"Psychol Bull"},{"key":"R44-20250501","doi-asserted-by":"crossref","first-page":"8021","DOI":"10.1038\/s41598-019-44408-8","article-title":"Behavioural and neural responses to facial disfigurement.","volume":"9","author":"Hartung","year":"2019","journal-title":"Sci Rep"},{"key":"R45-20250501","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1521\/soco.2009.27.6.813","article-title":"Evaluating faces on trustworthiness after minimal time exposure.","volume":"27","author":"Todorov","year":"2009","journal-title":"Social Cogn"},{"key":"R46-20250501","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1037\/1528-3542.5.4.498","article-title":"Facial attractiveness is appraised in a glance.","volume":"5","author":"Olson","year":"2005","journal-title":"Emotion"},{"key":"R47-20250501","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/S1740-1445(03)00005-6","article-title":"Body image and disfigurement: Issues and interventions.","volume":"1","author":"Rumsey","year":"2004","journal-title":"Body Image"},{"key":"R48-20250501","first-page":"560","article-title":"Developing a behavior rating scale for comparing teachers\u2019 ratings of children with and without craniofacial anomalies.","volume":"38","author":"Broder","year":"2001","journal-title":"Cleft Palate Craniofac J"}],"container-title":["Plastic &amp; Reconstructive Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/PRS.0000000000007572","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T00:26:29Z","timestamp":1746145589000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/PRS.0000000000007572"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,24]]},"references-count":46,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021]]}},"URL":"https:\/\/doi.org\/10.1097\/prs.0000000000007572","relation":{},"ISSN":["0032-1052"],"issn-type":[{"value":"0032-1052","type":"print"}],"subject":[],"published":{"date-parts":[[2020,11,24]]}}}