{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T11:16:59Z","timestamp":1790767019872,"version":"4.1.0"},"reference-count":35,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2023,9,7]],"date-time":"2023-09-07T00:00:00Z","timestamp":1694044800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Rare Disease Clinical Research Network Consortium","award":["NIH U54 NS115054"],"award-info":[{"award-number":["NIH U54 NS115054"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Due to the precautions put in place during the COVID-19 pandemic, utilization of telemedicine has increased quickly for patient care and clinical trials. Unfortunately, teleconsultation is closer to a video conference than a medical consultation, with the current solutions setting the patient and doctor into an evaluation that relies entirely on a two-dimensional view of each other. We are developing a patented telehealth platform that assists with diagnostic testing of ocular manifestations of myasthenia gravis. We present a hybrid algorithm combining deep learning with computer vision to give quantitative metrics of ptosis and ocular muscle fatigue leading to eyelid droop and diplopia. The method works both on a fixed image and frame by frame of the video in real-time, allowing capture of dynamic muscular weakness during the examination. We then use signal processing and filtering to derive robust metrics of ptosis and l ocular misalignment. In our construction, we have prioritized the robustness of the method versus accuracy obtained in controlled conditions in order to provide a method that can operate in standard telehealth conditions. The approach is general and can be applied to many disorders of ocular motility and ptosis.<\/jats:p>","DOI":"10.3390\/s23187744","type":"journal-article","created":{"date-parts":[[2023,9,8]],"date-time":"2023-09-08T08:01:30Z","timestamp":1694160090000},"page":"7744","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Eye Segmentation Method for Telehealth: Application to the Myasthenia Gravis Physical Examination"],"prefix":"10.3390","volume":"23","author":[{"given":"Quentin","family":"Lesport","sequence":"first","affiliation":[{"name":"Department of Surgery, School of Medicine and Health Sciences, George Washington University, Washington, DC 20037, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guillaume","family":"Joerger","sequence":"additional","affiliation":[{"name":"Care Constitution Corp., Newark, DE 19702, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Henry J.","family":"Kaminski","sequence":"additional","affiliation":[{"name":"Department of Neurology & Rehabilitation Medicine, School of Medicine and Health Sciences, George Washington University, Washington, DC 20037, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Helen","family":"Girma","sequence":"additional","affiliation":[{"name":"Department of Neurology & Rehabilitation Medicine, School of Medicine and Health Sciences, George Washington University, Washington, DC 20037, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sienna","family":"McNett","sequence":"additional","affiliation":[{"name":"Department of Neurology & Rehabilitation Medicine, School of Medicine and Health Sciences, George Washington University, Washington, DC 20037, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad","family":"Abu-Rub","sequence":"additional","affiliation":[{"name":"Department of Neurology & Rehabilitation Medicine, School of Medicine and Health Sciences, George Washington University, Washington, DC 20037, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc","family":"Garbey","sequence":"additional","affiliation":[{"name":"Department of Surgery, School of Medicine and Health Sciences, George Washington University, Washington, DC 20037, USA"},{"name":"Care Constitution Corp., Newark, DE 19702, USA"},{"name":"LaSIE, UMR CNRS 7356, Universit\u00e9 de la Rochelle, 17000 La Rochelle, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,7]]},"reference":[{"key":"ref_1","first-page":"30","article-title":"Telemedicine applied to neuromuscular disorders: Focus on the COVID-19 pandemic era","volume":"41","author":"Giannotta","year":"2022","journal-title":"Acta Myol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3553","DOI":"10.1007\/s10072-021-05396-8","article-title":"How to manage with telemedicine people with neuromuscular diseases?","volume":"42","author":"Spina","year":"2021","journal-title":"Neurol. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"667813","DOI":"10.3389\/fneur.2021.667813","article-title":"Satisfaction of Telehealth in Patients with Established Neuromuscular Disorders","volume":"12","author":"Hooshmand","year":"2021","journal-title":"Front. Neurol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4889","DOI":"10.1007\/s10072-021-05566-8","article-title":"Myasthenia gravis and telemedicine: A lesson from COVID-19 pandemic","volume":"42","author":"Ricciardi","year":"2021","journal-title":"Neurol. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1002\/mus.27260","article-title":"Telemedicine visits in myasthenia gravis: Expert guidance and the myasthenia gravis core exam (MG-CE)","volume":"64","author":"Guidon","year":"2021","journal-title":"Muscle Nerve"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"596382","DOI":"10.3389\/fneur.2020.596382","article-title":"Outcome Measures in Clinical Trials of Patients with Myasthenia Gravis","volume":"11","author":"Thomsen","year":"2020","journal-title":"Front. Neurol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.ncl.2018.01.003","article-title":"Ocular Myasthenia","volume":"36","author":"Benatar","year":"2018","journal-title":"Neurol. Clin."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"749","DOI":"10.26599\/TST.2021.9010025","article-title":"A computer-aided system for ocular myasthenia gravis diagnosis","volume":"26","author":"Liu","year":"2021","journal-title":"Tsinghua Sci. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.carj.2018.02.002","article-title":"Health Policy and Practice\/Sante: Politique et pratique medicale, Canadian Association of Radiologists White Paper on Artificial Intelligence in Radiology","volume":"69","author":"Tang","year":"2018","journal-title":"Can. Assoc. Radiol. J."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Leigh, R.J., and Zee, D.S. (2015). The Neurology of Eye Movements, Oxford University Press. [5th ed.].","DOI":"10.1093\/med\/9780199969289.001.0001"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1177\/1533317509332093","article-title":"Eye Tracking During a Visual Paired Comparison Task as a Predictor of Early Dementia","volume":"24","author":"Crutcher","year":"2009","journal-title":"Am. J. Alzheimer\u2019s Dis. Other Dement."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1212\/WNL.34.1.99","article-title":"Eye tracking dysfunction in Alzheimer-type dementia","volume":"34","author":"Hutton","year":"1984","journal-title":"Neurology"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1418","DOI":"10.1109\/TBME.2007.891930","article-title":"Contact-free measurement of cardiac pulse based on the analysis of thermal imagery","volume":"54","author":"Garbey","year":"2007","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1434","DOI":"10.1212\/WNL.0b013e3181dc1b1e","article-title":"The MG Composite: A valid and reliable outcome measure for myasthenia gravis","volume":"74","author":"Burns","year":"2010","journal-title":"Neurology"},{"key":"ref_15","first-page":"201","article-title":"Pupil Detection Methods for Eye Tracking","volume":"26","author":"Rynkiewicz","year":"2018","journal-title":"J. Appl. Comput. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1109\/TPAMI.2009.30","article-title":"In the eye of the beholder: A survey of models for eyes and gaze","volume":"32","author":"Hansen","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","first-page":"1","article-title":"Human Eye Tracking and Related Issues: A Review","volume":"2","author":"Singh","year":"2012","journal-title":"Int. J. Sci. Res. Publ."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Khan, W., Hussain, A., Kuru, K., and Al-Askar, H. (2020). Pupil Localisation and Eye Centre Estimation Using Machine Learning and Computer Vision. Sensors, 20.","DOI":"10.3390\/s20133785"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"19415","DOI":"10.1007\/s11042-017-5380-8","article-title":"Eye state recognition based on deep integrated neural network and transfer learning","volume":"77","author":"Zhao","year":"2017","journal-title":"Multimed. Tools Appl."},{"key":"ref_20","unstructured":"Kunka, B., and Kostek, B. (2009, January 24\u201326). Non-Intrusive Infrared-Free Eye Tracking Method. Proceedings of the Signal Processing Algorithms, Architectures, Arrangements, and Applications Conference Proceedings (SPA), Poznan, Poland."},{"key":"ref_21","first-page":"175","article-title":"A Review of Iris Recogntion Algorithms","volume":"1","author":"Ghali","year":"2017","journal-title":"JOIV Int. J. Inform. Vis."},{"key":"ref_22","unstructured":"Toennies, K., Behrens, F., and Aurnhammer, M. (2002, January 11\u201315). Feasibility of Hough-Transform-Based Iris Localization for Real-Time Application. Proceedings of the 16th International Conference on Pattern Recognition, Quebec City, QC, Canada."},{"key":"ref_23","unstructured":"Liang, D.B.B., and Houi, L.K. (2007, January 17\u201319). Non-Intrusive Eye Gaze Direction Tracking Using Color Segmentation and Hough Transform. Proceedings of the International Symposium on Communications and Information Technologies, Sydney, NSW, Australia."},{"key":"ref_24","first-page":"177","article-title":"Daughman\u2019s Algorithm Method for Iris Recognition\u2014A Biometric Approach","volume":"2","author":"Verma","year":"2012","journal-title":"Int. J. Emerg. Technol. Adv. Eng."},{"key":"ref_25","unstructured":"Jain, V., and Learned-Miller, E. (2010). FDDB: A Benchmark for Face Detection in Unconstrained Settings, UMASS. Tech. Rep. UM-CS-2010-009."},{"key":"ref_26","first-page":"5","article-title":"An Experimental Performance Comparison of Widely Used Face Detection Tools","volume":"8","author":"Kabakus","year":"2019","journal-title":"ADCAIJ Adv. Distrib. Comput. Artif. Intell. J."},{"key":"ref_27","unstructured":"(2022, March 30). OpenCV Haar Cascade Eye Detector [En ligne]. Available online: https:\/\/github.com\/opencv\/opencv\/blob\/master\/data\/haarcascades\/haarcascade_eye.xml."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e25435","DOI":"10.2196\/25435","article-title":"Using an Extended Technology Acceptance Model to Understand the Factors Influencing Telehealth Utilization After Flattening the COVID-19 Curve in South Korea: Cross-sectional Survey Study","volume":"9","author":"An","year":"2021","journal-title":"JMIR Med. Inform."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1186\/s13640-018-0324-4","article-title":"A review of image-based automatic facial landmark identification techniques","volume":"2018","author":"Johnston","year":"2018","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/s11263-013-0667-3","article-title":"Face Alignment by Explicit Shape Regression","volume":"107","author":"Cao","year":"2014","journal-title":"Int. J. Comput. Vis."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kazemi, V., and Sullivan, J. (2014, January 23\u201328). One Millisecond Face Alignment with an Ensemble of Regression Trees. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.241"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.imavis.2016.01.002","article-title":"300 Faces In-The-Wild Challenge: Database and results","volume":"47","author":"Sagonas","year":"2016","journal-title":"Image Vis. Comput."},{"key":"ref_33","unstructured":"Reports and Data (2022, January 03). Myasthenia Gravis Market Size, Share, Industry Analysis by Treatment, By End-Use and Forecast to 2028. Available online: https:\/\/www.biospace.com\/article\/myasthenia-gravis-market-size-share-industry-analysis-by-treatment-by-end-use-and-forecast-to-2028\/."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"798","DOI":"10.3389\/fnins.2020.00798","article-title":"Disease Classification Based on Eye Movement Features with Decision Tree and Random Forest","volume":"14","author":"Mao","year":"2020","journal-title":"Front. Neurosci."},{"key":"ref_35","unstructured":"(2021, June 25). Care Constitution. Available online: https:\/\/careconstitution.com."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/18\/7744\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:47:04Z","timestamp":1760129224000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/18\/7744"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,7]]},"references-count":35,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["s23187744"],"URL":"https:\/\/doi.org\/10.3390\/s23187744","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,7]]}}}