{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T22:15:11Z","timestamp":1773785711729,"version":"3.50.1"},"reference-count":47,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2020,7,15]],"date-time":"2020-07-15T00:00:00Z","timestamp":1594771200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the 34 developed and 156 developing countries, there are ~132 million disabled people who need a wheelchair, constituting 1.86% of the world population. Moreover, there are millions of people suffering from diseases related to motor disabilities, which cause inability to produce controlled movement in any of the limbs or even head. This paper proposes a system to aid people with motor disabilities by restoring their ability to move effectively and effortlessly without having to rely on others utilizing an eye-controlled electric wheelchair. The system input is images of the user\u2019s eye that are processed to estimate the gaze direction and the wheelchair was moved accordingly. To accomplish such a feat, four user-specific methods were developed, implemented, and tested; all of which were based on a benchmark database created by the authors. The first three techniques were automatic, employ correlation, and were variants of template matching, whereas the last one uses convolutional neural networks (CNNs). Different metrics to quantitatively evaluate the performance of each algorithm in terms of accuracy and latency were computed and overall comparison is presented. CNN exhibited the best performance (i.e., 99.3% classification accuracy), and thus it was the model of choice for the gaze estimator, which commands the wheelchair motion. The system was evaluated carefully on eight subjects achieving 99% accuracy in changing illumination conditions outdoor and indoor. This required modifying a motorized wheelchair to adapt it to the predictions output by the gaze estimation algorithm. The wheelchair control can bypass any decision made by the gaze estimator and immediately halt its motion with the help of an array of proximity sensors, if the measured distance goes below a well-defined safety margin. This work not only empowers any immobile wheelchair user, but also provides low-cost tools for the organization assisting wheelchair users.<\/jats:p>","DOI":"10.3390\/s20143936","type":"journal-article","created":{"date-parts":[[2020,7,16]],"date-time":"2020-07-16T10:54:46Z","timestamp":1594896886000},"page":"3936","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":54,"title":["An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair Control"],"prefix":"10.3390","volume":"20","author":[{"given":"Mahmoud","family":"Dahmani","sequence":"first","affiliation":[{"name":"School of Engineering, University of Maryland, College Park, MD 20742, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0744-8206","authenticated-orcid":false,"given":"Muhammad E. H.","family":"Chowdhury","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, College of Engineering, Qatar University, Doha 2713, Qatar"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7068-9112","authenticated-orcid":false,"given":"Amith","family":"Khandakar","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, College of Engineering, Qatar University, Doha 2713, Qatar"}]},{"given":"Tawsifur","family":"Rahman","sequence":"additional","affiliation":[{"name":"Department of Biomedical Physics and Technology, University of Dhaka, Dhaka 1000, Bangladesh"}]},{"given":"Khaled","family":"Al-Jayyousi","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, College of Engineering, Qatar University, Doha 2713, Qatar"}]},{"given":"Abdalla","family":"Hefny","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, College of Engineering, Qatar University, Doha 2713, Qatar"}]},{"given":"Serkan","family":"Kiranyaz","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, College of Engineering, Qatar University, Doha 2713, Qatar"}]}],"member":"1968","published-online":{"date-parts":[[2020,7,15]]},"reference":[{"key":"ref_1","unstructured":"(2017, March 10). Analysis of Wheelchair Need\/Del-Corazon.org. Available online: http:\/\/www.del-corazon.org\/analysis-of-wheelchair-need."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1177\/0361198119847985","article-title":"Non-Intrusive Detection of Drowsy Driving Based on Eye Tracking Data","volume":"2673","author":"Zandi","year":"2019","journal-title":"Transp. Res. Rec. J. Transp. Res. Board"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhang, J., Yang, Z., Deng, H., Yu, H., Ma, M., and Xiang, Z. (2019). Dynamic Visual Measurement of Driver Eye Movements. Sensors, 19.","DOI":"10.3390\/s19102217"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1186\/s12938-019-0670-1","article-title":"Look me in the eye: Evaluating the accuracy of smartphone-based eye tracking for potential application in autism spectrum disorder research","volume":"18","author":"Strobl","year":"2019","journal-title":"Biomed. Eng. Online"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1002\/npr2.12046","article-title":"Application of eye trackers for understanding mental disorders: Cases for schizophrenia and autism spectrum disorder","volume":"39","author":"Shishido","year":"2019","journal-title":"Neuropsychopharmacol. Rep."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Cruz, R., Souza, V., Filho, T.B., and Lucena, V. (2019, January 11\u201313). Electric Powered Wheelchair Command by Information Fusion from Eye Tracking and BCI. Proceedings of the 2019 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.","DOI":"10.1109\/ICCE.2019.8662090"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Rupanagudi, S.R., Koppisetti, M., Satyananda, V., Bhat, V.G., Gurikar, S.K., Koundinya, S.P., Sumedh, S.K.M., Shreyas, R., Shilpa, S., and Suman, N.M. (2019, January 5\u20137). A Video Processing Based Eye Gaze Recognition Algorithm for Wheelchair Control. Proceedings of the 2019 10th International Conference on Dependable Systems, Services and Technologies (DESSERT), Leeds, UK.","DOI":"10.1109\/DESSERT.2019.8770025"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"17","DOI":"10.16910\/jemr.10.5.10","article-title":"Visual Multi-Metric Grouping of Eye-Tracking Data","volume":"10","author":"Kumar","year":"2018","journal-title":"J. Eye Mov. Res."},{"key":"ref_9","first-page":"177","article-title":"A Survey on Human Eye-Gaze Tracking (EGT) System \u201cA Comparative Study\u201d","volume":"9","author":"Ahmed","year":"2019","journal-title":"Iraqi J. Inf. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1306","DOI":"10.1016\/j.comcom.2011.11.002","article-title":"Wearable eye tracking for mental health monitoring","volume":"35","author":"Vidal","year":"2012","journal-title":"Comput. Commun."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Reddy, T.K., Gupta, V., and Behera, L. (2018). Autoencoding Convolutional Representations for Real-Time Eye-Gaze Detection. Advances in Intelligent Systems and Computing, Springer Science and Business Media LLC.","DOI":"10.1007\/978-981-13-1135-2_18"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Jafar, F., Fatima, S.F., Mushtaq, H.R., Khan, S., Rasheed, A., and Sadaf, M. (2019, January 28\u201329). Eye Controlled Wheelchair Using Transfer Learning. Proceedings of the 2019 International Symposium on Recent Advances in Electrical Engineering (RAEE), Islamabad, Pakistan.","DOI":"10.1109\/RAEE.2019.8886992"},{"key":"ref_13","first-page":"141","article-title":"Eye Monitored Wheelchair Control for People Suffering from Quadriplegia","volume":"8","author":"Deshpande","year":"2019","journal-title":"Univers. Rev."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Majaranta, P., and Bulling, A. (2014). Eye Tracking and Eye-Based Human\u2013Computer Interaction. Human\u2013Computer Interaction Series, Springer Science and Business Media LLC.","DOI":"10.1007\/978-1-4471-6392-3_3"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hickson, S., Dufour, N., Sud, A., Kwatra, V., and Essa, I. (2019, January 7\u201311). Eyemotion: Classifying Facial Expressions in VR Using Eye-Tracking Cameras. Proceedings of the 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa Village, HI, USA.","DOI":"10.1109\/WACV.2019.00178"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1016\/j.compmedimag.2017.04.006","article-title":"Application of eye tracking in medicine: A survey, research issues and challenges","volume":"65","author":"Harezlak","year":"2018","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.1007\/s00138-016-0776-4","article-title":"Pupil detection for head-mounted eye tracking in the wild: An evaluation of the state of the art","volume":"27","author":"Fuhl","year":"2016","journal-title":"Mach. Vis. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Liu, T.-L., and Fan, C.-P. (2018, January 12\u201314). Visible-light wearable eye gaze tracking by gradients-based eye center location and head movement compensation with IMU. Proceedings of the 2018 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.","DOI":"10.1109\/ICCE.2018.8326076"},{"key":"ref_19","unstructured":"Robbins, S., McEldowney, S., Lou, X., Nister, D., Steedly, D., Miller, Q.S.C., Bohn, D.D., Terrell, J.P., Goris, A.C., and Ackerman, N. (2019). Eye-Tracking System Using a Freeform Prism and Gaze-Detection Light. (10,228,561), U.S. Patent."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sasaki, M., Nagamatsu, T., and Takemura, K. (2019, January 25\u201328). Screen corner detection using polarization camera for cross-ratio based gaze estimation. Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications, Denver, CO, USA.","DOI":"10.1145\/3314111.3319814"},{"key":"ref_21","first-page":"1001","article-title":"Eye Tracking: Biometric Evaluations of Instructional Materials for Improved Learning","volume":"13","author":"Holland","year":"2019","journal-title":"Int. J Educ. Pedag. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chen, B.-C., Wu, P.-C., and Chien, S.-Y. (2015, January 27\u201330). Real-time eye localization, blink detection, and gaze estimation system without infrared illumination. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec, QC, Canada.","DOI":"10.1109\/ICIP.2015.7350892"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Fuhl, W., Santini, T.C., K\u00fcbler, T., and Kasneci, E. (2016, January 14\u201317). Else: Ellipse selection for robust pupil detection in real-world environments. Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications, Charleston, SC, USA.","DOI":"10.1145\/2857491.2857505"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Fuhl, W., K\u00fcbler, T., Sippel, K., Rosenstiel, W., and Kasneci, E. (2015). ExCuSe: Robust Pupil Detection in Real-World Scenarios. International Conference on Computer Analysis of Images and Patterns, Springer.","DOI":"10.1007\/978-3-319-23192-1_4"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kassner, M., Patera, W., and Bulling, A. (2014, January 13\u201317). Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interaction. Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication, Seattle, WA, USA.","DOI":"10.1145\/2638728.2641695"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"4","DOI":"10.3389\/fneng.2015.00004","article-title":"SET: A pupil detection method using sinusoidal approximation","volume":"8","author":"Javadi","year":"2015","journal-title":"Front. Neuroeng."},{"key":"ref_27","unstructured":"Li, D., Winfield, D., and Parkhurst, D.J. (2005, January 21\u201323). Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905)-Workshops, San Diego, CA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"\u015awirski, L., Bulling, A., and Dodgson, N. (2012, January 28\u201330). Robust real-time pupil tracking in highly off-axis images. Proceedings of the Symposium on Eye Tracking Research and Applications, Santa Barbara, CA, USA.","DOI":"10.1145\/2168556.2168585"},{"key":"ref_29","first-page":"1836","article-title":"Design of an accurate and high-speed binocular pupil tracking system based on GPGPUs","volume":"74","author":"Aragon","year":"2017","journal-title":"J. Supercomput."},{"key":"ref_30","first-page":"65","article-title":"Voice controlled intelligent wheelchair using raspberry pi","volume":"2","author":"Naeem","year":"2014","journal-title":"Int. J. Technol. Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.cmpb.2018.08.013","article-title":"A facial expression controlled wheelchair for people with disabilities","volume":"165","author":"Rabhi","year":"2018","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"66","DOI":"10.20965\/jrm.2011.p0066","article-title":"A Prototype of ElectricWheelchair Controlled by Eye-Only for Paralyzed User","volume":"23","author":"Arai","year":"2011","journal-title":"J. Robot. Mechatron."},{"key":"ref_33","unstructured":"Mani, N., Sebastian, A., Paul, A.M., Chacko, A., and Raghunath, A. (2015). Eye controlled electric wheel chair. Int. J. Adv. Res. Electr. Electron. Instrum. Eng., 4."},{"key":"ref_34","first-page":"206","article-title":"Eye movement based electronic wheel chair for physically challenged persons","volume":"3","author":"Gautam","year":"2014","journal-title":"Int. J. Sci. Technol. Res."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Patel, S.N., Prakash, V., and Narayan, P.S. (2015, January 19\u201320). Autonomous camera based eye controlled wheelchair system using raspberry-pi. Proceedings of the 2015 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS), Coimbatore, India.","DOI":"10.1109\/ICIIECS.2015.7192876"},{"key":"ref_36","first-page":"409","article-title":"Microcontroller based EOG guided wheelchair","volume":"7","author":"Chacko","year":"2013","journal-title":"Int. J. Med. Health Pharm. Biomed. Eng."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Al-Haddad, A., Sudirman, R., and Omar, C. (2011, January 20\u201322). Guiding Wheelchair Motion Based on EOG Signals Using Tangent Bug Algorithm. Proceedings of the 2011 Third International Conference on Computational Intelligence, Modelling & Simulation, Langkawi, Malaysia.","DOI":"10.1109\/CIMSim.2011.17"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1002\/mus.26655","article-title":"Eye-controlled, power wheelchair performs well for ALS patients","volume":"60","author":"Elliott","year":"2019","journal-title":"Muscle Nerve"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Krafka, K., Khosla, A., Kellnhofer, P., Kannan, H., Bhandarkar, S., Matusik, W., and Torralba, A. (July, January 26). Eye Tracking for Everyone. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.239"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"George, A., and Routray, A. (2016, January 12\u201315). Real-time eye gaze direction classification using convolutional neural network. Proceedings of the 2016 International Conference on Signal Processing and Communications (SPCOM), Bangalore, India.","DOI":"10.1109\/SPCOM.2016.7746701"},{"key":"ref_41","unstructured":"(2017, March 10). Spinel IR Camera, Spinel 2MP full HD USB Camera Module Infrared OV2710 with Non-distortion Lens FOV 100 degree, Support 1920x1080@30fps, UVC Compliant, Support most OS, Focus Adjustable UC20MPD_ND. Available online: https:\/\/www.amazon.com\/Spinel-Non-distortion-1920x1080-Adjustable-UC20MPD_ND\/dp\/B0711JVGTN."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1109\/TGRS.1990.572934","article-title":"Texture Unit, Texture Spectrum, and Texture Analysis","volume":"28","author":"He","year":"1990","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Lian, Z., Er, M.J., and Li, J. (2011, January 29\u201331). A Novel Face Recognition Approach under Illumination Variations Based on Local Binary Pattern. Proceedings of the International Conference on Computer Analysis of Images and Patterns, Seville, Spain.","DOI":"10.1007\/978-3-642-23678-5_9"},{"key":"ref_44","unstructured":"Cs.columbia.edu (2017, March 10). CAVE\/Database: Columbia Gaze Data Set. Available online: http:\/\/www.cs.columbia.edu\/CAVE\/databases\/columbia_gaze\/."},{"key":"ref_45","unstructured":"(2017, March 10). GI4E\/Gi4E Database. Available online: Ttp:\/\/gi4e.unavarra.es\/databases\/gi4e\/."},{"key":"ref_46","unstructured":"(2017, March 10). UBIRIS Database. Available online: http:\/\/iris.di.ubi.pt\/."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Lakovic, N., Brkic, M., Batinic, B., Bajic, J., Rajs, V., and Kulundzic, N. (2019, January 20\u201322). Application of low-cost VL53L0X ToF sensor for robot environment detection. Proceedings of the 2019 18th International Symposium Infoteh-Jahorina (INFOTEH), East Sarajevo, Srpska.","DOI":"10.1109\/INFOTEH.2019.8717779"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/14\/3936\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:48:45Z","timestamp":1760176125000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/14\/3936"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,15]]},"references-count":47,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2020,7]]}},"alternative-id":["s20143936"],"URL":"https:\/\/doi.org\/10.3390\/s20143936","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,15]]}}}