{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T16:55:22Z","timestamp":1774716922499,"version":"3.50.1"},"reference-count":33,"publisher":"Wiley","issue":"7","license":[{"start":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T00:00:00Z","timestamp":1680739200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["advanced.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Advanced Intelligent Systems"],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:sec><jats:label\/><jats:p>Recent advances in sensors and electronics have enabled electrooculogram (EOG) detection systems for capturing eye movements. However, EOG signals are susceptible to the sensor's skin\u2010contact quality, limiting the precise detection of eye angles and gaze. Herein, a two\u2010camera eye\u2010tracking system and a data classification method for persistent human\u2013machine interfaces (HMIs) are introduced. Machine\u2010learning technology is used for a continuous real\u2010time classification of gaze and eye directions, to precisely control a robotic arm. In addition, a deep\u2010learning algorithm for classifying eye directions is developed and the pupil center\u2010corneal reflection method of an eye tracker for gaze tracking is utilized. A supervisory control and data acquisition architecture that can be universally applied to any screen\u2010based HMI task are used by the system. It is shown in the study that the classification algorithm using deep learning enables exceptional accuracy (99.99%) with the number of actions per command (\u226564), the highest performance compared to other HMI systems. Demonstrating real\u2010time control of a robotic arm captures the unique advantages of the precise eye\u2010tracking system for playing chess and manipulating dice. Overall, this paper shows the HMI system's potential for remote control of surgery robots, warehouse systems, and construction tools.<\/jats:p><\/jats:sec>","DOI":"10.1002\/aisy.202200408","type":"journal-article","created":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T05:02:52Z","timestamp":1680757372000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Persistent Human\u2013Machine Interfaces for Robotic Arm Control Via Gaze and Eye Direction Tracking"],"prefix":"10.1002","volume":"5","author":[{"given":"Seunghyeb","family":"Ban","sequence":"first","affiliation":[{"name":"School of Engineering and Computer Science Washington State University  Vancouver WA 98686 USA"},{"name":"IEN Center for Human-Centric Interfaces and Engineering at the Institute for Electronics and Nanotechnology Georgia Institute of Technology  Atlanta GA 30332 USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yoon Jae","family":"Lee","sequence":"additional","affiliation":[{"name":"IEN Center for Human-Centric Interfaces and Engineering at the Institute for Electronics and Nanotechnology Georgia Institute of Technology  Atlanta GA 30332 USA"},{"name":"School of Electrical and Computer Engineering Georgia Institute of Technology  Atlanta GA 30332 USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ki Jun","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Electrical and Electronic Engineering Yonsei University  Seoul 03722 Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jae Won","family":"Chang","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery School of Medicine Chungnam National University Hospital  Daejeon 35015 Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jong-Hoon","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Engineering and Computer Science Washington State University  Vancouver WA 98686 USA"},{"name":"Department of Mechanical Engineering University of Washington  Seattle WA 98195 USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5526-3882","authenticated-orcid":false,"given":"Woon-Hong","family":"Yeo","sequence":"additional","affiliation":[{"name":"IEN Center for Human-Centric Interfaces and Engineering at the Institute for Electronics and Nanotechnology Georgia Institute of Technology  Atlanta GA 30332 USA"},{"name":"George W. Woodruff School of Mechanical Engineering Wallace H. Coulter Department of Biomedical Engineering Parker H. Petit Institute for Bioengineering and Biosciences Institute for Materials Neural Engineering Center Institute for Robotics and Intelligent Machines Georgia Institute of Technology  Atlanta GA 30332 USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2023,4,6]]},"reference":[{"key":"e_1_2_8_2_1","unstructured":"V.Kartsch M.Guermandi S.Benatti F.Montagna L.Benini presented atIEEE Sensors Applications Symp. IEEE Piscataway NJ2019."},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.3233\/AIS-2009-0020"},{"key":"e_1_2_8_3_2","doi-asserted-by":"publisher","DOI":"10.1080\/03091902.2020.1853838"},{"key":"e_1_2_8_3_3","doi-asserted-by":"publisher","DOI":"10.1155\/2014\/713818"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1021\/acs.nanolett.9b02014"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.aay1729"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2011.11.002"},{"key":"e_1_2_8_7_1","unstructured":"C. C.Poon E. Y.Leung K. C.Lau B. H.Leung Y. L.Zheng P. W.Chiu Y.Yam InDesign User Experience and Usability: Interactive Experience Design: 4th Inte. Conf. Springer International Publishing Los Angeles CA USAAugust 2\u201372015 pp.693\u2013701."},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/advs.201900939"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/1087054720972786"},{"key":"e_1_2_8_9_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-88191-x"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbtep.2017.11.004"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11412-018-9281-2"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2017.11.011"},{"key":"e_1_2_8_13_1","doi-asserted-by":"crossref","unstructured":"S.Albawi T. A.Mohammed S.Al-Zawi In 2017 Inte. Conf. on Engineering and Technology (ICET) IEEE Akdeniz University Antalya TurkeyAugust2017 pp.1\u20136.","DOI":"10.1109\/ICEngTechnol.2017.8308186"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1299\/mej.15-00568"},{"key":"e_1_2_8_15_1","unstructured":"H.Kenneth A.Richard Eye-Tracking: A Comprehensive Guide to Methods Paradigms and Measures Lund Eye-Tracking Research Institute Lund Sweden2017 p.978 ISBN-13 978-1979484893."},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/JTEHM.2013.2289879"},{"key":"e_1_2_8_17_1","doi-asserted-by":"crossref","unstructured":"E.Mendoza J.Andramu\u00f1o J.N\u00fa\u00f1ez L.C\u00f3rdova presented at10th IC-MSQUARE 2021 Vol.2090 AIP Publishing GR (Virtual)6\u20139 September2021 pp.1\u201315 https:\/\/iopscience.iop.org\/article\/10.1088\/1742-6596\/2090\/1\/012124\/pdf.","DOI":"10.1088\/1742-6596\/2090\/1\/012124"},{"key":"e_1_2_8_18_1","volume-title":"Physiology of the Eye: An Introduction to the Vegetative Functions","author":"Fatt I.","year":"2013"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.heliyon.2020.e04388"},{"key":"e_1_2_8_20_1","doi-asserted-by":"crossref","unstructured":"K.Gangar H.Ruparel S.Lele InInt. Conf. on Communication Computing and Electronics Systems: Proc. of ICCCES 2020 Springer Singapore PPG Institute of Technology Coimbatore India2021 pp.337\u2013347.","DOI":"10.1007\/978-981-33-4909-4_25"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.3390\/bios11090343"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1021\/acsami.0c03110"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.measurement.2018.06.017"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.18494\/SAM.2020.2517"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41699-018-0064-4"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbe.2019.04.002"},{"key":"e_1_2_8_27_1","unstructured":"L.Wei H.Hu K.Yuan presented atIEEE Inter. Conf. on Robotics and Biomimetics IEEE Pisataway NJ2009."},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.3390\/s17071485"},{"key":"e_1_2_8_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bios.2017.01.044"},{"key":"e_1_2_8_30_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21175882"},{"key":"e_1_2_8_31_1","doi-asserted-by":"crossref","unstructured":"P.Shyamkumar S.Oh N.Banerjee V. K.Varadan InAdvances in Science and Technology Vol.85 Trans Tech Publications Ltd.2013 pp.11\u201316.","DOI":"10.4028\/www.scientific.net\/AST.85.11"}],"container-title":["Advanced Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202200408","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T23:45:53Z","timestamp":1759880753000},"score":1,"resource":{"primary":{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/10.1002\/aisy.202200408"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,6]]},"references-count":33,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["10.1002\/aisy.202200408"],"URL":"https:\/\/doi.org\/10.1002\/aisy.202200408","archive":["Portico"],"relation":{},"ISSN":["2640-4567","2640-4567"],"issn-type":[{"value":"2640-4567","type":"print"},{"value":"2640-4567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,6]]},"assertion":[{"value":"2022-11-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-04-06","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"2200408"}}