{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T21:21:49Z","timestamp":1762377709110,"version":"3.44.0"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2025,5,22]],"date-time":"2025-05-22T00:00:00Z","timestamp":1747872000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,5,22]]},"abstract":"<jats:p>Future intelligent aircraft are envisioned to predict human failures and mitigate threats at runtime to optimize safety. Contributing towards realizing this vision, and more specifically, recognizing when timely interventions should be invoked, this paper investigates gaze-based predictions on pilots' success and failure. In a simulated study with 50 licensed pilots performing an Instrument Landing System approach in low-visibility conditions, we examined the use of saccade magnitude and direction, pupil dilation, fixation duration, and blink rate to detect notable events experienced by pilots. We performed classification experiments using established machine learning models demonstrating that pilots' performance can be successfully predicted as early as 3.42 minutes after task initiation with accuracies up to 80.92% depending on the gaze measure used. Our findings also showed improved accuracies compared to predictions generated using established gaze measures such as gaze entropy. Furthermore, accuracies tend to peak during critical flight phases and support vector machines performed well across the tested gaze measures.<\/jats:p>","DOI":"10.1145\/3725836","type":"journal-article","created":{"date-parts":[[2025,5,22]],"date-time":"2025-05-22T18:18:53Z","timestamp":1747937933000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Event-Driven Predictive Gaze Analytics to Enhance Aviation Safety"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9874-9551","authenticated-orcid":false,"given":"Bo","family":"Fu","sequence":"first","affiliation":[{"name":"California State University Long Beach, Long Beach, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-5169-5479","authenticated-orcid":false,"given":"Christopher","family":"De Jong","sequence":"additional","affiliation":[{"name":"California State University Long Beach, Long Beach, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-3590-2520","authenticated-orcid":false,"given":"Nicolas Guardado","family":"Guardado","sequence":"additional","affiliation":[{"name":"California State University Long Beach, Long Beach, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-8345-8032","authenticated-orcid":false,"given":"Angelo Ryan","family":"Soriano","sequence":"additional","affiliation":[{"name":"California State University Long Beach, Long Beach, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8889-5296","authenticated-orcid":false,"given":"Anthony","family":"Reyes","sequence":"additional","affiliation":[{"name":"California State University Long Beach, Long Beach, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,5,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21134289"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/24721840.2018.1514978"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1080\/10508414.2017.1313096"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140139.2019.1685132"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517031.3532199"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.promfg.2015.07.583"},{"key":"e_1_2_1_7_1","volume-title":"European Association for Aviation Psychology Conference","author":"Lefrancois O.","year":"2016","unstructured":"Lefrancois, O., Matton, N., Yves, G., Peysakhovich, V., and Causse, M. (2016). The role of Pilots' monitoring strategies in flight performance. EAAP32, European Association for Aviation Psychology Conference, Cascais, Portugal."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1080\/10508414.2017.1366269"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.3390\/safety4010008"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3649902.3653336"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3631700.3664871"},{"key":"e_1_2_1_12_1","volume-title":"Visualizing Pilot Eye Movements for Flight Instructors. In ETVIS'18: 3rd Workshop on Eye Tracking and Visualization, June 14--17","author":"Rudi D.","year":"2018","unstructured":"Rudi, D., Kiefer, P., and Raubal, M. (2018). Visualizing Pilot Eye Movements for Flight Instructors. In ETVIS'18: 3rd Workshop on Eye Tracking and Visualization, June 14--17, 2018, Warsaw, Poland. ACM, New York, NY, USA."},{"key":"e_1_2_1_13_1","first-page":"10","volume-title":"VR Cognitive Load Dashboard for Flight Simulator. In 2022 Symposium on Eye Tracking Research and Applications (ETRA '22)","author":"Arjun S.","year":"2022","unstructured":"Arjun, S., Hebbar, A., Vinod, S., and Biswas, P. (2022). VR Cognitive Load Dashboard for Flight Simulator. In 2022 Symposium on Eye Tracking Research and Applications (ETRA '22), June 8--11, 2022, Seattle, WA, USA. ACM, New York, NY, USA, 4 pages. doi: 10. 1145\/3517031.3529777"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0247061"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1027\/2192-0923\/a000221"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517031.3529641"},{"key":"e_1_2_1_17_1","volume-title":"Towards Intelligent Flight Deck -- A Case Study of Applied Eye Tracking in The Predictions of Pilot Success and Failure During Simulated Flight Takeoff","author":"Fu B.","year":"2024","unstructured":"Fu, B., Gatsby, P., Soriano, A. R., Chu, K., and Guardado, N. G. (2024b). Towards Intelligent Flight Deck -- A Case Study of Applied Eye Tracking in The Predictions of Pilot Success and Failure During Simulated Flight Takeoff, In: Alan Dix, Matt Roach, Tommaso Turchi, Alessio Malizia, and Ben Wilson (Eds) Proceedings of the International Workshop on Designing and Building Hybrid Human--AI Systems, co-located with the 17th International Conference on Advanced Visual Interfaces, ceur-ws.org, Vol-3701."},{"key":"e_1_2_1_18_1","volume-title":"DC 20591","author":"Federal Aviation Administration","year":"2018","unstructured":"Federal Aviation Administration (2018). Instrument Rating-Airplane Airman Certification Standards, Flight Standards Service, Washington, DC 20591, FAA-S-ACS-8B, June 2018. Retrieved November 1, 2024 from https:\/\/www.faa.gov\/sites\/faa.gov\/files\/training_testing\/testing\/acs\/instrument_rating_acs_change_1.pdf"},{"key":"e_1_2_1_19_1","volume-title":"FAA-H-8083--3C","author":"Federal Aviation Administration","year":"2022","unstructured":"Federal Aviation Administration (2022a). Airplane Flying Handbook, FAA-H-8083--3C, 2022. Retrieved November 1, 2024 from https:\/\/www.faa.gov\/sites\/faa.gov\/files\/regulations_policies\/handbooks_manuals\/aviation\/airplane_handbook\/00_afh_full.pdf"},{"key":"e_1_2_1_20_1","volume-title":"FAA-H-8083--168","author":"Federal Aviation Administration","year":"2022","unstructured":"Federal Aviation Administration (2022b). Instrument Procedures Handbook, FAA-H-8083--168, 2022. Retrieved November 1, 2024 from https:\/\/www.faa.gov\/sites\/faa.gov\/files\/regulations_policies\/handbooks_manuals\/aviation\/instrument_procedures_handbook\/FAA-H-8083--16B.pdf"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-55109-3_7"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3576050.3576108"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 2022 Conference on Human Information Interaction and Retrieval, 211--220","author":"Steichen B.","year":"2022","unstructured":"Steichen, B., Kosasih, W., and Becerra, C. (2022). March. Inferring search user language proficiency from eye gaze data. In Proceedings of the 2022 Conference on Human Information Interaction and Retrieval, 211--220."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/alz.055717"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301400"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340631.3394881"},{"key":"e_1_2_1_27_1","volume-title":"Stationary gaze entropy predicts lane departure events in sleep-deprived drivers. Scientific reports, 8(1), 1--10","author":"Shiferaw B.A.","year":"2018","unstructured":"Shiferaw, B.A., Downey, L.A., Westlake, J., Stevens, B., Rajaratnam, S.M., Berlowitz, D.J., Swann, P. and Howard, M.E. (2018). Stationary gaze entropy predicts lane departure events in sleep-deprived drivers. Scientific reports, 8(1), 1--10."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2633043"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","unstructured":"Fu B. Predictive Gaze Analytics: A Comparative Case Study of the Foretelling Signs of User Performance During Interaction with Visualizations of Ontology Class Hierarchies Multimodal Technologies and Interaction 8(10):90 2024. doi:10.3390\/mti8100090","DOI":"10.3390\/mti8100090"},{"key":"e_1_2_1_30_1","volume-title":"retrieved","author":"Beach Environment","year":"2025","unstructured":"Beach Environment for the Analytics of Human Gaze (BEACH-Gaze) codebase, retrieved Apr 2, 2025 from https:\/\/github.com\/TheD2Lab\/BEACH-Gaze"},{"key":"e_1_2_1_31_1","volume-title":"Blink rate as a measure of fatigue (Report No. DOT\/FAA\/AM-94\/17)","author":"Federal Aviation Administration","year":"1994","unstructured":"Federal Aviation Administration (1994). Blink rate as a measure of fatigue (Report No. DOT\/FAA\/AM-94\/17). FAA Civil Aeromedical Institute. Retrieved November 1, 2024 from FAA Civil Aeromedical Institute Study https:\/\/www.faa.gov\/sites\/faa.gov\/files\/data_research\/research\/med_humanfacs\/oamtechreports\/AM94--17.pdf"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1177\/001872089403600209"},{"key":"e_1_2_1_33_1","volume-title":"Pilots' Role in Collision Avoidance (Advisory Circular AC 90--48D). Retrieved","author":"Federal Aviation Administration","year":"2016","unstructured":"Federal Aviation Administration (2016). Pilots' Role in Collision Avoidance (Advisory Circular AC 90--48D). Retrieved November 1, 2024 from FAA Advisory Circular AC 90--48D https:\/\/www.faa.gov\/documentLibrary\/media\/Advisory_Circular\/AC_90--48D.pdf"},{"key":"e_1_2_1_34_1","volume-title":"Pilot Vision. Retrieved","author":"Federal Aviation Administration","year":"2021","unstructured":"Federal Aviation Administration (2021). Pilot Vision. Retrieved November 1, 2024 from https:\/\/www.faa.gov\/pilots\/safety\/pilotsafetybrochures\/media\/Pilot_Vision.pdf"},{"key":"e_1_2_1_35_1","volume-title":"Topography of the Layer of Rods and Cones in the Human Retina. A. Busck","author":"\u00d8sterberg G.","year":"1935","unstructured":"\u00d8sterberg, G. (1935). Topography of the Layer of Rods and Cones in the Human Retina. A. Busck."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-018--1432-y"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0203629"},{"key":"e_1_2_1_38_1","volume-title":"Morgan Kaufmann","author":"Frank E.","year":"2016","unstructured":"Frank, E., Hall, M. A., and Witten, I.H. (2016). The WEKA Workbench. Online Appendix for Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufmann, Fourth Edition, 2016."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnsys.2023.1242654"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1201\/b18042--48"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3725836","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3725836","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,23]],"date-time":"2025-08-23T01:51:19Z","timestamp":1755913879000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3725836"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,22]]},"references-count":40,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,5,22]]}},"alternative-id":["10.1145\/3725836"],"URL":"https:\/\/doi.org\/10.1145\/3725836","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2025,5,22]]},"assertion":[{"value":"2025-05-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}