{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T12:14:33Z","timestamp":1788869673009,"version":"build-2803163510"},"reference-count":16,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T00:00:00Z","timestamp":1788825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Eye Mov. Res.","JEMR"],"abstract":"<jats:p>Eye tracking technologies have become increasingly accessible through webcam-based solutions such as WebGazer, enabling large-scale and low-cost experimentation. However, their performance remains sensitive to several experimental and device-related parameters. This study presents a controlled experimental framework developed to systematically evaluate WebGazer under configurable experimental conditions. Within this framework, we design and implement a controlled experimental protocol to investigate the effect of key parameters, including (i) joint calibration\/evaluation point-density configuration, (ii) evaluation-point distribution, (iii) target presentation duration, (iv) stimulus color, and (v) stimulus (target) size. WebGazer\u2019s performance is assessed using both device-pixel spatial error metrics and angular error (delta), providing complementary measures of gaze accuracy. Results from 20 participants show that denser point configurations were associated with lower mean spatial error, from 1383 to 1009 device pixels, and lower mean angular error, from 13.556 to 10.322 degrees, within the tested conditions. Across the aggregated condition summaries, the joint point-density configuration showed the widest spatial-error range, whereas target presentation duration showed the widest angular-error range. Taken together, these two factors displayed the clearest descriptive differences, followed by evaluation-point distribution. Pseudo-random layouts were associated with moderately higher errors than fixed layouts. In contrast, visual properties such as color and size showed comparatively smaller and less consistent differences, with stimulus size displaying a non-monotonic pattern. Overall, temporal and calibration-related settings showed the clearest descriptive associations with WebGazer performance, while visual design choices showed smaller differences. This study provides a practical quantitative framework for systematically assessing webcam-based eye tracking systems under realistic usage conditions.<\/jats:p>","DOI":"10.3390\/jemr19050099","type":"journal-article","created":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T11:23:51Z","timestamp":1788866631000},"page":"99","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Systematic Performance Evaluation of WebGazer Webcam-Based Eye Tracking with Spatial and Angular Error Analysis"],"prefix":"10.3390","volume":"19","author":[{"given":"Evgenia","family":"Psarra","sequence":"first","affiliation":[{"name":"Department of Surveying & Geoinformatics Engineering, University of West Attica, Egaleo Park Campus, Ag. Spyridonos Str., Egaleo, 12243 Athens, Greece"},{"name":"Department of Informatics, University of Piraeus, Karaoli & Dimitriou 80, 18534 Piraeus, Greece"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3030-4203","authenticated-orcid":false,"given":"Vassilios","family":"Krassanakis","sequence":"additional","affiliation":[{"name":"Department of Surveying & Geoinformatics Engineering, University of West Attica, Egaleo Park Campus, Ag. Spyridonos Str., Egaleo, 12243 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"given":"Anastasios L.","family":"Kesidis","sequence":"additional","affiliation":[{"name":"Department of Surveying & Geoinformatics Engineering, University of West Attica, Egaleo Park Campus, Ag. Spyridonos Str., Egaleo, 12243 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,8]]},"reference":[{"key":"ref_1","unstructured":"Duchowski, A.T. (2007). Eye Tracking Methodology: Theory and Practice, Springer. [2nd ed.]."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1109\/TPAMI.2009.30","article-title":"In the eye of the beholder: A survey of models for eyes and gaze","volume":"32","author":"Hansen","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","unstructured":"Papoutsaki, A., Sangkloy, P., Laskey, J., Daskalova, N., Huang, J., and Hays, J. (2016, January 9\u201315). WebGazer: Scalable webcam eye tracking using user interactions. Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI), New York, NY, USA."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Papoutsaki, A., Laskey, J., and Huang, J. (2017, January 7\u201311). SearchGazer: Webcam eye tracking for remote studies of web search. Proceedings of the Conference on Human Information Interaction and Retrieval (CHIIR), Oslo, Norway.","DOI":"10.1145\/3020165.3020170"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"451","DOI":"10.3758\/s13428-017-0913-7","article-title":"Online webcam-based eye tracking in cognitive science: A first look","volume":"50","author":"Semmelmann","year":"2018","journal-title":"Behav. Res. Methods"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3758\/s13428-022-02040-x","article-title":"Webcam-based eye tracking to detect mind wandering and comprehension errors","volume":"56","author":"Hutt","year":"2023","journal-title":"Behav. Res. Methods"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1485","DOI":"10.1017\/S1930297500008512","article-title":"Webcam-based online eye tracking for behavioral research","volume":"16","author":"Yang","year":"2021","journal-title":"Judgm. Decis. Mak."},{"key":"ref_8","first-page":"1","article-title":"jsPsych: A JavaScript library for creating behavioral experiments in a Web browser","volume":"47","year":"2015","journal-title":"Behav. Res. Methods"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1111\/infa.12564","article-title":"Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood","volume":"29","author":"Steffan","year":"2024","journal-title":"Infancy"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ooms, K., and Krassanakis, V. (2018). Measuring the Spatial Noise of a Low-Cost Eye Tracker to Enhance Fixation Detection. J. Imaging, 4.","DOI":"10.3390\/jimaging4080096"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.16910\/jemr.8.1.5","article-title":"Accuracy and Precision of Fixation Locations Recorded with the Low-Cost Eye Tribe Tracker in Different Experimental Set-Ups","volume":"8","author":"Ooms","year":"2015","journal-title":"J. Eye Mov. Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.16910\/jemr.7.1.1","article-title":"EyeMMV Toolbox: An Eye Movement Post-Analysis Tool Based on a Two-Step Spatial Dispersion Threshold for Fixation Identification","volume":"7","author":"Krassanakis","year":"2014","journal-title":"J. Eye Mov. Res."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Krassanakis, V., and Kesidis, A.L. (2020). MatMouse: A Mouse Movements Tracking and Analysis Toolbox for Visual Search Experiments. Multimodal Technol. Interact., 4.","DOI":"10.3390\/mti4040083"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Brandl, S., Eberle, O., Ribeiro, T., S\u00f8gaard, A., and Hollenstein, N. (2024, January 20\u201325). Evaluating webcam-based gaze data as an alternative for human rationale annotations. Proceedings of the LREC-COLING, Torino, Italy.","DOI":"10.63317\/2u3b4pei3y5h"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chhimpa, G.R., Kumar, A., Garhwal, S., Kumar, D., Wani, N.A., Wani, M.A., and Shakil, K.A. (2025). A Comprehensive Framework for Eye Tracking: Methods, Tools, Applications, and Cross-Platform Evaluation. J. Eye Mov. Res., 18.","DOI":"10.3390\/jemr18050047"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lai, L., Su, B., and She, L. (2025). Trends and Transformations: A Bibliometric Analysis of Eye-Tracking Research in Educational Technology. J. Eye Mov. Res., 18.","DOI":"10.3390\/jemr18030023"}],"container-title":["Journal of Eye Movement Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1995-8692\/19\/5\/99\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T11:44:18Z","timestamp":1788867858000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1995-8692\/19\/5\/99"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,8]]},"references-count":16,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2026,10]]}},"alternative-id":["jemr19050099"],"URL":"https:\/\/doi.org\/10.3390\/jemr19050099","relation":{},"ISSN":["1995-8692"],"issn-type":[{"value":"1995-8692","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,8]]}}}