{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T09:00:36Z","timestamp":1768467636933,"version":"3.49.0"},"reference-count":33,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2019,5,23]],"date-time":"2019-05-23T00:00:00Z","timestamp":1558569600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Science Centre in Poland","award":["2017\/27\/B\/HS6\/00169"],"award-info":[{"award-number":["2017\/27\/B\/HS6\/00169"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Existing research has shown that human eye-movement data conveys rich information about underlying mental processes, and that the latter may be inferred from the former. However, most related studies rely on spatial information about which different areas of visual stimuli were looked at, without considering the order in which this occurred. Although powerful algorithms for making pairwise comparisons between eye-movement sequences (scanpaths) exist, the problem is how to compare two groups of scanpaths, e.g., those registered with vs. without an experimental manipulation in place, rather than individual scanpaths. Here, we propose that the problem might be solved by projecting a scanpath similarity matrix, obtained via a pairwise comparison algorithm, to a lower-dimensional space (the comparison and dimensionality-reduction techniques we use are ScanMatch and t-SNE). The resulting distributions of low-dimensional vectors representing individual scanpaths can be statistically compared. To assess if the differences result from temporal scanpath features, we propose to statistically compare the cross-validated accuracies of two classifiers predicting group membership: (1) based exclusively on spatial metrics; (2) based additionally on the obtained scanpath representation vectors. To illustrate, we compare autistic vs. typically-developing individuals looking at human faces during a lab experiment and find significant differences in temporal scanpath features.<\/jats:p>","DOI":"10.3390\/s19102377","type":"journal-article","created":{"date-parts":[[2019,5,24]],"date-time":"2019-05-24T02:22:00Z","timestamp":1558664520000},"page":"2377","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A Novel Eye Movement Data Transformation Technique that Preserves Temporal Information: A Demonstration in a Face Processing Task"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5512-214X","authenticated-orcid":false,"given":"Micha\u0142","family":"Kr\u00f3l","sequence":"first","affiliation":[{"name":"Department of Economics, The University of Manchester, Manchester M13 9PL, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7951-1537","authenticated-orcid":false,"given":"Magdalena Ewa","family":"Kr\u00f3l","sequence":"additional","affiliation":[{"name":"Wroclaw Faculty of Psychology, SWPS University of Social Sciences and Humanities, 53-238 Warszawa, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2019,5,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Betz, T., Kietzmann, T.C., Wilming, N., and K\u00f6nig, P. (2010). Investigating task-dependent top-down effects on overt visual attention. J. Vis., 10.","DOI":"10.1167\/10.3.15"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1097","DOI":"10.1007\/s10586-017-0746-2","article-title":"Mining biometric data to predict programmer expertise and task difficulty","volume":"21","author":"Lee","year":"2018","journal-title":"Clust. Comput."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1167\/17.5.23","article-title":"Scan patterns during real-world scene viewing predict individual differences in cognitive capacity","volume":"17","author":"Hayes","year":"2017","journal-title":"J. Vis."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1167\/14.3.29","article-title":"Defending Yarbus: Eye movements reveal observers\u2019 task","volume":"14","author":"Borji","year":"2014","journal-title":"J. Vis."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1162\/neco.1993.5.4.613","article-title":"Improving Generalization for Temporal Difference Learning: The Successor Representation","volume":"5","author":"Dayan","year":"1993","journal-title":"Neural Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1167\/11.10.10","article-title":"A novel method for analyzing sequential eye movements reveals strategic influence on Raven\u2019s Advanced Progressive Matrices","volume":"11","author":"Hayes","year":"2011","journal-title":"J. Vis."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kr\u00f3l, M., and Kr\u00f3l, M.E. (2019). Learning From Peers\u2019 Eye Movements in the Absence of Expert Guidance: A Proof of Concept Using Laboratory Stock Trading, Eye Tracking, and Machine Learning. Cogn. Sci., 43.","DOI":"10.1111\/cogs.12716"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"362","DOI":"10.3758\/s13428-017-0876-8","article-title":"Scanpath modeling and classification with hidden Markov models","volume":"50","author":"Coutrot","year":"2018","journal-title":"Behav. Res. Methods"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"692","DOI":"10.3758\/BRM.42.3.692","article-title":"ScanMatch: A novel method for comparing fixation sequences","volume":"42","author":"Cristino","year":"2010","journal-title":"Behav. Res. Methods"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1016\/0022-2836(70)90057-4","article-title":"A general method applicable to the search for similarities in the amino acid sequence of two proteins","volume":"48","author":"Needleman","year":"1970","journal-title":"J. Mol. Biol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.3758\/s13428-014-0550-3","article-title":"A comparison of scanpath comparison methods","volume":"47","author":"Anderson","year":"2015","journal-title":"Behav. Res. Methods"},{"key":"ref_12","first-page":"2579","article-title":"Visualizing Data using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/s10994-011-5273-4","article-title":"Visualizing non-metric similarities in multiple maps","volume":"87","author":"Hinton","year":"2012","journal-title":"Mach. Learn."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1148","DOI":"10.1214\/aoms\/1177704477","article-title":"On the Distribution of the Two-Sample Cramer-von Mises Criterion","volume":"33","author":"Anderson","year":"1962","journal-title":"Ann. Math. Statist."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1186\/1866-1955-5-28","article-title":"Eye tracking in early autism research","volume":"5","year":"2013","journal-title":"J. Neurodev. Disord."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.neubiorev.2014.03.013","article-title":"Visual social attention in autism spectrum disorder: Insights from eye tracking studies","volume":"42","author":"Guillon","year":"2014","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1167\/13.10.5","article-title":"Abnormality in face scanning by children with autism spectrum disorder is limited to the eye region: Evidence from multi-method analyses of eye tracking data","volume":"13","author":"Yi","year":"2013","journal-title":"J. Vis."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.rasd.2016.09.003","article-title":"Contextual effects on visual short-term memory in high-functioning autism spectrum disorders","volume":"32","author":"Souza","year":"2016","journal-title":"Res. Autism Spect. Disord."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"864","DOI":"10.3758\/s13428-011-0092-x","article-title":"iMap: a novel method for statistical fixation mapping of eye movement data","volume":"43","author":"Caldara","year":"2011","journal-title":"Behav. Res."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bulat, A., and Tzimiropoulos, G. (2017, January 22\u201329). How Far Are We From Solving the 2D & 3D Face Alignment Problem? (And a Dataset of 230,000 3D Facial Landmarks). Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.116"},{"key":"ref_21","unstructured":"Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., and Liu, T.Y. (2017, January 4\u20139). LightGBM: A Highly Efficient Gradient Boosting Decision Tree. Proceedings of the Advances in Neural Information Processing Systems 30, Long Beach, CA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"351","DOI":"10.3758\/BRM.42.1.351","article-title":"FACES\u2014A database of facial expressions in young, middle-aged, and older women and men: Development and validation","volume":"42","author":"Ebner","year":"2010","journal-title":"Behav. Res. Methods"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1016\/j.neuropsychologia.2019.04.022","article-title":"A novel machine learning analysis of eye-tracking data reveals suboptimal visual information extraction from facial stimuli in individuals with autism","volume":"129","year":"2019","journal-title":"Neuropsychologia"},{"key":"ref_24","first-page":"66","article-title":"Dimensionality Reduction: A Comparative Review","volume":"10","author":"Postma","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_25","unstructured":"(2019, May 22). Available online: https:\/\/rdrr.io\/cran\/cramer\/."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1895","DOI":"10.1162\/089976698300017197","article-title":"Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms","volume":"10","author":"Dietterich","year":"1998","journal-title":"Neural Comput."},{"key":"ref_27","first-page":"1833","article-title":"Permutation Tests for Studying Classifier Performance","volume":"11","author":"Ojala","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1005653411471","article-title":"The Autism-Spectrum Quotient (AQ): Evidence from Asperger Syndrome\/High-Functioning Autism, Malesand Females, Scientists and Mathematicians","volume":"31","author":"Wheelwright","year":"2001","journal-title":"J. Autism Dev. Disord."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1007\/s10803-005-3300-7","article-title":"Screening Adults for Asperger Syndrome Using the AQ:A Preliminary Study of its Diagnostic Validity in Clinical Practice","volume":"35","author":"Robinson","year":"2005","journal-title":"J. Autism Dev. Disord."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1002\/aur.1615","article-title":"Identifying children with autism spectrum disorder based on their face processing abnormality: A machine learning framework","volume":"9","author":"Liu","year":"2016","journal-title":"Autism Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.3758\/s13428-012-0212-2","article-title":"It depends on how you look at it: Scanpath comparison in multiple dimensions with MultiMatch, a vector-based approach","volume":"44","author":"Dewhurst","year":"2012","journal-title":"Behav. Res. Methods"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"842","DOI":"10.3758\/s13428-012-0299-5","article-title":"Recurrence quantification analysis of eye movements","volume":"45","author":"Anderson","year":"2013","journal-title":"Behav. Res. Methods"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"596","DOI":"10.1017\/S1930297500006720","article-title":"A novel approach to studying strategic decisions with eye-tracking and machine learning","volume":"12","year":"2017","journal-title":"Judgm. Decis. Mak."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/10\/2377\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:54:37Z","timestamp":1760187277000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/10\/2377"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,23]]},"references-count":33,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2019,5]]}},"alternative-id":["s19102377"],"URL":"https:\/\/doi.org\/10.3390\/s19102377","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,5,23]]}}}