{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T17:47:12Z","timestamp":1778176032983,"version":"3.51.4"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1012529","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,11,5]],"date-time":"2024-11-05T00:00:00Z","timestamp":1730764800000}}],"reference-count":50,"publisher":"Public Library of Science (PLoS)","issue":"10","license":[{"start":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T00:00:00Z","timestamp":1729728000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004937","name":"Bundesministerium f\u00fcr Forschung und Technologie","doi-asserted-by":"publisher","award":["16SV8052"],"award-info":[{"award-number":["16SV8052"]}],"id":[{"id":"10.13039\/501100004937","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Natural eye movements have primarily been studied for over-learned activities such as tea-making, sandwich-making, and hand-washing, which have a fixed sequence of associated actions. These studies demonstrate a sequential activation of low-level cognitive schemas facilitating task completion. However, whether these action schemas are activated in the same pattern when a task is novel and a sequence of actions must be planned in the moment is unclear. Here, we recorded gaze and body movements in a naturalistic task to study action-oriented gaze behavior. In a virtual environment, subjects moved objects on a life-size shelf to achieve a given order. To compel cognitive planning, we added complexity to the sorting tasks. Fixations aligned with the action onset showed gaze as tightly coupled with the action sequence, and task complexity moderately affected the proportion of fixations on the task-relevant regions. Our analysis revealed that gaze fixations were allocated to action-relevant targets just in time. Planning behavior predominantly corresponded to a greater visual search for task-relevant objects before the action onset. The results support the idea that natural behavior relies on the frugal use of working memory, and humans refrain from encoding objects in the environment to plan long-term actions. Instead, they prefer just-in-time planning by searching for action-relevant items at the moment, directing their body and hand to it, monitoring the action until it is terminated, and moving on to the following action.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1012529","type":"journal-article","created":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T14:01:42Z","timestamp":1729778502000},"page":"e1012529","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":12,"title":["Just-in-time: Gaze guidance in natural behavior"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7541-4369","authenticated-orcid":true,"given":"Ashima","family":"Keshava","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1599-6958","authenticated-orcid":true,"given":"Farbod Nosrat","family":"Nezami","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9849-152X","authenticated-orcid":true,"given":"Henri","family":"Neumann","sequence":"additional","affiliation":[]},{"given":"Krzysztof","family":"Izdebski","sequence":"additional","affiliation":[]},{"given":"Thomas","family":"Sch\u00fcler","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3654-5267","authenticated-orcid":true,"given":"Peter","family":"K\u00f6nig","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2024,10,24]]},"reference":[{"key":"pcbi.1012529.ref001","volume-title":"Being There: Putting Brain, Body, and World Together Again","author":"A Clark","year":"1998"},{"issue":"12","key":"pcbi.1012529.ref002","doi-asserted-by":"crossref","first-page":"8081","DOI":"10.1111\/ejn.14783","article-title":"Perfect timing: Mobile brain\/body imaging scaffolds the 4E-cognition research program","volume":"54","author":"FJ Parada","year":"2020","journal-title":"The European journal of neuroscience"},{"issue":"5","key":"pcbi.1012529.ref003","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.tics.2013.03.006","article-title":"Where\u2019s the action? the pragmatic turn in cognitive science","volume":"17","author":"AK Engel","year":"2013","journal-title":"Trends in cognitive sciences"},{"issue":"5","key":"pcbi.1012529.ref004","doi-asserted-by":"crossref","DOI":"10.16910\/jemr.9.5.3","article-title":"Eye movements as a window to cognitive processes","volume":"9","author":"P K\u00f6nig","year":"2016","journal-title":"Journal of eye movement research"},{"key":"pcbi.1012529.ref005","doi-asserted-by":"crossref","unstructured":"K\u00f6nig P, Melnik A, Goeke A, Gert AL, K\u00f6nig SU, Kietzmann TC. Embodied cognition. In 2018 6th International Conference on Brain-Computer Interface (BCI), pages 1\u20134. ieeexplore.ieee.org, January 2018. URL http:\/\/dx.doi.org\/10.1109\/IWW-BCI.2018.8311486.","DOI":"10.1109\/IWW-BCI.2018.8311486"},{"issue":"9","key":"pcbi.1012529.ref006","doi-asserted-by":"crossref","first-page":"1546","DOI":"10.1111\/ejn.15963","article-title":"Action affordance affects proximal and distal goal-oriented planning","volume":"57","author":"A Keshava","year":"2023","journal-title":"The European journal of neuroscience"},{"key":"pcbi.1012529.ref007","doi-asserted-by":"crossref","unstructured":"Keshava A, Aumeistere A, Izdebski K, Konig P. Decoding task from oculomotor behavior in virtual reality. In ACM Symposium on Eye Tracking Research and Applications, number Article 30 in ETRA \u201920 Short Papers, pages 1\u20135, New York, NY, USA, June 2020. Association for Computing Machinery. ISBN 9781450371346. URL https:\/\/doi.org\/10.1145\/3379156.3391338.","DOI":"10.1145\/3379156.3391338"},{"key":"pcbi.1012529.ref008","article-title":"Combining EEG and eye-tracking in virtual reality: Obtaining fixation-onset event-related potentials and event-related spectral perturbations","author":"D Nolte","year":"2024","journal-title":"Attention, perception & psychophysics"},{"issue":"11","key":"pcbi.1012529.ref009","doi-asserted-by":"crossref","first-page":"1311","DOI":"10.1068\/p2935","article-title":"The roles of vision and eye movements in the control of activities of daily living","volume":"28","author":"M Land","year":"1999","journal-title":"Perception"},{"issue":"1","key":"pcbi.1012529.ref010","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1167\/3.1.6","article-title":"Visual memory and motor planning in a natural task","volume":"3","author":"MM Hayhoe","year":"2003","journal-title":"Journal of vision"},{"issue":"1","key":"pcbi.1012529.ref011","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1162\/jocn.1995.7.1.66","article-title":"Memory representations in natural tasks","volume":"7","author":"DH Ballard","year":"1995","journal-title":"Journal of cognitive neuroscience"},{"issue":"25-26","key":"pcbi.1012529.ref012","doi-asserted-by":"crossref","first-page":"3559","DOI":"10.1016\/S0042-6989(01)00102-X","article-title":"In what ways do eye movements contribute to everyday activities?","volume":"41","author":"MF Land","year":"2001","journal-title":"Vision research"},{"issue":"25-26","key":"pcbi.1012529.ref013","doi-asserted-by":"crossref","first-page":"3587","DOI":"10.1016\/S0042-6989(01)00245-0","article-title":"Oculomotor behavior and perceptual strategies in complex tasks","volume":"41","author":"JB Pelz","year":"2001","journal-title":"Vision research"},{"issue":"3","key":"pcbi.1012529.ref014","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1007\/s00221-006-0804-0","article-title":"Look-ahead fixations: anticipatory eye movements in natural tasks","volume":"179","author":"N Mennie","year":"2007","journal-title":"Experimental brain research. Experimentelle Hirnforschung. Experimentation cerebrale"},{"issue":"3","key":"pcbi.1012529.ref015","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1016\/j.preteyeres.2006.01.002","article-title":"Eye movements and the control of actions in everyday life","volume":"25","author":"MF Land","year":"2006","journal-title":"Progress in retinal and eye research"},{"issue":"4","key":"pcbi.1012529.ref016","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.tics.2005.02.009","article-title":"Eye movements in natural behavior","volume":"9","author":"MM Hayhoe","year":"2005","journal-title":"Trends in cognitive sciences"},{"issue":"10-12","key":"pcbi.1012529.ref017","doi-asserted-by":"crossref","first-page":"1489","DOI":"10.1016\/S0042-6989(99)00163-7","article-title":"A saliency-based search mechanism for overt and covert shifts of visual attention","volume":"40","author":"L Itti","year":"2000","journal-title":"Vision research"},{"issue":"3","key":"pcbi.1012529.ref018","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1167\/8.3.4","article-title":"Eye movement statistics in humans are consistent with an optimal search strategy","volume":"8","author":"J Najemnik","year":"2008","journal-title":"Journal of vision"},{"issue":"3","key":"pcbi.1012529.ref019","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1167\/7.3.6","article-title":"Where to look next? eye movements reduce local uncertainty","volume":"7","author":"LW Renninger","year":"2007","journal-title":"Journal of vision"},{"issue":"4","key":"pcbi.1012529.ref020","doi-asserted-by":"crossref","first-page":"766","DOI":"10.1037\/0033-295X.113.4.766","article-title":"Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search","volume":"113","author":"A Torralba","year":"2006","journal-title":"Psychological review"},{"key":"pcbi.1012529.ref021","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.12215","article-title":"Active sensing in the categorization of visual patterns","volume":"5","author":"S Yang","year":"2016","journal-title":"eLife"},{"issue":"7031","key":"pcbi.1012529.ref022","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1038\/nature03390","article-title":"Optimal eye movement strategies in visual search","volume":"434","author":"J Najemnik","year":"2005","journal-title":"Nature"},{"issue":"1","key":"pcbi.1012529.ref023","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1038\/s41598-018-37536-0","article-title":"Multi-step planning of eye movements in visual search","volume":"9","author":"D Hoppe","year":"2019","journal-title":"Scientific reports"},{"issue":"1358","key":"pcbi.1012529.ref024","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1098\/rstb.1997.0105","article-title":"The knowledge base of the oculomotor system","volume":"352","author":"MF Land","year":"1997","journal-title":"Philosophical transactions of the Royal Society of London. Series B, Biological sciences"},{"issue":"1","key":"pcbi.1012529.ref025","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1167\/3.1.9","article-title":"What you see is what you need","volume":"3","author":"J Triesch","year":"2003","journal-title":"Journal of vision"},{"issue":"4","key":"pcbi.1012529.ref026","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1037\/a0020198","article-title":"Decision making and the avoidance of cognitive demand","volume":"139","author":"W Kool","year":"2010","journal-title":"Journal of experimental psychology. General"},{"issue":"2","key":"pcbi.1012529.ref027","doi-asserted-by":"crossref","first-page":"2","DOI":"10.7771\/1932-6246.1090","article-title":"Human performance on the traveling salesman and related problems: A review","volume":"3","author":"JN MacGregor","year":"2011","journal-title":"The Journal of Problem Solving"},{"issue":"6","key":"pcbi.1012529.ref028","doi-asserted-by":"crossref","first-page":"1069","DOI":"10.3758\/BF03193214","article-title":"Solving combinatorial problems: the 15-puzzle","volume":"33","author":"Z Pizlo","year":"2005","journal-title":"Memory & cognition"},{"issue":"4","key":"pcbi.1012529.ref029","doi-asserted-by":"crossref","first-page":"650","DOI":"10.1037\/0033-295X.103.4.650","article-title":"Reasoning the fast and frugal way: Models of bounded rationality","volume":"103","author":"G Gigerenzer","year":"1996","journal-title":"Psychological review"},{"issue":"11","key":"pcbi.1012529.ref030","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1167\/16.11.8","article-title":"The dynamic effect of reading direction habit on spatial asymmetry of image perception","volume":"16","author":"Z Afsari","year":"2016","journal-title":"Journal of vision"},{"issue":"3","key":"pcbi.1012529.ref031","doi-asserted-by":"crossref","first-page":"843","DOI":"10.3758\/s13423-022-02239-1","article-title":"Reading\/writing direction as a source of directional bias in spatial cognition: Possible mechanisms and scope","volume":"30","author":"N Faghihi","year":"2023","journal-title":"Psychonomic bulletin & review"},{"issue":"2","key":"pcbi.1012529.ref032","doi-asserted-by":"crossref","DOI":"10.1167\/14.2.20","article-title":"Spatial biases in viewing behavior","volume":"14","author":"JP Ossand\u00f3n","year":"2014","journal-title":"Journal of vision"},{"issue":"12","key":"pcbi.1012529.ref033","article-title":"Motor \u201claziness\u201d constrains fixation selection in real-world tasks","volume":"121","author":"CS Burlingham","year":"2024","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"4","key":"pcbi.1012529.ref034","doi-asserted-by":"crossref","first-page":"625","DOI":"10.3758\/BF03196322","article-title":"Six views of embodied cognition","volume":"9","author":"M Wilson","year":"2002","journal-title":"Psychonomic bulletin & review"},{"issue":"1-2","key":"pcbi.1012529.ref035","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1163\/22134808-00002414","article-title":"A hierarchical modular architecture for embodied cognition","volume":"26","author":"DH Ballard","year":"2013","journal-title":"Multisensory research"},{"issue":"5-8","key":"pcbi.1012529.ref036","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1080\/13506285.2020.1742827","article-title":"An embodied account of visual working memory","volume":"28","author":"S Van der Stigchel","year":"2020","journal-title":"Visual cognition"},{"key":"pcbi.1012529.ref037","doi-asserted-by":"crossref","first-page":"253","DOI":"10.3389\/fnbeh.2018.00253","article-title":"The world as an external memory: The price of saccades in a sensorimotor task","volume":"12","author":"A Melnik","year":"2018","journal-title":"Frontiers in behavioral neuroscience"},{"issue":"4","key":"pcbi.1012529.ref038","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1016\/j.cub.2020.11.013","article-title":"When natural behavior engages working memory","volume":"31","author":"D Draschkow","year":"2021","journal-title":"Current biology: CB"},{"issue":"6","key":"pcbi.1012529.ref039","doi-asserted-by":"crossref","first-page":"1352","DOI":"10.1037\/0096-1523.33.6.1352","article-title":"Trade-offs between gaze and working memory use","volume":"33","author":"JA Droll","year":"2007","journal-title":"Journal of experimental psychology. Human perception and performance"},{"key":"pcbi.1012529.ref040","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.1038\/nn948","article-title":"Virtual reality in behavioral neuroscience and beyond","volume":"5","author":"MJ Tarr","year":"2002","journal-title":"Nature neuroscience"},{"key":"pcbi.1012529.ref041","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/B978-0-444-53752-2.00016-3","article-title":"Naturalistic approaches to sensorimotor control","volume":"191","author":"JN Ingram","year":"2011","journal-title":"Progress in brain research"},{"issue":"13","key":"pcbi.1012529.ref042","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1167\/12.13.19","article-title":"The role of uncertainty and reward on eye movements in a virtual driving task","volume":"12","author":"BT Sullivan","year":"2012","journal-title":"Journal of vision"},{"issue":"14","key":"pcbi.1012529.ref043","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1167\/19.14.28","article-title":"Predictive eye movements when hitting a bouncing ball","volume":"19","author":"DL Mann","year":"2019","journal-title":"Journal of vision"},{"issue":"3","key":"pcbi.1012529.ref044","doi-asserted-by":"crossref","first-page":"1140","DOI":"10.3758\/s13428-019-01307-0","article-title":"The impact of slippage on the data quality of head-worn eye trackers","volume":"52","author":"DC Niehorster","year":"2020","journal-title":"Behavior research methods"},{"key":"pcbi.1012529.ref045","doi-asserted-by":"crossref","DOI":"10.3389\/frvir.2021.712378","article-title":"Size perception bias and Reach-to-Grasp kinematics: An exploratory study on the virtual hand with a consumer immersive Virtual-Reality device","volume":"2","author":"Y Itaguchi","year":"2021","journal-title":"Frontiers in Virtual Reality"},{"issue":"8","key":"pcbi.1012529.ref046","doi-asserted-by":"crossref","DOI":"10.16910\/jemr.12.8.3","article-title":"MAD saccade: statistically robust saccade threshold estimation via the median absolute deviation","volume":"12","author":"B Voloh","year":"2020","journal-title":"Journal of eye movement research"},{"key":"pcbi.1012529.ref047","doi-asserted-by":"crossref","first-page":"104038","DOI":"10.1016\/j.jml.2019.104038","article-title":"How to capitalize on a priori contrasts in linear (mixed) models: A tutorial","volume":"110","author":"DJ Schad","year":"2020","journal-title":"Journal of memory and language"},{"issue":"1","key":"pcbi.1012529.ref048","doi-asserted-by":"crossref","first-page":"31","DOI":"10.2307\/1267913","article-title":"Restricted maximum likelihood (REML) estimation of variance components in the mixed model","volume":"18","author":"RR Corbeil","year":"1976","journal-title":"Technometrics: a journal of statistics for the physical, chemical, and engineering sciences"},{"issue":"4","key":"pcbi.1012529.ref049","doi-asserted-by":"crossref","first-page":"1494","DOI":"10.3758\/s13428-016-0809-y","article-title":"Evaluating significance in linear mixed-effects models in R","volume":"49","author":"SG Luke","year":"2017","journal-title":"Behavior research methods"},{"issue":"3","key":"pcbi.1012529.ref050","first-page":"392","article-title":"Symbolic description of factorial models for analysis of variance","volume":"22","author":"GN Wilkinson","year":"1973","journal-title":"Journal of the Royal Statistical Society. Series C, Applied statistics"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1012529","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,11,5]],"date-time":"2024-11-05T00:00:00Z","timestamp":1730764800000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012529","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,5]],"date-time":"2024-11-05T13:35:53Z","timestamp":1730813753000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012529"}},"subtitle":[],"editor":[{"given":"Aldo A","family":"Faisal","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2024,10,24]]},"references-count":50,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,10,24]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1012529","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.01.29.428782","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,24]]}}}