{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T09:18:25Z","timestamp":1788254305158,"version":"build-2803163510"},"reference-count":54,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T00:00:00Z","timestamp":1788220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Intell."],"abstract":"<jats:p>Matrix reasoning performance is often treated as a static indicator of cognitive ability, although it reflects a dynamic process that unfolds across items. The present study examined how reasoning ability and visuospatial working memory (vsWM) interact with item difficulty and item position to shape problem-solving behavior. Eye movements were recorded from 300 participants during a figural matrices test. Three indices of problem-solving behavior were analyzed using Bayesian multilevel models: toggle rate (ToR), proportional time on matrix (PoM), and proportional time to first fixation on response alternatives (PoFA). Results showed that higher reasoning was consistently associated with behavior indicative of constructive matching, reflected in lower ToR, higher PoM, and higher PoFA. Further, individuals with higher reasoning ability showed stronger adaptations in problem-solving behavior in response to changing task demands. Evidence regarding vsWM was more nuanced, revealing selective interactions with reasoning ability and test characteristics rather than a consistent main effect across measures. Item position revealed substantial between-person variability, which exceeded the variability associated with item difficulty. This suggests that individuals differ more strongly in how their behavior evolves across the test than in their responses to increasing difficulty. Overall, the findings highlight that problem-solving behavior in reasoning tests reflects a dynamic interplay between individual characteristics and test characteristics, emphasizing the importance of modeling both simultaneously when investigating reasoning performance.<\/jats:p>","DOI":"10.3390\/jintelligence14090206","type":"journal-article","created":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T08:31:13Z","timestamp":1788251473000},"page":"206","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Individual Differences in Problem-Solving Behavior in Reasoning Tests: The Role of Item Difficulty and Item Position"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7971-5038","authenticated-orcid":false,"given":"Helene M.","family":"von Gugelberg","sequence":"first","affiliation":[{"name":"Institute of Education, University of Zurich, 8001 Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ackerman, R. (2026). It\u2019s time to opt out: Metacognitive analysis of time regulation under uncertainty, Journal of Experimental Psychology: Learning Memory and Cognition. Advance online publication.","DOI":"10.1037\/xlm0001640"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1016\/j.tics.2017.05.004","article-title":"Meta-reasoning: Monitoring and control of thinking and reasoning","volume":"21","author":"Ackerman","year":"2017","journal-title":"Trends in Cognitive Sciences"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/0160-2896(84)90009-6","article-title":"Adaptive reasoning: Componential and eye movement analysis of geometric analogy performance","volume":"8","author":"Lohman","year":"1984","journal-title":"Intelligence"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Birney, D. P., and Beckmann, J. F. (2022). Intelligence is cognitive flexibility: Why multilevel models of within-individual processes are needed to realise this. Journal of Intelligence, 10, (3).","DOI":"10.3390\/jintelligence10030049"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.intell.2017.01.005","article-title":"Beyond the intellect: Complexity and learning trajectories in Raven\u2019s progressive matrices depend on self-regulatory processes and conative dispositions","volume":"61","author":"Birney","year":"2017","journal-title":"Intelligence"},{"key":"ref_6","unstructured":"Bojko, A. (2013). Eye tracking the user experience: A practical guide to research, Rosenfeld Media."},{"key":"ref_7","first-page":"1","article-title":"brms: An R package for Bayesian multilevel models using Stan","volume":"80","year":"2017","journal-title":"Journal of Statistical Software"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1037\/0033-295X.97.3.404","article-title":"What one intelligence test measures: A theoretical account of the processing in the Raven progressive matrices test","volume":"97","author":"Carpenter","year":"1990","journal-title":"Psychological Review"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1162\/opmi_a_00127","article-title":"Response to difficulty drives variation in IQ test performance","volume":"8","author":"Cheyette","year":"2024","journal-title":"Open Mind"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1080\/13546783.2025.2542252","article-title":"Metacognitive sensitivity moderates reactivity to confidence ratings","volume":"32","author":"Choo","year":"2026","journal-title":"Thinking & Reasoning"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.intell.2006.02.001","article-title":"Intelligence and educational achievement","volume":"35","author":"Deary","year":"2007","journal-title":"Intelligence"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"202694","DOI":"10.1016\/j.reia.2025.202694","article-title":"Visual strategies in solving Raven\u2019s matrices: Insights from autism","volume":"128","author":"Diu","year":"2025","journal-title":"Research in Autism"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1080\/13546783.2017.1289121","article-title":"Are you sure about that? Eliciting confidence ratings may influence performance on Raven\u2019s progressive matrices","volume":"23","author":"Double","year":"2017","journal-title":"Thinking & Reasoning"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1037\/xge0001518","article-title":"Development of reasoning performance in Raven\u2019s matrices is grounded in the development of effective strategy use","volume":"153","author":"Gonthier","year":"2024","journal-title":"Journal of Experimental Psychology: General"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1037\/xge0000660","article-title":"Intraindividual strategy shifts in Raven\u2019s matrices, and their dependence on working memory capacity and need for cognition","volume":"149","author":"Gonthier","year":"2020","journal-title":"Journal of Experimental Psychology: General"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"916","DOI":"10.1037\/xge0000101","article-title":"Strategy use fully mediates the relationship between working memory capacity and performance on Raven\u2019s matrices","volume":"144","author":"Gonthier","year":"2015","journal-title":"Journal of Experimental Psychology: General"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"101387","DOI":"10.1016\/j.intell.2019.101387","article-title":"Working memory capacity and strategy use on the RAPM","volume":"77","author":"Jarosz","year":"2019","journal-title":"Intelligence"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.intell.2017.11.002","article-title":"The strong link between fluid intelligence and working memory cannot be explained away by strategy use","volume":"66","author":"Ciechanowska","year":"2018","journal-title":"Intelligence"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1037\/0033-2909.131.1.66","article-title":"Working memory capacity and fluid intelligence are strongly related constructs: Comment on Ackerman, Beier, and Boyle (2005)","volume":"131","author":"Kane","year":"2005","journal-title":"Psychological Bulletin"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1037\/0022-3514.71.2.352","article-title":"Measurement-induced improvement in anxiety: Mean shifts with repeated assessment","volume":"71","author":"Knowles","year":"1996","journal-title":"Journal of Personality and Social Psychology"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"507","DOI":"10.3758\/s13428-018-1098-4","article-title":"General fluid\/inductive reasoning battery for a high-ability population","volume":"51","author":"Kyllonen","year":"2019","journal-title":"Behavior Research Methods"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Laurence, P. G., Jana, T. A., Bunge, S. A., and Macedo, E. C. (2023). Eye gaze patterns during reasoning provide insights regarding individual differences in underlying cognitive abilities. Journal of Intelligence, 11, (4).","DOI":"10.3390\/jintelligence11040075"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Laurence, P. G., Mecca, T. P., Serpa, A., Martin, R., and Macedo, E. C. (2018). Eye movements and cognitive strategy in a fluid intelligence test: Item type analysis. Frontiers in Psychology, 9.","DOI":"10.3389\/fpsyg.2018.00380"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Law, M. K., Stankov, L., and Kleitman, S. (2022). I choose to opt-out of answering: Individual differences in giving up behaviour on cognitive tests. Journal of Intelligence, 10, (4).","DOI":"10.3390\/jintelligence10040086"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"101627","DOI":"10.1016\/j.intell.2022.101627","article-title":"Strategy use moderates the relation between working memory capacity and fluid intelligence: A combined approach","volume":"91","author":"Li","year":"2022","journal-title":"Intelligence"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"101782","DOI":"10.1016\/j.intell.2023.101782","article-title":"Using a multi-strategy eye-tracking psychometric model to measure intelligence and identify cognitive strategy in Raven\u2019s advanced progressive matrices","volume":"100","author":"Liu","year":"2023","journal-title":"Intelligence"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.paid.2015.04.049","article-title":"Are impulsivity and intelligence truly related constructs? Evidence based on the fixed-links model","volume":"85","author":"Lozano","year":"2015","journal-title":"Personality and Individual Differences"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s00426-012-0439-7","article-title":"Eye movements during long-term pictorial recall","volume":"77","author":"Martarelli","year":"2013","journal-title":"Psychological Research"},{"key":"ref_29","first-page":"699","article-title":"Solve the problem first: Constructive solution strategies can influence the accuracy of retrospective confidence judgments","volume":"36","author":"Mitchum","year":"2010","journal-title":"Journal of Experimental Psychology: Learning, Memory, and Cognition"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1111\/jcal.12719","article-title":"The role of rapid guessing and test-taking persistence in modelling test-taking engagement","volume":"39","author":"Nagy","year":"2023","journal-title":"Journal of Computer Assisted Learning"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1162\/opmi_a_00078","article-title":"The development of relational reasoning: An eyetracking analysis of strategy use and adaptation in children and adults performing matrix completion","volume":"7","author":"Niebaum","year":"2023","journal-title":"Open Mind"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Oberauer, K. (2020). Towards a theory of working memory. Working memory: The state of the science, Oxford University Press.","DOI":"10.1093\/oso\/9780198842286.003.0005"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"195","DOI":"10.3758\/s13428-018-01193-y","article-title":"PsychoPy2: Experiments in behavior made easy","volume":"51","author":"Peirce","year":"2019","journal-title":"Behavior Research Methods"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Perret, P., and Dauvier, B. (2018). Children\u2019s allocation of study time during the solution of Raven\u2019s progressive matrices. Journal of Intelligence, 6, (1).","DOI":"10.3390\/jintelligence6010009"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"101618","DOI":"10.1016\/j.intell.2021.101618","article-title":"Strategy transfer on fluid reasoning tasks","volume":"91","author":"Raden","year":"2022","journal-title":"Intelligence"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"McCallum, R. S. (2003). Raven Progressive Matrices. Handbook of nonverbal assessment, Springer.","DOI":"10.1007\/978-1-4615-0153-4"},{"key":"ref_37","unstructured":"R Core Team (2020). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.lindif.2014.01.002","article-title":"A learning-based account of fluid intelligence from the perspective of the position effect","volume":"31","author":"Ren","year":"2014","journal-title":"Learning and Individual Differences"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.3758\/s13428-020-01484-3","article-title":"Looking with the (computer) mouse: How to unveil problem-solving strategies in matrix reasoning without eye-tracking","volume":"53","author":"Rivollier","year":"2021","journal-title":"Behavior Research Methods"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1037\/neu0001081","article-title":"Eye-gaze strategies reveal cognitive variability in a real-world executive function task","volume":"40","author":"Rodrigues","year":"2026","journal-title":"Neuropsychology"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.intell.2015.09.002","article-title":"Intelligence and school grades: A meta-analysis","volume":"53","author":"Roth","year":"2015","journal-title":"Intelligence"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1037\/apl0001159","article-title":"A contemporary look at the relationship between general cognitive ability and job performance","volume":"109","author":"Sackett","year":"2024","journal-title":"Journal of Applied Psychology"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"101473","DOI":"10.1016\/j.intell.2020.101473","article-title":"Teaching the underlying rules of figural matrices in a short video increases test scores","volume":"82","author":"Schneider","year":"2020","journal-title":"Intelligence"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1027\/1614-2241.2.4.149","article-title":"The fixed-links model for investigating the effects of general and specific processes on intelligence","volume":"2","author":"Schweizer","year":"2006","journal-title":"Methodology"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"102991","DOI":"10.1016\/j.actpsy.2019.102991","article-title":"Higher-order processing and change-to-automaticity as explanations of the item-position effect in reasoning tests","volume":"203","author":"Schweizer","year":"2020","journal-title":"Acta Psychologica"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/0160-2896(78)90019-3","article-title":"Theory and method for research on aptitude processes","volume":"2","author":"Snow","year":"1978","journal-title":"Intelligence"},{"key":"ref_47","first-page":"27","article-title":"Aptitude processes","volume":"Vol. 1","author":"Snow","year":"1980","journal-title":"Aptitude, learning, and instruction"},{"key":"ref_48","unstructured":"SR Research (2016). Eyelink 1000 plus [Apparatus and software], SR Research Ltd."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.intell.2005.11.003","article-title":"Eye-movement analysis demonstrates strategic influences on intelligence","volume":"34","author":"Vigneau","year":"2006","journal-title":"Intelligence"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"102622","DOI":"10.1016\/j.lindif.2024.102622","article-title":"Experimental evidence for rule learning as the underlying source of the item-position effect in reasoning ability measures","volume":"118","author":"Schweizer","year":"2025","journal-title":"Learning and Individual Differences"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"von Gugelberg, H. M., and Troche, S. J. (2025). Individual differences in strategy and the item-position effect in reasoning ability measures. Journal of Intelligence, 13, (7).","DOI":"10.3390\/jintelligence13070077"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"175","DOI":"10.3758\/s13428-025-02678-3","article-title":"Eye-tracking-based hidden Markov modeling for revealing within-item cognitive strategy switching","volume":"57","author":"Wang","year":"2025","journal-title":"Behavior Research Methods"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1686","DOI":"10.21105\/joss.01686","article-title":"Welcome to the tidyverse","volume":"4","author":"Wickham","year":"2019","journal-title":"Journal of Open Source Software"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1080\/10705511.2017.1306706","article-title":"Is the item-position effect in achievement measures induced by increasing item difficulty?","volume":"24","author":"Zeller","year":"2017","journal-title":"Structural Equation Modeling: A Multidisciplinary Journal"}],"container-title":["Journal of Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/9\/206\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T08:49:20Z","timestamp":1788252560000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/9\/206"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,1]]},"references-count":54,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["jintelligence14090206"],"URL":"https:\/\/doi.org\/10.3390\/jintelligence14090206","relation":{},"ISSN":["2079-3200"],"issn-type":[{"value":"2079-3200","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,1]]}}}