{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T22:03:00Z","timestamp":1790114580515,"version":"4.0.1"},"reference-count":33,"publisher":"Wiley","license":[{"start":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T00:00:00Z","timestamp":1790035200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T00:00:00Z","timestamp":1790035200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Topics in Cognitive Science"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Different models of learning have been developed to account for human performance over time, often fitting aggregate rather than individual performance. Understanding performance at an individual level is often more difficult because multiple factors (e.g., motivation, strategy exploration, or changes in memory representation) vary across individuals and can lead to sudden changes in performance that cannot be accounted for by models used to account for aggregate behavior. One approach used to account for the sudden changes in individual performance is to integrate change detection algorithms (CDAs) with learning models. Indeed, past research has shown that performance at the individual level can be understood not as a single continuous process but instead as a sequence of different segments marked by change points, each accounted for by different or varying processes. Previous research has posited different explanations as to what features (e.g., individual, problem, problem\u2010type) drive the inferences of these change points. Here, we compared these different explanations' ability to explain the variance in inferred change points across a single data set. To this end, we use a simple model of learning paired with a CDA to account for performance in a real\u2010world data set with individuals performing multiple different games on the website Lumosity that tap into different task attributes (i.e., memory, attention, problem\u2010solving, etc.). Our findings confirmed previous results about the nature of individual learning curves proposed from prior research. We found that change points were inferred across a majority of the users' game performance and that the inferred change points were associated with greater overall performance improvement over time. Finally, we found that the task features previously proposed to be associated with change points could both explain and predict inferred change points to varying degrees. The results clarify what features are driving the inferences of change points and show how psychological theory can be used to better understand and predict real\u2010world behavior at the individual\u00a0level.<\/jats:p>","DOI":"10.1111\/tops.70080","type":"journal-article","created":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T21:10:13Z","timestamp":1790111413000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Understanding and Predicting Change Points in Individual Learning: An Analysis With Real\u2010World Data"],"prefix":"10.1111","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-1781-1973","authenticated-orcid":false,"given":"Michael G.","family":"Collins","sequence":"first","affiliation":[{"name":"Air Force Research Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9982-4701","authenticated-orcid":false,"given":"Florian","family":"Sense","sequence":"additional","affiliation":[{"name":"Infinite Tactics, LLC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Krusmark","sequence":"additional","affiliation":[{"name":"CAE, Inc"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tiffany","family":"Myers","sequence":"additional","affiliation":[{"name":"Air Force Research Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,9,22]]},"reference":[{"issue":"2","key":"e_1_2_9_2_1","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1007\/s10115-016-0987-z","article-title":"A survey of methods for time series change point detection","volume":"51","author":"Aminikhanghahi S.","year":"2017","journal-title":"Knowledge and Information Systems"},{"issue":"2","key":"e_1_2_9_3_1","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1037\/0033-295X.94.2.192","article-title":"Skill acquisition: Compilation of weak\u2010method problem situations","volume":"94","author":"Anderson J. R.","year":"1987","journal-title":"Psychological Review"},{"key":"e_1_2_9_4_1","unstructured":"Bjork R. A. Bjork E. L. (1992).A new theory of disuse and an old theory of stimulus fluctuation. InFrom learning processes to cognitive processes: Essays in honor of William K. Estes 2 35\u201367."},{"issue":"6","key":"e_1_2_9_5_1","doi-asserted-by":"crossref","DOI":"10.1289\/EHP10498","article-title":"Short\u2010term exposure to wildfire smoke and PM 2.5 and cognitive performance in a brain\u2010training game: A longitudinal study of US adults","volume":"130","author":"Cleland S. E.","year":"2022","journal-title":"Environmental Health Perspectives"},{"key":"e_1_2_9_6_1","unstructured":"Collins M. G. Sense F. Krusmark M. &Myers T.(2023).Modeling change points and performance variability in large\u2010scale naturalistic data. InMathPsych\/ICCM."},{"key":"e_1_2_9_7_1","first-page":"159","volume-title":"International Conference on Human\u2010Computer Interaction","author":"Collins M. G.","year":"2025"},{"key":"e_1_2_9_8_1","unstructured":"Collins M. G. Tenison C. Gluck K. A. &Anderson J.(2020).Detecting learning phases to improve performance prediction. InProceedings of the 18th International Conference on Cognitive Modeling."},{"issue":"3","key":"e_1_2_9_9_1","doi-asserted-by":"crossref","first-page":"403","DOI":"10.3758\/BF03193784","article-title":"Risks of drawing inferences about cognitive processes from model fits to individual versus average performance","volume":"12","author":"Estes W. K.","year":"2005","journal-title":"Psychonomic Bulletin & Review"},{"issue":"5","key":"e_1_2_9_10_1","doi-asserted-by":"crossref","first-page":"2447","DOI":"10.3758\/s13428-022-01901-9","article-title":"Common, uncommon, and novel applications of random forest in psychological research","volume":"55","author":"Fife D. A.","year":"2023","journal-title":"Behavior Research Methods"},{"issue":"2011","key":"e_1_2_9_11_1","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1146\/annurev-psych-120709-145346","article-title":"Heuristic decision making","volume":"62","author":"Gigerenzer G.","year":"2011","journal-title":"Annual Review of Psychology"},{"issue":"7","key":"e_1_2_9_12_1","doi-asserted-by":"crossref","first-page":"1838","DOI":"10.1111\/cogs.12412","article-title":"Plateaus, dips, and leaps: Where to look for inventions and discoveries during skilled performance","volume":"41","author":"Gray W. D.","year":"2017","journal-title":"Cognitive Science"},{"issue":"2","key":"e_1_2_9_13_1","doi-asserted-by":"crossref","first-page":"185","DOI":"10.3758\/BF03212979","article-title":"The power law repealed: The case for an exponential law of practice","volume":"7","author":"Heathcote A.","year":"2000","journal-title":"Psychonomic Bulletin & Review"},{"key":"e_1_2_9_14_1","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1038\/s41586-021-03659-0","article-title":"Integrating explanation and prediction in computational social science","volume":"595","author":"Hofman J. M.","year":"2021","journal-title":"Nature"},{"issue":"1","key":"e_1_2_9_15_1","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1080\/1464536X.2011.573008","article-title":"An integrated theory for improved skill acquisition and retention in the three stages of learning","volume":"14","author":"Kim J. W.","year":"2013","journal-title":"Theoretical Issues in Ergonomics Science"},{"issue":"1","key":"e_1_2_9_16_1","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1038\/s41539-022-00142-x","article-title":"Comparing models of learning and relearning in large\u2010scale cognitive training data sets","volume":"7","author":"Kumar A.","year":"2022","journal-title":"npj Science of Learning"},{"issue":"60","key":"e_1_2_9_17_1","doi-asserted-by":"crossref","first-page":"3139","DOI":"10.21105\/joss.03139","article-title":"performance: An R package for assessment, comparison and testing of statistical models","volume":"6","author":"L\u00fcdecke D.","year":"2021","journal-title":"Journal of Open Source Software"},{"key":"e_1_2_9_18_1","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1007\/s42113-020-00092-w","article-title":"Modeling strategy switches in multi\u2010attribute decision making","volume":"4","author":"Lee M. D.","year":"2021","journal-title":"Computational Brain & Behavior"},{"issue":"4","key":"e_1_2_9_19_1","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1037\/dec0000105","article-title":"Understanding the complexity of simple decisions: Modeling multiple behaviors and switching strategies","volume":"6","author":"Lee M. D.","year":"2019","journal-title":"Decision"},{"key":"e_1_2_9_20_1","volume-title":"An introduction to genetic algorithms","author":"Mitchell M.","year":"1998"},{"key":"e_1_2_9_21_1","volume-title":"Human problem solving","author":"Newell A.","year":"1972"},{"issue":"1","key":"e_1_2_9_22_1","doi-asserted-by":"crossref","first-page":"e59","DOI":"10.1097\/SIH.0000000000000559","article-title":"Personalized training schedules for retention and sustainment of cardiopulmonary resuscitation skills","volume":"17","author":"Oermann M. H.","year":"2022","journal-title":"Simulation in Healthcare"},{"issue":"5","key":"e_1_2_9_23_1","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0281095","article-title":"Transfer of learning: Analysis of dose\u2013response functions from a large\u2010scale, online, cognitive training dataset","volume":"18","author":"Osman A. M.","year":"2023","journal-title":"PLoS One"},{"issue":"4","key":"e_1_2_9_24_1","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1207\/s15516709cog0000_14","article-title":"Practice and forgetting effects on vocabulary memory: An activation\u2010based model of the spacing effect","volume":"29","author":"Pavlik P. I.","year":"2005","journal-title":"Cognitive Science"},{"issue":"3","key":"e_1_2_9_25_1","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1207\/s15516709cog2703_5","article-title":"Spacing and repetition effects in human memory: Application of the SAM model","volume":"27","author":"Raaijmakers J. G.","year":"2003","journal-title":"Cognitive Science"},{"issue":"3","key":"e_1_2_9_26_1","doi-asserted-by":"crossref","first-page":"975","DOI":"10.1111\/tops.12512","article-title":"Spotlight on dynamics of individual learning","volume":"12","author":"Rahman R.","year":"2020","journal-title":"Topics in Cognitive Science"},{"key":"e_1_2_9_27_1","unstructured":"Schmitt M. Li C. Vehtari A. Acerbi L. B\u00fcrkner P.\u2010C. &Radev S. T.(2024).Amortized Bayesian workflow. arXiv preprint arXiv:2409.04332."},{"key":"e_1_2_9_28_1","unstructured":"Serre A. Ch\u00e9telat D. &Lodi A.(2020).Change point detection by cross\u2010entropy maximization. arXiv preprint arXiv:2009.01358."},{"issue":"3","key":"e_1_2_9_29_1","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1214\/10-STS330","article-title":"To explain or to predict?","volume":"25","author":"Shmueli G.","year":"2010","journal-title":"Statistical Science"},{"issue":"6","key":"e_1_2_9_30_1","first-page":"1411","article-title":"Prototypes in the mist: The early epochs of category learning","volume":"24","author":"Smith J. D.","year":"1998","journal-title":"Journal of Experimental Psychology: Learning, Memory, and Cognition"},{"issue":"11","key":"e_1_2_9_31_1","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1038\/s41562-020-00935-3","article-title":"Inferring latent learning factors in large\u2010scale cognitive training data","volume":"4","author":"Steyvers M.","year":"2020","journal-title":"Nature Human Behaviour"},{"issue":"1","key":"e_1_2_9_32_1","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1518\/hfes.45.1.61.27224","article-title":"Production compilation: A simple mechanism to model complex skill acquisition","volume":"45","author":"Taatgen N. A.","year":"2003","journal-title":"Human Factors"},{"issue":"5","key":"e_1_2_9_33_1","first-page":"749","article-title":"Modeling the distinct phases of skill acquisition","volume":"42","author":"Tenison C.","year":"2016","journal-title":"Journal of Experimental Psychology: Learning, Memory, and Cognition"},{"key":"e_1_2_9_34_1","doi-asserted-by":"crossref","first-page":"644","DOI":"10.1111\/cogs.12602","article-title":"Evaluating the theoretic adequacy and applied potential of computational models of the spacing effect","volume":"42","author":"Walsh M. M.","year":"2018","journal-title":"Cognitive Science"}],"container-title":["Topics in Cognitive Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/tops.70080","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/tops.70080","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/tops.70080","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T21:10:24Z","timestamp":1790111424000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/tops.70080"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,22]]},"references-count":33,"alternative-id":["10.1111\/tops.70080"],"URL":"https:\/\/doi.org\/10.1111\/tops.70080","archive":["Portico"],"relation":{},"ISSN":["1756-8757","1756-8765"],"issn-type":[{"value":"1756-8757","type":"print"},{"value":"1756-8765","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,22]]},"assertion":[{"value":"2025-07-07","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-05-26","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70080"}}