{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T22:06:52Z","timestamp":1773698812677,"version":"3.50.1"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T00:00:00Z","timestamp":1731974400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T00:00:00Z","timestamp":1731974400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Online cognitive tasks are gaining traction as scalable and cost-effective alternatives to traditional supervised assessments. However, variability in peoples\u2019 home devices, visual and motor abilities, and speed-accuracy biases confound the specificity with which online tasks can measure cognitive abilities. To address these limitations, we developed IDoCT (Iterative Decomposition of Cognitive Tasks), a method for estimating domain-specific cognitive abilities and trial-difficulty scales from task performance timecourses in a data-driven manner while accounting for device and visuomotor latencies, unspecific cognitive processes and speed-accuracy trade-offs. IDoCT can operate with any computerised task where cognitive difficulty varies across trials. Using data from 388,757 adults, we show that IDoCT successfully dissociates cognitive abilities from these confounding factors. The resultant cognitive scores exhibit stronger dissociation of psychometric factors, improved cross-participants distributions, and meaningful demographic\u2019s associations. We propose that IDoCT can enhance the precision of online cognitive assessments, especially in large scale clinical and research applications.<\/jats:p>","DOI":"10.1038\/s41746-024-01327-x","type":"journal-article","created":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T11:49:57Z","timestamp":1732016997000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["An iterative approach for estimating domain-specific cognitive abilities from large scale online cognitive data"],"prefix":"10.1038","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2165-7840","authenticated-orcid":false,"given":"Valentina","family":"Giunchiglia","sequence":"first","affiliation":[]},{"given":"Dragos-Cristian","family":"Gruia","sequence":"additional","affiliation":[]},{"given":"Annalaura","family":"Lerede","sequence":"additional","affiliation":[]},{"given":"William","family":"Trender","sequence":"additional","affiliation":[]},{"given":"Peter","family":"Hellyer","sequence":"additional","affiliation":[]},{"given":"Adam","family":"Hampshire","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,11,19]]},"reference":[{"key":"1327_CR1","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-24365-5","volume":"12","author":"A Hampshire","year":"2021","unstructured":"Hampshire, A. et al. Associations between dimensions of behaviour, personality traits, and mental-health during the COVID-19 pandemic in the United Kingdom. Nat. Commun. 12, 4111 (2021).","journal-title":"Nat. Commun."},{"key":"1327_CR2","doi-asserted-by":"publisher","first-page":"1328","DOI":"10.1080\/13854046.2013.834971","volume":"27","author":"CM Parsey","year":"2013","unstructured":"Parsey, C. M. & Schmitter-Edgecombe, M. Applications of technology in neuropsychological assessment. Clin. Neuropsychol. 27, 1328\u20131361 (2013).","journal-title":"Clin. Neuropsychol."},{"key":"1327_CR3","doi-asserted-by":"publisher","first-page":"806","DOI":"10.1056\/NEJMoa2311330","volume":"390","author":"A Hampshire","year":"2024","unstructured":"Hampshire, A. et al. Cognition and memory after Covid-19 in a large community sample. N. Engl. J. Med. 390, 806\u2013818 (2024).","journal-title":"N. Engl. J. Med."},{"key":"1327_CR4","first-page":"e12217","volume":"13","author":"F \u00d6hman","year":"2021","unstructured":"\u00d6hman, F., Hassenstab, J., Berron, D., Sch\u00f6ll, M. & Papp, K. V. Current advances in digital cognitive assessment for preclinical Alzheimer\u2019s disease. Alzheimers Dement. Diagn. Assess. Dis. Monit. 13, e12217 (2021).","journal-title":"Alzheimers Dement. Diagn. Assess. Dis. Monit."},{"key":"1327_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.eclinm.2022.101417","volume":"47","author":"A Hampshire","year":"2022","unstructured":"Hampshire, A. et al. Multivariate profile and acute-phase correlates of cognitive deficits in a COVID-19 hospitalised cohort. eClinicalMedicine 47, 101417 (2022).","journal-title":"eClinicalMedicine"},{"key":"1327_CR6","doi-asserted-by":"publisher","DOI":"10.2196\/rehab.6376","volume":"4","author":"F Meiland","year":"2017","unstructured":"Meiland, F. et al. Technologies to support community-dwelling persons with dementia: a position paper on issues regarding development, usability, effectiveness and cost-effectiveness, deployment, and ethics. JMIR Rehabil. Assist. Technol. 4, e1 (2017).","journal-title":"JMIR Rehabil. Assist. Technol."},{"key":"1327_CR7","doi-asserted-by":"publisher","DOI":"10.1016\/j.eclinm.2023.101980","volume":"59","author":"M Del Giovane","year":"2023","unstructured":"Del Giovane, M. et al. Computerised cognitive assessment in patients with traumatic brain injury: an observational study of feasibility and sensitivity relative to established clinical scales. eClinicalMedicine 59, 101980 (2023).","journal-title":"eClinicalMedicine"},{"key":"1327_CR8","doi-asserted-by":"crossref","unstructured":"Tsoy, E., Zygouris, S. & Possin, K. L. Current state of self-administered brief computerized cognitive assessments for detection of cognitive disorders in older adults: a systematic review. J. Prev. Alzheimers Dis. 8, 267\u2013276 (2021).","DOI":"10.14283\/jpad.2021.11"},{"key":"1327_CR9","doi-asserted-by":"publisher","DOI":"10.1016\/j.eclinm.2023.102086","volume":"62","author":"NJ Cheetham","year":"2023","unstructured":"Cheetham, N. J. et al. The effects of COVID-19 on cognitive performance in a community-based cohort: a COVID symptom study biobank prospective cohort study. eClinicalMedicine 62, 102086 (2023).","journal-title":"eClinicalMedicine"},{"key":"1327_CR10","doi-asserted-by":"publisher","DOI":"10.1016\/j.eclinm.2024.102437","volume":"69","author":"K Shibata","year":"2024","unstructured":"Shibata, K. et al. Remote digital cognitive assessment reveals cognitive deficits related to hippocampal atrophy in autoimmune limbic encephalitis: a cross-sectional validation study. eClinicalMedicine 69, 102437 (2024).","journal-title":"eClinicalMedicine"},{"key":"1327_CR11","doi-asserted-by":"publisher","first-page":"105119","DOI":"10.1016\/j.jstrokecerebrovasdis.2020.105119","volume":"29","author":"S Verstraeten","year":"2020","unstructured":"Verstraeten, S. et al. Motor impairment three months post stroke implies a corresponding cognitive deficit. J. Stroke Cerebrovasc. Dis. 29, 105119 (2020).","journal-title":"J. Stroke Cerebrovasc. Dis."},{"key":"1327_CR12","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-87287-8","volume":"11","author":"N Demeyere","year":"2021","unstructured":"Demeyere, N. et al. Introducing the tablet-based Oxford Cognitive Screen-Plus (OCS-Plus) as an assessment tool for subtle cognitive impairments. Sci. Rep. 11, 8000 (2021).","journal-title":"Sci. Rep."},{"key":"1327_CR13","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1007\/s42113-020-00074-y","volume":"3","author":"D Katsimpokis","year":"2020","unstructured":"Katsimpokis, D., Hawkins, G. E. & Van Maanen, L. Not all speed-accuracy trade-off manipulations have the same psychological effect. Comput. Brain Behav. 3, 252\u2013268 (2020).","journal-title":"Comput. Brain Behav."},{"key":"1327_CR14","doi-asserted-by":"publisher","first-page":"480","DOI":"10.2307\/1422636","volume":"98","author":"JG Snodgrass","year":"1985","unstructured":"Snodgrass, J. G., Townsend, J. T. & Ashby, F. G. Stochastic modeling of elementary psychological processes. Am. J. Psychol. 98, 480 (1985).","journal-title":"Am. J. Psychol."},{"key":"1327_CR15","doi-asserted-by":"publisher","first-page":"653","DOI":"10.3758\/s13428-016-0721-5","volume":"49","author":"A Vandierendonck","year":"2017","unstructured":"Vandierendonck, A. A comparison of methods to combine speed and accuracy measures of performance: a rejoinder on the binning procedure. Behav. Res. Methods 49, 653\u2013673 (2017).","journal-title":"Behav. Res. Methods"},{"key":"1327_CR16","doi-asserted-by":"crossref","unstructured":"Liesefeld, H. R. & Janczyk, M. Combining speed and accuracy to control for speed-accuracy trade-offs(?). Behav. Res. Methods 51, 40\u201360 (2019).","DOI":"10.3758\/s13428-018-1076-x"},{"key":"1327_CR17","doi-asserted-by":"publisher","first-page":"513","DOI":"10.3758\/s13428-016-0740-2","volume":"49","author":"V Lerche","year":"2017","unstructured":"Lerche, V., Voss, A. & Nagler, M. How many trials are required for parameter estimation in diffusion modeling? A comparison of different optimization criteria. Behav. Res. Methods 49, 513\u2013537 (2017).","journal-title":"Behav. Res. Methods"},{"key":"1327_CR18","doi-asserted-by":"publisher","first-page":"1039172","DOI":"10.3389\/fpsyg.2022.1039172","volume":"13","author":"CE Myers","year":"2022","unstructured":"Myers, C. E., Interian, A. & Moustafa, A. A. A practical introduction to using the drift diffusion model of decision-making in cognitive psychology, neuroscience, and health sciences. Front. Psychol. 13, 1039172 (2022).","journal-title":"Front. Psychol."},{"key":"1327_CR19","doi-asserted-by":"publisher","first-page":"873","DOI":"10.1162\/neco.2008.12-06-420","volume":"20","author":"R Ratcliff","year":"2008","unstructured":"Ratcliff, R. & McKoon, G. The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput. 20, 873\u2013922 (2008).","journal-title":"Neural Comput."},{"key":"1327_CR20","doi-asserted-by":"crossref","unstructured":"Nguyen, T. H., Han, H.-R., Kim, M. T. & Chan, K. S. An introduction to item response theory for patient-reported outcome measurement. Patient\u2013 Patient-Centered Outcomes Res. 7, 23\u201335 (2014).","DOI":"10.1007\/s40271-013-0041-0"},{"key":"1327_CR21","doi-asserted-by":"crossref","unstructured":"Hvan der Linden W. J. (ed) Handbook of Item Response Theory (Chapman & Hall\/CRC, 2019).","DOI":"10.1201\/9781315119144"},{"key":"1327_CR22","doi-asserted-by":"publisher","first-page":"45","DOI":"10.3389\/feduc.2019.00045","volume":"4","author":"JC Immekus","year":"2019","unstructured":"Immekus, J. C., Snyder, K. E. & Ralston, P. A. Multidimensional item response theory for factor structure assessment in educational psychology research. Front. Educ. 4, 45 (2019).","journal-title":"Front. Educ."},{"key":"1327_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.eclinm.2021.101044","volume":"39","author":"A Hampshire","year":"2021","unstructured":"Hampshire, A. et al. Cognitive deficits in people who have recovered from COVID-19. EClinicalMedicine 39, 101044 (2021).","journal-title":"EClinicalMedicine"},{"key":"1327_CR24","unstructured":"Hampshire, A. Great British Intelligence Test Protocol. https:\/\/protocolexchange.researchsquare.com\/article\/pex-1085\/v1 (2020)."},{"key":"1327_CR25","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/0160-2896(92)90023-K","volume":"16","author":"LT Miller","year":"1992","unstructured":"Miller, L. T. & Vernon, P. A. The general factor in short-term memory, intelligence, and reaction time. Intelligence 16, 5\u201329 (1992).","journal-title":"Intelligence"},{"key":"1327_CR26","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-22199-9","volume":"12","author":"E Soreq","year":"2021","unstructured":"Soreq, E., Violante, I. R., Daws, R. E. & Hampshire, A. Neuroimaging evidence for a network sampling theory of individual differences in human intelligence test performance. Nat. Commun. 12, 2072 (2021).","journal-title":"Nat. Commun."},{"key":"1327_CR27","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1093\/geronb\/gbw074","volume":"72","author":"MA Shafto","year":"2017","unstructured":"Shafto, M. A., James, L. E., Abrams, L., Tyler, L. K. & Cam-CAN. Age-related increases in verbal knowledge are not associated with word finding problems in the Cam-CAN cohort: what you know won\u2019t hurt you. J. Gerontol. B. Psychol. Sci. Soc. Sci. 72, 100\u2013106 (2017).","journal-title":"J. Gerontol. B. Psychol. Sci. Soc. Sci."},{"key":"1327_CR28","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1037\/0033-295X.105.1.158","volume":"105","author":"A Baddeley","year":"1998","unstructured":"Baddeley, A., Gathercole, S. & Papagno, C. The phonological loop as a language learning device. Psychol. Rev. 105, 158\u2013173 (1998).","journal-title":"Psychol. Rev."},{"key":"1327_CR29","doi-asserted-by":"publisher","DOI":"10.1002\/mpr.1562","volume":"26","author":"RC Moore","year":"2017","unstructured":"Moore, R. C., Swendsen, J. & Depp, C. A. Applications for self\u2010administered mobile cognitive assessments in clinical research: a systematic review. Int. J. Methods Psychiatr. Res. 26, e1562 (2017).","journal-title":"Int. J. Methods Psychiatr. Res."},{"key":"1327_CR30","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1136\/ebm.5.5.132","volume":"5","author":"SE Straus","year":"2000","unstructured":"Straus, S. E. Clinical assessment of the reliability of the examination (CARE). Evid. Based Med. 5, 132\u2013134 (2000).","journal-title":"Evid. Based Med."},{"key":"1327_CR31","unstructured":"Carroll, J. B. Human Cognitive Abilities: A Survey of Factor-Analytic Studies (Cambridge University Press, 2004)."},{"key":"1327_CR32","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1016\/j.intell.2004.12.002","volume":"33","author":"W Johnson","year":"2005","unstructured":"Johnson, W. & Bouchardjr, T. The structure of human intelligence: It is verbal, perceptual, and image rotation (VPR), not fluid and crystallized. Intelligence 33, 393\u2013416 (2005).","journal-title":"Intelligence"},{"key":"1327_CR33","doi-asserted-by":"publisher","first-page":"201","DOI":"10.2307\/1412107","volume":"15","author":"C Spearman","year":"1904","unstructured":"Spearman, C. General intelligence,\u2019 objectively determined and measured. Am. J. Psychol. 15, 201 (1904).","journal-title":"Am. J. Psychol."},{"key":"1327_CR34","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.intell.2015.07.006","volume":"52","author":"GE Gignac","year":"2015","unstructured":"Gignac, G. E. Raven\u2019s is not a pure measure of general intelligence: Implications for g factor theory and the brief measurement of g. Intelligence 52, 71\u201379 (2015).","journal-title":"Intelligence"},{"key":"1327_CR35","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1080\/23279095.2019.1585351","volume":"28","author":"ZC Merz","year":"2021","unstructured":"Merz, Z. C., Van Patten, R., Hurless, N., Grant, A. & McGrath, A. B. Furthering the understanding of wechsler adult intelligence scale-fourth edition factor structure in a clinical sample. Appl. Neuropsychol. Adult 28, 12\u201323 (2021).","journal-title":"Appl. Neuropsychol. Adult"},{"key":"1327_CR36","doi-asserted-by":"publisher","first-page":"e0231627","DOI":"10.1371\/journal.pone.0231627","volume":"15","author":"C Fawns-Ritchie","year":"2020","unstructured":"Fawns-Ritchie, C. & Deary, I. J. Reliability and validity of the UK Biobank cognitive tests. PLoS ONE 15, e0231627 (2020).","journal-title":"PLoS ONE"},{"key":"1327_CR37","doi-asserted-by":"publisher","first-page":"101376","DOI":"10.1016\/j.intell.2019.101376","volume":"76","author":"SR Cox","year":"2019","unstructured":"Cox, S. R., Ritchie, S. J., Fawns-Ritchie, C., Tucker-Drob, E. M. & Deary, I. J. Structural brain imaging correlates of general intelligence in UK Biobank. Intelligence 76, 101376 (2019).","journal-title":"Intelligence"},{"key":"1327_CR38","doi-asserted-by":"publisher","first-page":"858","DOI":"10.1007\/s11336-017-9599-0","volume":"83","author":"NG Waller","year":"2018","unstructured":"Waller, N. G. Direct Schmid\u2013Leiman transformations and rank-deficient loadings matrices. Psychometrika 83, 858\u2013870 (2018).","journal-title":"Psychometrika"},{"key":"1327_CR39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1162\/imag_a_00087","volume":"2","author":"V Giunchiglia","year":"2024","unstructured":"Giunchiglia, V., Curtis, S., Smith, S., Allen, N. & Hampshire, A. Neural correlates of cognitive ability and visuo-motor speed: Validation of IDoCT on UK Biobank Data. Imaging Neurosci 2, 1\u201325 (2024).","journal-title":"Imaging Neurosci"},{"key":"1327_CR40","doi-asserted-by":"publisher","unstructured":"Giunchiglia, V. et al. Iterative decomposition of visuomotor, device and cognitive variance in large scale online cognitive test data. https:\/\/doi.org\/10.21203\/rs.3.rs-2972434\/v1 (2023).","DOI":"10.21203\/rs.3.rs-2972434\/v1"},{"key":"1327_CR41","doi-asserted-by":"publisher","DOI":"10.1002\/alz.074654","volume":"19","author":"MD Giovane","year":"2023","unstructured":"Giovane, M. D. et al. Computerised cognitive testing and multi\u2010domain structural magnetic resonance imaging in patients with idiopathic normal pressure hydrocephalus and Alzheimer\u2019s disease. Alzheimers Dement 19, e074654 (2023).","journal-title":"Alzheimers Dement"},{"key":"1327_CR42","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1037\/0033-2909.112.1.155","volume":"112","author":"J Cohen","year":"1992","unstructured":"Cohen, J. A power primer. Psychol. Bull. 112, 155\u2013159 (1992).","journal-title":"Psychol. Bull."},{"key":"1327_CR43","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1007\/BF02289209","volume":"22","author":"J Schmid","year":"1957","unstructured":"Schmid, J. & Leiman, J. M. The development of hierarchical factor solutions. Psychometrika 22, 53\u201361 (1957).","journal-title":"Psychometrika"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01327-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01327-x","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01327-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,20]],"date-time":"2024-11-20T00:07:59Z","timestamp":1732061279000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-024-01327-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,19]]},"references-count":43,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["1327"],"URL":"https:\/\/doi.org\/10.1038\/s41746-024-01327-x","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,19]]},"assertion":[{"value":"2 April 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 November 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 November 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A.H. is the owner and founder of Future Cognition Ltd. and H2 Cognitive Designs Ltd., which develop custom cognitive assessment software for other university-based research groups. P.J.H. is the owner and co-founder of H2 Cognitive Designs Ltd. The authors report no other conflicts of interest.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"328"}}