{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,3]],"date-time":"2026-01-03T15:16:02Z","timestamp":1767453362130,"version":"3.41.2"},"reference-count":71,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2021,10,28]],"date-time":"2021-10-28T00:00:00Z","timestamp":1635379200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychol."],"abstract":"<jats:p>Learning to read involves efficient binding of visual to auditory information. Aberrant cross-modal binding skill has been observed in both children and adults with developmental dyslexia. Here, we examine the contribution of episodic memory to acquisition of novel cross-modal bindings in typical and dyslexic adult readers. Participants gradually learned arbitrary associations between unfamiliar Mandarin Chinese characters and English-like pseudowords over multiple exposures, simulating the early stages of letter-to-letter sound mapping. The novel cross-modal bindings were presented in consistent or varied locations (i.e., screen positions), and within consistent or varied contexts (i.e., co-occurring distractor items). Our goal was to examine the contribution, if any, of these episodic memory cues (i.e., the contextual and spatial properties of the stimuli) to binding acquisition, and investigate the extent to which readers with and without dyslexia would differ in their reliance on episodic memory during the learning process. Participants were tested on their ability to recognize and recall the bindings both during training and then in post-training tasks. We tracked participants\u2019 eye movements remotely with their personal webcams to assess whether they would re-fixate relevant empty screen locations upon hearing an auditory cue\u2014indicative of episodic memory retrieval\u2014and the extent to which the so-called \u201clooking-at-nothing behavior\u201d would modulate recognition of the novel bindings. Readers with dyslexia both recognized and recalled significantly fewer bindings than typical readers, providing further evidence of their persistent difficulties with cross-modal binding. Looking-at-nothing behavior was generally associated with higher recognition error rates for both groups, a pattern that was particularly more evident in later blocks for bindings encoded in the inconsistent location condition. Our findings also show that whilst readers with and without dyslexia are capable of using stimulus consistencies in the input\u2014both location and context\u2014to assist in audiovisual learning, readers with dyslexia appear particularly reliant on consistent contextual information. Taken together, our results suggest that whilst readers with dyslexia fail to efficiently learn audiovisual binding as a function of stimulus frequency, they are able to use stimulus consistency\u2014aided by episodic recall\u2014to assist in the learning process.<\/jats:p>","DOI":"10.3389\/fpsyg.2021.754610","type":"journal-article","created":{"date-parts":[[2021,10,28]],"date-time":"2021-10-28T08:58:45Z","timestamp":1635411525000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Audiovisual Learning in Dyslexic and Typical Adults: Modulating Influences of Location and Context Consistency"],"prefix":"10.3389","volume":"12","author":[{"given":"Simone L.","family":"Calabrich","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gary M.","family":"Oppenheim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manon W.","family":"Jones","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2021,10,28]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1016\/j.tics.2007.08.015","article-title":"Dyslexia and the anchoring-deficit hypothesis.","volume":"11","author":"Ahissar","year":"2007","journal-title":"Trends Cogn. Sci."},{"key":"B2","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1037\/pne0000066","article-title":"Deficits in working memory visual-phonological binding in children with dyslexia.","volume":"9","author":"Albano","year":"2016","journal-title":"Psychol. Neurosci."},{"key":"B3","doi-asserted-by":"publisher","first-page":"B79","DOI":"10.1016\/j.cognition.2004.02.005","article-title":"Language-mediated eye movements in the absence of a visual world: the \u201cblank screen paradigm\u201d.","volume":"93","author":"Altmann","year":"2004","journal-title":"Cognition"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2016.0060","article-title":"Abstraction and generalization in statistical learning: implications for the relationship between semantic types and episodic tokens.","volume":"372","author":"Altmann","year":"2017","journal-title":"Philos. Trans. R. Soc. B Biol. Sci."},{"key":"B5","doi-asserted-by":"publisher","first-page":"388","DOI":"10.3758\/s13428-019-01237-x","article-title":"Gorilla in our midst: an online behavioral experiment builder.","volume":"52","author":"Anwyl-Irvine","year":"2020","journal-title":"Behav. Res. Methods"},{"key":"B6","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1016\/j.jecp.2013.03.009","article-title":"A lab-controlled simulation of a letter-speech sound binding deficit in dyslexia.","volume":"115","author":"Aravena","year":"2013","journal-title":"J. Exper. Child Psychol."},{"key":"B7","doi-asserted-by":"publisher","first-page":"552","DOI":"10.1177\/0022219417715407","article-title":"Predicting individual differences in reading and spelling skill with artificial script\u2013based letter\u2013speech sound training.","volume":"51","author":"Aravena","year":"2018","journal-title":"J. Learn. Disabil."},{"key":"B8","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1016\/j.jml.2012.11.001","article-title":"Random effects structure for confirmatory hypothesis testing: keep it maximal.","volume":"68","author":"Barr","year":"2013","journal-title":"J. Mem. Lang."},{"key":"B9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting linear mixed-effects models using lme4.","volume":"67","author":"Bates","year":"2015","journal-title":"J. Statist. Softw."},{"key":"B10","doi-asserted-by":"publisher","first-page":"868","DOI":"10.1093\/brain\/awp308","article-title":"Deviant processing of letters and speech sounds as proximate cause of reading failure: a functional magnetic resonance imaging study of dyslexic children.","volume":"133","author":"Blau","year":"2010","journal-title":"Brain"},{"key":"B11","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1016\/j.cub.2009.01.065","article-title":"Reduced neural integration of letters and speech sounds links phonological and reading deficits in adult Dyslexia.","volume":"19","author":"Blau","year":"2009","journal-title":"Curr. Biol."},{"key":"B12","doi-asserted-by":"publisher","first-page":"695","DOI":"10.1016\/j.neuroimage.2010.11.003","article-title":"The neural signature of orthographic-phonological binding in successful and failing reading development.","volume":"57","author":"Blomert","year":"2011","journal-title":"Neuroimage"},{"journal-title":"Praat: Doing Phonetics by Computer [Computer Program]. Version 6.1.50.","year":"2021","author":"Boersma","key":"B13"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2017.00370","article-title":"Web camera based eye tracking to assess visual memory on a visual paired comparison task.","volume":"11","author":"Bott","year":"2017","journal-title":"Front. Neurosci."},{"key":"B15","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1038\/nrn3475","article-title":"Power failure: why small sample size undermines the reliability of neuroscience.","volume":"14","author":"Button","year":"2013","journal-title":"Nat. Rev. Neurosci."},{"key":"B16","article-title":"Episodic memory cues in acquisition of novel visual-phonological associations: a webcam-based eye-tracking study","author":"Calabrich","year":"2021","journal-title":"Proceedings of the Annual Meeting of the Cognitive Science Society"},{"key":"B17","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1207\/s1532799xssr0902_4","article-title":"Learning to read words: theory, findings, and issues.","volume":"9","author":"Ehri","year":"2005","journal-title":"Sci. Stud. Read."},{"key":"B18","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1007\/BF03162082","article-title":"Beginning readers outperform older disabled readers in learning to read words by sight.","volume":"7","author":"Ehri","year":"1995","journal-title":"Read. Writ."},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-018-08189-4","article-title":"Changing temporal context in human temporal lobe promotes memory of distinct episodes.","volume":"10","author":"El-Kalliny","year":"2019","journal-title":"Nat. Commun."},{"key":"B20","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1016\/j.tics.2008.07.007","article-title":"Taking a new look at looking at nothing.","volume":"12","author":"Ferreira","year":"2008","journal-title":"Trends Cogn. Sci."},{"key":"B21","doi-asserted-by":"publisher","first-page":"1063","DOI":"10.1080\/09297049.2019.1572729","article-title":"Cross-modal working memory binding and learning of visual-phonological associations in children with reading difficulties.","volume":"25","author":"Garcia","year":"2019","journal-title":"Child Neuropsychol."},{"key":"B22","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1111\/2041-210X.12504","article-title":"SIMR: an R package for power analysis of generalized linear mixed models by simulation.","volume":"7","author":"Green","year":"2016","journal-title":"Methods Ecol. Evol."},{"key":"B23","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1037\/0033-295X.106.3.491","article-title":"Phonology, reading acquisition, and dyslexia: insights from connectionist models.","volume":"106","author":"Harm","year":"1999","journal-title":"Psychol. Rev."},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2014.00686","article-title":"Devil in the details? Developmental dyslexia and visual long-term memory for details.","volume":"5","author":"Huestegge","year":"2014","journal-title":"Front. Psychol."},{"key":"B25","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1016\/j.jecp.2006.09.002","article-title":"Paired-associate learning, phoneme awareness, and learning to read.","volume":"96","author":"Hulme","year":"2007","journal-title":"J. Exper. Child Psychol."},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.7554\/elife.20557","article-title":"Dyslexics\u2019 faster decay of implicit memory for sounds and words is manifested in their shorter neural adaptation.","volume":"6","author":"Jaffe-Dax","year":"2017","journal-title":"eLife"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1167\/16.9.10","article-title":"Dyslexics\u2019 usage of visual priors is impaired.","volume":"16","author":"Jaffe-Dax","year":"2016","journal-title":"J. Vis."},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2202-16-s1-o12","article-title":"Towards a computational model of Dyslexia.","author":"Jaffe-Dax","year":"2015","journal-title":"BMC Neurosci."},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2019.104169","article-title":"Gaze position regulates memory accessibility during competitive memory retrieval.","volume":"197","author":"Johansson","year":"2020","journal-title":"Cognition"},{"key":"B30","doi-asserted-by":"publisher","first-page":"1807","DOI":"10.1037\/a0033334","article-title":"Cross-modal binding in developmental dyslexia.","volume":"39","author":"Jones","year":"","journal-title":"J. Exper. Psychol. Learn. Mem. Cogn."},{"key":"B31","doi-asserted-by":"publisher","first-page":"554","DOI":"10.1037\/a0029710","article-title":"Dyslexia and fluency: parafoveal and foveal influences on rapid automatized naming.","volume":"39","author":"Jones","year":"","journal-title":"J. Exper. Psychol. Hum. Percept. Perform."},{"key":"B32","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1016\/j.cognition.2018.04.010","article-title":"Episodic traces and statistical regularities: paired associate learning in typical and dyslexic readers.","volume":"177","author":"Jones","year":"2018","journal-title":"Cognition"},{"key":"B33","doi-asserted-by":"publisher","first-page":"627","DOI":"10.3758\/BRM.42.3.627","article-title":"Wuggy: a multilingual pseudoword generator.","volume":"42","author":"Keuleers","year":"2010","journal-title":"Behav. Res. Methods"},{"key":"B34","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1007\/s00426-018-1084-6","article-title":"Less imageable words lead to more looks to blank locations during memory retrieval.","volume":"84","author":"Kumcu","year":"2020","journal-title":"Psychol. Res."},{"key":"B35","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1016\/0010-0285(74)90015-2","article-title":"Toward a theory of automatic information processing in reading.","volume":"6","author":"LaBerge","year":"1974","journal-title":"Cogn. Psychol."},{"key":"B36","first-page":"1","article-title":"Controlling for participants\u2019 viewing distance in large-scale, psychophysical online experiments using a virtual chinrest.","volume":"10","author":"Li","year":"2020","journal-title":"Sci. Rep."},{"key":"B37","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.jml.2013.10.005","article-title":"The nature and specificity of paired associate learning deficits in children with dyslexia.","volume":"71","author":"Litt","year":"2014","journal-title":"J. Mem. Lang."},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-41503-8","article-title":"Pattern separation of spiketrains in hippocampal neurons.","volume":"9","author":"Madar","year":"2019","journal-title":"Sci. Rep."},{"key":"B39","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1002\/dys.410","article-title":"Developmental dyslexia and explicit long-term memory.","volume":"16","author":"Menghini","year":"2010","journal-title":"Dyslexia"},{"key":"B40","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/S0022-0965(02)00179-0","article-title":"Word, nonword, and visual paired associate learning in Dutch dyslexic children.","volume":"84","author":"Messbauer","year":"2003","journal-title":"J. Exper. Child Psychol."},{"key":"B41","article-title":"WebGazer: scalable webcam eye tracking using user interactions","author":"Papoutsaki","year":"2016","journal-title":"Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI 2016)"},{"key":"B42","doi-asserted-by":"publisher","first-page":"798","DOI":"10.1080\/09541440902978365","article-title":"Rules versus statistics in reading aloud: new evidence on an old debate.","volume":"22","author":"Perry","year":"2010","journal-title":"Eur. J. Cogn. Psychol."},{"journal-title":"R: A Language and Environment for Statistical Computing.","year":"2020","key":"B43"},{"key":"B44","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1016\/S0010-0277(00)00084-6","article-title":"Representation, space and Hollywood squares: looking at things that aren\u2019t there anymore.","volume":"76","author":"Richardson","year":"2000","journal-title":"Cognition"},{"key":"B45","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1006\/jmla.1996.0032","article-title":"Word segmentation: the role of distributional cues.","volume":"35","author":"Saffran","year":"1996","journal-title":"J. Mem. Lang."},{"key":"B46","article-title":"Looking at nothing diminishes with practice","author":"Scholz","year":"2011","journal-title":"Proceedings of the 33rd Annual Meeting of the Cognitive Science Society"},{"key":"B47","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1037\/0033-295X.96.4.523","article-title":"A distributed, developmental model of word recognition and naming.","volume":"96","author":"Seidenberg","year":"1989","journal-title":"Psychol. Rev."},{"key":"B48","doi-asserted-by":"publisher","first-page":"451","DOI":"10.3758\/s13428-017-0913-7","article-title":"Online webcam-based eye tracking in cognitive science: a first look.","volume":"50","author":"Semmelmann","year":"2018","journal-title":"Behav. Res. Methods"},{"key":"B49","doi-asserted-by":"publisher","first-page":"1744","DOI":"10.1523\/JNEUROSCI.2389-17.2017","article-title":"Signal complexity of human intracranial EEG tracks successful associative-memory formation across individuals.","volume":"38","author":"Sheehan","year":"2018","journal-title":"J. Neurosci."},{"key":"B50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/dys.1432","article-title":"Validity of a protocol for adult self-report of dyslexia and related difficulties.","volume":"18","author":"Snowling","year":"2012","journal-title":"Dyslexia"},{"key":"B51","article-title":"Uniting and freeing the mind","author":"Spivey","year":"2007","journal-title":"The Continuity of Mind"},{"key":"B52","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1002\/(SICI)1098-1063(1998)8:3<205::AID-HIPO3>3.0.CO;2-I","article-title":"Episodic memory, semantic memory, and amnesia.","volume":"8","author":"Squire","year":"1998","journal-title":"Hippocampus"},{"key":"B53","doi-asserted-by":"crossref","DOI":"10.1016\/B978-0-12-407794-2.00067-5","article-title":"Chapter 67: Introduction to memory","author":"Stark","year":"2016","journal-title":"Neurobiology of Language"},{"key":"B54","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1177\/0022219418786691","article-title":"A cross-modal working memory binding span deficit in reading disability.","volume":"52","author":"Toffalini","year":"2019","journal-title":"J. Learn. Disabil."},{"key":"B55","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1080\/09297049.2017.1329411","article-title":"The effects of the constancy of location and order in working memory visual\u2013phonological binding of children with dyslexia.","volume":"24","author":"Toffalini","year":"2018","journal-title":"Child Neuropsychol."},{"journal-title":"TOWRE: Test of Word Reading Efficiency.","year":"1999","author":"Torgesen","key":"B56"},{"key":"B57","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/0010-0285(80)90005-5","article-title":"A feature-integration theory of attention.","volume":"12","author":"Treisman","year":"1980","journal-title":"Cogn. Psychol."},{"key":"B58","doi-asserted-by":"crossref","first-page":"1704","DOI":"10.3758\/BF03195932","article-title":"Location and binding in visual working memory.","volume":"34","author":"Treisman","year":"2006","journal-title":"Mem. Cogn."},{"key":"B59","first-page":"381","article-title":"Chapter 10: Episodic and sematic memory","author":"Tulving","year":"1972","journal-title":"Organisation of Memory"},{"key":"B60","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1037\/h0080641","article-title":"Synergistic ecphory in recall and recognition.","volume":"36","author":"Tulving","year":"1982","journal-title":"Can. J. Psychol."},{"key":"B61","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1002\/icd.1824","article-title":"That\u2019s more like it: multiple exemplars facilitate word learning.","volume":"23","author":"Twomey","year":"2014","journal-title":"Infant Child Dev."},{"key":"B62","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1016\/j.neubiorev.2015.01.008","article-title":"A compensatory role for declarative memory in neurodevelopmental disorders.","volume":"51","author":"Ullman","year":"2015","journal-title":"Neurosci. Biobehav. Rev."},{"key":"B63","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1016\/j.jecp.2010.09.011","article-title":"Developmental differences in children\u2019s context-dependent word learning.","volume":"108","author":"Vlach","year":"2011","journal-title":"J. Exper. Child Psychol."},{"journal-title":"saccades","year":"2019","author":"von der Malsburg","key":"B64"},{"journal-title":"Comprehensive Test of Phonological Processing: CTOPP","year":"1999","author":"Wagner","key":"B65"},{"key":"B66","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1080\/10888438.2016.1231686","article-title":"Paired-associate learning ability accounts for unique variance in orthographic learning.","volume":"21","author":"Wang","year":"2017","journal-title":"Sci. Stud. Read."},{"key":"B67","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1007\/s10339-015-0741-6","article-title":"When looking back to nothing goes back to nothing.","volume":"17","author":"Wantz","year":"2016","journal-title":"Cogn. Process."},{"key":"B68","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1080\/10888438.2010.534832","article-title":"Phoneme awareness, visual-verbal paired-associate learning, and rapid automatized naming as predictors of individual differences in reading ability.","volume":"16","author":"Warmington","year":"2012","journal-title":"Sci. Stud. Read."},{"journal-title":"WAIS-R Manual: Wechsler Adult Intelligence Scale-Revised.","year":"1981","author":"Wechsler","key":"B69"},{"journal-title":"Manual for the Wechsler Abbreviated Intelligence Scale (WASI).","year":"1999","author":"Wechsler","key":"B70"},{"key":"B71","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2015.00369","article-title":"Crossmodal deficit in dyslexic children: practice affects the neural timing of letter-speech sound integration.","volume":"9","author":"\u017dari\u0107","year":"2015","journal-title":"Front. Hum. Neurosci."}],"container-title":["Frontiers in Psychology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2021.754610\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,28]],"date-time":"2021-10-28T08:59:06Z","timestamp":1635411546000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2021.754610\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,28]]},"references-count":71,"alternative-id":["10.3389\/fpsyg.2021.754610"],"URL":"https:\/\/doi.org\/10.3389\/fpsyg.2021.754610","relation":{},"ISSN":["1664-1078"],"issn-type":[{"type":"electronic","value":"1664-1078"}],"subject":[],"published":{"date-parts":[[2021,10,28]]},"article-number":"754610"}}