{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T06:29:14Z","timestamp":1787725754026,"version":"build-2784847793"},"reference-count":46,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T00:00:00Z","timestamp":1787702400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003696","name":"Electronics and Telecommunications Research Institute","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003696","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychol."],"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Visual-to-auditory sensory substitution converts visual information into structured sound patterns when visual input is unavailable, impaired, or experimentally restricted, thereby supporting access to information otherwise conveyed visually. Its perceptual usability depends jointly on the sensory-conversion scheme that encodes visual information into sound and on the learning conditions under which learners acquire sound-visual mappings through learning and experience. Although prior visual-to-auditory sensory-substitution studies have often evaluated substituted coding schemes or learning approaches primarily through endpoint learnability or recognition accuracy, endpoint performance alone does not characterize the temporal cost and efficiency with which usable perceptual decoding emerges during learning.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This study examined whether structured learning based on information-processing principles was associated with more efficient early acquisition of sound-visual mappings in a controlled perceptual-learning model with a constant visual-to-auditory mapping framework. Acquisition-phase behavioral records from 63 blindfolded sighted adults who completed a randomized visual-to-auditory sensory-substitution learning experiment were analyzed, with 31 and 32 participants in the structured-learning and control conditions, respectively. The outcomes included correct-trial response time, total learning time, response-time variability, and inverse efficiency score.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Compared with the control condition, structured learning was associated with shorter correct-trial response time, lower total learning time, and lower inverse efficiency score, without a meaningful between-group difference in response-time variability. These patterns remained evident across robustness analyses and after adjustment for baseline pre-test performance. Exploratory schedule-derived analyses suggested that structured learning provided denser repeated exposure and a more staged introduction of sensory mappings.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>Together, these behavioral-log findings indicate that structured learning was associated with more efficient early acquisition of sound-visual mappings and suggest that acquisition efficiency in sensory-substitution learning may be related to how those mappings are sequenced and repeated during learning.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpsyg.2026.1887888","type":"journal-article","created":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T06:01:51Z","timestamp":1787724111000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Early acquisition efficiency in visual-to-auditory sensory substitution: the role of structured learning"],"prefix":"10.3389","volume":"17","author":[{"given":"Kyeong Deok","family":"Moon","sequence":"first","affiliation":[{"name":"Sensory-Perception AX Research Section, Electronics and Telecommunications Research Institute (ETRI)","place":["Daejeon, Republic of Korea"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yun Kyung","family":"Park","sequence":"additional","affiliation":[{"name":"Sensory-Perception AX Research Section, Electronics and Telecommunications Research Institute (ETRI)","place":["Daejeon, Republic of Korea"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Moo Seop","family":"Kim","sequence":"additional","affiliation":[{"name":"Sensory-Perception AX Research Section, Electronics and Telecommunications Research Institute (ETRI)","place":["Daejeon, Republic of Korea"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chi Yoon","family":"Jeong","sequence":"additional","affiliation":[{"name":"Sensory-Perception AX Research Section, Electronics and Telecommunications Research Institute (ETRI)","place":["Daejeon, Republic of Korea"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,8,26]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"247","DOI":"10.3233\/RNN-130338","article-title":"Eyemusic: introducing a visual colorful experience for the blind using auditory sensory substitution","volume":"32","author":"Abboud","year":"2014","journal-title":"Restorativ. Neurol. Neurosci"},{"key":"B2","doi-asserted-by":"publisher","first-page":"105619","DOI":"10.1016\/j.actpsy.2025.105619","article-title":"Exploration strategies influence visual-auditory sensory substitution in a passive guidance setup","volume":"260","author":"Akar","year":"2025","journal-title":"Acta Psychologica"},{"key":"B3","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1038\/nn1912","article-title":"Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex","volume":"10","author":"Amedi","year":"2007","journal-title":"Nature Neurosci"},{"key":"B4","author":"Auvray","year":"2025"},{"key":"B5","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1068\/p5631","article-title":"Learning to perceive with a visuo-auditory substitution system: localization and object recognition with the voice","volume":"36","author":"Auvray","year":"2007","journal-title":"Perception"},{"key":"B6","doi-asserted-by":"publisher","first-page":"963","DOI":"10.1038\/221963a0","article-title":"Vision substitution by tactile image projection","volume":"221","author":"Bach-y-Rita","year":"1969","journal-title":"Nature"},{"key":"B7","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1016\/j.tics.2003.10.013","article-title":"Sensory substitution and the human-machine interface","volume":"7","author":"Bach-y-Rita","year":"2003","journal-title":"Trends Cogn. Sci"},{"key":"B8","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1037\/0033-295X.94.2.115","article-title":"Recognition-by-components: a theory of human image understanding","volume":"94","author":"Biederman","year":"1987","journal-title":"Psychol. Rev"},{"key":"B9","doi-asserted-by":"publisher","first-page":"2184","DOI":"10.3758\/s13414-025-03065-y","article-title":"Localization abilities with a visual-to-auditory substitution device are modulated by the spatial arrangement of the scene","volume":"87","author":"Bordeau","year":"2025","journal-title":"Attention, Perception, Psychophy"},{"key":"B10","doi-asserted-by":"publisher","first-page":"5","DOI":"10.5334\/pb-51-1-5","article-title":"Combining speed and accuracy in cognitive psychology: is the inverse efficiency score a better dependent variable than mean reaction time and error rate?","volume":"51","author":"Bruyer","year":"2011","journal-title":"Psychologica Belgica"},{"key":"B11","doi-asserted-by":"publisher","first-page":"e0250281","DOI":"10.1371\/journal.pone.0250281","article-title":"A self-training program for sensory substitution devices","volume":"16","author":"Buchs","year":"2021","journal-title":"PLoS ONE"},{"key":"B12","doi-asserted-by":"publisher","first-page":"1095","DOI":"10.1111\/j.1467-9280.2008.02209.x","article-title":"Spacing effects in learning: a temporal ridgeline of optimal retention","volume":"19","author":"Cepeda","year":"2008","journal-title":"Psychol. Sci"},{"key":"B13","doi-asserted-by":"publisher","first-page":"346","DOI":"10.3390\/info10110346","article-title":"Combining visual contrast information with sound can produce faster decisions","volume":"10","author":"Dresp-Langley","year":"2019","journal-title":"Information"},{"key":"B14","doi-asserted-by":"publisher","first-page":"62","DOI":"10.3389\/fnagi.2020.00062","article-title":"Heterogeneous indicators of cognitive performance and performance variability across the lifespan","volume":"12","author":"Dykiert","year":"2020","journal-title":"Front. Aging Neurosci"},{"key":"B15","volume-title":"Principles of Perceptual Learning and Development","author":"Gibson","year":"1969"},{"key":"B16","doi-asserted-by":"publisher","first-page":"330","DOI":"10.3389\/fpsyg.2013.00330","article-title":"How well do you see what you hear? the acuity of visual-to-auditory sensory substitution","volume":"4","author":"Haigh","year":"2013","journal-title":"Front. Psychol"},{"key":"B17","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1155\/2010\/282341","article-title":"The vibe: a versatile vision-to-audition sensory substitution device","volume":"7","author":"Hanneton","year":"2010","journal-title":"Appl. Bionics Biomech"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1443","DOI":"10.3389\/fpsyg.2020.01443","article-title":"Efficiency of sensory substitution devices alone and in combination with self-motion for spatial navigation in sighted and visually impaired","volume":"11","author":"Jicol","year":"2020","journal-title":"Front. Psychol"},{"key":"B19","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1177\/1059712318771690","article-title":"Guidelines for quantitative and qualitative studies of sensory substitution experience","volume":"26","author":"Ka\u0142wak","year":"2018","journal-title":"Adaptiv. Behav"},{"key":"B20","doi-asserted-by":"publisher","first-page":"90501","DOI":"10.1109\/ACCESS.2024.3419102","article-title":"Impact of device and environment on visual-auditory sensory substitution: a comprehensive behavioral analysis using the voice algorithm","volume":"12","author":"Kim","year":"2024","journal-title":"IEEE Access"},{"key":"B21","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1038\/s41539-025-00385-4","article-title":"Learning visual to auditory sensory substitution reveals flexibility in image to sound mapping","volume":"11","author":"Kucinkas","year":"2026","journal-title":"NPJ Sci. Learning"},{"key":"B22","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1093\/biomet\/73.1.13","article-title":"Longitudinal data analysis using generalized linear models","volume":"73","author":"Liang","year":"1986","journal-title":"Biometrika"},{"key":"B23","doi-asserted-by":"publisher","first-page":"40","DOI":"10.3758\/s13428-018-1076-x","article-title":"Combining speed and accuracy to control for speed-accuracy trade-offs","volume":"51","author":"Liesefeld","year":"2019","journal-title":"Behav. Res. Methods"},{"key":"B24","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.neubiorev.2013.11.007","article-title":"Sensory substitution: closing the gap between basic research and widespread practical visual rehabilitation","volume":"41","author":"Maidenbaum","year":"2014","journal-title":"Neurosci. Biobehav. Rev"},{"key":"B25","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1109\/10.121642","article-title":"An experimental system for auditory image representations","volume":"39","author":"Meijer","year":"1992","journal-title":"IEEE Transac. Biomed. Eng"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1097","DOI":"10.1109\/TNSRE.2025.3548942","article-title":"Improving acceptance to sensory substitution: a study on the v2a-ss learning model based on information processing learning theory","volume":"33","author":"Moon","year":"2025","journal-title":"IEEE Transac. Neural Syst. Rehabil. Eng"},{"key":"B27","doi-asserted-by":"publisher","first-page":"737","DOI":"10.1177\/001872089303500412","article-title":"The efficiency of instructional conditions: an approach to combine mental-effort and performance measures","volume":"35","author":"Paas","year":"1993","journal-title":"Human Factors"},{"key":"B28","doi-asserted-by":"publisher","first-page":"41684","DOI":"10.1038\/srep41684","article-title":"Sounds can boost the awareness of visual events through attention without cross-modal integration","volume":"7","author":"P\u00e1pai","year":"2017","journal-title":"Sci. Rep"},{"key":"B29","doi-asserted-by":"publisher","first-page":"79","DOI":"10.3389\/fnbeh.2016.00079","article-title":"Sensory substitution: the spatial updating of auditory scenes \u201cmimics\u201d the spatial updating of visual scenes","volume":"10","author":"Pasqualotto","year":"2016","journal-title":"Front. Behav. Neurosci"},{"key":"B30","doi-asserted-by":"publisher","first-page":"1108","DOI":"10.1016\/j.neuropsychologia.2006.09.018","article-title":"Pattern recognition using a device substituting audition for vision in blindfolded sighted subjects","volume":"45","author":"Poirier","year":"2007","journal-title":"Neuropsychologia"},{"key":"B31","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1016\/j.neubiorev.2012.11.017","article-title":"Multisensory perceptual learning and sensory substitution","volume":"41","author":"Proulx","year":"2014","journal-title":"Neurosci. Biobehav. Rev"},{"key":"B32","doi-asserted-by":"publisher","first-page":"3404","DOI":"10.3390\/s19153404","article-title":"Navigation systems for the blind and visually impaired: past work, challenges, and open problems","volume":"19","author":"Real","year":"2019","journal-title":"Sensors"},{"key":"B33","doi-asserted-by":"publisher","first-page":"15359","DOI":"10.1038\/srep15359","article-title":"\u201cVisual\u201d parsing can be taught quickly without visual experience during critical periods","volume":"5","author":"Reich","year":"2015","journal-title":"Sci. Rep"},{"key":"B34","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1016\/S0006-8993(01)02667-1","article-title":"Brain plasticity: visual acuity of blind persons via the tongue","volume":"908","author":"Sampaio","year":"2001","journal-title":"Brain Res"},{"key":"B35","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1111\/j.1467-9280.1992.tb00029.x","article-title":"New conceptualizations of practice: common principles in three paradigms suggest new concepts for training","volume":"3","author":"Schmidt","year":"1992","journal-title":"Psychol. Sci"},{"key":"B36","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1177\/1745691615569000","article-title":"Learning versus performance: an integrative review","volume":"10","author":"Soderstrom","year":"2015","journal-title":"Perspectiv. Psychol. Sci"},{"key":"B37","doi-asserted-by":"publisher","first-page":"842","DOI":"10.3389\/fpsyg.2015.00842","article-title":"Length and orientation constancy learning in 2-dimensions with auditory sensory substitution: the importance of self-initiated movement","volume":"6","author":"Stiles","year":"2015","journal-title":"Front. Psychol"},{"key":"B38","doi-asserted-by":"publisher","first-page":"640","DOI":"10.1016\/j.neuron.2012.08.026","article-title":"Reading with sounds: sensory substitution selectively activates the visual word form area in the blind","volume":"76","author":"Striem-Amit","year":"","journal-title":"Neuron"},{"key":"B39","doi-asserted-by":"publisher","first-page":"e33136","DOI":"10.1371\/journal.pone.0033136","article-title":"\u201cVisual\u201d acuity of the congenitally blind using visual-to-auditory sensory substitution","volume":"7","author":"Striem-Amit","year":"","journal-title":"PLoS ONE"},{"key":"B40","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4419-8126-4","volume-title":"Cognitive Load Theory","author":"Sweller","year":"2011"},{"key":"B41","doi-asserted-by":"publisher","first-page":"181","DOI":"10.3102\/10769986031002181","article-title":"A lognormal model for response times on test items","volume":"31","author":"van der Linden","year":"2006","journal-title":"J. Educ. Behav. Stat"},{"key":"B42","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1111\/j.1745-3984.2009.00080.x","article-title":"Conceptual issues in response-time modeling","volume":"46","author":"van der Linden","year":"2009","journal-title":"J. Educ. Measurement"},{"key":"B43","doi-asserted-by":"publisher","first-page":"102","DOI":"10.3389\/fpsyg.2019.00102","article-title":"An overview of models for response times and processes in cognitive tests","volume":"10","author":"van der Linden","year":"2019","journal-title":"Front. Psychol"},{"key":"B44","doi-asserted-by":"publisher","first-page":"653","DOI":"10.3758\/s13428-016-0721-5","article-title":"A comparison of methods to combine speed and accuracy measures of performance: a rejoinder on the binning procedure","volume":"49","author":"Vandierendonck","year":"2017","journal-title":"Behav. Res. Methods"},{"key":"B45","doi-asserted-by":"publisher","first-page":"677","DOI":"10.1037\/0278-7393.16.4.677","article-title":"Reduced frequency of knowledge of results enhances motor skill learning","volume":"16","author":"Winstein","year":"1990","journal-title":"J. Exp. Psychol.: Learning, Mem Cogn"},{"key":"B46","doi-asserted-by":"publisher","first-page":"1506261","DOI":"10.3389\/fneur.2025.1506261","article-title":"The impact of frequency-specific music stimulation on consciousness in patients with disorders of consciousness","volume":"16","author":"Yang","year":"2025","journal-title":"Front. Neurol"}],"container-title":["Frontiers in Psychology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1887888\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T06:01:53Z","timestamp":1787724113000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1887888\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,26]]},"references-count":46,"alternative-id":["10.3389\/fpsyg.2026.1887888"],"URL":"https:\/\/doi.org\/10.3389\/fpsyg.2026.1887888","relation":{},"ISSN":["1664-1078"],"issn-type":[{"value":"1664-1078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,26]]},"article-number":"1887888"}}