{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:01:13Z","timestamp":1776092473907,"version":"3.50.1"},"reference-count":58,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,7,2]],"date-time":"2021-07-02T00:00:00Z","timestamp":1625184000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,2]],"date-time":"2021-07-02T00:00:00Z","timestamp":1625184000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Multimodal User Interfaces"],"published-print":{"date-parts":[[2022,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Depth, colour, and thermal images contain practical and actionable information for the blind. Conveying this information through alternative modalities such as audition creates new interaction possibilities for users as well as opportunities to study neuroplasticity. The \u2018SoundSight\u2019 App (<jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"http:\/\/www.SoundSight.co.uk\">www.SoundSight.co.uk<\/jats:ext-link>) is a smartphone platform that allows 3D position, colour, and thermal information to directly control thousands of high-quality sounds in real-time to create completely unique and responsive soundscapes for the user. Users can select the specific sensor input and style of auditory output, which can be based on anything\u2014tones, rainfall, speech, instruments, or even full musical tracks. Appropriate default settings for image-sonification are given by designers, but users still have a fine degree of control over the timing and selection of these sounds. Through utilising smartphone technology with a novel approach to sonification, the SoundSight App provides a cheap, widely accessible, scalable, and flexible sensory tool. In this paper we discuss common problems encountered with assistive sensory tools reaching long-term adoption, how our device seeks to address these problems, its theoretical background, its technical implementation, and finally we showcase both initial user experiences and a range of use case scenarios for scientists, artists, and the blind community.<\/jats:p>","DOI":"10.1007\/s12193-021-00376-w","type":"journal-article","created":{"date-parts":[[2021,7,2]],"date-time":"2021-07-02T12:02:31Z","timestamp":1625227351000},"page":"107-123","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["SoundSight: a mobile sensory substitution device that sonifies colour, distance, and temperature"],"prefix":"10.1007","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5903-4334","authenticated-orcid":false,"given":"Giles","family":"Hamilton-Fletcher","sequence":"first","affiliation":[]},{"given":"James","family":"Alvarez","sequence":"additional","affiliation":[]},{"given":"Marianna","family":"Obrist","sequence":"additional","affiliation":[]},{"given":"Jamie","family":"Ward","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,7,2]]},"reference":[{"issue":"5","key":"376_CR1","first-page":"769","volume":"34","author":"A Kristjansson","year":"2016","unstructured":"Kristjansson A, Moldoveanu A, Johannesson OI, Balan O, Spagnol S, Valgeirsdottir VV et al (2016) Designing sensory-substitution devices: principles, pitfalls and potential. Restor Neurol Neurosci 34(5):769\u2013787","journal-title":"Restor Neurol Neurosci"},{"issue":"11","key":"376_CR2","doi-asserted-by":"publisher","first-page":"1717","DOI":"10.4103\/1673-5374.169612","volume":"10","author":"AC Nau","year":"2015","unstructured":"Nau AC, Murphy MC, Chan KC (2015) Use of sensory substitution devices as a model system for investigating cross-modal neuroplasticity in humans. Neural Regen Res 10(11):1717\u20131719","journal-title":"Neural Regen Res"},{"key":"376_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.neubiorev.2014.03.004","volume":"41","author":"MJ Proulx","year":"2014","unstructured":"Proulx MJ, Ptito M, Amedi A (2014) Multisensory integration, sensory substitution and visual rehabilitation. Neurosci Biobehav Rev 41:1\u20132","journal-title":"Neurosci Biobehav Rev"},{"key":"376_CR4","volume-title":"Sensory substitution devices as advanced sensory tools. Sensory substitution and augmentation","author":"T Wright","year":"2018","unstructured":"Wright T, Ward J (2018) Sensory substitution devices as advanced sensory tools. Sensory substitution and augmentation. Oxford University Press, Oxford"},{"key":"376_CR5","first-page":"83","volume":"50","author":"P Bach-y-Rita","year":"1969","unstructured":"Bach-y-Rita P, Collins CC, Saunders FA, White B, Scadden L (1969) Vision substitution by tactile image projection. Trans Pac Coast Otoophthalmol Soc Annu Meet 50:83\u201391","journal-title":"Trans Pac Coast Otoophthalmol Soc Annu Meet"},{"key":"376_CR6","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1196\/annals.1305.006","volume":"1013","author":"P Bach-y-Rita","year":"2004","unstructured":"Bach-y-Rita P (2004) Tactile sensory substitution studies. Ann N Y Acad Sci 1013:83\u201391","journal-title":"Ann N Y Acad Sci"},{"key":"376_CR7","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1177\/0145482X1611000202","volume":"110","author":"P Grant","year":"2016","unstructured":"Grant P, Spencer L, Arnoldussen A, Hogle R, Nau A, Szlyk J et al (2016) The functional performance of the BrainPort V100 device in persons who are profoundly blind. J Visual Impair Blind 110:77\u201388","journal-title":"J Visual Impair Blind"},{"issue":"8","key":"376_CR8","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1163\/22134808-00002542","volume":"29","author":"M Vincent","year":"2016","unstructured":"Vincent M, Tang H, Khoo W, Zhu Z, Ro T (2016) Shape discrimination using the tongue: Implications for a visual-to-tactile sensory substitution device. Multisens Res 29(8):773\u2013798","journal-title":"Multisens Res"},{"key":"376_CR9","doi-asserted-by":"crossref","unstructured":"Richardson ML, Lloyd-Esenkaya T, Petrini K, Proulx MJ, editors. Reading with the Tongue: Individual Differences Affect the Perception of Ambiguous Stimuli with the BrainPort. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems; 2020","DOI":"10.1145\/3313831.3376184"},{"issue":"4","key":"376_CR10","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1121\/1.1906788","volume":"23","author":"H Jacobson","year":"1951","unstructured":"Jacobson H (1951) Information and the human ear. J Acoust Soc Am 23(4):463\u2013471","journal-title":"J Acoust Soc Am"},{"issue":"1","key":"376_CR11","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1109\/TSMC.1987.289337","volume":"17","author":"KJ Kokjer","year":"1987","unstructured":"Kokjer KJ (1987) The information capacity of the human fingertip. IEEE Trans Syst Man Cybern 17(1):100\u2013102","journal-title":"IEEE Trans Syst Man Cybern"},{"key":"376_CR12","doi-asserted-by":"publisher","first-page":"1443","DOI":"10.3389\/fpsyg.2020.01443","volume":"11","author":"C Jicol","year":"2020","unstructured":"Jicol C, Lloyd-Esenkaya T, Proulx MJ, Lange-Smith S, Scheller M, O\u2019Neill E et al (2020) Efficiency of sensory substitution devices alone and in combination with self-motion for spatial navigation in sighted and visually impaired. Front Psychol 11:1443","journal-title":"Front Psychol"},{"issue":"2","key":"376_CR13","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1109\/10.121642","volume":"39","author":"PB Meijer","year":"1992","unstructured":"Meijer PB (1992) An experimental system for auditory image representations. IEEE Trans Biomed Eng 39(2):112\u2013121","journal-title":"IEEE Trans Biomed Eng"},{"key":"376_CR14","doi-asserted-by":"publisher","first-page":"15628","DOI":"10.1038\/srep15628","volume":"5","author":"NR Stiles","year":"2015","unstructured":"Stiles NR, Shimojo S (2015) Auditory sensory substitution is intuitive and automatic with texture stimuli. Sci Rep 5:15628","journal-title":"Sci Rep"},{"issue":"6","key":"376_CR15","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1038\/nn1912","volume":"10","author":"A Amedi","year":"2007","unstructured":"Amedi A, Stern WM, Camprodon JA, Bermpohl F, Merabet L, Rotman S et al (2007) Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex. Nat Neurosci 10(6):687\u2013689","journal-title":"Nat Neurosci"},{"issue":"3","key":"376_CR16","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1068\/p5631","volume":"36","author":"M Auvray","year":"2007","unstructured":"Auvray M, Hanneton S, O\u2019Regan JK (2007) Learning to perceive with a visuo-auditory substitution system: localisation and object recognition with \u201cthe vOICe.\u201d Perception 36(3):416\u2013430","journal-title":"Perception"},{"key":"376_CR17","doi-asserted-by":"publisher","first-page":"932","DOI":"10.1016\/j.neuroimage.2015.11.021","volume":"125","author":"MC Murphy","year":"2016","unstructured":"Murphy MC, Nau AC, Fisher C, Kim SG, Schuman JS, Chan KC (2016) Top-down influence on the visual cortex of the blind during sensory substitution. Neuroimage 125:932\u2013940","journal-title":"Neuroimage"},{"issue":"1","key":"376_CR18","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1016\/j.concog.2009.10.006","volume":"19","author":"J Ward","year":"2010","unstructured":"Ward J, Meijer P (2010) Visual experiences in the blind induced by an auditory sensory substitution device. Conscious Cogn 19(1):492\u2013500","journal-title":"Conscious Cogn"},{"issue":"10","key":"376_CR19","doi-asserted-by":"publisher","first-page":"1279","DOI":"10.1109\/10.720206","volume":"45","author":"C Capelle","year":"1998","unstructured":"Capelle C, Trullemans C, Arno P, Veraart C (1998) A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution. IEEE Trans Biomed Eng 45(10):1279\u20131293","journal-title":"IEEE Trans Biomed Eng"},{"issue":"4","key":"376_CR20","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1142\/S0219635205001002","volume":"4","author":"M Auvray","year":"2005","unstructured":"Auvray M, Hanneton S, Lenay C, O\u2019Regan K (2005) There is something out there: distal attribution in sensory substitution, twenty years later. J Integr Neurosci 4(4):505\u2013521","journal-title":"J Integr Neurosci"},{"issue":"1436","key":"376_CR21","doi-asserted-by":"publisher","first-page":"2427","DOI":"10.1098\/rspb.1999.0942","volume":"266","author":"J Cronly-Dillon","year":"1999","unstructured":"Cronly-Dillon J, Persaud K, Gregory RP (1999) The perception of visual images encoded in musical form: a study in cross-modality information transfer. Proc Biol Sci 266(1436):2427\u20132433","journal-title":"Proc Biol Sci"},{"issue":"2","key":"376_CR22","first-page":"247","volume":"32","author":"S Abboud","year":"2014","unstructured":"Abboud S, Hanassy S, Levy-Tzedek S, Maidenbaum S, Amedi A (2014) EyeMusic: Introducing a \u201cvisual\u201d colorful experience for the blind using auditory sensory substitution. Restor Neurol Neurosci 32(2):247\u2013257","journal-title":"Restor Neurol Neurosci"},{"key":"376_CR23","doi-asserted-by":"crossref","unstructured":"Hamilton-Fletcher G, Obrist M, Watten P, Mengucci M, Ward J. \"I Always Wanted to See the Night Sky\" Blind User Preferences for Sensory Substitution Devices. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems: ACM; 2016. p. 2162\u201374","DOI":"10.1145\/2858036.2858241"},{"key":"376_CR24","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.neubiorev.2013.11.007","volume":"41","author":"S Maidenbaum","year":"2014","unstructured":"Maidenbaum S, Abboud S, Amedi A (2014) Sensory substitution: closing the gap between basic research and widespread practical visual rehabilitation. Neurosci Biobehav Rev 41:3\u201315","journal-title":"Neurosci Biobehav Rev"},{"issue":"5\u20136","key":"376_CR25","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1163\/22134808-00002460","volume":"27","author":"GV Elli","year":"2014","unstructured":"Elli GV, Benetti S, Collignon O (2014) Is there a future for sensory substitution outside academic laboratories? Multisens Res 27(5\u20136):271\u2013291","journal-title":"Multisens Res"},{"key":"376_CR26","doi-asserted-by":"crossref","unstructured":"Chebat DR, Harrar V, Kupers R, Maidenbaum S, Amedi A, Ptito M. Sensory substitution and the neural correlates of navigation in blindness. Mobility of Visually Impaired People. Springer, Cham.2018. p. 167\u2013200","DOI":"10.1007\/978-3-319-54446-5_6"},{"issue":"3","key":"376_CR27","doi-asserted-by":"publisher","first-page":"175","DOI":"10.3109\/17483100903253936","volume":"5","author":"L Renier","year":"2010","unstructured":"Renier L, De Volder AG (2010) Vision substitution and depth perception: early blind subjects experience visual perspective through their ears. Disabil Rehabil Assist Technol 5(3):175\u2013183","journal-title":"Disabil Rehabil Assist Technol"},{"key":"376_CR28","doi-asserted-by":"publisher","first-page":"330","DOI":"10.3389\/fpsyg.2013.00330","volume":"4","author":"A Haigh","year":"2013","unstructured":"Haigh A, Brown DJ, Meijer P, Proulx MJ (2013) How well do you see what you hear? The acuity of visual-to-auditory sensory substitution. Front Psychol 4:330","journal-title":"Front Psychol"},{"issue":"8","key":"376_CR29","doi-asserted-by":"publisher","first-page":"4802","DOI":"10.1167\/iovs.14-16311","volume":"56","author":"JJ van Rheede","year":"2015","unstructured":"van Rheede JJ, Wilson IR, Qian RI, Downes SM, Kennard C, Hicks SL (2015) Improving mobility performance in low vision with a distance-based representation of the visual scene. Invest Ophthalmol Vis Sci 56(8):4802\u20134809","journal-title":"Invest Ophthalmol Vis Sci"},{"key":"376_CR30","doi-asserted-by":"publisher","first-page":"1522","DOI":"10.3389\/fpsyg.2015.01522","volume":"6","author":"DJ Brown","year":"2015","unstructured":"Brown DJ, Simpson AJ, Proulx MJ (2015) Auditory scene analysis and sonified visual images. Does consonance negatively impact on object formation when using complex sonified stimuli? Front Psychol 6:1522","journal-title":"Front Psychol"},{"issue":"5","key":"376_CR31","doi-asserted-by":"publisher","first-page":"924","DOI":"10.1109\/JSTSP.2016.2543678","volume":"10","author":"DJ Brown","year":"2016","unstructured":"Brown DJ, Proulx MJ (2016) Audio\u2013vision substitution for blind individuals: addressing human information processing capacity limitations. IEEE J Sel Topics Signal Process 10(5):924\u2013931","journal-title":"IEEE J Sel Topics Signal Process"},{"issue":"5\u20136","key":"376_CR32","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1163\/22134808-00002462","volume":"27","author":"DJ Brown","year":"2014","unstructured":"Brown DJ, Simpson AJ, Proulx MJ (2014) Visual objects in the auditory system in sensory substitution: how much information do we need? Multisens Res 27(5\u20136):337\u2013357","journal-title":"Multisens Res"},{"key":"376_CR33","doi-asserted-by":"publisher","first-page":"358","DOI":"10.3389\/fnins.2014.00358","volume":"8","author":"S Levy-Tzedek","year":"2014","unstructured":"Levy-Tzedek S, Riemer D, Amedi A (2014) Color improves \u201cvisual\u201d acuity via sound. Front Neurosci 8:358","journal-title":"Front Neurosci"},{"issue":"6","key":"376_CR34","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1163\/22134808-00002434","volume":"26","author":"G Hamilton-Fletcher","year":"2013","unstructured":"Hamilton-Fletcher G, Ward J (2013) Representing colour through hearing and touch in sensory substitution devices. Multisens Res 26(6):503\u2013532","journal-title":"Multisens Res"},{"issue":"4\u20135","key":"376_CR35","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1163\/22134808-00002519","volume":"29","author":"G Hamilton-Fletcher","year":"2016","unstructured":"Hamilton-Fletcher G, Wright TD, Ward J (2016) Cross-modal correspondences enhance performance on a colour-to-sound sensory substitution device. Multisens Res 29(4\u20135):337\u2013363","journal-title":"Multisens Res"},{"key":"376_CR36","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1016\/j.neubiorev.2016.05.026","volume":"68","author":"C Bertram","year":"2016","unstructured":"Bertram C, Stafford T (2016) Improving training for sensory augmentation using the science of expertise. Neurosci Biobehav Rev 68:234\u2013244","journal-title":"Neurosci Biobehav Rev"},{"issue":"3","key":"376_CR37","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1121\/1.1913640","volume":"54","author":"BC Moore","year":"1973","unstructured":"Moore BC (1973) Frequency difference limens for short-duration tones. J Acoust Soc Am 54(3):610\u2013619","journal-title":"J Acoust Soc Am"},{"key":"376_CR38","first-page":"303","volume-title":"Foundations of modern auditory theory","author":"AW Mills","year":"1972","unstructured":"Mills AW (1972) Auditory Localization. In: Tobias JV (ed) Foundations of modern auditory theory, vol 2. Academic Press, New York, pp 303\u2013348"},{"key":"376_CR39","volume-title":"Spatial hearing: the psychophysics of human sound localization","author":"J Blauert","year":"1997","unstructured":"Blauert J (1997) Spatial hearing: the psychophysics of human sound localization. MIT press"},{"issue":"16","key":"376_CR40","doi-asserted-by":"publisher","first-page":"6104","DOI":"10.1073\/pnas.1322705111","volume":"111","author":"CV Parise","year":"2014","unstructured":"Parise CV, Knorre K, Ernst MO (2014) Natural auditory scene statistics shapes human spatial hearing. Proc Natl Acad Sci U S A 111(16):6104\u20136108","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"4","key":"376_CR41","doi-asserted-by":"publisher","first-page":"1728","DOI":"10.1121\/1.399421","volume":"87","author":"DR Perrott","year":"1990","unstructured":"Perrott DR, Saberi K (1990) Minimum audible angle thresholds for sources varying in both elevation and azimuth. J Acoust Soc Am 87(4):1728\u20131731","journal-title":"J Acoust Soc Am"},{"issue":"1\u20132","key":"376_CR42","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.heares.2006.05.004","volume":"219","author":"C Micheyl","year":"2006","unstructured":"Micheyl C, Delhommeau K, Perrot X, Oxenham AJ (2006) Influence of musical and psychoacoustical training on pitch discrimination. Hear Res 219(1\u20132):36\u201347","journal-title":"Hear Res"},{"issue":"6","key":"376_CR43","doi-asserted-by":"publisher","first-page":"1986","DOI":"10.1121\/1.392655","volume":"78","author":"JM Sinnott","year":"1985","unstructured":"Sinnott JM, Aslin RN (1985) Frequency and intensity discrimination in human infants and adults. J Acoust Soc Am 78(6):1986\u20131992","journal-title":"J Acoust Soc Am"},{"issue":"9","key":"376_CR44","doi-asserted-by":"publisher","first-page":"1129","DOI":"10.1177\/0956797620935584","volume":"31","author":"C Battal","year":"2020","unstructured":"Battal C, Occelli V, Bertonati G, Falagiarda F, Collignon O (2020) General enhancement of spatial hearing in congenitally blind people. Psychol Sci 31(9):1129\u20131139","journal-title":"Psychol Sci"},{"key":"376_CR45","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1016\/j.apacoust.2015.12.014","volume":"105","author":"M Paquier","year":"2016","unstructured":"Paquier M, C\u00f4t\u00e9 N, Devillers F, Koehl V (2016) Interaction between auditory and visual perceptions on distance estimations in a virtual environment. Appl Acoust 105:186\u2013199","journal-title":"Appl Acoust"},{"issue":"2","key":"376_CR46","doi-asserted-by":"publisher","first-page":"373","DOI":"10.3758\/s13414-015-1015-1","volume":"78","author":"AJ Kolarik","year":"2016","unstructured":"Kolarik AJ, Moore BC, Zahorik P, Cirstea S, Pardhan S (2016) Auditory distance perception in humans: a review of cues, development, neuronal bases, and effects of sensory loss. Atten Percept Psychophys 78(2):373\u2013395","journal-title":"Atten Percept Psychophys"},{"issue":"12","key":"376_CR47","doi-asserted-by":"publisher","first-page":"3467","DOI":"10.1109\/TVCG.2020.3023574","volume":"26","author":"N Khenak","year":"2020","unstructured":"Khenak N, Vezien J, Bourdot P (2020) Spatial presence, performance, and behavior between real, remote, and virtual immersive environments. IEEE Trans Vis Comput Graph 26(12):3467\u20133478","journal-title":"IEEE Trans Vis Comput Graph"},{"issue":"1","key":"376_CR48","doi-asserted-by":"publisher","first-page":"7189","DOI":"10.1038\/s41598-017-06495-3","volume":"7","author":"PE Etchemendy","year":"2017","unstructured":"Etchemendy PE, Abregu E, Calcagno ER, Eguia MC, Vechiatti N, Iasi F et al (2017) Auditory environmental context affects visual distance perception. Sci Rep 7(1):7189","journal-title":"Sci Rep"},{"issue":"1","key":"376_CR49","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1038\/82931","volume":"4","author":"P Zahorik","year":"2001","unstructured":"Zahorik P, Wightman FL (2001) Loudness constancy with varying sound source distance. Nat Neurosci 4(1):78\u201383","journal-title":"Nat Neurosci"},{"issue":"5","key":"376_CR50","doi-asserted-by":"publisher","first-page":"2902","DOI":"10.1121\/1.3642604","volume":"130","author":"G Peeters","year":"2011","unstructured":"Peeters G, Giordano BL, Susini P, Misdariis N, McAdams S (2011) The Timbre Toolbox: extracting audio descriptors from musical signals. J Acoust Soc Am 130(5):2902\u20132916","journal-title":"J Acoust Soc Am"},{"issue":"1","key":"376_CR51","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1037\/a0018762","volume":"16","author":"G Lemaitre","year":"2010","unstructured":"Lemaitre G, Houix O, Misdariis N, Susini P (2010) Listener expertise and sound identification influence the categorization of environmental sounds. J Exp Psychol Appl 16(1):16\u201332","journal-title":"J Exp Psychol Appl"},{"key":"376_CR52","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1016\/j.cognition.2018.02.023","volume":"175","author":"G Hamilton-Fletcher","year":"2018","unstructured":"Hamilton-Fletcher G, Pisanski K, Reby D, Stefanczyk M, Ward J, Sorokowska A (2018) The role of visual experience in the emergence of cross-modal correspondences. Cognition 175:114\u2013121","journal-title":"Cognition"},{"issue":"11","key":"376_CR53","doi-asserted-by":"publisher","first-page":"1316","DOI":"10.1167\/jov.20.11.1316","volume":"20","author":"G Hamilton-Fletcher","year":"2020","unstructured":"Hamilton-Fletcher G, Pieniak M, Stefanczyk M, Chan KC, Oleszkiewicz A (2020) Visual experience influences association between pitch and distance, but not pitch and height. J Vis 20(11):1316","journal-title":"J Vis"},{"issue":"3\u20135","key":"376_CR54","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1163\/22134808-00002567","volume":"30","author":"G Hamilton-Fletcher","year":"2017","unstructured":"Hamilton-Fletcher G, Witzel C, Reby D, Ward J (2017) Sound properties associated with equiluminant colours. Multisens Res 30(3\u20135):337\u2013362","journal-title":"Multisens Res"},{"issue":"2","key":"376_CR55","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1111\/j.1467-9280.1992.tb00006.x","volume":"3","author":"RN Shepard","year":"1992","unstructured":"Shepard RN, Cooper LA (1992) Representation of colors in the blind, color-blind, and normally sighted. Psychol Sci 3(2):97\u2013104","journal-title":"Psychol Sci"},{"issue":"2","key":"376_CR56","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1108\/JAT-08-2013-0025","volume":"8","author":"JD Gomez","year":"2014","unstructured":"Gomez JD, Bologna G, Pun T (2014) See ColOr: an extended sensory substitution device for the visually impaired. J Assist Technol 8(2):77\u201394","journal-title":"J Assist Technol"},{"issue":"4","key":"376_CR57","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1109\/TOH.2011.57","volume":"5","author":"T Froese","year":"2012","unstructured":"Froese T, McGann M, Bigge W, Spiers A, Seth AK (2012) The enactive torch: a new tool for the science of perception. IEEE Trans Haptics 5(4):365\u2013375","journal-title":"IEEE Trans Haptics"},{"issue":"6","key":"376_CR58","first-page":"813","volume":"32","author":"S Maidenbaum","year":"2014","unstructured":"Maidenbaum S, Hanassy S, Abboud S, Buchs G, Chebat DR, Levy-Tzedek S et al (2014) The \u201cEyeCane\u201d, a new electronic travel aid for the blind: Technology, behavior and swift learning. Restor Neurol Neurosci 32(6):813\u2013824","journal-title":"Restor Neurol Neurosci"}],"container-title":["Journal on Multimodal User Interfaces"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-021-00376-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12193-021-00376-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-021-00376-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,4]],"date-time":"2023-02-04T16:25:03Z","timestamp":1675527903000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12193-021-00376-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,2]]},"references-count":58,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,3]]}},"alternative-id":["376"],"URL":"https:\/\/doi.org\/10.1007\/s12193-021-00376-w","relation":{},"ISSN":["1783-7677","1783-8738"],"issn-type":[{"value":"1783-7677","type":"print"},{"value":"1783-8738","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,2]]},"assertion":[{"value":"29 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 July 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}