{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T14:35:23Z","timestamp":1776090923132,"version":"3.50.1"},"reference-count":46,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,11,18]],"date-time":"2024-11-18T00:00:00Z","timestamp":1731888000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>Assistive technologies play a major role in bridging the accessibility gap in arts (especially paintings). Despite the constant advancements in these areas, the visually impaired often encounter challenges in independently experiencing and interpreting paintings. Our goal was to effectively convey the contents of a painting to visually impaired students using selected multi-sensory stimuli (tactile, auditory, and somatosensory) to compensate for the loss of input from the sense of sight. A prototype (named SEMA\u2014Specially Enhanced Multi-sensory Art) was developed around a simple painting to incorporate descriptive outputs of the aforementioned stimuli. The prototype was developed and refined iteratively with the visually impaired students at the University of Colombo, Sri Lanka. We evaluated all the systems individually using the user feedback and several quantitative and qualitative measures were adopted to analyze the results. The final user study with 22 visually impaired participants yielded a strong preference (92.6 %) for the prototype and highlighted its potential to enhance the art experiences. The findings of this study contribute to the further exploration of multi-sensory integration in entertainment and its impact on the visually impaired community.<\/jats:p>","DOI":"10.3389\/fcomp.2024.1450799","type":"journal-article","created":{"date-parts":[[2024,11,18]],"date-time":"2024-11-18T06:11:00Z","timestamp":1731910260000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["SEMA: utilizing multi-sensory cues to enhance the art experience of visually impaired students"],"prefix":"10.3389","volume":"6","author":[{"given":"Ruwani","family":"Welewatta","sequence":"first","affiliation":[]},{"given":"Akila","family":"Maithripala","sequence":"additional","affiliation":[]},{"given":"Heshan","family":"Weerasinghe","sequence":"additional","affiliation":[]},{"given":"Kasun","family":"Karunanayake","sequence":"additional","affiliation":[]},{"given":"Damitha","family":"Sandaruwan","sequence":"additional","affiliation":[]},{"given":"Samantha Mathara","family":"Arachchi","sequence":"additional","affiliation":[]},{"given":"Adrian David","family":"Cheok","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2024,11,18]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"545","DOI":"10.1152\/jn.00173.2007","article-title":"Multisensory processing in \u201cunimodal\u201d neurons: cross-modal subthreshold auditory effects in cat extrastriate visual cortex","volume":"98","author":"Allman","year":"2007","journal-title":"J. Neurophysiol"},{"key":"B2","first-page":"139","article-title":"Inside-the-scenes: the rise of experiential cinema","volume":"13","author":"Atkinson","year":"2016","journal-title":"Participation"},{"key":"B3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3491102.3501872","article-title":"\u201cEyes-off your fingers: Gradual surface haptic feedback improves eyes-free touchscreen interaction,\u201d","author":"Bernard","year":"2022","journal-title":"Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems"},{"key":"B4","article-title":"OpenCV","author":"Bradski","year":"2000","journal-title":"Dobbs J. Softw. Tools"},{"key":"B5","unstructured":"Cabanillas\n              R.\n            \n          \n          Mixing Music in Dolby Atmos\n          \n          2020"},{"key":"B6","doi-asserted-by":"publisher","first-page":"297","DOI":"10.3390\/electronics10030297","article-title":"Accessible visual artworks for blind and visually impaired people: comparing a multimodal approach with tactile graphics","volume":"10","author":"Cavazos Quero","year":"2021","journal-title":"Electronics"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1718","DOI":"10.3390\/sym12101718","article-title":"Design of desktop audiovisual entertainment system with deep learning and haptic sensations","volume":"12","author":"Chou","year":"2020","journal-title":"Symmetry"},{"key":"B8","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1080\/09647775.2018.1516561","article-title":"Art, touch and meaning making: an analysis of multisensory interpretation in the museum","volume":"34","author":"Christidou","year":"2019","journal-title":"Mus. Manag. Curatorsh"},{"key":"B9","doi-asserted-by":"publisher","first-page":"462","DOI":"10.1145\/3132272.3132290","article-title":"\u201cSensart demo: A multisensory prototype for engaging with visual art,\u201d","author":"Faustino","year":"2017","journal-title":"Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces"},{"key":"B10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3290605.3300907","article-title":"\u201cSound forest: evaluation of an accessible multisensory music installation,\u201d","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems","author":"Frid","year":"2019"},{"key":"B11","first-page":"169","article-title":"\u201cDesign and implementation of a whole-body haptic suit for \u201cilinx\u201d, a multisensory art installation,\u201d","author":"Giordano","year":"2015","journal-title":"12th International Conference on Sound and Music Computing (SMC-15), Ireland, July 30, 31 & August 1, 2015, Volume 1"},{"key":"B12","doi-asserted-by":"publisher","first-page":"33","DOI":"10.3390\/digital2010002","article-title":"Augmented reality (AR) as a tool for engaging museum experience: a case study on Chinese art pieces","volume":"2","author":"Gong","year":"2022","journal-title":"Digital"},{"key":"B13","doi-asserted-by":"publisher","first-page":"10963480211030319","DOI":"10.1177\/10963480211030319","article-title":"Immersive digital tourism: the role of multisensory cues in digital museum experiences","volume":"47","author":"Guo","year":"2021","journal-title":"J. Hosp. Tour. Res"},{"key":"B14","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1086\/376802","article-title":"Speaking of art as embodied imagination: a multisensory approach to understanding aesthetic experience","volume":"30","author":"Joy","year":"2003","journal-title":"J. Consum. Res"},{"key":"B15","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1080\/10286630600613309","article-title":"Audience development and social inclusion in Britain: tensions, contradictions and paradoxes in policy and their implications for cultural management","volume":"12","author":"Kawashima","year":"2006","journal-title":"Int. J. Cult. Policy"},{"key":"B16","volume-title":"Decameron and the Philosophy of Storytelling: Author as Midwife and Pimp","author":"Kuhns","year":"2005"},{"key":"B17","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.neuron.2006.12.011","article-title":"Neuronal oscillations and multisensory interaction in primary auditory cortex","volume":"53","author":"Lakatos","year":"2007","journal-title":"Neuron"},{"key":"B18","doi-asserted-by":"publisher","first-page":"n2","DOI":"10.58729\/2167-3454.1088","article-title":"A virtual assistant on campus for blind and low vision students","volume":"8","author":"Lannan","year":"2019","journal-title":"J. Spec. Educ. Apprenticeship"},{"key":"B19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3290605.3300930","article-title":"\u201cSensory alignment in immersive entertainment,\u201d","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems","author":"Marshall","year":"2019"},{"key":"B20","doi-asserted-by":"publisher","first-page":"20387","DOI":"10.1007\/s11042-023-16355-0","article-title":"Development of a visual to audio and tactile substitution system for mobility and orientation of visually impaired people: a review","volume":"83","author":"Masal","year":"2024","journal-title":"Multimed. Tools Appl"},{"key":"B21","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.procs.2015.09.244","article-title":"Multi-sensory storytelling to support learning for people with intellectual disability: an exploratory didactic study","volume":"67","author":"Matos","year":"2015","journal-title":"Procedia Comput. Sci"},{"key":"B22","unstructured":"McMillen\n              R.\n            \n          \n          Museum Disability Access: Social Inclusion Opportunities Through Innovative New Media Practices\n          \n          2015"},{"key":"B23","first-page":"389","article-title":"\u201cHaptic saliency model for rigid textured surfaces,\u201d","volume-title":"Haptics: Science, Technology, and Applications: 11th International Conference, EuroHaptics 2018, Pisa, Italy, June 13-16, 2018, Proceedings, Part I 11","author":"Metzger","year":"2018"},{"key":"B24","doi-asserted-by":"publisher","first-page":"65","DOI":"10.2298\/GEI1201065M","article-title":"The multisensory museum","volume":"60","author":"Morgan","year":"2012","journal-title":"Glas. Etnogr. Inst."},{"key":"B25","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1109\/MMUL.2017.33","article-title":"Multisensory experiences in hci","volume":"24","author":"Obrist","year":"2017","journal-title":"IEEE MultiMedia"},{"key":"B26","unstructured":"Visual Health \u2013 paho.org\n          \n          2024"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.4324\/9780429497063","author":"Panofsky","year":"2018","journal-title":"Studies in iconology: humanistic themes in the art of the Renaissance"},{"key":"B28","doi-asserted-by":"publisher","first-page":"12004","DOI":"10.1109\/ACCESS.2023.3242040","article-title":"Thermosurf: thermal display technology for dynamic and multi-finger interactions","volume":"11","author":"Peters","year":"2023","journal-title":"IEEE Access"},{"key":"B29","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1080\/17458927.2018.1516026","article-title":"Tate sensorium: an experiment in multisensory immersive design","volume":"13","author":"Pursey","year":"2018","journal-title":"Senses Soc"},{"key":"B30","doi-asserted-by":"publisher","first-page":"408","DOI":"10.3233\/SHTI220867","article-title":"\u201cA multisensorial storytelling design strategy to build empathy and a culture of inclusion,\u201d","author":"Rieger","year":"2022"},{"key":"B31","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1136\/archdischild-2012-303002","article-title":"Epidemiology, aetiology and management of visual impairment in children","volume":"99","author":"Solebo","year":"2013","journal-title":"Arch. Dis. Child"},{"key":"B32","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1080\/17411548.2022.2064155","article-title":"Step right up and take a whiff! Does incorporating scents in film projection increase viewer enjoyment?","volume":"21","author":"Solves","year":"2022","journal-title":"Stud. Eur. Cinema"},{"key":"B33","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1007\/s00221-009-1880-8","article-title":"Challenges in quantifying multisensory integration: alternative criteria, models, and inverse effectiveness","volume":"198","author":"Stein","year":"2009","journal-title":"Exp. Brain Res"},{"key":"B34","doi-asserted-by":"publisher","first-page":"707","DOI":"10.1007\/s10548-014-0365-7","article-title":"Identifying and quantifying multisensory integration: a tutorial review","volume":"27","author":"Stevenson","year":"2014","journal-title":"Brain Topogr"},{"key":"B35","doi-asserted-by":"publisher","first-page":"57","DOI":"10.18848\/1835-2014\/CGP\/v13i02\/57-80","article-title":"Blind and visually impaired visitors' experiences in museums: increasing accessibility through assistive technologies","volume":"13","author":"Vaz","year":"2020","journal-title":"Int. J. Incl. Mus"},{"key":"B36","doi-asserted-by":"publisher","first-page":"12","DOI":"10.3389\/fcomp.2021.614524","article-title":"Multisensory experiences: a primer","volume":"3","author":"Velasco","year":"2021","journal-title":"Front. Comput. Sci"},{"key":"B37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3279954.3279956","article-title":"\u201cTowards multisensory storytelling with taste and flavor,\u201d","volume-title":"Proceedings of the 3rd International Workshop on Multisensory Approaches to Human-Food Interaction","author":"Velasco","year":"2018"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2008.09960","article-title":"Translating paintings into music using neural networks","author":"Verma","year":"2020","journal-title":"arXiv"},{"key":"B39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ijhcs.2017.06.004","article-title":"Not just seeing, but also feeling art: mid-air haptic experiences integrated in a multisensory art exhibition","volume":"108","author":"Vi","year":"2017","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"B40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3173574.3173783","article-title":"\u201cSimulator sickness in augmented reality training using the microsoft hololens,\u201d","author":"Vovk","year":"2018","journal-title":"Proceedings of the 2018 CHI conference on human factors in computing systems"},{"key":"B41","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1098\/rstb.2007.2092","article-title":"Modulation of visual processing by attention and emotion: windows on causal interactions between human brain regions","volume":"362","author":"Vuilleumier","year":"2007","journal-title":"Philos. Trans. R Soc. Lond. B Biol. Sci"},{"key":"B42","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1007\/978-3-030-22649-7_7","article-title":"\u201cThe design of the body: suit: score, a full-body vibrotactile musical score,\u201d","author":"West","year":"2019","journal-title":"Human Interface and the Management of Information. Information in Intelligent Systems: Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, USA, July 26-31, 2019, Proceedings, Part II 21"},{"key":"B43","doi-asserted-by":"publisher","first-page":"154","DOI":"10.54097\/ehss.v6i.4417","article-title":"The research on the characteristics and forms of immersive experience in art exhibitions\u2013take \u201cvan gogh\u2013the immersive experience\u201d as an example","volume":"6","author":"Yu","year":"2022","journal-title":"J. Educ. Humanit. Soc. Sci"},{"key":"B44","first-page":"012003","article-title":"\u201cDesign and production of digital interactive installation for the cultural theme of the belt and road initiative,\u201d","volume-title":"Journal of Physics: Conference Series, Volume 1627","author":"Yuan","year":"2020"},{"key":"B45","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1109\/MMUL.2004.13","article-title":"Multisensory musical entertainment systems","volume":"11","author":"Zhou","year":"2004","journal-title":"IEEE MultiMedia"},{"key":"B46","doi-asserted-by":"crossref","first-page":"150","DOI":"10.4324\/9781003135616-13","article-title":"\u201cTouch technologies and museum access,\u201d","volume-title":"Touch in Museums","author":"Zimmer","year":"2020"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2024.1450799\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T14:35:44Z","timestamp":1732286144000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2024.1450799\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,18]]},"references-count":46,"alternative-id":["10.3389\/fcomp.2024.1450799"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2024.1450799","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,18]]},"article-number":"1450799"}}