{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T11:17:29Z","timestamp":1790767049340,"version":"4.1.0"},"reference-count":123,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,10,25]],"date-time":"2024-10-25T00:00:00Z","timestamp":1729814400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"<jats:p>In today\u2019s world, there has been a significant increase in the use of devices, gadgets, and mobile applications in our daily activities. Although this has had a significant impact on the lives of the general public, people who are Partially Visually Impaired SPVI, which includes a much broader range of vision loss that includes mild to severe impairments, and Completely Visually Impaired (CVI), who have no light perception, still face significant obstacles when trying to access and use these technologies. This review article aims to provide an overview of the NUI, Multi-sensory Interfaces and UX Design (NMUD) of apps and devices specifically tailored CVI and PVI individuals. The article begins by emphasizing the importance of accessible technology for the visually impaired and the need for a human-centered design approach. It presents a taxonomy of essential design components that were considered during the development of applications and gadgets for individuals with visual impairments. Furthermore, the article sheds light on the existing challenges that need to be addressed to improve the design of apps and devices for CVI and PVI individuals. These challenges include usability, affordability, and accessibility issues. Some common problems include battery life, lack of user control, system latency, and limited functionality. Lastly, the article discusses future research directions for the design of accessible apps and devices for visually impaired individuals. It emphasizes the need for more user-centered design approaches, adherence to guidelines such as the Web Content Accessibility Guidelines, the application of e-accessibility principles, the development of more accessible and affordable technologies, and the integration of these technologies into the wider assistive technology ecosystem.<\/jats:p>","DOI":"10.3389\/fpubh.2024.1357160","type":"journal-article","created":{"date-parts":[[2024,10,25]],"date-time":"2024-10-25T00:33:48Z","timestamp":1729816428000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["A comprehensive review on NUI, multi-sensory interfaces and UX design for applications and devices for visually impaired users"],"prefix":"10.3389","volume":"12","author":[{"given":"Lauryn","family":"Arora","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Akansh","family":"Choudhary","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Margi","family":"Bhatt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jayakumar","family":"Kaliappan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathiravan","family":"Srinivasan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,10,25]]},"reference":[{"key":"ref1","unstructured":"2024"},{"key":"ref2","unstructured":"2019"},{"key":"ref3","unstructured":"2024"},{"key":"ref4","unstructured":"GrahamT\n            Gon\u00e7alvesA\n          2017"},{"key":"ref5","unstructured":"2023"},{"key":"ref6","unstructured":"MehediM.\n          2023"},{"key":"ref7","unstructured":"NaharL.\n            JaafarA.\n            AhamedE.\n            KaishA. B. M. A.\n          2023"},{"key":"ref8","unstructured":"GruverJ.\n          2024"},{"key":"ref9","unstructured":"CraigA.\n          2019"},{"key":"ref10","unstructured":"CraigA.\n          2019"},{"key":"ref11","unstructured":"2021"},{"key":"ref12","unstructured":"2018"},{"key":"ref13","author":"Pohjolainen","year":"2020"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1007\/s12193-015-0182-7","article-title":"A survey of assistive technologies and applications for blind users on mobile platforms: a review and foundation for research","volume":"9","author":"Csap\u00f3","year":"2015","journal-title":"J Multimodal User Interfaces"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"e771","DOI":"10.7717\/PEERJ-CS.771","article-title":"A systematic literature review on the usability of mobile applications for visually impaired users","volume":"7","author":"al-Razgan","year":"2021","journal-title":"PeerJ Computer Sci"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1007\/s10209-020-00733-8","article-title":"An insight into smartphone-based assistive solutions for visually impaired and blind people: issues, challenges and opportunities","volume":"20","author":"Khan","year":"2021","journal-title":"Univ Access Inf Soc"},{"key":"ref17","author":"Torres-Carazo","year":"2016"},{"key":"ref18","author":"Kim","year":"2016"},{"key":"ref19","first-page":"99","article-title":"Universal design principles: An overview","volume":"2","author":"Crow","year":"2007","journal-title":"Annual Proceedings Anaheim"},{"key":"ref20","first-page":"223","volume-title":"Simple smart HomesWeb interfaces for blind people","author":"Buzzi","year":"2018"},{"key":"ref21","first-page":"98","article-title":"Gamified model to support shopping in closed spaces aimed at blind people: a systematic literature review","volume-title":"Communications in computer and information science","author":"Solano","year":"2021"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"102081","DOI":"10.1016\/j.displa.2021.102081","article-title":"Non-visual access to mobile devices: a survey of touchscreen accessibility for users who are visually impaired","volume":"70","author":"Alajarmeh","year":"2021","journal-title":"Displays"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"3151","DOI":"10.3390\/ijerph19063151","article-title":"Use of auditory cues and other strategies as sources of spatial information for people with visual impairment when navigating unfamiliar environments","volume":"19","author":"Bilal Salih","year":"2022","journal-title":"Int J Environ Res Public Health"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1007\/s10209-017-0550-z","article-title":"Blind users\u2019 expectations of touch interfaces: factors affecting interface accessibility of touchscreen-based smartphones for people with moderate visual impairment","volume":"17","author":"Huang","year":"2018","journal-title":"Univ Access Inf Soc"},{"key":"ref25","unstructured":"2020"},{"key":"ref26","unstructured":""},{"key":"ref27","unstructured":"2004"},{"key":"ref28","author":"Helal","year":"2001"},{"key":"ref29","author":"Harjumaa","year":"2011"},{"key":"ref30","first-page":"99","article-title":"Usability and design guidelines of smart canes for users with visual impairments","volume":"7","author":"Kim","year":"2013","journal-title":"Int J Des"},{"key":"ref31","first-page":"232","volume-title":"iShop \u2014 Shopping application for visually challenged","author":"De Silva","year":"2017"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.techsoc.2021.101805","article-title":"Assistive technology in smart cities: a case of street crossing for the visually-impaired","volume":"68","author":"Huang","year":"2022","journal-title":"Technol Soc"},{"key":"ref33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13673-018-0134-9","article-title":"User-centered design of a depth data based obstacle detection and avoidance system for the visually impaired","volume":"8","author":"Jafri","year":"2018","journal-title":"HCIS"},{"key":"ref34","author":"Devkar","year":"2015"},{"key":"ref35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10055-021-00536-z","article-title":"Teleguidance-based remote navigation assistance for visually impaired and blind people\u2014usability and user experience","volume":"27","author":"Chaudary","year":"2021","journal-title":"Virtual Reality"},{"key":"ref36","author":"Aiordachioae","year":"2020"},{"key":"ref37","author":"Chen","year":"2015"},{"key":"ref38","unstructured":"GordonK.\n          2024"},{"key":"ref39","author":"Landazabal","year":"2019"},{"key":"ref40","author":"Albraheem","year":"2014"},{"key":"ref41","author":"Al-Busaidi","year":"2017"},{"key":"ref42","doi-asserted-by":"publisher","first-page":"238","DOI":"10.3390\/sym11020238","article-title":"An intelligent and interactive interface to support symmetrical collaborative educational writing among visually impaired and sighted users","volume":"11","author":"Waqar","year":"2019","journal-title":"Symmetry"},{"key":"ref43","author":"Liimatainen","year":"2012"},{"key":"ref44","doi-asserted-by":"publisher","first-page":"813","DOI":"10.1007\/s10209-019-00696-5","article-title":"Automatic switching between speech and non-speech: adaptive auditory feedback in desktop assistance for the visually impaired","volume":"19","author":"Shoaib","year":"2020","journal-title":"Univ Access Inf Soc"},{"key":"ref45","doi-asserted-by":"publisher","first-page":"486","DOI":"10.1080\/10447318.2017.1279827","article-title":"Visual impairments and mobile touchscreen interaction: state-of-the-art, causes of visual impairment, and design guidelines","volume":"33","author":"Vatavu","year":"2017","journal-title":"Int J Human\u2013Computer Interaction"},{"key":"ref46","author":"Ferati","year":"2016"},{"key":"ref47","doi-asserted-by":"publisher","first-page":"127","DOI":"10.3233\/TAD-180191","article-title":"User experience of mainstream and assistive technologies for people with visual impairments","volume":"30","author":"Kim","year":"2018","journal-title":"Technol Disabil"},{"key":"ref48","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1016\/j.ergon.2016.07.002","article-title":"The interaction experiences of visually impaired people with assistive technology: a case study of smartphones","volume":"55","author":"Kim","year":"2016","journal-title":"Int J Ind Ergon"},{"key":"ref49","author":"Alvarez Robles","year":"2019"},{"key":"ref50","author":"Francis","year":"2013"},{"key":"ref51","doi-asserted-by":"publisher","first-page":"1","DOI":"10.5210\/fm.v26i8.11612","article-title":"Toward a purposeful design strategy for visually impaired web users","volume":"26","author":"Barpanda","year":"2021","journal-title":"First Monday"},{"key":"ref52","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1080\/10400435.2012.715112","article-title":"Enhancing mobile phones for people with visual impairments through haptic icons: the effect of learning processes","volume":"25","author":"Gald\u00f3n","year":"2013","journal-title":"Assist Technol"},{"key":"ref53","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1109\/MMUL.2006.68","article-title":"Testing usability of multimodal applications with visually impaired children","volume":"13","author":"Raisamo","year":"2006","journal-title":"IEEE MultiMedia, MultiMedia, IEEE"},{"key":"ref54","author":"Matusiak","year":"2013"},{"key":"ref55","author":"Garg","year":"2014"},{"key":"ref56","author":"Pandey","year":"2021"},{"key":"ref57","author":"Mon","year":"2019"},{"key":"ref58","author":"Zouhaier","year":"2017"},{"key":"ref59","author":"Rizan","year":"2021"},{"key":"ref60","doi-asserted-by":"publisher","first-page":"107","DOI":"10.21776\/ub.IJDS.2019.007.01.12","article-title":"E-accessibility analysis in user experience for people with disabilities","volume":"7","author":"Yusril","year":"2020","journal-title":"Indonesian J Disability Stud (IJDS)"},{"key":"ref61","first-page":"328","volume-title":"Evaluating smartphone screen divisions for designing blind-friendly touch-based interfaces","author":"Khusro","year":"2019"},{"key":"ref62","first-page":"402","volume-title":"ABLE transit: A Mobile application for visually impaired users to navigate public transit","author":"Harrington","year":"2012"},{"key":"ref63","first-page":"825","volume-title":"Mobile applications aiding the visually impaired in travelling with public transport","author":"Korbel","year":"2013"},{"key":"ref64","first-page":"421","volume-title":"Smartphone haptic applications for visually impaired users","author":"Voutsakelis","year":"2021"},{"key":"ref65","first-page":"7","volume-title":"A crowdsourcing approach to promote safe walking for visually impaired people","author":"Lin","year":"2014"},{"key":"ref66","volume-title":"Assistive Technologies for Visually Impaired Users on android Mobile phones","author":"Chaudhari","year":"2018"},{"key":"ref67","first-page":"1","volume-title":"Vision: Android application for the visually impaired","author":"Suresh","year":"2020"},{"key":"ref68","first-page":"439","volume-title":"Route planning and navigation aid for blind and visually impaired people","author":"Chatzina","year":"2021"},{"key":"ref69","volume-title":"Journal of Human Centered Technology","author":"Rose","year":"2023"},{"key":"ref70","unstructured":"SakharchukS.\n            SakharchukS.\n          2024"},{"key":"ref71","unstructured":"ChurchvilleF.\n          2021"},{"key":"ref72","unstructured":"2023"},{"key":"ref73","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1080\/10447318.2020.1819668","article-title":"Mapping human\u2013computer interaction research themes and trends from its existence to today: a topic modeling-based review of past 60 years","volume":"37","author":"Gurcan","year":"2021","journal-title":"Int J Human\u2013Computer Interaction"},{"key":"ref74","doi-asserted-by":"crossref","DOI":"10.1145\/3587828.3587845","volume-title":"UI\/UX fundamental Design for Mobile Application Prototype to support web accessibility and usability acceptance","author":"Jantan","year":"2023"},{"key":"ref75","unstructured":""},{"key":"ref76","unstructured":"2023"},{"key":"ref77","author":"Kasthuri","year":"2017"},{"key":"ref78","doi-asserted-by":"publisher","first-page":"pp614","DOI":"10.34190\/EJEL.19.6.2040","article-title":"Design, development, and evaluation of haptic-and olfactory-based application for visually impaired learners","volume":"19","author":"Chit Su Mon","year":"2022","journal-title":"Electronic J E-Learn"},{"key":"ref79","author":"Huppert","year":"2021"},{"key":"ref80","unstructured":""},{"key":"ref81","volume-title":"Universal design: Process, principles, and applications","author":"Burgstahler","year":"2009"},{"key":"ref82","author":"Vanderheiden","year":"2000"},{"key":"ref83","first-page":"433","volume-title":"Guidelines are only half of the story: Accessibility problems encountered by blind users on the web","author":"Power","year":"2012"},{"key":"ref84","doi-asserted-by":"crossref","unstructured":"HussainA.\n            OmarA. M.\n          2020","DOI":"10.1155\/2020\/4538602"},{"key":"ref85","unstructured":"OberoiA\n          2020"},{"key":"ref86","unstructured":"2022"},{"key":"ref87","unstructured":"BhagatV.\n          2024"},{"key":"ref88","author":"Stein","year":"2011"},{"key":"ref89","author":"Russ","year":"2017"},{"key":"ref90","author":"Marvin","year":"2020"},{"key":"ref91","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1051\/matecconf\/201819715007","article-title":"Mobile BrailleTouch application for visually impaired people using double diamond approach","volume":"197","author":"Cahya","year":"2018","journal-title":"MATEC Web of Conferences"},{"key":"ref92","author":"Wang","year":"2019"},{"key":"ref93","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1080\/10400435.2015.1011758","article-title":"Design of a Braille learning application for visually impaired students in Bangladesh","volume":"27","author":"Nahar","year":"2015","journal-title":"Assist Technol"},{"key":"ref94","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1108\/LHTN-11-2017-0083","article-title":"Android based voice assistant for blind people","volume":"35","author":"Barata","year":"2018","journal-title":"Library Hi Tech News"},{"key":"ref95","doi-asserted-by":"crossref","DOI":"10.1007\/978-981-10-4980-4_36","article-title":"An eye-free android application for visually impaired users","volume-title":"Ergonomics in caring for people","author":"Sagale","year":"2018"},{"key":"ref96","doi-asserted-by":"publisher","first-page":"270","DOI":"10.14419\/ijet.v2i4.1101","article-title":"An enhanced mobile phone dialler application for blind and visually impaired people","volume":"2","author":"Yousef","year":"2013","journal-title":"Int J Eng Technol"},{"key":"ref97","doi-asserted-by":"publisher","first-page":"103356","DOI":"10.1016\/j.csi.2019.103356","article-title":"Adapting card sorting for blind people: evaluation of the interaction design in TalkBack","volume":"66","author":"Robles","year":"2019","journal-title":"Computer Standards and Interfaces"},{"key":"ref98","first-page":"19","volume-title":"Brailletouch: Mobile texting for the visually impaired","author":"Frey","year":"2011"},{"key":"ref99","author":"Zhang","year":"2021"},{"key":"ref100","author":"Hoque","year":"2021"},{"key":"ref101","doi-asserted-by":"publisher","first-page":"2235","DOI":"10.1002\/asi.23325","article-title":"Evaluating a search interface for visually impaired searchers","volume":"66","author":"Gooda Sahib","year":"2015","journal-title":"J Association for Info Sci Technol"},{"key":"ref102","author":"Anagnostakis","year":"2016"},{"key":"ref103","first-page":"27","volume-title":"Personal shopping assistance and navigator system for visually impaired people","author":"Chippendale","year":"2015"},{"key":"ref104","first-page":"1","article-title":"Comparison of automatic, manual and real user experience based testing of accessibility of web sites for persons with visual impairment","volume":"3","author":"Regec","year":"2015","journal-title":"J Exceptional People"},{"key":"ref105","author":"Kangeswaran","year":"2021"},{"key":"ref106","first-page":"0039","volume-title":"BlindAid - android-based Mobile application guide for visually challenged people","author":"Senarathne","year":"2021"},{"key":"ref107","first-page":"1","volume-title":"Tourism for all: A mobile application to assist visually impaired users in enjoying tourist services","author":"Ceccarini","year":"2019"},{"key":"ref108","first-page":"1","volume-title":"Design and development of a digital scribe for visually challenged students","author":"Nikhil","year":"2020"},{"key":"ref109","first-page":"615","volume-title":"Smart navigation guidance system for visually challenged people","author":"Devi","year":"2020"},{"key":"ref110","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1016\/j.ajo.2016.12.021","article-title":"Head-mounted display Technology for low-Vision Rehabilitation and Vision Enhancement","volume":"176","author":"Ehrlich","year":"2017","journal-title":"Am J Ophthalmol"},{"key":"ref111","author":"Sierra","year":"2012"},{"key":"ref112","author":"Liu","year":"2015"},{"key":"ref113","author":"Ghidini","year":"2016"},{"key":"ref114","author":"Jakhete","year":"2019"},{"key":"ref115","first-page":"1","volume-title":"An image captioner for the visually challenged","author":"Ariane","year":"2021"},{"key":"ref116","first-page":"1","volume-title":"Voice based form filling system for visually challenged people","author":"Usharani","year":"2020"},{"key":"ref117","first-page":"236","volume-title":"Book4All: A tool to make an e-book more accessible to students with vision\/visual-impairments","author":"Calabro","year":"2010"},{"key":"ref118","unstructured":"NayakS.\n          2020"},{"key":"ref119","first-page":"1","volume-title":"VisualPal: A mobile app for object recognition for the visually impaired","author":"Bagwan","year":"2015"},{"key":"ref120","first-page":"28","volume-title":"Task-oriented approach to guide visually impaired people during smart device usage","author":"Akkapusit","year":"2021"},{"key":"ref121","doi-asserted-by":"publisher","first-page":"1371","DOI":"10.3390\/s17061371","article-title":"Simple smartphone-based guiding system for visually impaired people","volume":"17","author":"Lin","year":"2017","journal-title":"Sensors"},{"key":"ref122","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-31534-3_7","article-title":"Towards a real-time system for finding and Reading signs for visually impaired users","volume-title":"Computers helping people with special needs. ICCHP 2012","author":"Shen","year":"2012"},{"key":"ref123","unstructured":""}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2024.1357160\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,25]],"date-time":"2024-10-25T00:34:01Z","timestamp":1729816441000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2024.1357160\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,25]]},"references-count":123,"alternative-id":["10.3389\/fpubh.2024.1357160"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2024.1357160","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,25]]},"article-number":"1357160"}}