{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:28:11Z","timestamp":1776094091383,"version":"3.50.1"},"reference-count":49,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2022,12,18]],"date-time":"2022-12-18T00:00:00Z","timestamp":1671321600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020","award":["861166"],"award-info":[{"award-number":["861166"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Access to complex graphical information is essential when connecting blind and visually impaired (BVI) people with the world. Tactile graphics readers enable access to graphical data through audio-tactile user interfaces (UIs), but these have yet to mature. A challenging task for blind people is locating specific elements\u2013areas in detailed tactile graphics. To this end, we developed three audio navigation UIs that dynamically guide the user\u2019s hand to a specific position using audio feedback. One is based on submarine sonar sounds, another relies on the target\u2019s coordinate plan x and y-axis, and the last uses direct voice instructions. The UIs were implemented in the Tactonom Reader device, a new tactile graphic reader that enhances swell paper graphics with pinpointed audio explanations. To evaluate the effectiveness of the three different dynamic navigation UIs, we conducted a within-subject usability test that involved 13 BVI participants. Beyond comparing the effectiveness of the different UIs, we observed and recorded the interaction of the visually impaired participants with the different navigation UI to further investigate their behavioral patterns during the interaction. We observed that user interfaces that required the user to move their hand in a straight direction were more likely to provoke frustration and were often perceived as challenging for blind and visually impaired people. The analysis revealed that the voice-based navigation UI guides the participant the fastest to the target and does not require prior training. This suggests that a voice-based navigation strategy is a promising approach for designing an accessible user interface for the blind.<\/jats:p>","DOI":"10.3390\/mti6120113","type":"journal-article","created":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T04:54:13Z","timestamp":1671425653000},"page":"113","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Developing Dynamic Audio Navigation UIs to Pinpoint Elements in Tactile Graphics"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8884-0922","authenticated-orcid":false,"given":"Gaspar","family":"Ram\u00f4a","sequence":"first","affiliation":[{"name":"Inventivio GmbH, 90402 N\u00fcrnberg, Germany"},{"name":"Computer Vision for Human-Computer Interaction Lab, Karlsruhe Institute of Technology, 76131 Karlsruhe, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2578-1355","authenticated-orcid":false,"given":"Vincent","family":"Schmidt","sequence":"additional","affiliation":[{"name":"Institute of Cognitive Science, Osnabr\u00fcck University, 49090 Osnabr\u00fcck, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3654-5267","authenticated-orcid":false,"given":"Peter","family":"K\u00f6nig","sequence":"additional","affiliation":[{"name":"Institute of Cognitive Science, Osnabr\u00fcck University, 49090 Osnabr\u00fcck, Germany"},{"name":"Institute of Neurophysiology & Pathophysiology, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,18]]},"reference":[{"key":"ref_1","first-page":"19","article-title":"Redesigning Input Controls of a Touch-Sensitive Pin-Matrix Device","volume":"1324","author":"Bornschein","year":"2014","journal-title":"Proc. Int. Workshop Tactile\/Haptic User Interfaces Tabletops Tablets Held Conjunction ACM ITS"},{"key":"ref_2","first-page":"835","article-title":"Tactile Graphics Revised: The Novel BrailleDis 9000 Pin-Matrix Device with Multitouch Input","volume":"Volume 5105","author":"Weber","year":"2008","journal-title":"ICCHP 2008: Computers Helping People with Special Needs"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1007\/s10209-017-0538-8","article-title":"Touching graphical applications: Bimanual tactile interaction on the HyperBraille pin-matrix display","volume":"17","author":"Bornschein","year":"2018","journal-title":"Univers. Access Inf. Soc."},{"key":"ref_4","first-page":"36","article-title":"BrailleIO\u2014A Tactile Display Abstraction Framework","volume":"1324","author":"Bornschein","year":"2014","journal-title":"Proc. Int. Workshop Tactile\/Haptic User Interfaces Tabletops Tablets Held Conjunction ACM ITS"},{"key":"ref_5","unstructured":"Bornschein, J., Weber, G., and G\u00f6tzelmann, T. (2020). Multimodales Kollaboratives Zeichensystem f\u00fcr Blinde Benutzer, Technische Universit\u00e4t Dresden."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1177\/0146167284104003","article-title":"The Midas touch: The effects of interpersonal touch on restaurant tipping","volume":"10","author":"Crusco","year":"1984","journal-title":"Personal. Soc. Psychol. Bull."},{"key":"ref_7","first-page":"186","article-title":"Classification of 2D refreshable tactile user interfaces","volume":"1","year":"2022","journal-title":"Assist. Technol. Access. Incl. ICCHP AAATE"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Engel, C., Konrad, N., and Weber, G. (2020). TouchPen: Rich Interaction Technique for Audio-Tactile Charts by Means of Digital Pens. International Conference on Computers Helping People with Special Needs, Springer International Publishing.","DOI":"10.1007\/978-3-030-58796-3_52"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Goncu, C., Madugalla, A., Marinai, S., and Marriott, K. (2015, January 18\u201322). Accessible On-Line Floor Plans. Proceedings of the 24th International Conference on World Wide Web, Florence, Italy.","DOI":"10.1145\/2736277.2741660"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"135","DOI":"10.3233\/TAD-2008-20208","article-title":"Speech technologies for blind and low vision persons","volume":"20","author":"Freitas","year":"2008","journal-title":"Technol. Disabil."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kane, S.K., Morris, M.R., Perkins, A.Z., Wigdor, D., Ladner, R.E., and Wobbrock, J.O. (2011, January 16\u201319). Access Overlays: Improving Non-Visual Access to Large Touch Screens for Blind Users. Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, Santa Barbara, CA, USA.","DOI":"10.1145\/2047196.2047232"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1111\/bjet.12852","article-title":"Interactive sonification of images in serious games as an education aid for visually impaired children","volume":"51","author":"Radecki","year":"2020","journal-title":"Br. J. Educ. Technol."},{"key":"ref_13","unstructured":"Poppinga, B., Magnusson, C., Pielot, M., and Rassmus-Gr\u00f6hn, K. (September, January 30). TouchOver Map: Audio-Tactile Exploration of Interactive Maps. Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, Stockholm, Sweden."},{"key":"ref_14","unstructured":"He, L., Wan, Z., Findlater, L., and Froehlich, J.E. (November, January 20). TacTILE: A Preliminary Toolchain for Creating Accessible Graphics with 3D-Printed Overlays and Auditory Annotations. Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility, Baltimore, MD, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Jagdish, D., Sawhney, R., Gupta, M., and Nangia, S. (2008, January 13\u201316). Sonic Grid: An Auditory Interface for the Visually Impaired to Navigate GUI-Based Environments. Proceedings of the 13th International Conference on Intelligent User Interfaces, Gran Canaria, Spain.","DOI":"10.1145\/1378773.1378824"},{"key":"ref_16","unstructured":"Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., and Winckler, M. (2011). GraVVITAS: Generic Multi-touch Presentation of Accessible Graphics. Human-Computer Interaction\u2014INTERACT 2011, Springer."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"V\u00e1zquez, M., and Steinfeld, A. (2012, January 22\u201324). Helping Visually Impaired Users Properly Aim a Camera. Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility, Boulder, CO, USA.","DOI":"10.1145\/2384916.2384934"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Tekin, E., and Coughlan, J.M. (2010). A Mobile Phone Application Enabling Visually Impaired Users to Find and Read Product Barcodes. Computers Helping People with Special Needs, Springer.","DOI":"10.1007\/978-3-642-14100-3_43"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"G\u00f6tzelmann, T., and Winkler, K. (2015, January 1\u20133). SmartTactMaps: A Smartphone-Based Approach to Support Blind Persons in Exploring Tactile Maps. Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments, Corfu, Greece.","DOI":"10.1145\/2769493.2769497"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Baker, C.M., Milne, L.R., Scofield, J., Bennett, C.L., and Ladner, R.E. (2014, January 20\u201322). Tactile Graphics with a Voice: Using QR Codes to Access Text in Tactile Graphics. Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility, Rochester, NY, USA.","DOI":"10.1145\/2661334.2661366"},{"key":"ref_21","first-page":"94","article-title":"Graille: Design research of graphical tactile display for the visually impaired","volume":"1","author":"Yang","year":"2016","journal-title":"Decorate"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Prescher, D., and Weber, G. (2016). Locating widgets in different tactile information visualizations. International Conference on Computers Helping People with Special Needs, Springer International Publishing.","DOI":"10.1007\/978-3-319-41267-2_14"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bornschein, J., Prescher, D., and Weber, G. (2015, January 26\u201328). Collaborative Creation of Digital Tactile Graphics. Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, Lisbon, Portugal.","DOI":"10.1145\/2700648.2809869"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Prescher, D., Weber, G., and Spindler, M. (2010, January 25\u201327). A Tactile Windowing System for Blind Users. Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility, Orlando, FL, USA.","DOI":"10.1145\/1878803.1878821"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Melfi, G., M\u00fcller, K., Schwarz, T., Jaworek, G., and Stiefelhagen, R. (2020, January 25\u201330). Understanding What You Feel: A Mobile Audio-Tactile System for Graphics Used at Schools with Students with Visual Impairment. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3313831.3376508"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1080\/07370024.2014.924412","article-title":"Interactivity Improves Usability of Geographic Maps for Visually Impaired People","volume":"30","author":"Brock","year":"2015","journal-title":"Hum. Comput. Interact."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Fusco, G., and Morash, V.S. (2015, January 26\u201328). The Tactile Graphics Helper: Providing Audio Clarification for Tactile Graphics Using Machine Vision. Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, Lisbon, Portugal.","DOI":"10.1145\/2700648.2809868"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1145\/2850440.2850441","article-title":"Interactive Audio-Tactile Maps for Visually Impaired People","volume":"113","author":"Brock","year":"2015","journal-title":"SIGACCESS Access. Comput."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Miesenberger, K., Klaus, J., Zagler, W.L., and Karshmer, A.I. (2006). Scientific Diagrams Made Easy with IVEOTM. Computers Helping People with Special Needs, Springer.","DOI":"10.1007\/11788713"},{"key":"ref_30","unstructured":"Landau, S., and Gourgey, K. (2001). Development of a talking tactile tablet. Inf. Technol. Disabil., 7, Available online: https:\/\/www.researchgate.net\/publication\/243786112_Development_of_a_talking_tactile_tablet."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Miesenberger, K., B\u00fchler, C., and Penaz, P. (2016). CapMaps. Computers Helping People with Special Needs, Springer International Publishing.","DOI":"10.1007\/978-3-319-41264-1"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"G\u00f6tzelmann, T. (2016, January 23\u201326). LucentMaps: 3D Printed Audiovisual Tactile Maps for Blind and Visually Impaired People. Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility, Reno, NV, USA.","DOI":"10.1145\/2982142.2982163"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Miesenberger, K., Kouroupetroglou, G., Mavrou, K., Manduchi, R., Covarrubias Rodriguez, M., and Pen\u00e1z, P. (2022). An Audio-Tactile System for Visually Impaired People to Explore Indoor Maps. Computers Helping People with Special Needs, Springer International Publishing.","DOI":"10.1007\/978-3-031-08648-9"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Miesenberger, K., Kouroupetroglou, G., Mavrou, K., Manduchi, R., Covarrubias Rodriguez, M., and Pen\u00e1z, P. (2022). ATIM: Automated Generation of Interactive, Audio-Tactile Indoor Maps by Means of a Digital Pen. Computers Helping People with Special Needs, Springer International Publishing.","DOI":"10.1007\/978-3-031-08645-8_64"},{"key":"ref_35","unstructured":"Suzuki, R., Stangl, A., Gross, M.D., and Yeh, T. (November, January 20). FluxMarker: Enhancing Tactile Graphics with Dynamic Tactile Markers. Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility, Baltimore, MD, USA."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chase, E.D.Z., Siu, A.F., Boadi-Agyemang, A., Kim, G.S.H., Gonzalez, E.J., and Follmer, S. (2020, January 26\u201328). PantoGuide: A Haptic and Audio Guidance System To Support Tactile Graphics Exploration. Proceedings of the the 22nd International ACM SIGACCESS Conference on Computers and Accessibility, Vitual.","DOI":"10.1145\/3373625.3418023"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2700109","DOI":"10.1109\/JTEHM.2014.2309343","article-title":"FingerSight: Fingertip Haptic Sensing of the Visual Environment","volume":"2","author":"Horvath","year":"2014","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Li, J., Kim, S., Miele, J.A., Agrawala, M., and Follmer, S. (2019, January 4\u20139). Editing Spatial Layouts through Tactile Templates for People with Visual Impairments. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK.","DOI":"10.1145\/3290605.3300436"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Tsai, H.R., Chang, Y.C., Wei, T.Y., Tsao, C.A., Koo, X.C.Y., Wang, H.C., and Chen, B.Y. (2021, January 8\u201313). GuideBand: Intuitive 3D Multilevel Force Guidance on a Wristband in Virtual Reality. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445262"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Walker, J.M., Zemiti, N., Poignet, P., and Okamura, A.M. (2019, January 9\u201312). Holdable Haptic Device for 4-DOF Motion Guidance. Proceedings of the 2019 IEEE World Haptics Conference (WHC), Tokyo, Japan.","DOI":"10.1109\/WHC.2019.8816171"},{"key":"ref_41","unstructured":"EBU (2022, October 10). About Blindness and Partial Sight. Available online: https:\/\/www.euroblind.org\/about-blindness-and-partial-sight."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"13-es","DOI":"10.1145\/1279700.1279703","article-title":"Analysis of Navigability of Web Applications for Improving Blind Usability","volume":"14","author":"Takagi","year":"2007","journal-title":"ACM Trans. Comput. Hum. Interact."},{"key":"ref_43","unstructured":"Petrie, H., Hamilton, F., King, N., and Pavan, P. Remote Usability Evaluations with Disabled People. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3410446","article-title":"Creating Accessible Online Floor Plans for Visually Impaired Readers","volume":"13","author":"Madugalla","year":"2020","journal-title":"ACM Trans. Access. Comput."},{"key":"ref_45","unstructured":"Inventivio GmbH (2022). Tactonom Reader (The Tactile Graphics Reader), Inventivio GmbH. Available online: https:\/\/www.tactonom.com\/en\/tactonomreader-2\/."},{"key":"ref_46","unstructured":"ProBlind (2022). ProBlind (Open-Source Tactile Graphics Dataset), ProBlind. Available online: https:\/\/www.problind.org\/en\/."},{"key":"ref_47","unstructured":"Merz, E.X. (2022, October 10). Sonifying Processing: The Beads Tutorial. Available online: https:\/\/emptyurglass.com\/wp-content\/uploads\/2018\/02\/Sonifying_Processing_The_Beads_Tutorial.pdf."},{"key":"ref_48","unstructured":"Piaf Tactile: Adaptive Technology (2022). PIAF Tactile Image Maker, Herpo. Available online: https:\/\/piaf-tactile.com\/."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Petit, G., Dufresne, A., Levesque, V., Hayward, V., and Trudeau, N. (2008, January 13\u201315). Refreshable Tactile Graphics Applied to Schoolbook Illustrations for Students with Visual Impairment. Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility, Halifax, NS, Canada.","DOI":"10.1145\/1414471.1414489"}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/6\/12\/113\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:43:38Z","timestamp":1760147018000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/6\/12\/113"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,18]]},"references-count":49,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["mti6120113"],"URL":"https:\/\/doi.org\/10.3390\/mti6120113","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,18]]}}}