{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T01:24:49Z","timestamp":1768008289329,"version":"3.49.0"},"reference-count":74,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2019,12,3]],"date-time":"2019-12-03T00:00:00Z","timestamp":1575331200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Institute for Information &amp; communication Technology Planning &amp; evaluation","award":["IITP-2019-2017-0-01630"],"award-info":[{"award-number":["IITP-2019-2017-0-01630"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents two methodologies for delivering multimedia content to visually impaired people with the use of a haptic device and braille display. Based on our previous research, the research using Kinect v2 and haptic device with 2D+ (RGB frame with depth) data has the limitations of slower operational speed while reconstructing object details. Thus, this study focuses on the development of 2D multiarray braille display using an electronic book translator application because of its accuracy and high speed. This approach provides mobility and uses 2D multiarray braille display to represent media content contour more efficiently. In conclusion, this study achieves the representation of considerably massive text content compared to previous 1D braille displays. Besides, it also represents illustrations and figures to braille displays through quantization and binarization.<\/jats:p>","DOI":"10.3390\/s19235319","type":"journal-article","created":{"date-parts":[[2019,12,4]],"date-time":"2019-12-04T04:30:35Z","timestamp":1575433835000},"page":"5319","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Towards Tangible Vision for the Visually Impaired through 2D Multiarray Braille Display"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3667-3157","authenticated-orcid":false,"given":"Seondae","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Computer Education, Sungkyunkwan University, Seoul 03063, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yeongil","family":"Ryu","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Gachon University, Seongnam-si, Gyeonggi-do 13120, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinsoo","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Gachon University, Seongnam-si, Gyeonggi-do 13120, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4894-6105","authenticated-orcid":false,"given":"Eun-Seok","family":"Ryu","sequence":"additional","affiliation":[{"name":"Department of Computer Education, Sungkyunkwan University, Seoul 03063, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,3]]},"reference":[{"key":"ref_1","unstructured":"Colby, S.L., and Ortman, J.M. (2017). Projections of the Size and Composition of the US Population: 2014 to 2060: Population Estimates and Projections."},{"key":"ref_2","unstructured":"He, W., and Larsen, L.J. (2014). Older Americans with a Disability, 2008\u20132012."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e888","DOI":"10.1016\/S2214-109X(17)30293-0","article-title":"Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: A systematic review and meta-analysis","volume":"5","author":"Bourne","year":"2017","journal-title":"Lancet Glob. Health"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Elmannai, W., and Elleithy, K. (2017). Sensor-based assistive devices for visually-impaired people: Current status, challenges, and future directions. Sensors, 17.","DOI":"10.3390\/s17030565"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1109\/JQE.1967.1074528","article-title":"A laser cane for the blind","volume":"3","author":"Bolgiano","year":"1967","journal-title":"IEEE J. Quantum Electron."},{"key":"ref_6","unstructured":"Borenstein, J., and Ulrich, I. (1997, January 21\u201327). The guidecane-a computerized travel aid for the active guidance of blind pedestrians. Proceedings of the ICRA, Albuquerque, NM, USA."},{"key":"ref_7","unstructured":"Yi, Y., and Dong, L. (2015, January 15\u201317). A design of blind-guide crutch based on multi-sensors. Proceedings of the 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), Zhangjiajie, China."},{"key":"ref_8","unstructured":"Wahab, M.H.A., Talib, A.A., Kadir, H.A., Johari, A., Noraziah, A., Sidek, R.M., and Mutalib, A.A. (2011). Smart cane: Assistive cane for visually-impaired people. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1514","DOI":"10.1002\/acs.2495","article-title":"Robotics-based telepresence using multi-modal interaction for individuals with visual impairments","volume":"28","author":"Park","year":"2014","journal-title":"Int. J. Adapt. Control Signal Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1109\/TOH.2015.2460253","article-title":"Telerobotic haptic exploration in art galleries and museums for individuals with visual impairments","volume":"8","author":"Park","year":"2015","journal-title":"IEEE Trans. Haptics"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Park, C.H., and Howard, A.M. (2010, January 25\u201326). Towards real-time haptic exploration using a mobile robot as mediator. Proceedings of the 2010 IEEE Haptics Symposium, Waltham, MA, USA.","DOI":"10.1109\/HAPTIC.2010.5444643"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Park, C.H., and Howard, A.M. (2012, January 2\u20135). Real world haptic exploration for telepresence of the visually impaired. Proceedings of the Seventh Annual ACM\/IEEE International Conference on Human-Robot Interaction, Portland, OR, USA.","DOI":"10.1145\/2157689.2157701"},{"key":"ref_13","unstructured":"Park, C.H., and Howard, A.M. (2013, January 14\u201317). Real-time haptic rendering and haptic telepresence robotic system for the visually impaired. Proceedings of the World Haptics Conference (WHC), Daejeon, Korea."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Hicks, S.L., Wilson, I., Muhammed, L., Worsfold, J., Downes, S.M., and Kennard, C. (2013). A depth-based head-mounted visual display to aid navigation in partially sighted individuals. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0067695"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hong, D., Kimmel, S., Boehling, R., Camoriano, N., Cardwell, W., Jannaman, G., Purcell, A., Ross, D., and Russel, E. (2008, January 16\u201318). Development of a semi-autonomous vehicle operable by the visually-impaired. Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Daegu, Korea.","DOI":"10.1109\/MFI.2008.4648051"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1097\/OPX.0000000000001232","article-title":"Using an Augmented Reality Device as a Distance-based Vision Aid\u2014Promise and Limitations","volume":"95","author":"Kinateder","year":"2018","journal-title":"Optom. Vis. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Oliveira, J., Guerreiro, T., Nicolau, H., Jorge, J., and Gon\u00e7alves, D. (2011, January 5\u20139). BrailleType: Unleashing braille over touch screen mobile phones. Proceedings of the IFIP Conference on Human-Computer Interaction, Lisbon, Portugal.","DOI":"10.1007\/978-3-642-23774-4_10"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Vel\u00e1zquez, R., Preza, E., and Hern\u00e1ndez, H. (2008, January 18\u201319). Making eBooks accessible to blind Braille readers. Proceedings of the IEEE International Workshop on Haptic Audio visual Environments and Games, Ottawa, ON, Canada.","DOI":"10.1109\/HAVE.2008.4685293"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Goncu, C., and Marriott, K. (2015, January 8\u201311). Creating ebooks with accessible graphics content. Proceedings of the 2015 ACM Symposium on Document Engineering, Lausanne, Switzerland.","DOI":"10.1145\/2682571.2797076"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bornschein, J., Bornschein, D., and Weber, G. (2018, January 21\u201326). Comparing computer-based drawing methods for blind people with real-time tactile feedback. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada.","DOI":"10.1145\/3173574.3173689"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bornschein, J., Prescher, D., and Weber, G. (2015, January 26\u201328). Collaborative creation of digital tactile graphics. Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, Lisbon, Portugal.","DOI":"10.1145\/2700648.2809869"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1109\/MC.2016.327","article-title":"Tactile Digital Braille Display","volume":"49","author":"Byrd","year":"2016","journal-title":"Computer"},{"key":"ref_23","first-page":"173","article-title":"A Study on the DAISY Service Interface for the Print-Disabled","volume":"22","author":"Bae","year":"2011","journal-title":"J. Korean Biblia Soc. Libr. Inf. Sci."},{"key":"ref_24","unstructured":"Jihyeon, W., Hyerina, L., Tae-Eun, K., and Jongwoo, L. (2010). An Implementation of an Android Mobile E-book Player for Disabled People, Korea Multimedia Society."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"291","DOI":"10.9728\/dcs.2011.12.3.291","article-title":"A Design and Implementation of DAISY3 compliant Mobile E-book Viewer","volume":"12","author":"Kim","year":"2011","journal-title":"J. Digit. Contents Soc."},{"key":"ref_26","unstructured":"Harty, J., LogiGearTeam, Holdt, H.C., and Coppola, A. (2018, October 06). Android-Daisy-Epub-Reader. Available online: https:\/\/code.google.com\/archive\/p\/android-daisy-epub-reader."},{"key":"ref_27","unstructured":"Mahule, A. (2018, October 06). Daisy3-Reader. Available online: https:\/\/github.com\/amahule\/Daisy3-Reader."},{"key":"ref_28","unstructured":"BLITAB Technology (2019, January 10). Blitab. Available online: http:\/\/blitab.com\/."},{"key":"ref_29","unstructured":"HIMS International (2018, October 18). BrailleSense Polaris and U2. Available online: http:\/\/himsintl.com\/blindness\/."},{"key":"ref_30","unstructured":"Humanware Store (2019, January 10). BrailleNote Touch 32 Braille Notetaker. Available online: https:\/\/store.humanware.com\/asia\/braillenote-touch-32.html."},{"key":"ref_31","unstructured":"Humanware (2019, June 08). Brailliant B 80 Braille Display (New Generation). Available online: https:\/\/store.humanware.com\/asia\/brailliant-b-80-new-generation.html."},{"key":"ref_32","unstructured":"Humanware (2011). Brailliant BI Braille Display User Guide, Humanware Inc."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"072101","DOI":"10.1007\/s11432-016-5575-z","article-title":"A method for automatically translating print books into electronic Braille books","volume":"59","author":"Park","year":"2016","journal-title":"Sci. China Inf. Sci."},{"key":"ref_34","unstructured":"Kim, S., Roh, H.J., Ryu, Y., and Ryu, E.S. (2017, January 18\u201320). Daisy\/EPUB-based Braille Conversion Software Development for 2D Braille Information Terminal. Proceedings of the 2017 Korea Computer Congress of the Korean Institute of Information Scientists and Engineers, Seoul, Korea."},{"key":"ref_35","unstructured":"Park, E.S., Kim, S.D., Ryu, Y., Roh, H.J., Koo, J., and Ryu, E.S. (2018, January 17\u201319). Design and Implementation of Daisy 3 Viewer for 2D Braille Device. Proceedings of the 2018 Winter Conference of the Korean Institute of Communications and Information Sciences, Seoul, Korea."},{"key":"ref_36","first-page":"1061","article-title":"Haptic Telepresence System for Individuals with Visual Impairments","volume":"29","author":"Ryu","year":"2017","journal-title":"Sens. Mater."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kim, S., Park, E.S., and Ryu, E.S. (2019). Multimedia Vision for the Visually Impaired through 2D Multiarray Braille Display. Appl. Sci., 9.","DOI":"10.3390\/app9050878"},{"key":"ref_38","unstructured":"Microsoft (2018, October 03). Kinect for Windows. Available online: https:\/\/developer.microsoft.com\/en-us\/windows\/kinect."},{"key":"ref_39","unstructured":"Microsoft (2018, October 04). Setting up Kinect for Windows. Available online: https:\/\/support.xbox.com\/en-US\/xboxon-windows\/accessories\/kinect-for-windows-setup."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Daniilidis, K., Maragos, P., and Paragios, N. (2010). Guided Image Filtering. Proceedings of the Computer Vision\u2014ECCV 2010, Springer.","DOI":"10.1007\/978-3-642-15561-1"},{"key":"ref_41","unstructured":"At\u0131l\u0131m \u00c7etin (2019, May 25). Guided Filter for OpenCV. Available online: https:\/\/github.com\/atilimcetin\/guidedfilter."},{"key":"ref_42","unstructured":"CHAI3D (2018, October 05). CHAI3D: CHAI3D Documentation. Available online: http:\/\/www.chai3d.org\/download\/doc\/html\/wrapper-overview.html."},{"key":"ref_43","unstructured":"3D Systems, Inc. (2018, October 05). OpenHaptics: Geomagic\u00ae OpenHaptics\u00ae Toolkit. Available online: https:\/\/www.3dsystems.com\/haptics-devices\/openhaptics?utm_source=geomagic.com&utm_medium=301."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1649","DOI":"10.1109\/TCSVT.2012.2221191","article-title":"Overview of the high efficiency video coding (HEVC) standard","volume":"22","author":"Sullivan","year":"2012","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"25271","DOI":"10.1007\/s11042-017-4413-7","article-title":"Prediction complexity-based HEVC parallel processing for asymmetric multicores","volume":"76","author":"Roh","year":"2017","journal-title":"Multimed. Tools Appl."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ryu, Y., and Ryu, E.S. (2017, January 20\u201323). Video on Mobile CPU: UHD Video Parallel Decoding for Asymmetric Multicores. Proceedings of the 8th ACM on Multimedia Systems Conference, Taipei, Taiwan.","DOI":"10.1145\/3083187.3083229"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1109\/JSTSP.2013.2283657","article-title":"Standardized extensions of high efficiency video coding (HEVC)","volume":"7","author":"Sullivan","year":"2013","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/s13640-015-0058-5","article-title":"Low-complexity depth map compression in HEVC-based 3D video coding","volume":"2015","author":"Zhang","year":"2015","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_49","unstructured":"Fraunhofer., and HHI (2019, October 16). 3D HEVC Extension. Available online: https:\/\/www.hhi.fraunhofer.de\/en\/departments\/vca\/research-groups\/image-video-coding\/research-topics\/3d-hevc-extension.html."},{"key":"ref_50","first-page":"2551","article-title":"Raptor codes","volume":"14","author":"Shokrollahi","year":"2006","journal-title":"IEEE\/ACM Trans. Netw. (TON)"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Ryu, E.S., and Jayant, N. (2011). Home gateway for three-screen TV using H. 264 SVC and raptor FEC. IEEE Trans. Consum. Electron., 57.","DOI":"10.1109\/TCE.2011.6131138"},{"key":"ref_52","unstructured":"Canadian Assistive Technologies Ltd. (2019, January 10). What to Know before You Buy a Braille Display. Available online: https:\/\/canasstech.com\/blogs\/news\/what-to-know-before-you-buy-a-braille-display."},{"key":"ref_53","unstructured":"Consortium, T.D. (2018, October 06). Daisy Consortium Homepage. Available online: http:\/\/www.daisy.org\/home."},{"key":"ref_54","unstructured":"IDPF (International Digital Publishing Forum) (2018, October 06). EPUB Official Homepage. Available online: http:\/\/idpf.org\/epub."},{"key":"ref_55","unstructured":"Google Developers (2018, October 07). Documentation for Android Developers\u2014Message. Available online: https:\/\/developer.android.com\/reference\/android\/os\/Message."},{"key":"ref_56","unstructured":"Google Developers (2018, October 07). Documentation for Android Developers\u2014Activity. Available online: https:\/\/developer.android.com\/reference\/android\/app\/Activity."},{"key":"ref_57","unstructured":"Bray, T., Paoli, J., Sperberg-McQueen, C.M., Maler, E., and Yergeau, F. (2019, December 03). Extensible Markup Language (XML) 1.0. Available online: http:\/\/ctt.sbras.ru\/docs\/rfc\/rec-xml.htm."},{"key":"ref_58","unstructured":"Daisy Consortium (2018, October 07). DAISY 2.02 Specification. Available online: http:\/\/www.daisy.org\/z3986\/specifications\/daisy_202.html."},{"key":"ref_59","unstructured":"Daisy Consortium (2018, October 07). Part I: Introduction to Structured Markup\u2014Daisy 3 Structure Guidelines. Available online: http:\/\/www.daisy.org\/z3986\/structure\/SG-DAISY3\/part1.html."},{"key":"ref_60","unstructured":"Paul Siegmann (2018, October 18). EPUBLIB\u2014A Java EPUB Library. Available online: http:\/\/www.siegmann.nl\/epublib."},{"key":"ref_61","unstructured":"Siegmann, P. (2018, October 06). Epublib for Android OS. Available online: http:\/\/www.siegmann.nl\/epublib\/android."},{"key":"ref_62","unstructured":"Hedley, J. (2018, October 07). Jsoup: Java HTML Parser. Available online: https:\/\/jsoup.org\/."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"94","DOI":"10.5392\/JKCA.2011.11.12.094","article-title":"Design and implementation of a real-time education assistive technology system based on haptic display to improve education environment of total blindness people","volume":"11","author":"Jung","year":"2011","journal-title":"J. Korea Contents Assoc."},{"key":"ref_64","unstructured":"Jung, J., Hongchan, Y., Hyelim, L., and Jinsoo, C. (2015, January 9\u201312). Graphic haptic electronic board-based education assistive technology system for blind people. Proceedings of the 2015 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA."},{"key":"ref_65","unstructured":"Shi, J., and Tomasi, C. (1993). Good Features to Track, Cornell University. Technical Report."},{"key":"ref_66","unstructured":"Daisy Consortium (2018, October 10). Daisy Sample Books. Available online: http:\/\/www.daisy.org\/sample-content."},{"key":"ref_67","unstructured":"PRESSBOOKS (2018, October 08). EPUB Sample Books. Available online: https:\/\/pressbooks.com\/sample-books\/."},{"key":"ref_68","unstructured":"Jeong, I., Ahn, E., Seo, Y., Lee, S., Jung, J., and Cho, J. (2018, January 20\u201322). Design of Electronic Braille Learning Tool System for low vision people and Blind People. Proceedings of the 2018 Summer Conference of the Korean Institute of Information Scientists and Engineers, Seoul, Korea."},{"key":"ref_69","unstructured":"Seo, Y.S., Joo, H.J., Jung, J.I., and Cho, J.S. (2016, January 22\u201324). Implementation of Improved Functional Router Using Embedded Linux System. Proceedings of the 2016 IEIE Summer Conference, Seoul, Korea."},{"key":"ref_70","unstructured":"Park, J., Sung, K.K., Cho, J., and Choi, J. (2016, January 21\u201323). Layout Design and Implementation for Information Output of Mobile Devices based on Multi-array Braille Terminal. Proceedings of the 2016 Winter Korean Institute of Information Scientists and Engineers, Seoul, Korea."},{"key":"ref_71","unstructured":"Goyang-City (2019, October 16). Cat character illustration by Goyang City. Available online: http:\/\/www.goyang.go.kr\/www\/user\/bbs\/BD_selectBbsList.do?q_bbsCode=1054."},{"key":"ref_72","unstructured":"Repo, P. (2019, October 16). Like PNG Icon. Available online: https:\/\/www.pngrepo.com\/svg\/111221\/like."},{"key":"ref_73","unstructured":"FLATICON (2019, October 16). Chat Icon. Available online: https:\/\/www.flaticon.com\/free-icon\/chat_126500#term=chat&page=1&position=9."},{"key":"ref_74","unstructured":"NV Access (2019, March 12). About NVDA. Available online: https:\/\/www.nvaccess.org\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/23\/5319\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:39:41Z","timestamp":1760189981000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/23\/5319"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,3]]},"references-count":74,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["s19235319"],"URL":"https:\/\/doi.org\/10.3390\/s19235319","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,3]]}}}