{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T05:06:10Z","timestamp":1787029570740,"version":"build-2736575974"},"reference-count":53,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2019,10,7]],"date-time":"2019-10-07T00:00:00Z","timestamp":1570406400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002569","name":"Wonkwang University","doi-asserted-by":"publisher","award":["2019"],"award-info":[{"award-number":["2019"]}],"id":[{"id":"10.13039\/501100002569","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Accompanying the advent of wireless networking and the Internet of Things (IoT), traditional augmented reality (AR) systems to visualize virtual 3D models of the real world are evolving into smart and interactive AR related to the context of things for physical objects. We propose the integration of AR and IoT in a complementary way, making AR scalable to cover objects everywhere with an acceptable level of performance and interacting with IoT in a more intuitive manner. We identify three key components for realizing such a synergistic integration: (1) distributed and object-centric data management (including for AR services); (2) IoT object-guided tracking; (3) seamless interaction and content interoperability. We survey the current state of these respective areas and herein discuss research on issues about realizing a future smart and interactive living environment.<\/jats:p>","DOI":"10.3390\/s19194330","type":"journal-article","created":{"date-parts":[[2019,10,7]],"date-time":"2019-10-07T10:05:12Z","timestamp":1570442712000},"page":"4330","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":74,"title":["AR Enabled IoT for a Smart and Interactive Environment: A Survey and Future Directions"],"prefix":"10.3390","volume":"19","author":[{"given":"Dongsik","family":"Jo","sequence":"first","affiliation":[{"name":"Department of Digital Contents Engineering, Wonkwang University, Jeonbuk 54538, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gerard Jounghyun","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Korea University, Seoul 02841, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Jo, D., and Kim, G.J. (2015, January 13\u201315). Local context based recognition+ Internet of Things: Complementary infrastructures for future generic mixed reality space. Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology (VRST 2015), Beijing, China.","DOI":"10.1145\/2821592.2821647"},{"key":"ref_2","unstructured":"White, G., Cabrara, C., Palade, A., and Clarke, S. (2018, January 12\u201315). Augmented reality in IoT. Proceedings of the 8th International Workshop on Context-Aware and IoT Services, Hangzhou, China."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Phupattanasilp, P., and Tong, S. (2019). Augmented reality in the integrative Internet of Things (IoT): Application for precision farming. Sustainability, 11.","DOI":"10.3390\/su11092658"},{"key":"ref_4","unstructured":"Gimenez, R., and Pous, M. (2010, January 15\u201316). Augmented reality as an enabling factor for the Internet of Things. Proceedings of the W3C Workshop: Augmented Reality on the Web, Barcelona, Spain."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1145\/227234.227243","article-title":"The computer scientist as toolsmith","volume":"39","author":"Brooks","year":"1996","journal-title":"Commun. ACM"},{"key":"ref_6","unstructured":"Radkowski, R. (2013, January 18\u201319). Augmented reality to supplement work instructions. Proceedings of the Model-Based Enterprise Summit, Gaithersburg, MD, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1002\/ett.2704","article-title":"Sensing as a service model for smart cities supported by Internet of Things","volume":"25","author":"Perera","year":"2014","journal-title":"Trans. Emerg. Telecommun. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhang, H., Zhang, Z., Zhang, L., Yang, Y., Kang, Q., and Sun, D. (2019). Object tracking for a smart city using IoT and edge computing. Sensors, 19.","DOI":"10.3390\/s19091987"},{"key":"ref_9","first-page":"809","article-title":"Augmented reality based IoT concept for smart environment","volume":"5","author":"Srimathi","year":"2019","journal-title":"Int. J. Intellect. Adv. Res. Eng. Comput."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Badouch, A., Krit, S., Kabrane, M., and Karimi, K. (2018, January 19\u201320). Augmented reality service implemented within smart cities, based on an Internet of Things infrastructure, concepts and challenges: An overview. Proceedings of the Fourth International Conference on Engineering & MIS, Istanbul, Turkey.","DOI":"10.1145\/3234698.3234751"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13673-018-0162-5","article-title":"IoT+AR: Pervasive and augmented environments for Digi-log shopping experience","volume":"9","author":"Jo","year":"2019","journal-title":"Hum.-Centric Comput. Inf. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lee, S., Lee, G., Choi, G., Roh, B., and Kang, J. (2019, January 11\u201313). Integration of OneM2M-based IoT service platform and mixed reality device. Proceedings of the IEEE International Conference on Consumer Electronics, Las Vegas, NV, USA.","DOI":"10.1109\/ICCE.2019.8662008"},{"key":"ref_13","unstructured":"Kasahara, S., Heun, V., Lee, A.S., and Ishii, H. (December, January 28). Second surface: Multi-user spatial collaboration system based on augmented reality. Proceedings of the SIGGRAPH Asia Emerging Technologies, Singapore."},{"key":"ref_14","first-page":"966","article-title":"Context-aware mobile AR system for personalization, selective sharing, and interaction of contents in ubiquitous computing environments","volume":"4551","author":"Suh","year":"2007","journal-title":"Hum.-Comput. Interact."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1109\/MCE.2018.2797638","article-title":"Visualizing the Internet of Things: Naturalizing human-computer interaction by incorporating AR features","volume":"7","author":"Michalakis","year":"2018","journal-title":"IEEE Consum. Electron. Mag."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Bonomi, F., Milito, R., Jhu, J., and Addepalli, S. (2012, January 17). Fog computing and its role in the Internet of things. Proceedings of the First Edition of the MCC Workshop on Mobile Cloud Computing, Helsinki, Finland.","DOI":"10.1145\/2342509.2342513"},{"key":"ref_17","unstructured":"Jesudian, S., and Jabez, J. (2018). An Intergration of IoT and Mixed Reality Using Fog Computing Concepts. [Master\u2019s Thesis, Texas State University]."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1080\/13614568.2013.857727","article-title":"Webizing mobile augmented reality content","volume":"20","author":"Ahn","year":"2014","journal-title":"New Rev. Hypermedia Multimed."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kruijff, E., Swan, E., and Feiner, S. (2010, January 13\u201316). Perceptual issues in augmented reality revisited. Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR), Seoul, Korea.","DOI":"10.1109\/ISMAR.2010.5643530"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Campana, F., and Dominguez, F. (2018, January 15\u201319). Ariotivity: Provisioning smart objects with augmented reality and open standards. Proceedings of the IEEE Third Ecuador Technical Chapters Meeting, Cuenca, Ecuador.","DOI":"10.1109\/ETCM.2018.8580341"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Diao, P., and Shih, N. (2018). MARINS: A mobile smartphone AR system for pathfinding in a dark environment. Sensors, 18.","DOI":"10.3390\/s18103442"},{"key":"ref_22","unstructured":"Newman, J., Wagner, M., Bauer, M., Williams, A.M., Pintaric, T., Beyer, D., Pustka, D., Strasser, F., Schmalstieg, D., and Klinker, G. (2004, January 5). Ubiquitous tracking for augmented reality. Proceedings of the 3rd IEEE\/ACM International Symposium on Mixed and Augmented Reality, Arlington, VA, USA."},{"key":"ref_23","unstructured":"Negara, G.P.K., Teck, F.W., and Yiqun, L. (2014). Hybrid feature and template-based tracking for augmented reality application. ACCV 2014 Workshops, Springer."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TCE.2015.7298088","article-title":"AVIoT: Web-based interactive authoring and visualization of indoor Internet of Things","volume":"61","author":"Jeong","year":"2015","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_25","unstructured":"Jackson, B.J.C., Watten, P.L., Newbury, P.F., and Lister, P.F. (2005, January 3\u20137). Rapid authoring for VR-based simulations of pervasive computing applications. Proceedings of the 1st International Workshop on Methods & Tools for Designing VR Applications (MeTo-VR) In conjunction with 11th International Conference on Virtual Systems and Multimedia, Flanders Expo, Ghent, Belgium."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Heun, V., Hobin, J., and Maes, P. (2013, January 8\u201312). Reality Editor: Programming smarter objects. Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, Zurich, Switzerland.","DOI":"10.1145\/2494091.2494185"},{"key":"ref_27","unstructured":"Choi, M., Park, L., Lee, S., Hwang, J., and Park, S. (2017, January 8\u201310). Design and implementation of hyper-connected IoT-VR platform for customizable and intuitive remote services. Proceedings of the IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kim, M., Choi, S., Park, K., and Lee, J. (2019). User Interactions for Augmented Reality Smart Glasses: A comparative evaluation of visual contexts and interaction gestures. Appl. Sci., 9.","DOI":"10.3390\/app9153171"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mihara, S., Sakamoto, A., Shimada, H., and Sato, K. (2011, January 24\u201326). Augmented reality marker for operating home appliances. Proceedings of the International Conference on Embedded and Ubiquitous Computing (EUC), Melbourne, VIC, Australia.","DOI":"10.1109\/EUC.2011.20"},{"key":"ref_30","unstructured":"Lu, C.-H. (October, January 29). IoT-enhanced and bidirectionally interactive information visualization for context-aware home energy savings. Proceedings of the Mixed and Augmented Reality\u2014Media, Art, Social Science, Humanities and Design (ISMAR), Fukuoka, Japan."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Rekimoto, J., and Nagao, K. (1995, January 15\u201317). The world through the computer: Computer augmented interaction with real world environments. Proceedings of the Symposium on User Interface Software and Technology (UIST), Pittsburgh, PA, USA.","DOI":"10.1145\/215585.215639"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Iglesias, J., Bernardos, A., and Casar, J. (2013). An evidential and context-aware recommendation strategy to enhance interactions with smart spaces. Hybrid Artificial Intelligent Systems, Springer.","DOI":"10.1007\/978-3-642-40846-5_25"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/s10055-010-0183-5","article-title":"An augmented reality interface to contextual information","volume":"15","author":"Ajanki","year":"2011","journal-title":"Virtual Real."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Huang, B.-R., Lin, C.H., and Lee, C.-H. (2012, January 24\u201326). Mobile augmented reality based on cloud computing. Proceedings of the International Conference on Anti-Counterfeiting, Security and Identification (ASID), Taipei, Taiwan.","DOI":"10.1109\/ICASID.2012.6325354"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ghobaei-Arani, M., Souri, A., and Rahmanian, A. (2019). Resource management approaches in fog computing: A comprehensive review. J. Grid Comput., 1\u201342.","DOI":"10.1007\/s10723-019-09491-1"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Muller, L., Aslan, I., and Kru\u00dfen, L. (2013). GuideMe: A Mobile augmented reality system to display user manuals for home appliances. Advances in Computer Entertainment (ACE), Springer.","DOI":"10.1007\/978-3-319-03161-3_11"},{"key":"ref_37","unstructured":"(2019, August 14). The Physical Web. Available online: https:\/\/google.github.io\/physical-web\/."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J., Yoo, B., Ahn, S., and Go, H. (2014, January 10\u201312). View management for webized mobile AR contents. Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Munich, Germany.","DOI":"10.1109\/ISMAR.2014.6948445"},{"key":"ref_39","unstructured":"Greg, T. (2019, September 13). Mediating Mediums. Available online: http:\/\/www.inventinginteractive.com\/2011\/08\/22\/mediating-mediums\/."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Claros, D., Seron, M., Dominguez, M., and Trazegnies, C. (2007). Augmented reality visualization interface for biometric wireless sensor networks. Proceedings 9th International Work-Conference on Artificial Neural Networks (IWANN), Springer.","DOI":"10.1007\/978-3-540-73007-1_130"},{"key":"ref_41","unstructured":"Uchiyama, H., and Marchand, E. (2012, January 2\u20134). Object detection and pose tracking for augmented reality: Recent approaches. Proceedings of the 18th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV), Kawasaki, Japan."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Park, Y., Yun, S., and Kim, K. (2019, January 17\u201321). When IoT met augmented reality: Visualizing the source of the wireless signal in AR view. Proceedings of the 17th Annual International Conference on Mobile System, Applications, and Services, Seoul, Korea.","DOI":"10.1145\/3307334.3326079"},{"key":"ref_43","unstructured":"Lifton, J., and Paradiso, J.A. (2009, January 27\u201329). Dual reality-merging the real and virtual. Proceedings of the 1st International Conference on Facets of Virtual Environments (FAVE), Berlin, Germany."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Zhu, Z., Branzoi, V., and Wolverton, M. (2014, January 10\u201312). AR-Mentor: Augmented reality based mentoring system. Proceedings of the 13rd IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Munich, Germany.","DOI":"10.1109\/ISMAR.2014.6948404"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Rekimoto, J., and Ayatsuka, Y. (2000). CyberCode: Designing augmented reality environments with visual tags. Proc. DARE, 1\u201310.","DOI":"10.1145\/354666.354667"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1162\/105474600566808","article-title":"Optical versus video see-through head-mounted displays in medical visualization","volume":"9","author":"Rolland","year":"2000","journal-title":"Presence"},{"key":"ref_47","unstructured":"(2019, August 14). WebGL. Available online: https:\/\/www.khronos.org\/webgl\/."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1109\/TVCG.2013.94","article-title":"Optimal local searching for fast and robust textureless 3D object tracking in highly cluttered backgrounds","volume":"20","author":"Seo","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_49","unstructured":"Tatzqern, M., Kalkofen, D., Grasset, R., and Schmalstieg, D. (April, January 29). Hedgehog Labeling: View management techniques for external labels in 3D space. Proceedings of the IEEE VR, Minneapolis, MN, USA."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1109\/TVCG.2016.2518318","article-title":"Temporal coherence strategies for augmented reality labeling","volume":"22","author":"Madsen","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Lee, T., and Hollerer, T. (2007, January 11\u201313). Handy AR: Markerless inspection of augmented reality objects using fingertip tracking. Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers, Boston, MA, USA.","DOI":"10.1109\/ISWC.2007.4373785"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1109\/TVCG.2015.2391860","article-title":"3D Finger CAPE: Clicking action and position Estimation under Self-Occlusions in Egocentric Viewpoint","volume":"21","author":"Jang","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph. TVCG"},{"key":"ref_53","unstructured":"Heun, V., Kasahara, S., and Maes, P. (May, January 27). Smarter Objects: Using AR technology to program physical objects and their interactions. Proceedings of the ACM International Conference Human Factors in Computing (CHI), Paris, France."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/19\/4330\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:28:05Z","timestamp":1760189285000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/19\/4330"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,7]]},"references-count":53,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["s19194330"],"URL":"https:\/\/doi.org\/10.3390\/s19194330","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,7]]}}}