{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T10:39:19Z","timestamp":1779359959672,"version":"3.51.4"},"reference-count":53,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2020,6,11]],"date-time":"2020-06-11T00:00:00Z","timestamp":1591833600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"This work was supported by the Plant Information and Augmented Reality research line of the Navantia-UDC Joint Research Unit","award":["IN853B-2018\/02"],"award-info":[{"award-number":["IN853B-2018\/02"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Augmented Reality (AR) and Mixed Reality (MR) devices have evolved significantly in the last years, providing immersive AR\/MR experiences that allow users to interact with virtual elements placed on the real-world. However, to make AR\/MR devices reach their full potential, it is necessary to go further and let them collaborate with the physical elements around them, including the objects that belong to the Internet of Things (IoT). Unfortunately, AR\/MR and IoT devices usually make use of heterogeneous technologies that complicate their intercommunication. Moreover, the implementation of the intercommunication mechanisms requires involving specialized developers with have experience on the necessary technologies. To tackle such problems, this article proposes the use of a framework that makes it easy to integrate AR\/MR and IoT devices, allowing them to communicate dynamically and in real time. The presented AR\/MR-IoT framework makes use of standard and open-source protocols and tools like MQTT, HTTPS or Node-RED. After detailing the inner workings of the framework, it is illustrated its potential through a practical use case: a smart power socket that can be monitored and controlled through Microsoft HoloLens AR\/MR glasses. The performance of such a practical use case is evaluated and it is demonstrated that the proposed framework, under normal operation conditions, enables to respond in less than 100 ms to interaction and data update requests.<\/jats:p>","DOI":"10.3390\/s20113328","type":"journal-article","created":{"date-parts":[[2020,6,15]],"date-time":"2020-06-15T05:56:27Z","timestamp":1592200587000},"page":"3328","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":50,"title":["Creating the Internet of Augmented Things: An Open-Source Framework to Make IoT Devices and Augmented and Mixed Reality Systems Talk to Each Other"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8608-1088","authenticated-orcid":false,"given":"\u00d3scar","family":"Blanco-Novoa","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Faculty of Computer Science, Universidade da Coru\u00f1a, 15071 A Coru\u00f1a, Spain"},{"name":"Centro de Investigaci\u00f3n CITIC, Universidade da Coru\u00f1a, 15071 A Coru\u00f1a, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4991-6808","authenticated-orcid":false,"given":"Paula","family":"Fraga-Lamas","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Faculty of Computer Science, Universidade da Coru\u00f1a, 15071 A Coru\u00f1a, Spain"},{"name":"Centro de Investigaci\u00f3n CITIC, Universidade da Coru\u00f1a, 15071 A Coru\u00f1a, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Miguel","family":"A. Vilar-Montesinos","sequence":"additional","affiliation":[{"name":"Navantia S. A., Astillero de Ferrol, 15403 Ferrol, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2179-5917","authenticated-orcid":false,"given":"Tiago M.","family":"Fern\u00e1ndez-Caram\u00e9s","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Faculty of Computer Science, Universidade da Coru\u00f1a, 15071 A Coru\u00f1a, Spain"},{"name":"Centro de Investigaci\u00f3n CITIC, Universidade da Coru\u00f1a, 15071 A Coru\u00f1a, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Blanco-Novoa, O., Fern\u00e1ndez-Caram\u00e9s, T.M., Fraga-Lamas, P., and Castedo, L. (2017). An Electricity Price-Aware Open-Source Smart Socket for the Internet of Energy. Sensors, 17.","DOI":"10.3390\/s17030643"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Blanco-Novoa, O., Fern\u00e1ndez-Caram\u00e9s, T.M., Fraga-Lamas, P., and Castedo, L. (2018). A Cost-Effective IoT System for Monitoring Indoor Radon Gas Concentration. Sensors, 18.","DOI":"10.3390\/s18072198"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"129551","DOI":"10.1109\/ACCESS.2019.2932609","article-title":"Internet-of-Things (IoT)-Based Smart Agriculture: Toward Making the Fields Talk","volume":"7","author":"Ayaz","year":"2019","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Fern\u00e1ndez-Caram\u00e9s, T.M., Froiz-M\u00edguez, I., Blanco-Novoa, O., and Fraga-Lamas, P. (2019). Enabling the Internet of Mobile Crowdsourcing Health Things: A Mobile Fog Computing, Blockchain and IoT Based Continuous Glucose Monitoring System for Diabetes Mellitus Research and Care. Sensors, 19.","DOI":"10.3390\/s19153319"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"36611","DOI":"10.1109\/ACCESS.2018.2853148","article-title":"A Survey on the Roles of Communication Technologies in IoT-Based Personalized Healthcare Applications","volume":"6","author":"Alam","year":"2018","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Fraga-Lamas, P., Celaya-Echarri, M., Lopez-Iturri, P., Castedo, L., Azpilicueta, L., Aguirre, E., Su\u00e1rez-Albela, M., Falcone, F., and Fern\u00e1ndez-Caram\u00e9s, T.M. (2019). Design and Experimental Validation of a LoRaWAN Fog Computing Based Architecture for IoT Enabled Smart Campus Applications. Sensors, 19.","DOI":"10.3390\/s19153287"},{"key":"ref_7","unstructured":"(2020, April 19). HIS, Internet of Things (IoT) Connected Devices Installed Base Worldwide from 2015 to 2025. Available online: https:\/\/www.statista.com\/statistics\/471264\/iot-number-of-connected-devices-worldwide\/."},{"key":"ref_8","unstructured":"Sutherland, I.E. (1965, January 24\u201329). The Ultimate Display. Proceedings of the IFIP 65, New York, NY, USA."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sutherland, I.E. (1968, January 9\u201311). A head-mounted three dimensional display. Proceedings of the AFIPS 68, San Francisco, CA, USA.","DOI":"10.1145\/1476589.1476686"},{"key":"ref_10","unstructured":"Mizell, D.W. (1994, January 27\u201329). Virtual Reality and Augmented Reality in Aircraft Design and Manufacturing. Proceedings of the WESCON\/94, Anaheim, CA, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1162\/pres.1997.6.4.355","article-title":"A survey of augmented reality","volume":"6","author":"Azuma","year":"1997","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wohlgemuth, W., and Triebf\u00fcrst, G. (2000, January 12\u201314). ARVIKA: Augmented Reality for development, production and service. Proceedings of the DARE 2000, Elsinore, Denmark.","DOI":"10.1145\/354666.354688"},{"key":"ref_13","unstructured":"Friedrich, W. (2002, January 1). ARVIKA-Augmented Reality for Development, Production and Service. Proceedings of the International Symposium on Mixed and Augmented Reality, Darmstadt, Germany."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Fern\u00e1ndez-Caram\u00e9s, T.M., Blanco-Novoa, O., Froiz-M\u00edguez, I., and Fraga-Lamas, P. (2019). Towards an Autonomous Industry 4.0 Warehouse: A UAV and Blockchain-Based System for Inventory and Traceability Applications in Big Data-Driven Supply Chain Management. Sensors, 19.","DOI":"10.3390\/s19102394"},{"key":"ref_15","unstructured":"(2020, April 19). Open Source AR-IoT Framework Repository. Available online: https:\/\/github.com\/4m1g0\/IOT-AR-Framework."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1109\/MPRV.2015.44","article-title":"The mirror world: Preparing for mixed-reality living","volume":"14","author":"Ricci","year":"2015","journal-title":"IEEE Pervasive Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1109\/TVCG.2017.2745941","article-title":"The Hologram in My Hand: How Effective is Interactive Exploration of 3D Visualizations in Immersive Tangible Augmented Reality?","volume":"24","author":"Bach","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_18","first-page":"503","article-title":"Designing for Mobile and Immersive Visual Analytics in the Field","volume":"26","author":"Whitlock","year":"2020","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"60224","DOI":"10.1109\/ACCESS.2018.2875558","article-title":"A New Procedure for Advancing Telemedicine Using the HoloLens","volume":"6","author":"Sirilak","year":"2018","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/MCSE.2020.2971188","article-title":"Virtual and Augmented Reality Applications to support Data Analysis and Assessment of Science and Engineering","volume":"22","author":"Su","year":"2020","journal-title":"Comput. Sci. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MCG.2019.2957631","article-title":"Under Water to Outer Space: Augmented Reality for Astronauts and Beyond","volume":"40","author":"Nuernberger","year":"2020","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hern\u00e1ndez-Rojas, D., Fern\u00e1ndez-Caram\u00e9s, T.M., Fraga-Lamas, P., and Escudero, C.J. (2018). A Plug-and-Play Human-Centered Virtual TEDS Architecture for the Web of Things. Sensors, 18.","DOI":"10.3390\/s18072052"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Croatti, A., and Ricci, A. (2017, January 5\u20137). Towards the Web of Augmented Things. Proceedings of the 2017 IEEE International Conference on Software Architecture Workshops (ICSAW), Gothenburg, Sweden.","DOI":"10.1109\/ICSAW.2017.49"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Jo, D., and Kim, G.J. (2019). AR Enabled IoT for a Smart and Interactive Environment: A Survey and Future Directions. Sensors, 19.","DOI":"10.3390\/s19194330"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13673-018-0162-5","article-title":"IoT+AR: Pervasive and augmented environments for Digi-log shopping experience","volume":"9","author":"Jo","year":"2019","journal-title":"Hum.-Centric Comput. Inf. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Revetria, R., Tonelli, F., Damiani, L., Demartini, M., Bisio, F., and Peruzzo, N. (May, January 29). A Real-Time Mechanical Structures Monitoring System Based On Digital Twin, IoT and Augmented Reality. Proceedings of the 2019 Spring Simulation Conference (SpringSim), Tucson, AZ, USA.","DOI":"10.23919\/SpringSim.2019.8732917"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Baskaran, S., and Nagabushanam, H.K. (, January 17\u201319). Relational localization based Augmented reality Interface for IoT applications. Proceedings of the 2018 International Conference on Information and Communication Technology Convergence (ICTC), Jeju, Korea.","DOI":"10.1109\/ICTC.2018.8539469"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1109\/TCE.2016.7613201","article-title":"ARIoT: Scalable augmented reality framework for interacting with Internet of Things appliances everywhere","volume":"62","author":"Jo","year":"2016","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lee, S., Lee, G., Choi, G., Roh, B., and Kang, J. (2019, January 11\u201313). Integration of OneM2M-based IoT Service Platform and Mixed Reality Device. Proceedings of the 2019 IEEE Internet Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.","DOI":"10.1109\/ICCE.2019.8662008"},{"key":"ref_30","unstructured":"(2020, April 19). Microsoft HoloLens Official Webpage. Available online: www.hololens.com."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wu, J., Chou, D., and Jiang, J. (2014, January 1\u20133). The Virtual Environment of Things (VEoT): A Framework for Integrating Smart Things into Networked Virtual Environments. Proceedings of the 2014 IEEE International Conference on Internet of Things (iThings), and Green Computing and Communications (GreenCom), IEEE and Cyber, Physical and Social Computing(CPSCom), Taipei, Taiwan.","DOI":"10.1109\/iThings.2014.81"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Koutitas, G., Jabez, J., Grohman, C., Radhakrishna, C., Siddaraju, V., and Jadon, S. (2018, January 15\u201319). Demo\/poster abstract: XReality research lab \u2014 Augmented reality meets Internet of Things. Proceedings of the IEEE INFOCOM 2018, IEEE Conference on Computer Communications Workshops, Honolulu, HI, USA.","DOI":"10.1109\/INFCOMW.2018.8406848"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Jaafreh, M.A., Aloqaily, M., Ridhawi, I.A., and Mostafa, N. (2018, January 23\u201326). A hybrid-based 3D streaming framework for mobile devices over IoT environments. Proceedings of the 2018 Third International Conference on Fog and Mobile Edge Computing (FMEC), Barcelona, Spain.","DOI":"10.1109\/FMEC.2018.8364067"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Loch, F., Quint, F., and Brishtel, I. (2016, January 14\u201316). Comparing Video and Augmented Reality Assistance in Manual Assembly. Proceedings of the 2016 12th International Conference on Intelligent Environments (IE), London, UK.","DOI":"10.1109\/IE.2016.31"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1061\/(ASCE)CP.1943-5487.0000184","article-title":"Using Animated Augmented Reality to Cognitively Guide Assembly","volume":"27","author":"Hou","year":"2013","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hynes, E., Flynn, R., Lee, B., and Murray, N. (2019, January 27\u201329). A Quality of Experience Evaluation Comparing Augmented Reality and Paper Based Instruction for Complex Task Assistance. Proceedings of the 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP), Kuala Lumpur, Malaysia.","DOI":"10.1109\/MMSP.2019.8901705"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Engelke, U., Nguyen, H., and Ketchell, S. (June, January 31). Quality of augmented reality experience: A correlation analysis. Proceedings of the 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), Erfurt, Germany.","DOI":"10.1109\/QoMEX.2017.7965638"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Keighrey, C., Flynn, R., Murray, S., Brennan, S., and Murray, N. (2017, January 23\u201327). Comparing user QoE via physiological and interaction measurements of immersive AR and VR speech language therapy applications. Proceedings of the 25th ACM International Conference Multimed. ACM MM 2017, Mountain View, CA, USA.","DOI":"10.1145\/3126686.3126747"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"8201","DOI":"10.1109\/ACCESS.2018.2802699","article-title":"A Practical Evaluation of Commercial Industrial Augmented Reality Systems in an Industry 4.0 Shipyard","volume":"6","year":"2018","journal-title":"IEEE Access"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Fern\u00e1ndez-Caram\u00e9s, T.M., Fraga-Lamas, P., Su\u00e1rez-Albela, M., and Vilar-Montesinos, M. (2018). A Fog Computing and Cloudlet Based Augmented Reality System for the Industry 4.0 Shipyard. Sensors, 18.","DOI":"10.3390\/s18061798"},{"key":"ref_41","unstructured":"(2020, June 11). The Tactile Internet. Available online: https:\/\/www.itu.int\/dms_pub\/itu-t\/opb\/gen\/T-GEN-TWATCH-2014-1-PDF-E.pdf."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Su\u00e1rez-Albela, M., Fraga-Lamas, P., and Fern\u00e1ndez-Caram\u00e9s, T.M. (2018). A Practical Evaluation on RSA and ECC-Based Cipher Suites for IoT High-Security Energy-Efficient Fog and Mist Computing Devices. Sensors, 18.","DOI":"10.3390\/s18113868"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Hern\u00e1ndez-Rojas, D., Fern\u00e1ndez-Caram\u00e9s, T.M., Fraga-Lamas, P., and Escudero, C.J. (2018). Design and Practical Evaluation of a Family of Lightweight Protocols for Heterogeneous Sensing through BLE Beacons in IoT Telemetry Applications. Sensors, 18.","DOI":"10.3390\/s18010057"},{"key":"ref_44","unstructured":"(2020, April 19). MQTT v5.0 Now an Official OASIS Standard. Available online: http:\/\/mqtt.org\/2019\/04\/mqtt-v5-0-now-an-official-oasis-standard."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"13358","DOI":"10.1109\/ACCESS.2018.2808326","article-title":"A Review on Industrial Augmented Reality Systems for the Industry 4.0 Shipyard","volume":"6","year":"2018","journal-title":"IEEE Access"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Rokhsaritalemi, S., Sadeghi-Niaraki, A., and Choi, S.M. (2019). A Review on Mixed Reality: Current Trends, Challenges and Prospects. Appl. Sci., 10.","DOI":"10.3390\/app10020636"},{"key":"ref_47","unstructured":"(2020, April 19). Node-RED Official Webpage. Available online: https:\/\/nodered.org."},{"key":"ref_48","unstructured":"(2020, April 19). Mosquitto Official Webpage. Available online: https:\/\/mosquitto.org."},{"key":"ref_49","unstructured":"(2020, April 19). Node.js Official Webpage. Available online: https:\/\/nodejs.org."},{"key":"ref_50","unstructured":"(2020, April 19). Itead Studio Official Webpage. Available online: https:\/\/www.itead.cc\/sonoff-pow.html."},{"key":"ref_51","unstructured":"(2020, April 19). Tasmota GitHub Webpage. Available online: https:\/\/github.com\/arendst\/Tasmota."},{"key":"ref_52","unstructured":"Red El\u00e9ctrica de Espa\u00f1a (REE) (2020, April 19). Sistema de informaci\u00f3n del operador del sistema (ESIOS). Available online: https:\/\/www.esios.ree.es."},{"key":"ref_53","first-page":"2883","article-title":"Gaming in the clouds: QoE and the users\u2019 perspective","volume":"57","author":"Jarschel","year":"2013","journal-title":"Math. Comput."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/11\/3328\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:37:54Z","timestamp":1760175474000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/11\/3328"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,11]]},"references-count":53,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["s20113328"],"URL":"https:\/\/doi.org\/10.3390\/s20113328","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,11]]}}}