{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T14:34:50Z","timestamp":1781879690954,"version":"3.54.5"},"reference-count":56,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,6,27]],"date-time":"2023-06-27T00:00:00Z","timestamp":1687824000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>While Industrial Augmented Reality (IAR) has many applications across the whole product lifecycle, most IAR applications today are custom-built for specific use-cases in practice. This contribution builds upon a scoping literature review of IAR data representations to present a modern, modular IAR architecture. The individual modules of the presented approach are either responsible for user interface and user interaction or for data processing. They are use-case neutral and independent of each other, while communicating through a strictly separated application layer. To demonstrate the architecture, this contribution presents an assembly process that is supported once with a pick-to-light system and once using in situ projections. Both are implemented on top of the novel architecture, allowing most of the work on the individual models to be reused. This IAR architecture, based on clearly separated modules with defined interfaces, particularly allows small companies with limited personnel resources to adapt IAR for their specific use-cases more easily than developing single-use applications from scratch.<\/jats:p>","DOI":"10.3390\/mti7070065","type":"journal-article","created":{"date-parts":[[2023,6,27]],"date-time":"2023-06-27T02:11:22Z","timestamp":1687831882000},"page":"65","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Towards Universal Industrial Augmented Reality: Implementing a Modular IAR System to Support Assembly Processes"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3266-7526","authenticated-orcid":false,"given":"Detlef","family":"Gerhard","sequence":"first","affiliation":[{"name":"Digital Engineering Chair, Ruhr University Bochum, 44801 Bochum, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3424-3620","authenticated-orcid":false,"given":"Matthias","family":"Neges","sequence":"additional","affiliation":[{"name":"Digital Engineering Chair, Ruhr University Bochum, 44801 Bochum, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1115-7594","authenticated-orcid":false,"given":"Jan Luca","family":"Siewert","sequence":"additional","affiliation":[{"name":"Digital Engineering Chair, Ruhr University Bochum, 44801 Bochum, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0628-7570","authenticated-orcid":false,"given":"Mario","family":"Wolf","sequence":"additional","affiliation":[{"name":"Digital Engineering Chair, Ruhr University Bochum, 44801 Bochum, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fite-Georgel, P. (2011, January 26\u201329). Is there a reality in Industrial Augmented Reality?. Proceedings of the International Symposium on Mixed and Augmented Reality, Basel, Switzerland.","DOI":"10.1109\/ISMAR.2011.6092387"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s40436-015-0131-4","article-title":"A comprehensive survey of augmented reality assembly research","volume":"4","author":"Wang","year":"2016","journal-title":"Adv. Manuf."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.compind.2018.08.007","article-title":"A systematic review of Augmented Reality content-related techniques for knowledge transfer in maintenance applications","volume":"103","author":"Erkoyuncu","year":"2018","journal-title":"Comput. Ind."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.procir.2020.01.137","article-title":"Classification of industrial Augmented Reality use cases","volume":"91","author":"Dumitrescu","year":"2020","journal-title":"Procedia CIRP"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ludwig, B. (2015). Planbasierte Mensch-Maschine-Interaktion in multimodalen Assistenzsystemen, Springer.","DOI":"10.1007\/978-3-662-44819-9"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Funk, M., B\u00e4chler, A., B\u00e4chler, L., Kosch, T., Heidenreich, T., and Schmidt, A. (2017, January 21\u201323). Working with Augmented Reality?. Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments, Rhodes, Greece.","DOI":"10.1145\/3056540.3056548"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/978-3-030-31908-3_10","article-title":"Evaluating added value of Augmented Reality to assist aeronautical Maintenance Workers\u2014Experimentation on On-field Use Case","volume":"Volume 11883","author":"Bourdot","year":"2019","journal-title":"Virtual Reality and Augmented Reality. EuroVR 2019"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"103112","DOI":"10.1016\/j.compind.2019.07.002","article-title":"Adopting augmented reality in the age of industrial digitalisation","volume":"115","author":"Masood","year":"2020","journal-title":"Comput. Ind."},{"key":"ref_9","unstructured":"Bosch, T., van Rhijn, G., Krause, F., K\u00f6nemann, R., Wilschut, E.S., and de Looze, M. (July, January 30). Spatial augmented reality. Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments, Corfu, Greece."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.rcim.2017.06.002","article-title":"A Systematic Review of Augmented Reality applications in Maintenance","volume":"49","author":"Palmarini","year":"2018","journal-title":"Robot. -Comput.-Integr. Manuf."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103229","DOI":"10.1016\/j.compind.2020.103229","article-title":"A systematic design method of adaptive augmented reality work instruction for complex industrial operations","volume":"119","author":"Geng","year":"2020","journal-title":"Comput. Ind."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Huang, G., Qian, X., Wang, T., Patel, F., Sreeram, M., Cao, Y., Ramani, K., and Quinn, A.J. (2021, January 8\u201313). AdapTutAR: An adaptive tutoring system for machine tasks in Augmented Reality. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445283"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Siewert, J.L., Neges, M., and Gerhard, D. (2021). Ein Klassifizierungssystem f\u00fcr Industrielle Augmented Reality Anwendungen, TUDpress.","DOI":"10.25368\/2021.37"},{"key":"ref_14","unstructured":"Siewert, J.L., Wolf, M., B\u00f6hm, B., and Thienhaus, S. (2020). Cross Reality and Data Science in Engineering, Springer."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"B\u00fcttner, S., Prilla, M., and R\u00f6cker, C. (2020, January 25\u201330). Augmented Reality Training for Industrial Assembly Work - Are Projection-based AR Assistive Systems an Appropriate Tool for Assembly Training?. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3313831.3376720"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"061011","DOI":"10.1115\/1.4035721","article-title":"Cloud-Based Augmented Reality Remote Maintenance Through Shop-Floor Monitoring: A Product-Service System Approach","volume":"139","author":"Mourtzis","year":"2017","journal-title":"J. Manuf. Sci. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1007\/978-3-030-58468-9_21","article-title":"AugmenTech: The usability evaluation of an AR system for maintenance in industry","volume":"Volume 12243","author":"Brice","year":"2020","journal-title":"Augmented Reality, Virtual Reality and Computer Graphics. AVR 2020"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Siewert, J.L., Vogt, O., Wolf, M., Gerhard, D., and B\u00fckr\u00fc, S.F. (2023). Implementation of the Asset Administration Shell Concept to Industrial Augmented Reality Applications, Springer.","DOI":"10.1007\/978-3-031-24457-5_21"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"No\u00ebl, F., Nyffenegger, F., Rivest, L., and Bouras, A. (2023). Product Lifecycle Management. PLM in Transition Times: The Place of Humans and Transformative Technologies, Springer Nature.","DOI":"10.1007\/978-3-031-25182-5"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3618","DOI":"10.1016\/j.procs.2020.09.024","article-title":"The Production Quality Control Process, Enhanced with Augmented Reality Glasses and the New Generation Computing Support System","volume":"176","author":"Szajna","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Schwerdtfeger, B., Pustka, D., Hofhauser, A., and Klinker, G. (2008, January 27\u201329). Using Laser Projectors for Augmented Reality. Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology, VRST \u201908, Bordeaux, France.","DOI":"10.1145\/1450579.1450608"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/j.procs.2015.12.250","article-title":"Augmented Reality as a Tool for Production and Quality Monitoring","volume":"75","author":"Segovia","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Coscetti, S., Moroni, D., Pieri, G., and Tampucci, M. (2020, January 7\u20139). Factory maintenance application using Augmented Reality. Proceedings of the 3rd International Conference on Applications of Intelligent Systems, Las Palmas de Gran Canaria, Spain.","DOI":"10.1145\/3378184.3378218"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Vogel, C., Schulenburg, E., and Elkmann, N. (2020, January 8\u201311). Projective- AR Assistance System for shared Human-Robot Workplaces in Industrial Applications. Proceedings of the 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Vienna, Austria.","DOI":"10.1109\/ETFA46521.2020.9211953"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Pentenrieder, K., Bade, C., Doil, F., and Meier, P. (2007, January 13\u201316). Augmented Reality-based factory planning\u2014An application tailored to industrial needs. Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan.","DOI":"10.1109\/ISMAR.2007.4538822"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1112","DOI":"10.1016\/j.procir.2018.03.200","article-title":"Immersive modular factory layout planning using Augmented Reality","volume":"72","author":"Herr","year":"2018","journal-title":"Procedia CIRP"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Stadler, S., Kain, K., Giuliani, M., Mirnig, N., Stollnberger, G., and Tscheligi, M. (2016, January 26\u201331). Augmented reality for industrial robot programmers: Workload analysis for task-based, augmented reality-supported robot control. Proceedings of the 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, NY, USA.","DOI":"10.1109\/ROMAN.2016.7745108"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"101820","DOI":"10.1016\/j.rcim.2019.101820","article-title":"Augmented reality-assisted robot programming system for industrial applications","volume":"61","author":"Ong","year":"2020","journal-title":"Robot. Comput.-Integr. Manuf."},{"key":"ref_29","unstructured":"MacWilliams, A., Reicher, T., Klinker, G., and Bruegge, B. (2004, January 13). Design Patterns for Augmented Reality Systems. Proceedings of the International Workshop Exploring the Design and Engineering of Mixed Reality Systems (MIXER), Funchal, Portugal."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Djordjevic, L., Petrovic, N., and Tosic, M. (2019, January 26\u201327). Ontology based approach to development of augmented reality applications. Proceedings of the 2019 27th Telecommunications Forum (TELFOR), Belgrade, Serbia.","DOI":"10.1109\/TELFOR48224.2019.8971208"},{"key":"ref_31","first-page":"1334","article-title":"Achieving adaptive Augmented Reality through ontological context-awareness applied to AAL scenarios","volume":"19","author":"Hervas","year":"2013","journal-title":"J. Univers. Comput. Sci."},{"key":"ref_32","unstructured":"Correia, N., Jorge, J., Chambel, T., and Pan, Z. (2004, January 27\u201328). A component-based authoring environment for creating multimedia-rich Mixed Reality. Proceedings of the EUROGRAPHICS Workshop on Multimedia, Ninjing, China."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Kuster, T., Masuch, N., Fahndrich, J., Tschirner-Vinke, G., Taschner, J., Specker, M., Iben, H., Baumann, H., Schmid, F., and Stocklein, J. (2019, January 22\u201325). A distributed architecture for modular and dynamic Augmented Reality processes. Proceedings of the 2019 IEEE 17th International Conference on Industrial Informatics (INDIN), Helsinki, Finland.","DOI":"10.1109\/INDIN41052.2019.8972101"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"von Leipzig, K., Sacks, N., and Mc Clelland, M. (2023). Smart, Sustainable Manufacturing in an Ever-Changing World, Springer International Publishing.","DOI":"10.1007\/978-3-031-15602-1"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1162\/pres.1997.6.4.355","article-title":"A survey of augmented reality","volume":"6","author":"Azuma","year":"1997","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Lechner, M. (2013, January 17). ARML 2.0 in the context of existing AR data formats. Proceedings of the 2013 6th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), Orlando, FL, USA.","DOI":"10.1109\/SEARIS.2013.6798107"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1097\/XEB.0000000000000050","article-title":"Guidance for conducting systematic scoping reviews","volume":"13","author":"Peters","year":"2015","journal-title":"Int. J. Evid.-Based Healthc."},{"key":"ref_38","first-page":"412","article-title":"A Taxonomy of Augmented Reality Annotations","volume":"Volume 1","author":"Bouatouch","year":"2020","journal-title":"Proceedings of the 15Th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1443","DOI":"10.1109\/TVCG.2020.3014614","article-title":"What, How and Why are visual assets used in Industrial Augmented Reality? A systematic review and classification in maintenance, assembly and training (from 1997 to 2019)","volume":"28","author":"Gattullo","year":"2022","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Li, W., Nee, A., and Ong, S. (2017). A state-of-the-art review of augmented reality in engineering analysis and simulation. Multimodal Technol. Interact., 1.","DOI":"10.3390\/mti1030017"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1007\/978-3-319-40621-3_26","article-title":"A Taxonomy for Information Linking in Augmented Reality","volume":"Volume 9768","author":"DePaolis","year":"2016","journal-title":"Augmented Reality, Virtual Reality and Computer Graphics, Pt I"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Phaijit, O., Obaid, M., Sammut, C., and Johal, W. (2022, January 7\u201310). A Taxonomy of Functional Augmented Reality for Human-Robot Interaction. Proceedings of the 2022 17th ACM\/IEEE International Conference on Human-Robot Interaction (HRI \u201822), Sapporo, Japan.","DOI":"10.1109\/HRI53351.2022.9889622"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1007\/s40684-022-00444-w","article-title":"Systematic Literature Review on Augmented Reality-Based Maintenance Applications in Manufacturing Centered on Operator Needs","volume":"10","author":"Runji","year":"2023","journal-title":"Int. J. Precis. Eng.-Manuf.-Green Technol."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Suzuki, R., Karim, A., Xia, T., Hedayati, H., and Marquardt, N. (May, January 29). Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces. Proceedings of the 2022 Chi Conference on Human Factors in Computing Systems (CHI\u2019 22), New Orleans, LA, USA.","DOI":"10.1145\/3491102.3517719"},{"key":"ref_45","first-page":"329","article-title":"Multimodal Augmented Reality and Subtle Guidance for Industrial Assembly\u2014A Survey and Ideation Method","volume":"Volume 13318","author":"Chen","year":"2022","journal-title":"Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry, Pt Ii, Proceedings of the 14th International Conference, VAMR 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Virtual Event, 26 June\u2013 1 July 2022"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1016\/j.cag.2013.09.002","article-title":"Representing information\u2014Classifying the Augmented Reality presentation space","volume":"37","author":"Plecher","year":"2013","journal-title":"Comput. Graph."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2166","DOI":"10.1109\/TVCG.2022.3141585","article-title":"Analytic Review of Using Augmented Reality for Situational Awareness","volume":"29","author":"Woodward","year":"2023","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"3808","DOI":"10.1109\/TVCG.2020.2986247","article-title":"Visualization Techniques in Augmented Reality: A Taxonomy, Methods and Patterns","volume":"27","author":"Zollmann","year":"2021","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Keil, J., Schmitt, F., Engelke, T., Graf, H., and Olbrich, M. (2018). Augmented Reality Views: Discussing the Utility of Visual Elements by Mediation Means in Industrial AR from a Design Perspective, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-319-91584-5_24"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"71","DOI":"10.3934\/ElectrEng.2019.1.71","article-title":"Challenges in representing information with augmented reality to support manual procedural tasks","volume":"3","year":"2019","journal-title":"Aims Electron. Electr. Eng."},{"key":"ref_51","unstructured":"T\u00f6nnis, M., and Plecher, D.A. (2011). Presentation Principles in Augmented Reality Classification and Categorization Guidelines, Technische Universit\u00e4t M\u00fcnchen. Technical Report TUM-I111."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1016\/j.cag.2009.06.001","article-title":"Annotation in outdoor augmented reality","volume":"33","author":"Wither","year":"2009","journal-title":"Comput. Graph."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Wang, J., Feng, Y., Zeng, C., and Li, S. (2014, January 18\u201322). An augmented reality based system for remote collaborative maintenance instruction of complex products. Proceedings of the 2014 IEEE International Conference on Automation Science and Engineering (CASE), New Taipei, Taiwan.","DOI":"10.1109\/CoASE.2014.6899343"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.compind.2018.02.001","article-title":"Converting maintenance actions into standard symbols for Augmented Reality applications in Industry 4.0","volume":"98","author":"Scurati","year":"2018","journal-title":"Comput. Ind."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Rolim, C., Schmalstieg, D., Kalkofen, D., and Teichrieb, V. (October, January 29). [POSTER] Design Guidelines for Generating Augmented Reality Instructions. Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, Fukuoka, Japan.","DOI":"10.1109\/ISMAR.2015.36"},{"key":"ref_56","unstructured":"OASIS Open (2023, June 26). MQTT Version 5.0. OASIS Standard. Available online: https:\/\/docs.oasis-open.org\/mqtt\/mqtt\/v5.0\/mqtt-v5.0.html."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/7\/7\/65\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:01:31Z","timestamp":1760126491000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/7\/7\/65"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,27]]},"references-count":56,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["mti7070065"],"URL":"https:\/\/doi.org\/10.3390\/mti7070065","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,27]]}}}