{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T04:55:57Z","timestamp":1773809757762,"version":"3.50.1"},"reference-count":53,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2018,1,2]],"date-time":"2018-01-02T00:00:00Z","timestamp":1514851200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Tracking the 6DoF pose of arbitrary 3D objects is a fundamental topic in Augmented Reality (AR) research, having received a large amount of interest in the last decades. The necessity of accurate and computationally efficient object tracking is evident for a broad base of today\u2019s AR applications. In this work we present a fully comprehensive pipeline for 6DoF Object Tracking based on 3D scans of objects, covering object registration, initialization and frame to frame tracking, implemented to optimize the user experience and to perform well in all typical challenging conditions such as fast motion, occlusions and illumination changes. Furthermore, we present the deployment of our tracking system in a Remote Live Support AR application with 3D object-aware registration of annotations and remote execution for delay and performance optimization. Experimental results demonstrate the tracking quality, real-time capability and the advantages of remote execution for computationally less powerful mobile devices.<\/jats:p>","DOI":"10.3390\/computers7010006","type":"journal-article","created":{"date-parts":[[2018,1,3]],"date-time":"2018-01-03T12:00:06Z","timestamp":1514980806000},"page":"6","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":48,"title":["6DoF Object Tracking based on 3D Scans for Augmented Reality Remote Live Support"],"prefix":"10.3390","volume":"7","author":[{"given":"Jason","family":"Rambach","sequence":"first","affiliation":[{"name":"German Research Center for Artificial Intelligence (DFKI), Augmented Vision Department, 67663 Kaiserslautern, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alain","family":"Pagani","sequence":"additional","affiliation":[{"name":"German Research Center for Artificial Intelligence (DFKI), Augmented Vision Department, 67663 Kaiserslautern, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Schneider","sequence":"additional","affiliation":[{"name":"Bosch Rexroth AG, Research and Development, 97816 Lohr am Main, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Oleksandr","family":"Artemenko","sequence":"additional","affiliation":[{"name":"Robert Bosch GmbH, Corporate Research Department, 71272 Renningen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Didier","family":"Stricker","sequence":"additional","affiliation":[{"name":"German Research Center for Artificial Intelligence (DFKI), Augmented Vision Department, 67663 Kaiserslautern, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,1,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Barfield, W. (2015). Fundamentals of Wearable Computers and Augmented Reality, CRC Press.","DOI":"10.1201\/b18703"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Schneider, M., Rambach, J., and Stricker, D. (2017, January 22\u201325). Augmented reality based on edge computing using the example of remote live support. Proceedings of the 2017 IEEE International Conference on Industrial Technology (ICIT), Toronto, ON, Canada.","DOI":"10.1109\/ICIT.2017.7915547"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Dunleavy, M., and Dede, C. (2014). Augmented reality teaching and learning. Handbook of Research on Educational Communications and Technology, Springer.","DOI":"10.1007\/978-1-4614-3185-5_59"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chen, L., Day, T., Tang, W., and John, N.W. (arXiv, 2017). Recent Developments and Future Challenges in Medical Mixed Reality, arXiv.","DOI":"10.1109\/ISMAR.2017.29"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Von Itzstein, G.S., Billinghurst, M., Smith, R.T., and Thomas, B.H. (2017). Augmented Reality Entertainment: Taking Gaming Out of the Box. Encyclopedia of Computer Graphics and Games, Springer.","DOI":"10.1007\/978-3-319-08234-9_81-1"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1561\/1100000049","article-title":"A survey of augmented reality","volume":"8","author":"Billinghurst","year":"2015","journal-title":"Found. Trends Hum. Comput. Interact."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Weigel, J., Viller, S., and Schulz, M. (2014, January 10\u201312). Designing support for collaboration around physical artefacts: Using augmented reality in learning environments. Proceedings of the 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Munich, Germany.","DOI":"10.1109\/ISMAR.2014.6948507"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rambach, J., Pagani, A., and Stricker, D. (2017, January 9\u201313). [POSTER] Augmented Things: Enhancing AR Applications leveraging the Internet of Things and Universal 3D Object Tracking. Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), Nantes, France.","DOI":"10.1109\/ISMAR-Adjunct.2017.42"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rambach, J., Pagani, A., Lampe, S., Reiser, R., Pancholi, M., and Stricker, D. (2017, January 9\u201313). [POSTER] Fusion of Unsynchronized Optical Tracker and Inertial Sensor in EKF Framework for In-car Augmented Reality Delay Reduction. Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), Nantes, France.","DOI":"10.1109\/ISMAR-Adjunct.2017.43"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2633","DOI":"10.1109\/TVCG.2015.2513408","article-title":"Pose estimation for augmented reality: A hands-on survey","volume":"22","author":"Marchand","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_11","unstructured":"Pagani, A., Koehler, J., and Stricker, D. (2011, January 13\u201315). Circular markers for camera pose estimation. Proceedings of the WIAMIS 2011: 12th International Workshop on Image Analysis for Multimedia Interactive Services, Delft, The Netherlands."},{"key":"ref_12","unstructured":"Pagani, A. (2014). Reality Models for Efficient Registration in Augmented Reality, Verlag Dr. Hut."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1109\/TPAMI.2007.1049","article-title":"MonoSLAM: Real-time single camera SLAM","volume":"29","author":"Davison","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1186\/s41074-017-0027-2","article-title":"Visual SLAM algorithms: A survey from 2010 to 2016","volume":"9","author":"Taketomi","year":"2017","journal-title":"IPSJ Trans. Comput. Vis. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Klein, G., and Murray, D. (2007, January 13\u201316). Parallel tracking and mapping for small AR workspaces. Proceedings of the 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, 2007, ISMAR 2007, Nara, Japan.","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A versatile and accurate monocular SLAM system","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"932","DOI":"10.1109\/TPAMI.2002.1017620","article-title":"Real-time visual tracking of complex structures","volume":"24","author":"Drummond","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wuest, H., Vial, F., and Stricker, D. (2005, January 5\u20138). Adaptive line tracking with multiple hypotheses for augmented reality. Proceedings of the 4th IEEE\/ACM International Symposium on Mixed and Augmented Reality, Vienna, Austria.","DOI":"10.1109\/ISMAR.2005.8"},{"key":"ref_19","unstructured":"Vacchetti, L., Lepetit, V., and Fua, P. (2004, January 2\u20135). Combining edge and texture information for real-time accurate 3D camera tracking. Proceedings of the 3rd IEEE\/ACM International Symposium on Mixed and Augmented Reality, Arlington, VA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Petit, A., Marchand, E., and Kanani, K. (2012, January 7\u201312). Tracking complex targets for space rendezvous and debris removal applications. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal.","DOI":"10.1109\/IROS.2012.6386083"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Petit, A., Marchand, E., and Kanani, K. (2013, January 1\u20134). Augmenting markerless complex 3D objects by combining geometrical and color edge information. Proceedings of the 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Adelaide, Australia.","DOI":"10.1109\/ISMAR.2013.6671808"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1109\/TVCG.2013.94","article-title":"Optimal local searching for fast and robust textureless 3D object tracking in highly cluttered backgrounds","volume":"20","author":"Seo","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Seo, B.K., and Wuest, H. (2016). A Direct Method for Robust Model-Based 3D Object Tracking from a Monocular RGB Image. Computer Vision\u2013ECCV 2016 Workshops, Springer.","DOI":"10.1007\/978-3-319-49409-8_48"},{"key":"ref_24","unstructured":"Vuforia (2018, January 01). Augmented Reality. Available online: https:\/\/www.vuforia.com\/."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Besbes, B., Collette, S.N., Tamaazousti, M., Bourgeois, S., and Gay-Bellile, V. (2012, January 5\u20138). An Interactive Augmented Reality System: A Prototype for Industrial Maintenance Training Applications. Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Atlanta, GA, USA.","DOI":"10.1109\/ISMAR.2012.6402568"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Javornik, A. (2014, January 10\u201312). Classifications of augmented reality uses in marketing. Proceedings of the IEEE International Symposium on Mixed and Augmented Realities 2014, Munich, Germany.","DOI":"10.1109\/ISMAR-AMH.2014.6935441"},{"key":"ref_27","first-page":"699","article-title":"Augmented Reality System for Virtual Training of Parts Assembly","volume":"Volume 100","author":"Horejsi","year":"2015","journal-title":"Proceedings of the 25th DAAAM International Symposium on Intelligent Manufacturing and Automation"},{"key":"ref_28","unstructured":"(2018, January 01). Remote Live Support from Scope AR. Available online: www.scopear.com\/products\/remote-ar\/."},{"key":"ref_29","unstructured":"(2018, January 01). Augmented Repair App: To Repair a Coffee Machine without a User Manual in Minutes. Available online: www.re-flekt.com\/reflekt-remote\/."},{"key":"ref_30","unstructured":"(2018, January 01). Oculavis\u2014The Remote Process Platform. Available online: www.oculavis.de\/."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MC.2015.12","article-title":"Enabling the Internet of Things","volume":"48","author":"Want","year":"2015","journal-title":"IEEE Comput."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Aleksy, M., Vartiainen, E., Domova, V., and Naedele, M. (2014, January 13\u201316). Augmented Reality for Improved Service Delivery. Proceedings of the 2014 IEEE 28th International Conference on Advanced Information Networking and Applications (AINA), Victoria, BC, Canada.","DOI":"10.1109\/AINA.2014.146"},{"key":"ref_33","first-page":"292","article-title":"Comprehensive study of transmission techniques for reducing packet loss and delay in multimedia over ip","volume":"8","author":"Ngatman","year":"2008","journal-title":"Int. J. Comput. Sci. Netw. Secur."},{"key":"ref_34","first-page":"156","article-title":"Remote execution vs. simplification for mobile real-time computer vision","volume":"Volume 3","author":"Hasper","year":"2014","journal-title":"Proceedings of the 2014 International Conference on Computer Vision Theory and Applications (VISAPP)"},{"key":"ref_35","unstructured":"Melnyk, S., Tesfay, A., Schotten, H., Rambach, J., Stricker, D., Petri, M., Ehrig, M., Augustin, T., Franchi, N., and Fettweis, G. (2017). Next Generation Industrial Radio LAN for Tactile and Safety Applications. VDE\/ITG Fachtagung Mobilkommunikation, 22. May 9\u201310, Osnabrueck, Niedersachsen, Germany, VDE\/ITG."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1162\/pres.1997.6.4.355","article-title":"A Survey of Augmented Reality","volume":"Volume 6","author":"Azuma","year":"1997","journal-title":"Presence: Teleoperators and Virtual Environments"},{"key":"ref_37","unstructured":"Weckbrodt, H. (2018, January 01). Druckerei-Techniker Bekommen Augengesteuerte Datenbrillen. Available online: http:\/\/oiger.de\/2015\/10\/01\/druckerei-techniker-bekommen-augengesteuerte-datenbrillen\/155815."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, J., Feng, Y., Zeng, C., and Li, S. (2014, January 18\u201322). An augmented reality based system for remote collaborative maintenance instruction of complex products. Proceedings of the 2014 IEEE International Conference on Automation Science and Engineering (CASE), Taipei, Taiwan.","DOI":"10.1109\/CoASE.2014.6899343"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1296","DOI":"10.1016\/j.promfg.2017.07.257","article-title":"Supporting Remote Maintenance in Industry 4.0 through Augmented Reality","volume":"11","author":"Masoni","year":"2017","journal-title":"Procedia Manuf."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Limbu, B., Fominykh, M., Klemke, R., Specht, M., and Wild, F. (2018). Supporting training of expertise with wearable technologies: The WEKIT reference framework. Mobile and Ubiquitous Learning, Springer.","DOI":"10.1007\/978-981-10-6144-8_10"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Koehler, J., Noell, T., Reis, G., and Stricker, D. (2013, January 15\u201317). A full-spherical device for simultaneous geometry and reflectance acquisition. Proceedings of the 2013 IEEE Workshop on Applications of Computer Vision (WACV), Tampa, FL, USA.","DOI":"10.1109\/WACV.2013.6475040"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.optlaseng.2005.11.002","article-title":"Efficient iterative algorithm for phase-shifting interferometry","volume":"45","author":"Guo","year":"2007","journal-title":"Opt. Lasers Eng."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/BF01427149","article-title":"Iterative point matching for registration of free-form curves and surfaces","volume":"13","author":"Zhang","year":"1994","journal-title":"Int. J. Comput. Vis."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Noell, T., Koehler, J., Reis, G., and Stricker, D. (2012, January 3\u20135). High Quality and Memory Efficient Representation for Image Based 3D Reconstructions. Proceedings of the 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA), Fremantle, Australia.","DOI":"10.1109\/DICTA.2012.6411688"},{"key":"ref_45","unstructured":"Shi, J., and Tomasi, C. (1994, January 21\u201323). Good features to track. Proceedings of the 1994 IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA."},{"key":"ref_46","unstructured":"N\u00f6ll, T., Pagani, A., and Stricker, D. (2018, January 01). Markerless Camera Pose Estimation\u2014An Overview. Available online: http:\/\/drops.dagstuhl.de\/opus\/volltexte\/2011\/3096\/pdf\/7.pdf."},{"key":"ref_47","unstructured":"Lucas, B., and Kanade, T. (1981, January 24\u201328). An Iterative Image Registration Technique with an Application to Stereo Vision. Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), Vancouver, BC, Canada."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1150","DOI":"10.1109\/ICCV.1999.790410","article-title":"Object recognition from local scale-invariant features","volume":"Volume 2","author":"Lowe","year":"1999","journal-title":"Proceedings of the Seventh IEEE International Conference on Computer Vision"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.procir.2015.08.026","article-title":"Industrial big data analytics and cyber-physical systems for future maintenance & service innovation","volume":"38","author":"Lee","year":"2015","journal-title":"Procedia CIRP"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.future.2012.05.023","article-title":"Mobile cloud computing: A survey","volume":"29","author":"Fernando","year":"2013","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_52","unstructured":"Pasman, W., and Jansen, F.W. (2001, January 29\u201330). Distributed Low-latency Rendering for Mobile AR. Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR 2001), New York, NY, USA."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/38.799723","article-title":"What\u2019s Real About Virtual Reality?","volume":"19","author":"Brooks","year":"1999","journal-title":"IEEE Comput. Graph. Appl."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/7\/1\/6\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:49:52Z","timestamp":1760194192000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/7\/1\/6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1,2]]},"references-count":53,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,3]]}},"alternative-id":["computers7010006"],"URL":"https:\/\/doi.org\/10.3390\/computers7010006","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,1,2]]}}}