{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T15:12:24Z","timestamp":1761491544195,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,3,14]],"date-time":"2023-03-14T00:00:00Z","timestamp":1678752000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["2018YFC1800203","KM201811232010"],"award-info":[{"award-number":["2018YFC1800203","KM201811232010"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"The Scientific Research Project of Beijing Educational Committee","award":["2018YFC1800203","KM201811232010"],"award-info":[{"award-number":["2018YFC1800203","KM201811232010"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>The application of AR to explore augmented map representation has become a research hotspot due to the growing application of AR in maps and geographic information in addition to the rising demand for automated map interpretation. Taking the AR map as the research object, this paper focuses on AR map tracking and registration and the virtual\u2013real fusion method based on element recognition. It strives to establish a new geographic information visualization interface and application model. AR technology is applied to the augmented representation of 2D planar maps. A step-by-step identification and extraction method of unmarked map elements are designed and proposed based on the analysis of the characteristics of planar map elements. This method combines the spatial and attribute characteristics of point-like elements and line-like elements, extracts the color, geometric features, and spatial distribution of map elements through computer vision methods, and completes the identification and automatic extraction of map elements. The multi-target image recognition and extraction method based on template and contour matching, and the line element recognition and extraction method based on color space and area growth are introduced in detail. Then, 3D tracking and registration is used to realize the unmarked tracking and registration of planar map element images, and the AR map virtual\u2013real fusion algorithm is proposed. The experimental results and results of an analysis of stepwise identification and extraction of unmarked map elements and map virtual\u2013real fusion reveal that the stepwise identification of unmarked map elements and map model virtual\u2013real fusion studied in this paper is effective. Through the analysis of map element step-by-step recognition efficiency and recognition rate, it is proved that the element step-by-step method in this paper is fast, its recognition efficiency meets the AR real-time requirements, and its recognition accuracy is high.<\/jats:p>","DOI":"10.3390\/ijgi12030126","type":"journal-article","created":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T04:39:45Z","timestamp":1678855185000},"page":"126","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["An AR Map Virtual\u2013Real Fusion Method Based on Element Recognition"],"prefix":"10.3390","volume":"12","author":[{"given":"Zhangang","family":"Wang","sequence":"first","affiliation":[{"name":"School of Information and Communication Engineering, Beijing Information Science and Technology University, Beijing 100101, China"},{"name":"Key Laboratory of Information and Communication Systems, Ministry of Information Industry, Beijing Information Science and Technology University, Beijing 100101, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/MC.2019.2951981","article-title":"The promise of interactive shared augmented reality","volume":"53","author":"Peitso","year":"2020","journal-title":"Computer"},{"key":"ref_2","unstructured":"Cools, R., Han, J., and Simeone, A.L. (2021). Designing Interactive Systems Conference 2021 (DIS \u201921), Association for Computing Machinery."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"80","DOI":"10.2174\/2213275911104020080","article-title":"Augmented Reality Mobile Applications: Challenges and Solutions","volume":"4","author":"Francese","year":"2011","journal-title":"Recent Pat. Comput. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chatain, J., Demangeat, M., Brock, A.M., Laval, D., and Hachet, M. (2015, January 27\u201330). Exploring input modalities for interacting with augmented paper maps. Proceedings of the 27th Conference on l\u2019Interaction Homme-Machine, Toulouse, France.","DOI":"10.1145\/2820619.2825002"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1016\/j.cag.2011.04.009","article-title":"Collaborative use of mobile augmented reality with paper maps","volume":"35","author":"Morrison","year":"2011","journal-title":"Comput. Graph."},{"key":"ref_6","first-page":"906","article-title":"Augmented Reality Geographic Information System","volume":"6","author":"Sun","year":"2004","journal-title":"Acta Sci. Nat. Univ. Pekin."},{"key":"ref_7","first-page":"56","article-title":"Augmented paper maps exploring the design space of a mixed reality system","volume":"65","author":"Volker","year":"2010","journal-title":"Int. J. Photogramm. Remote Sens."},{"key":"ref_8","first-page":"502","article-title":"Augmented Maps","volume":"34","author":"Bobrich","year":"2002","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_9","unstructured":"Schmalstieg, D., and Reitmayr, G. (2006). Augmented Reality as a Medium for Cartography. Multimedia Cartography, Springer."},{"key":"ref_10","unstructured":"Uchiyama, H., Saito, H., Servi\u00e8res, M., and Moreau, G. (2009). Virtual and Mixed Reality, LNCS 5622, Springer."},{"key":"ref_11","first-page":"476","article-title":"Visualization and Interaction of Augmented Paper Maps Based on Augmented Reality","volume":"32","author":"Zhang","year":"2012","journal-title":"Trop. Geogr."},{"key":"ref_12","first-page":"41","article-title":"Paper map expression and its application based on mobile augmented reality","volume":"7","author":"Fang","year":"2014","journal-title":"Microcomput. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"9625","DOI":"10.1364\/AO.57.009625","article-title":"Research of the three-dimensional tracking and registration method based on multiobjective constraints in an AR system","volume":"57","author":"An","year":"2018","journal-title":"Appl. Opt."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"117","DOI":"10.14257\/ijmue.2017.12.4.10","article-title":"Hybrid approach using sensors, GPS and vision based tracking to improve the registration in mobile augmented reality applications","volume":"12","author":"Santos","year":"2017","journal-title":"Int. J. Multimed. Ubiquitous Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"8810991","DOI":"10.1155\/2021\/8810991","article-title":"An Improved 3D Registration Method of Mobile Augmented Reality for Urban Built Environment","volume":"2021","author":"Wu","year":"2021","journal-title":"Int. J. Comput. Games Technol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Pauwels, K., Rubio, L., Diaz, J., and Ros, E. (2013, January 23\u201328). Real-time model-based rigid object pose estimation and tracking combining dense and sparse visual cues. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.304"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Payet, N., and Todorovic, S. (2011, January 6\u201313). From contours to 3d object detection and pose estimation. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126342"},{"key":"ref_18","first-page":"83","article-title":"Model-based marker-less 3D tracking approach for augmented reality","volume":"52","author":"Yue","year":"2018","journal-title":"J. Shanghai Jiaotong Univ."},{"key":"ref_19","unstructured":"Chari, V., Singh, J.M., and Narayanan, P.J. (2008). Augmented Reality Using Over-Segmentation, Center for Visual Information Technology, International Institute of Information Technology."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"060010","DOI":"10.1063\/5.0106221","article-title":"Logarithmic transformation for enhancing keypoint matching of SIFT in augmented reality","volume":"2578","author":"Pambudi","year":"2022","journal-title":"AIP Conf. Proc."},{"key":"ref_21","unstructured":"Li, X., Wang, X., and Cheng, C. (2017, January 5\u20136). Application of scene recognition technology based on fast ER and surf algorithm in augmented reality. Proceedings of the 4th International Conference on Smart and Sustainable City (ICSSC 2017), Shanghai, China."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"21041","DOI":"10.1007\/s11042-020-10342-5","article-title":"Registration and occlusion handling based on the FAST ICP-ORB method for augmented reality systems","volume":"80","author":"Tian","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1007\/s10055-021-00519-0","article-title":"An improved colour binary descriptor algorithm for mobile augmented reality","volume":"25","author":"Tan","year":"2021","journal-title":"Virtual Real."},{"key":"ref_24","unstructured":"Malek, K., Mohammadkhorasani, A., and Moreu, F. (2022). Computer\u2014Aided Civil and Infrastructure Engineering, Wiley."},{"key":"ref_25","unstructured":"Araghi, L.F., and Arvan, M.R. (2009, January 18\u201320). An implementation image edge and feature detection using neural network. Proceedings of the International MultiConference of Engineers and Computer Scientists, Hong Kong, China."},{"key":"ref_26","first-page":"1","article-title":"Study and comparison of various image edge detection techniques","volume":"3","author":"Maini","year":"2009","journal-title":"Int. J. Image Process. (IJIP)"},{"key":"ref_27","first-page":"505","article-title":"Outdoor Augmented Reality Spatial Information Representation","volume":"7","author":"Ren","year":"2013","journal-title":"Appl. Math."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Pan, C., Chen, Y., and Wang, G. (2016, January 28\u201330). Virtual-Real Fusion with Dynamic Scene from Videos. Proceedings of the 2016 International Conference on Cyberworlds (CW), Chongqing, China.","DOI":"10.1109\/CW.2016.17"},{"key":"ref_29","unstructured":"Brejcha, J., Luk\u00e1\u010d, M., Hold-Geoffroy, Y., Wang, O., and \u010cad\u00edk, M. (2020). European Conference on Computer Vision, Springer."},{"key":"ref_30","first-page":"173","article-title":"Augmented Reality Geovisualisation for Underground Utilities","volume":"88","author":"Stylianidis","year":"2020","journal-title":"J. Photogramm. Remote Sens. Geoinf. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1590\/S1982-21702012000400007","article-title":"Semiotics and the Cartographic Visualization theory: Considerations on the analysis of map design","volume":"18","author":"Garbin","year":"2012","journal-title":"Bol. Ci\u00eanc. Geod."},{"key":"ref_32","unstructured":"Chang, K.T. (2018). Introduction to Geographic Information Systems, McGraw-Hill Education."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Eba, S., Nakabayashi, N., and Hashimoto, M. (2022, January 4\u20136). Single-scan multiple object detection based on template matching using only effective pixels. Proceedings of the International Workshop on Advanced Imaging Technology (IWAIT), Hong Kong, China.","DOI":"10.1117\/12.2624398"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Liu, Z., Guo, Y., Feng, Z., and Zhang, S. (2019, January 3\u20135). Improved Rectangle Template Matching Based Feature Point Matching Algorithm. Proceedings of the Chinese Control and Decision Conference (CCDC), Nanchang, China.","DOI":"10.1109\/CCDC.2019.8833208"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/j.procs.2016.02.064","article-title":"Respiratory mask selection and leakage detection system based on canny edge detection operator","volume":"78","author":"Ingle","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/TPAMI.2003.1159943","article-title":"Contour line and geographic feature extraction from USGS color topographical paper maps","volume":"25","author":"Khotanzad","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TCSVT.2021.3081182","article-title":"No-reference quality assessment for 360-degree images by analysis of multifrequency information and local-global naturalness","volume":"32","author":"Zhou","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Xu, S., Xun, Y., Jia, T., and Yang, Q. (2014, January 13\u201314). Detection method for the buds on winter vines based on computer vision. Proceedings of the 2014 Seventh International Symposium on Computational Intelligence and Design, Hangzhou, China.","DOI":"10.1109\/ISCID.2014.26"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Yalcinkaya, B., Aguizo, J., Couceiro, M., and Figueiredo, A. (2021, January 27\u201328). A Multimodal Tracking Approach For Augmented Reality Applications. Proceedings of the 12th Augmented Human International Conference (AH2021), Geneva, Switzerland.","DOI":"10.1145\/3460881.3460929"},{"key":"ref_40","first-page":"679","article-title":"Vision-Based Algorithm for Augmented Reality Registration","volume":"7","author":"Shi","year":"2002","journal-title":"J. Image Graph."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Burkard, S., and Fuchs-Kittowski, F. (2020, January 9\u201313). User-aided global registration method using geospatial 3D data for large-scale mobile outdoor augmented reality. Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Recife, Brazil.","DOI":"10.1109\/ISMAR-Adjunct51615.2020.00041"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1364\/JOSAA.8.000377","article-title":"Affine structure from motion","volume":"8","author":"Koenderink","year":"1991","journal-title":"JOSA A"},{"key":"ref_43","first-page":"16","article-title":"Spatial information augmented representation using affine transformations registration","volume":"3","author":"Wu","year":"2010","journal-title":"Comput. Eng. Appl."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Ma, W., Xiong, H., Dai, X., Zheng, X., and Zhou, Y. (2018). An indoor scene recognition-based 3D registration mechanism for real-time AR-GIS visualization in mobile applications. ISPRS Int. J. Geo-Inf., 7.","DOI":"10.3390\/ijgi7030112"},{"key":"ref_45","unstructured":"Laganiere, R. (2014). OpenCV Computer Vision Application Programming Cookbook Second Edition, Packt Publishing Ltd."},{"key":"ref_46","unstructured":"Sellers, G., Wright, R.S., and Haemel, N. (2013). OpenGL superBible: Comprehensive Tutorial and Reference, Addison-Wesley."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1145\/357994.358023","article-title":"A Fast Parallel Algorithm for Thinning Digital Patterns","volume":"27","author":"Zhang","year":"1984","journal-title":"Commun. Acm"}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/12\/3\/126\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:54:58Z","timestamp":1760122498000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/12\/3\/126"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,14]]},"references-count":47,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["ijgi12030126"],"URL":"https:\/\/doi.org\/10.3390\/ijgi12030126","relation":{},"ISSN":["2220-9964"],"issn-type":[{"type":"electronic","value":"2220-9964"}],"subject":[],"published":{"date-parts":[[2023,3,14]]}}}