{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T11:27:07Z","timestamp":1762342027480,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,3,14]],"date-time":"2023-03-14T00:00:00Z","timestamp":1678752000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Henan Province Science and Technology Tackling Program Project","award":["222102320220","42130112"],"award-info":[{"award-number":["222102320220","42130112"]}]},{"name":"National Natural Science Foundation of China","award":["222102320220","42130112"],"award-info":[{"award-number":["222102320220","42130112"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Mobile videos contain a large amount of data, where the information interesting to the user can either be discrete or distributed. This paper introduces a method for fusing 3D geographic information systems (GIS) and video image textures. For the dynamic fusion of video in 3DGIS where the position and pose angle of the filming device change moment by moment, it integrates GIS 3D visualization, pose resolution and motion interpolation, and proposes a projection texture mapping method for constructing a dynamic depth camera to achieve dynamic fusion. In this paper, the accuracy and time efficiency of different systems of gradient descent and complementary filtering algorithms are analyzed mainly by quantitative analysis method, and the effect of dynamic fusion is analyzed by the playback delay and rendering frame rate of video on 3DGIS as indicators. The experimental results show that the gradient descent method under the Aerial Attitude Reference System (AHRS) is more suitable for the solution of smartphone attitude, and can control the root mean square error of attitude solution within 2\u00b0; the delay of video playback on 3DGIS is within 29 ms, and the rendering frame rate is 34.9 fps, which meets the requirements of the minimum resolution of human eyes.<\/jats:p>","DOI":"10.3390\/ijgi12030125","type":"journal-article","created":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T04:39:45Z","timestamp":1678855185000},"page":"125","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Dynamic Fusion Technology of Mobile Video and 3D GIS: The Example of Smartphone Video"],"prefix":"10.3390","volume":"12","author":[{"given":"Ge","family":"Zhu","sequence":"first","affiliation":[{"name":"The School of Geo-Science & Technology, Zhengzhou University, Zhengzhou 450000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huili","family":"Zhang","sequence":"additional","affiliation":[{"name":"The School of Geo-Science & Technology, Zhengzhou University, Zhengzhou 450000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yirui","family":"Jiang","sequence":"additional","affiliation":[{"name":"The School of Geo-Science & Technology, Zhengzhou University, Zhengzhou 450000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juan","family":"Lei","sequence":"additional","affiliation":[{"name":"The School of Geo-Science & Technology, Zhengzhou University, Zhengzhou 450000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Linqing","family":"He","sequence":"additional","affiliation":[{"name":"The School of Geo-Science & Technology, Zhengzhou University, Zhengzhou 450000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongwei","family":"Li","sequence":"additional","affiliation":[{"name":"The School of Geo-Science & Technology, Zhengzhou University, Zhengzhou 450000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,14]]},"reference":[{"key":"ref_1","unstructured":"Debevec, P.E., Taylor, C.J., and Malik, J. (1996). SIGGRAPH \u201996, Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA, 4\u20139 August 1996, University of California."},{"key":"ref_2","unstructured":"Sawhney, H.S., Arpa, A., Kumar, R., Samarasekera, S., Aggarwal, M., Hsu, S., Nister, D., and Hanna, K. (2002, January 26\u201328). Video Flashlightsreal time rendering of multiple videos for immersive model visualization. Proceedings of the Thirteenth Eurographics Workshop on Rendering (2002), Pisa, Italy."},{"key":"ref_3","first-page":"2039","article-title":"Integration of Multiple Views for a 3-D Indoor Surveillance System","volume":"13","author":"Chen","year":"2010","journal-title":"Information"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Xie, Y.J., Wang, M.Z., Liu, X.J., and Wu, Y.G. (2017). Surveillance Video Synopsis in GIS. ISPRS Int. Geo-Inf., 6.","DOI":"10.3390\/ijgi6110333"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1221","DOI":"10.1111\/tgis.12862","article-title":"Multi-camera video synopsis of a geographic scene based on optimal virtual viewpoint","volume":"26","author":"Xie","year":"2022","journal-title":"Trans. GIS"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"e2129","DOI":"10.1002\/cav.2129","article-title":"Fusing surveillance videos and three-dimensional scene: A mixed reality system","volume":"34","author":"Cui","year":"2022","journal-title":"Comput. Animat. Virtual Worlds"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Abrams, A.D., and Pless, R.B. (2010, January 25). Webcams in context: Web interfaces to create live 3D environments. Proceedings of the 18th ACM International Conference on Multimedia, Firenze, Italy.","DOI":"10.1145\/1873951.1873997"},{"key":"ref_8","unstructured":"Chao, H. (2019). Design and Implementation of Three-Dimensional PoliGeographic Information System. [Master\u2019s Thesis, China University of Geosciences]."},{"key":"ref_9","unstructured":"Shihai, Z. (2016). Reflections on \u201cFragmentation\u201d and \u201cPictorialization\u201d of Reading in the Digital Age. Publ. Res., 62\u201365."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/s005300050043","article-title":"Towards video-based immersive environments","volume":"5","author":"Katkere","year":"1997","journal-title":"Multimed. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1568","DOI":"10.1109\/TVCG.2007.70544","article-title":"Contextualized videos: Combining videos with environment models to support situational understanding","volume":"13","author":"Wang","year":"2007","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1080\/13658811003792213","article-title":"GIS-augmented video surveillance","volume":"24","author":"Milosavljevic","year":"2010","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sebe, I.O., Hu, J., You, S., and Neumann, U. (2003, January 2). 3D video surveillance with Augmented Virtual Environments. Proceedings of the First ACM SIGMM International Workshop on Video Surveillance, Berkeley, CA, USA.","DOI":"10.1145\/982452.982466"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1007\/s10055-010-0186-2","article-title":"Augmenting aerial earth maps with dynamic information from videos","volume":"15","author":"Kim","year":"2011","journal-title":"Virtual Real."},{"key":"ref_15","first-page":"2089","article-title":"Integration of GIS and video surveillance","volume":"30","author":"Milosavljevic","year":"2016","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1177","DOI":"10.1080\/17538947.2017.1306126","article-title":"Augmented virtual environment: Fusion of real-time video and 3D models in the digital earth system","volume":"10","author":"Jian","year":"2017","journal-title":"Int. J. Digit. Earth"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gay-Bellile, V., Lothe, P., Bourgeois, S., Royer, E., and Naudet Collette, S. (2010, January 13\u201316). Augmented reality in large environments: Application to aided navigation in urban context. Proceedings of the 9th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Seoul, Republic of Korea. Science & Technology Papers.","DOI":"10.1109\/ISMAR.2010.5643579"},{"key":"ref_18","first-page":"745","article-title":"Research on GIS-based video surveillance system","volume":"32","author":"Wenjie","year":"2011","journal-title":"Comput. Eng. Des."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Han, L.T., Huang, B.H., and Chen, L. (2010, January 18\u201320). Integration and Application of Video Surveillance System and 3DGIS. Proceedings of the 18th International Conference on Geoinformatics, Beijing, China.","DOI":"10.1109\/GEOINFORMATICS.2010.5568152"},{"key":"ref_20","first-page":"728","article-title":"Intergration and application of video surveillance and 3DGIS","volume":"32","author":"Binghu","year":"2011","journal-title":"Comput. Eng. Des."},{"key":"ref_21","first-page":"154","article-title":"Innovative Application of Tunnel Operation Management Based on Three-Dimensional Video Fusion","volume":"42","author":"Wu","year":"2022","journal-title":"Tunn. Constr."},{"key":"ref_22","first-page":"6","article-title":"massive video integrated mixed reality technology","volume":"23","author":"Zhong","year":"2017","journal-title":"ZTE Technol. J."},{"key":"ref_23","first-page":"203","article-title":"A method of panorama stitching and spatialization for speed dome camera video","volume":"47","author":"Zhang","year":"2022","journal-title":"Sci. Surv. Mapp."},{"key":"ref_24","unstructured":"Zhou, Y., Cao, M.J., You, J.D., Meng, M., Wang, Y.H., and Zhou, Z. (December, January 28). MR Video Fusion: Interactive 3D Modeling and Stitching on Wide-baseline Videos. Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (ACM VRST), Tokyo, Japan."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Abrams, A., Fridrich, N., Jacobs, N., and Pless, R. (2010, January 1). Participatory integration of live webcams into GIS. Proceedings of the 1st International Conference and Exhibition on Computing for Geospatial Research & Application, Washington, DC, USA.","DOI":"10.1145\/1823854.1823867"},{"key":"ref_26","first-page":"2550","article-title":"Virtual-reality video fusion system based on video model","volume":"30","author":"Zhou","year":"2018","journal-title":"J. Syst. Simul."},{"key":"ref_27","unstructured":"Fan, Z. (2014). Research on Registration and Rendering Methodof Video to Enhance 3D Scene. [Ph.D. Thesis, Wuhan University]."},{"key":"ref_28","first-page":"281","article-title":"video fusion method based on 3D scene","volume":"47","author":"Zexi","year":"2020","journal-title":"Comput. Sci."},{"key":"ref_29","first-page":"632","article-title":"A fast fusion object determination method for multi-path video and three-dimensional GIS scene","volume":"49","author":"Liu","year":"2020","journal-title":"Acta Geod. Cartogr. Sin."},{"key":"ref_30","first-page":"141","article-title":"Design and implementation of real scene fusion system based on 3D GIS","volume":"4","author":"Liu","year":"2021","journal-title":"Bull. Surv. Mapp."},{"key":"ref_31","unstructured":"Neumann, U., Suya, Y., Jinhui, H., Bolan, J., and JongWeon, L. (2003, January 22\u201326). Augmented virtual environments (AVE): Dynamic fusion of imagery and 3D models. Proceedings of the IEEE Virtual Reality 2003, Los Angeles, CA, USA."},{"key":"ref_32","first-page":"20","article-title":"a fast method to build 3D GIS platform Based on Webgl","volume":"41","author":"Xiaolong","year":"2022","journal-title":"Henan Sci. Technol."},{"key":"ref_33","first-page":"111","article-title":"Research on Integrated Visualization of BIM and Real-Scene 3D Model Based on Cesium","volume":"47","author":"Fang","year":"2022","journal-title":"J. Geomat."},{"key":"ref_34","unstructured":"Madgwick, S.O.H., Harrison, A.J.L., and Vaidyanathan, R. (July, January 27). IEEE Estimation of IMU and MARG orientation using a gradient descent algorithm. Proceedings of the IEEE International Conference on Rehabilitation Robotics (ICORR)\/International Neurorehabilitation Symposium (INRS)\/International Conference on Virtual Rehabilitation (ICVR), Zurich, Switzerland."},{"key":"ref_35","first-page":"627","article-title":"Quaternion-based algorithm for orientation estimation from MARG sensors","volume":"52","author":"Liu","year":"2012","journal-title":"J. Tsinghua Univ. Sci. Technol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1109\/TMECH.2010.2095504","article-title":"Investigation of Attitude Tracking Using an Integrated Inertial and Magnetic Navigation System for Hand-Held Surgical Instruments","volume":"17","author":"Ren","year":"2012","journal-title":"IEEE-ASME Trans. Mechatron."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1561\/2000000094","article-title":"Using Inertial Sensors for Position and Orientation Estimation","volume":"11","author":"Kok","year":"2017","journal-title":"Found Trends\u00ae Signal Process."},{"key":"ref_38","first-page":"13","article-title":"Conjugate Gradient Based Method for Attitude Calculation of MARG Sensor","volume":"29","author":"Qi","year":"2022","journal-title":"Electron. Opt. Control"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"De Haan, G., Scheuer, J., de Vries, R., and Post, F.H. (2009, January 14\u201315). Egocentric Navigation for Video Surveillance in 3D Virtual Environments. Proceedings of the IEEE Symposium on 3U User Interfaces, Lafayette, LA, USA.","DOI":"10.1109\/3DUI.2009.4811214"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1474","DOI":"10.1109\/TVCG.2011.262","article-title":"Uniform B-Spline Curve Interpolation with Prescribed Tangent and Curvature Vectors","volume":"18","author":"Okaniwa","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1051\/jnwpu\/20224010084","article-title":"Joint motion planning of industrial robot based on hybrid polynomial interpolation","volume":"40","author":"Pu","year":"2022","journal-title":"J. Northwest. Polytech. Univ."},{"key":"ref_42","unstructured":"Debevec, P., Yizhou, Y., and Borshukov, G. (1998). Rendering Techniques \u201998, Proceedings of the Eurographics Workshop in Vienna, Austria, 29 June\u20141 July 1998, Springer."},{"key":"ref_43","unstructured":"Hsu, S., Samarasekera, S., Kumar, R., and Sawhney, H.S. (2000, January 15). Pose estimation, model refinement, and enhanced visualization using video. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662), Hilton Head, SC, USA."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Pan, C.W., Chen, Y.S., and Wang, G.P. (2016, January 28\u201330). Virtual-Real Fusion with Dynamic Scene from Videos. Proceedings of the International Conference on Cyberworlds (CW), Chongqing, China.","DOI":"10.1109\/CW.2016.17"},{"key":"ref_45","unstructured":"Chao, L. (2017). Research on Attitude Measurement Algorithm of a Moving Vehicle Based on Marg Sensor. [Master\u2019s Thesis, Shandong University]."},{"key":"ref_46","unstructured":"Ou, Y.F., Liu, T., Zhao, Z., Ma, Z., and Wang, Y. (2008, January 12\u201315). IEEE Modeling the Impact of Frame Rate on Perceptual Quality of Video. Proceedings of the 15th IEEE International Conference on Image Processing (ICIP 2008), San Diego, CA, USA."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/12\/3\/125\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:54:52Z","timestamp":1760122492000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/12\/3\/125"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,14]]},"references-count":46,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["ijgi12030125"],"URL":"https:\/\/doi.org\/10.3390\/ijgi12030125","relation":{},"ISSN":["2220-9964"],"issn-type":[{"type":"electronic","value":"2220-9964"}],"subject":[],"published":{"date-parts":[[2023,3,14]]}}}