{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:53:57Z","timestamp":1760234037083,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,3,15]],"date-time":"2021-03-15T00:00:00Z","timestamp":1615766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62073262","61672429"],"award-info":[{"award-number":["62073262","61672429"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In this paper, we investigate the problem of aligning multiple deployed camera into one united coordinate system for cross-camera information sharing and intercommunication. However, the difficulty is greatly increased when faced with large-scale scene under chaotic camera deployment. To address this problem, we propose a UAV-assisted wide area multi-camera space alignment approach based on spatiotemporal feature map. It employs the great global perception of Unmanned Aerial Vehicles (UAVs) to meet the challenge from wide-range environment. Concretely, we first present a novel spatiotemporal feature map construction approach to represent the input aerial and ground monitoring data. In this way, the motion consistency across view is well mined to overcome the great perspective gap between the UAV and ground cameras. To obtain the corresponding relationship between their pixels, we propose a cross-view spatiotemporal matching strategy. Through solving relative relationship with the above air-to-ground point correspondences, all ground cameras can be aligned into one surveillance space. The proposed approach was evaluated in both simulation and real environments qualitatively and quantitatively. Extensive experimental results demonstrate that our system can successfully align all ground cameras with very small pixel error. Additionally, the comparisons with other works on different test situations also verify its superior performance.<\/jats:p>","DOI":"10.3390\/rs13061117","type":"journal-article","created":{"date-parts":[[2021,3,15]],"date-time":"2021-03-15T22:16:54Z","timestamp":1615846614000},"page":"1117","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["UAV-Assisted Wide Area Multi-Camera Space Alignment Based on Spatiotemporal Feature Map"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9043-8633","authenticated-orcid":false,"given":"Jing","family":"Li","sequence":"first","affiliation":[{"name":"School of Telecommunications Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuguang","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Telecommunications Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Congcong","family":"Li","sequence":"additional","affiliation":[{"name":"School of Telecommunications Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanran","family":"Dai","sequence":"additional","affiliation":[{"name":"School of Telecommunications Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiaxin","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Telecommunications Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zheng","family":"Dong","sequence":"additional","affiliation":[{"name":"National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, SAIIP School of Computer Science, Northwestern Polytechnical University, Xi\u2019an 710129, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5180-2316","authenticated-orcid":false,"given":"Tao","family":"Yang","sequence":"additional","affiliation":[{"name":"National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, SAIIP School of Computer Science, Northwestern Polytechnical University, Xi\u2019an 710129, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Tang, Z., Naphade, M., Liu, M., Yang, X., Birchfield, S., Wang, S., Kumar, R., Anastasiu, D.C., and Hwang, J. (2019, January 15\u201320). CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00900"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"25763","DOI":"10.1109\/ACCESS.2019.2900167","article-title":"Panoramic UAV Surveillance and Recycling System Based on Structure-Free Camera Array","volume":"7","author":"Yang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3139","DOI":"10.1109\/TIM.2019.2928615","article-title":"Indoor Multi-Camera-Based Testbed for 3-D Tracking and Control of UAVs","volume":"69","author":"Deng","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yang, T., Ren, Q., Zhang, F., Xie, B., Ren, H., Li, J., and Zhang, Y. (2018). Hybrid Camera Array-Based UAV Auto-Landing on Moving UGV in GPS-Denied Environment. Remote Sens., 10.","DOI":"10.3390\/rs10111829"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hsu, H., Wang, Y., and Hwang, J. (2020, January 12\u201316). Traffic-Aware Multi-Camera Tracking of Vehicles Based on ReID and Camera Link Model. Proceedings of the 28th ACM International Conference on Multimedia, Seattle, WA, USA.","DOI":"10.1145\/3394171.3413863"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"6505","DOI":"10.1109\/ACCESS.2019.2963784","article-title":"PSO-ELM: A Hybrid Learning Model for Short-Term Traffic Flow Forecasting","volume":"8","author":"Cai","year":"2020","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Truong, A.M., Philips, W., Deligiannis, N., Abrahamyan, L., and Guan, J. (2019). Automatic Multi-Camera Extrinsic Parameter Calibration Based on Pedestrian Torsors \u2020. Sensors, 19.","DOI":"10.3390\/s19224989"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Khoramshahi, E., Campos, M.B., Tommaselli, A.M.G., Vilijanen, N., Mielonen, T., Kaartinen, H., Kukko, A., and Honkavaara, E. (2019). Accurate Calibration Scheme for a Multi-Camera Mobile Mapping System. Remote Sens., 11.","DOI":"10.3390\/rs11232778"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yin, L., Luo, B., Wang, W., Yu, H., Wang, C., and Li, C. (2020). CoMask: Corresponding Mask-Based End-to-End Extrinsic Calibration of the Camera and LiDAR. Remote Sens., 12.","DOI":"10.3390\/rs12121925"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5648","DOI":"10.1109\/TWC.2014.2322855","article-title":"Set Optimization for Efficient Interference Alignment in Heterogeneous Networks","volume":"13","author":"Castanheira","year":"2014","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1109\/TPAMI.2006.178","article-title":"Camera Calibration from Video of a Walking Human","volume":"28","author":"Lv","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","unstructured":"Liu, J., Collins, R., and Liu, Y. (September, January 29). Surveillance Camera Autocalibration based on Pedestrian Height Distributions. Proceedings of the British Machine Vision Conference, Dundee, UK."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liu, J., Collins, R.T., and Liu, Y. (2013, January 15\u201317). Robust Autocalibration for A Surveillance Camera Network. Proceedings of the 2013 IEEE Workshop on Applications of Computer Vision, Clearwater Beach, FL, USA.","DOI":"10.1109\/WACV.2013.6475051"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"19:1","DOI":"10.1145\/3199667","article-title":"AutoCalib: Automatic Traffic Camera Calibration at Scale","volume":"14","author":"Bhardwaj","year":"2018","journal-title":"ACM Trans. Sens. Netw."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1016\/j.patcog.2004.11.005","article-title":"Camera Calibration with Moving One-dimensional Objects","volume":"38","author":"Wu","year":"2005","journal-title":"Pattern Recognit."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A Flexible New Technique for Camera Calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"103","DOI":"10.14358\/PERS.81.2.103","article-title":"Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry","volume":"81","author":"Karara","year":"2015","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1049\/iet-cvi.2016.0193","article-title":"Multi-camera Rig Calibration by Double-sided Thick Checkerboard","volume":"11","author":"Marcon","year":"2017","journal-title":"IET Comput. Vis."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Unterberger, A., Menser, J., Kempf, A., and Mohri, K. (2019, January 22\u201325). Evolutionary Camera Pose Estimation of a Multi-Camera Setup for Computed Tomography. Proceedings of the IEEE International Conference on Image Processing, Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8804398"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.optlaseng.2018.11.005","article-title":"Research on Multi-camera Calibration and Point Cloud Correction Method based on Three-dimensional Calibration Object","volume":"115","author":"Huang","year":"2019","journal-title":"Opt. Lasers Eng."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yin, H., Ma, Z., Zhong, M., Wu, K., Wei, Y., Guo, J., and Huang, B. (2020). SLAM-Based Self-Calibration of a Binocular Stereo Vision Rig in Real-Time. Sensors, 20.","DOI":"10.3390\/s20030621"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"012047","DOI":"10.1088\/1742-6596\/1544\/1\/012047","article-title":"Research on Calibration Method of Multi-camera System without Overlapping Fields of View Based on SLAM","volume":"1544","author":"Mingchi","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/s00170-018-1704-8","article-title":"A Calibration Method for Non-overlapping Cameras based on Mirrored Absolute Phase Target","volume":"104","author":"Xu","year":"2019","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"9724","DOI":"10.1364\/AO.56.009724","article-title":"Accurate Calibration of A Multi-camera System Based on Flat Refractive Geometry","volume":"56","author":"Mingchi","year":"2017","journal-title":"Appl. Opt."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"22927","DOI":"10.1109\/ACCESS.2019.2896648","article-title":"Simultaneous Multi-View Camera Pose Estimation and Object Tracking With Squared Planar Markers","volume":"7","author":"Sarmadi","year":"2019","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"106305","DOI":"10.1016\/j.optlaseng.2020.106305","article-title":"Extrinsic Camera Calibration for Non-overlapping Cameras with Gray Code Projection","volume":"134","author":"Penne","year":"2020","journal-title":"Opt. Lasers Eng."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yin, L., Wang, X., Ni, Y., Zhou, K., and Zhang, J. (2018). Extrinsic Parameters Calibration Method of Cameras with Non-Overlapping Fields of View in Airborne Remote Sensing. Remote Sens., 10.","DOI":"10.3390\/rs10081298"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2831","DOI":"10.1109\/LRA.2019.2921648","article-title":"The Road is Enough! Extrinsic Calibration of Non-overlapping Stereo Camera and LiDAR using Road Information","volume":"4","author":"Jeong","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1162","DOI":"10.1109\/TITS.2014.2352854","article-title":"Fully Automatic Roadside Camera Calibration for Traffic Surveillance","volume":"16","author":"Herout","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1270","DOI":"10.1109\/TASLP.2020.2983589","article-title":"Frequency-Sliding Generalized Cross-Correlation: A Sub-Band Time Delay Estimation Approach","volume":"28","author":"Cobos","year":"2020","journal-title":"IEEE ACM Trans. Audio Speech Lang. Process."},{"key":"ref_31","unstructured":"Berndt, D.J., and Clifford, J. (1994, January 31). Using Dynamic Time Warping to Find Patterns in Time Series. Proceedings of the AAAI Workshop on Knowledge Discovery in Databases, Seattle, WA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Shah, S., Dey, D., Lovett, C., and Kapoor, A. (2017, January 12\u201315). AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles. Proceedings of the International Conference on Field and Service Robotics, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-67361-5_40"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sarlin, P., DeTone, D., Malisiewicz, T., and Rabinovich, A. (2020, January 14\u201319). SuperGlue: Learning Feature Matching With Graph Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00499"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"DeTone, D., Malisiewicz, T., and Rabinovich, A. (2018, January 18\u201322). SuperPoint: Self-Supervised Interest Point Detection and Description. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00060"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nberger, J.L., and Frahm, J.M. (2016, January 27\u201330). Structure-from-Motion Revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nberger, J.L., Zheng, E., Pollefeys, M., and Frahm, J.M. (2016, January 11\u201314). Pixelwise View Selection for Unstructured Multi-View Stereo. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_31"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Brahmbhatt, S., Gu, J., Kim, K., Hays, J., and Kautz, J. (2018, January 18\u201322). Geometry-Aware Learning of Maps for Camera Localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00277"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/6\/1117\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:36:06Z","timestamp":1760160966000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/6\/1117"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,15]]},"references-count":38,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["rs13061117"],"URL":"https:\/\/doi.org\/10.3390\/rs13061117","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2021,3,15]]}}}