{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T13:29:42Z","timestamp":1762867782725,"version":"build-2065373602"},"reference-count":55,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2019,4,22]],"date-time":"2019-04-22T00:00:00Z","timestamp":1555891200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61603354"],"award-info":[{"award-number":["61603354"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"111 project under Grant","award":["B17040"],"award-info":[{"award-number":["B17040"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["CUGL170221"],"award-info":[{"award-number":["CUGL170221"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper introduces a robust method for panoramic unmanned aerial vehicle (UAV) image mosaic. In the traditional automatic panoramic image stitching method (Autostitch), it assumes that the camera rotates about its optical centre and the group of transformations the source images may undergo is a special group of homographies. It is rare to get such ideal data in reality. In particular, remote sensing images obtained by UAV do not satisfy such an ideal situation, where the images may not be on a plane yet and even may suffer from nonrigid changes, leading to poor mosaic results. To overcome the above mentioned challenges, in this paper a nonrigid matching algorithm is introduced to the mosaic system to generate accurate feature matching on remote sensing images. We also propose a new strategy for bundle adjustment to make the mosaic system suitable for the UAV image panoramic mosaic effect. Experimental results show that our method outperforms the traditional method and some of the latest methods in terms of visual effect.<\/jats:p>","DOI":"10.3390\/s19081898","type":"journal-article","created":{"date-parts":[[2019,4,22]],"date-time":"2019-04-22T11:02:53Z","timestamp":1555930973000},"page":"1898","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["A Robust Method for Automatic Panoramic UAV Image Mosaic"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9005-6849","authenticated-orcid":false,"given":"Jun","family":"Chen","sequence":"first","affiliation":[{"name":"School of Automation, China University of Geosciences, Wuhan 430074, China"},{"name":"Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, Wuhan 430074, China"},{"name":"Hubei Provincial Key Laboratory of Intelligent Robot, Wuhan Institute of Technology, Wuhan 430073, China"}]},{"given":"Quan","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China"}]},{"given":"Linbo","family":"Luo","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China"}]},{"given":"Yongtao","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Automation, China University of Geosciences, Wuhan 430074, China"},{"name":"Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, Wuhan 430074, China"}]},{"given":"Shuchun","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Automation, China University of Geosciences, Wuhan 430074, China"},{"name":"Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, Wuhan 430074, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,22]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"Image stitching based on feature extraction techniques: A survey","volume":"99","author":"Adel","year":"2014","journal-title":"Int. J. Comput. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhang, W., Guo, B., Li, M., Liao, X., and Li, W. (2018). Improved Seam-Line Searching Algorithm for UAV Image Mosaic with Optical Flow. Sensors, 18.","DOI":"10.3390\/s18041214"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6469","DOI":"10.1109\/TGRS.2015.2441954","article-title":"Robust feature matching for remote sensing image registration via locally linear transforming","volume":"53","author":"Ma","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s11263-006-0002-3","article-title":"Automatic panoramic image stitching using invariant features","volume":"74","author":"Brown","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1145\/245.247","article-title":"A multiresolution spline with application to image mosaics","volume":"2","author":"Burt","year":"1983","journal-title":"ACM Trans. Graph."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Li, M., Chen, R., Zhang, W., Li, D., Liao, X., Wang, L., Pan, Y., and Zhang, P. (2017). A Stereo Dual-Channel Dynamic Programming Algorithm for UAV Image Stitching. Sensors, 17.","DOI":"10.3390\/s17092060"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1145\/1015706.1015718","article-title":"Interactive digital photomontage","volume":"23","author":"Agarwala","year":"2004","journal-title":"ACM Trans. Graph."},{"key":"ref_8","unstructured":"Eden, A., Uyttendaele, M., and Szeliski, R. (2006, January 17\u201322). Seamless image stitching of scenes with large motions and exposure differences. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New York, NY, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1145\/882262.882269","article-title":"Poisson image editing","volume":"22","author":"Gangnet","year":"2003","journal-title":"ACM Trans. Graph."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3519","DOI":"10.1016\/j.patcog.2013.05.017","article-title":"Regularized vector field learning with sparse approximation for mismatch removal","volume":"46","author":"Ma","year":"2013","journal-title":"Pattern Recognit."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wang, D., Liu, H., and Cheng, X. (2018). A Miniature Binocular Endoscope with Local Feature Matching and Stereo Matching for 3D Measurement and 3D Reconstruction. Sensors, 18.","DOI":"10.3390\/s18072243"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yu, M., Deng, K., Yang, H., and Qin, C. (2018). Improved W\u03b1SH Feature Matching Based on 2D-DWT for Stereo Remote Sensing Images. Sensors, 18.","DOI":"10.3390\/s18103494"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ma, J., Jiang, X., Jiang, J., Zhao, J., and Guo, X. (2019). LMR: Learning A Two-class Classifier for Mismatch Removal. IEEE Trans. Image Process.","DOI":"10.1109\/TIP.2019.2906490"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zaragoza, J., Chin, T.J., Brown, M.S., and Suter, D. (2013, January 23\u201328). As-projective-as-possible image stitching with moving DLT. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.303"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1706","DOI":"10.1109\/TIP.2014.2307478","article-title":"Robust Point Matching via Vector Field Consensus","volume":"23","author":"Ma","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Triggs, B., McLauchlan, P.F., Hartley, R.I., and Fitzgibbon, A.W. (1999, January 21\u201322). Bundle adjustment-a modern synthesis. Proceedings of the International Workshop on Vision Algorithms, Corfu, Greece.","DOI":"10.1007\/3-540-44480-7_21"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.inffus.2018.02.004","article-title":"Infrared and visible image fusion methods and applications: A survey","volume":"45","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.inffus.2018.09.004","article-title":"FusionGAN: A generative adversarial network for infrared and visible image fusion","volume":"48","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2530","DOI":"10.1109\/TIP.2018.2887017","article-title":"Multi-memory convolutional neural network for video super-resolution","volume":"28","author":"Wang","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"13103","DOI":"10.1109\/ACCESS.2017.2717963","article-title":"Robust face super-resolution via locality-constrained low-rank representation","volume":"5","author":"Lu","year":"2017","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1006\/cviu.1999.0832","article-title":"MLESAC: A new robust estimator with application to estimating image geometry","volume":"78","author":"Torr","year":"2000","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chum, O., Matas, J., and Kittler, J. (2003). Locally optimized RANSAC. Joint Pattern Recognition Symposium, Springer.","DOI":"10.1007\/978-3-540-45243-0_31"},{"key":"ref_26","unstructured":"Chum, O., and Matas, J. (2005, January 20\u201325). Matching with PROSAC-progressive sample consensus. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11263-010-0318-x","article-title":"Rejecting mismatches by correspondence function","volume":"89","author":"Li","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"Method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2262","DOI":"10.1109\/TPAMI.2010.46","article-title":"Point set registration: Coherent point drift","volume":"32","author":"Myronenko","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1109\/TIP.2015.2467217","article-title":"Non-rigid point set registration by preserving global and local structures","volume":"25","author":"Ma","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1007\/s11263-018-1117-z","article-title":"Locality preserving matching","volume":"127","author":"Ma","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4435","DOI":"10.1109\/TGRS.2018.2820040","article-title":"Guided locality preserving feature matching for remote sensing image registration","volume":"56","author":"Ma","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1109\/TCYB.2017.2655538","article-title":"Adaptive discrete hypergraph matching","volume":"48","author":"Yan","year":"2018","journal-title":"IEEE Trans. Cybern."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Torresani, L., Kolmogorov, V., and Rother, C. (2008, January 12\u201318). Feature correspondence via graph matching: Models and global optimization. Proceedings of the European Conference on Computer Vision, Marseille, France.","DOI":"10.1007\/978-3-540-88688-4_44"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Leordeanu, M., and Hebert, M. (2005, January 20\u201325). A spectral technique for correspondence problems using pairwise constraints. Proceedings of the IEEE International Conference on Computer Vision, San Diego, CA, USA.","DOI":"10.1109\/ICCV.2005.20"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Liu, H., and Yan, S. (2010, January 13\u201318). Common visual pattern discovery via spatially coherent correspondences. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539780"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1145\/1531326.1531350","article-title":"Content-preserving warps for 3D video stabilization","volume":"28","author":"Liu","year":"2009","journal-title":"ACM Trans. Graph."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Gao, J., Kim, S.J., and Brown, M.S. (2011, January 20\u201325). Constructing image panoramas using dual-homography warping. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995433"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Lin, W.Y., Liu, S., Matsushita, Y., Ng, T.T., and Cheong, L.F. (2011, January 20\u201325). Smoothly varying affine stitching. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995314"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Chang, C.H., Sato, Y., and Chuang, Y.Y. (2014, January 23\u201328). Shape-preserving half-projective warps for image stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.422"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Lin, C.C., Pankanti, S.U., Natesan Ramamurthy, K., and Aravkin, A.Y. (2015, January 7\u201312). Adaptive as-natural-as-possible image stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298719"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1023\/A:1008195814169","article-title":"Systems and experiment paper: Construction of panoramic image mosaics with global and local alignment","volume":"36","author":"Shum","year":"2000","journal-title":"Int. J. Comput. Vis."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Lourakis, M., and Argyros, A.A. (2005, January 17\u201321). Is Levenberg-Marquardt the most efficient optimization algorithm for implementing bundle adjustment?. Proceedings of the IEEE International Conference on Computer Vision, Beijing, China.","DOI":"10.1109\/ICCV.2005.128"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Park, S., Ghosh, D., Kaabouch, N., Fevig, R.A., and Semke, W. (2012, January 23). Hierarchical multi-level image mosaicing for autonomous navigation of UAV. Proceedings of the Intelligent Robots and Computer Vision XXIX: Algorithms and Techniques, International Society for Optics and Photonics, Burlingame, CA, USA.","DOI":"10.1117\/12.910334"},{"key":"ref_45","first-page":"68","article-title":"Robust spatial-domain based super-resolution mosaicing of CubeSat video frames: Algorithm and evaluation","volume":"7","author":"Ghosh","year":"2014","journal-title":"Comput. Inf. Sci."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ghosh, D., Park, S., Kaabouch, N., and Semke, W. (2012, January 6\u20138). Quantitative evaluation of image mosaicing in multiple scene categories. Proceedings of the 2012 IEEE International Conference on Electro\/Information Technology, Indianapolis, IN, USA.","DOI":"10.1109\/EIT.2012.6220726"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1090\/S0002-9947-1950-0051437-7","article-title":"Theory of reproducing kernels","volume":"68","author":"Aronszajn","year":"1950","journal-title":"Trans. Am. Math. Soc."},{"key":"ref_48","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/0600000009","article-title":"Image alignment and stitching: A tutorial","volume":"2","author":"Szeliski","year":"2007","journal-title":"Found. Trends Comput. Graph. Vis."},{"key":"ref_50","unstructured":"Kang, E.Y., Cohen, I., and Medioni, G. (2000, January 3\u20137). A graph-based global registration for 2d mosaics. Proceedings of the International Conference on Pattern Recognition, Barcelona, Spain."},{"key":"ref_51","unstructured":"Marzotto, R., Fusiello, A., and Murino, V. (July, January 27). High resolution video mosaicing with global alignment. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/S0262-8856(96)01112-2","article-title":"Parameter estimation techniques: A tutorial with application to conic fitting","volume":"15","author":"Zhang","year":"1997","journal-title":"Image Vis. Comput."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1115","DOI":"10.1109\/TSP.2014.2388434","article-title":"Robust L2E Estimation of Transformation for Non-Rigid Registration","volume":"63","author":"Ma","year":"2015","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1672","DOI":"10.1109\/TMM.2017.2777461","article-title":"Parallax-tolerant image stitching based on robust elastic warping","volume":"20","author":"Li","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_55","unstructured":"(2019, March 28). Sensefly. Available online: https:\/\/www.sensefly.com\/drones\/example-datasets.html."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/8\/1898\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:46:11Z","timestamp":1760186771000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/8\/1898"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,22]]},"references-count":55,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["s19081898"],"URL":"https:\/\/doi.org\/10.3390\/s19081898","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,4,22]]}}}