{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T14:23:20Z","timestamp":1788963800684,"version":"build-2803163510"},"reference-count":34,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2022,11,27]],"date-time":"2022-11-27T00:00:00Z","timestamp":1669507200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Outstanding Youth Project of Provincial Natural Science Foundation of China","award":["YQ2020F012"],"award-info":[{"award-number":["YQ2020F012"]}]},{"name":"Outstanding Youth Project of Provincial Natural Science Foundation of China","award":["61771186"],"award-info":[{"award-number":["61771186"]}]},{"name":"Outstanding Youth Project of Provincial Natural Science Foundation of China","award":["UNPYSCT2017125"],"award-info":[{"award-number":["UNPYSCT2017125"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["YQ2020F012"],"award-info":[{"award-number":["YQ2020F012"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61771186"],"award-info":[{"award-number":["61771186"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["UNPYSCT2017125"],"award-info":[{"award-number":["UNPYSCT2017125"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Nursing Program for Young Scholars with Creative Talents in Heilongjiang Province","award":["YQ2020F012"],"award-info":[{"award-number":["YQ2020F012"]}]},{"name":"Nursing Program for Young Scholars with Creative Talents in Heilongjiang Province","award":["61771186"],"award-info":[{"award-number":["61771186"]}]},{"name":"Nursing Program for Young Scholars with Creative Talents in Heilongjiang Province","award":["UNPYSCT2017125"],"award-info":[{"award-number":["UNPYSCT2017125"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>UAVs are flexible in action, changeable in shooting angles, and complex and changeable in the shooting environment. Most of the existing stitching algorithms are suitable for images collected by UAVs in static environments, but the images are in fact being captured dynamically, especially in low-altitude flights. Considering that the great changes of the object position may cause the low-altitude aerial images to be affected by the moving foreground during stitching, so as to result in quality problems, such as splicing misalignment and tearing, a UAV aerial image stitching algorithm is proposed based on semantic segmentation and ORB. In the image registration, the algorithm introduces a semantic segmentation network to separate the foreground and background of the image and obtains the foreground semantic information. At the same time, it uses the quadtree decomposition idea and the classical ORB algorithm to extract feature points. By comparing the feature point information with the foreground semantic information, the foreground feature points can be deleted to realize feature point matching. Based on the accurate image registration, the image stitching and fusion will be achieved by the homography matrix and the weighted fusion algorithm. The proposed algorithm not only preserves the details of the original image, but also improves the four objective data points of information entropy, average gradient, peak signal-to-noise ratio and root mean square error. It can solve the problem of splicing misalignment tearing during background stitching caused by dynamic foreground and improves the stitching quality of UAV low-altitude aerial images.<\/jats:p>","DOI":"10.3390\/rs14236013","type":"journal-article","created":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T07:01:30Z","timestamp":1669618890000},"page":"6013","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["UAV Low-Altitude Aerial Image Stitching Based on Semantic Segmentation and ORB Algorithm for Urban Traffic"],"prefix":"10.3390","volume":"14","author":[{"given":"Gengxin","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Electronic and Communication Engineering, Heilongjiang University, Harbin 150080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5829-6121","authenticated-orcid":false,"given":"Danyang","family":"Qin","sequence":"additional","affiliation":[{"name":"Department of Electronic and Communication Engineering, Heilongjiang University, Harbin 150080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiaqiang","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Electronic and Communication Engineering, Heilongjiang University, Harbin 150080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mengying","family":"Yan","sequence":"additional","affiliation":[{"name":"Department of Electronic and Communication Engineering, Heilongjiang University, Harbin 150080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huapeng","family":"Tang","sequence":"additional","affiliation":[{"name":"Department of Electronic and Communication Engineering, Heilongjiang University, Harbin 150080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haoze","family":"Bie","sequence":"additional","affiliation":[{"name":"Department of Electronic and Communication Engineering, Heilongjiang University, Harbin 150080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1684-9714","authenticated-orcid":false,"given":"Lin","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Electronics and Information Engineering, Harbin Institute of Technology, Harbin 150080, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Harris, C., and Stephens, M. (1988). A Combined Corner and Edge Detector. Alvey Vision Conference, The Plessey Company Plc.","DOI":"10.5244\/C.2.23"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). SURF: Speeded up robust features. Proceedings of the 9th European conference on Computer Vision-Volume Part I, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G.R. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yeh, C.C., Chang, Y.L., Alkhaleefah, M., Hsu, P.H., Eng, W., Koo, V.C., Huang, B.R., and Chang, L.A. (2021). YOLOv3-Based Matching Approach for Roof Region Detection from Drone Images. Remote Sens., 13.","DOI":"10.3390\/rs13010127"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A Versatile and Accurate Monocular SLAM System","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Li, M., Chen, R., Zhang, W., Li, D., Liao, X., Wang, L., Pan, Y., and Zhang, P. (2017). A Stereo Dual-Channel Dynamic Programming Algorithm for UAV Image Stitching. Sensors, 17.","DOI":"10.3390\/s17092060"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1186\/s13640-018-0323-5","article-title":"Remote sensing image mosaic technology based on SURF algorithm in agriculture","volume":"2018","author":"Zhang","year":"2018","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhao, J., Zhang, X., Gao, C., Qiu, X., and Cao, W. (2019). Rapid Mosaicking of Unmanned Aerial Vehicle (UAV) Images for Crop Growth Monitoring Using the SIFT Algorithm. Remote Sens., 11.","DOI":"10.3390\/rs11101226"},{"key":"ref_11","first-page":"2019","article-title":"A robust projection plane selection strategy for UAV image stitching","volume":"40","author":"Xie","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3844","DOI":"10.1109\/JSTARS.2020.3006289","article-title":"UAV Image Mosaicking Based on Multiregion Guided Local Projection Deformation","volume":"13","author":"Xu","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"127852","DOI":"10.1109\/ACCESS.2021.3111203","article-title":"Fast and Efficient Method for Large-Scale Aerial Image Stitching","volume":"9","author":"Pham","year":"2021","journal-title":"IEEE Access"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1565","DOI":"10.1109\/TGRS.2020.2999404","article-title":"Superpixel-Based Seamless Image Stitching for UAV Images","volume":"59","author":"Yuan","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Xue, W.L., Zhang, Z., and Chen, S.Y. (2021). Ghost Elimination via Multi-Component Collaboration for Unmanned Aerial Vehicle Remote Sensing Image Stitching. Remote Sens., 13.","DOI":"10.3390\/rs13071388"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Chen, J., Li, Z.X., Peng, C.L., Wang, Y., and Gong, W.P. (2022). UAV Image Stitching Based on Optimal Seam and Half-Projective Warp. Remote Sens., 14.","DOI":"10.3390\/rs14051068"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gao, J., Kim, S.J., and Brown, M.S. (2011). Constructing image panoramas using dual-homography warping. CVPR 2011 IEEE, IEEE.","DOI":"10.1109\/CVPR.2011.5995433"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1212","DOI":"10.1109\/72.410363","article-title":"Gradient calculations for dynamic recurrent neural networks: A survey","volume":"6","author":"Pearlmutter","year":"1995","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative Adversarial Networks","volume":"63","author":"Goodfellow","year":"2014","journal-title":"Commun. ACM"},{"key":"ref_21","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., and Jia, Y. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/TPAMI.2016.2572683","article-title":"Fully Convolutional Networks for Semantic Segmentation","volume":"39","author":"Shelhamer","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Mesbah, R., McCane, B., and Mills, S. (2016, January 21\u201322). Deep convolutional encoder-decoder for myelin and axon segmentation. Proceedings of the 2016 International Conference on Image and Vision Computing New Zealand (IVCNZ), Palmerston North, New Zealand.","DOI":"10.1109\/IVCNZ.2016.7804455"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yasrab, R., Gu, N., and Zhang, X. (2016, January 10\u201311). SCNet: A simplified encoder-decoder CNN for semantic segmentation. Proceedings of the 2016 5th International Conference on Computer Science and Network Technology (ICCSNT), Changchun, China.","DOI":"10.1109\/ICCSNT.2016.8070266"},{"key":"ref_27","unstructured":"Emer\u0161i\u010d, \u017d., Gabriel, L.L., \u0160truc, V., and Peer, P. (2017). Pixel-Wise Ear Detection with Convolutional Encoder-Decoder Networks. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Rosten, E. (2006). Machine learning for very high-speed corner detection. ECCV, Springer.","DOI":"10.1007\/11744023_34"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010). BRIEF: Binary Robust Independent Elementary Features. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1007\/s11265-019-01477-2","article-title":"An Image Mosaic Method Based on Convolutional Neural Network Semantic Features Extraction","volume":"92","author":"Shi","year":"2020","journal-title":"J. Signal Process. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Barath, D., and Matas, J. (2018, January 18\u201323). Graph-Cut RANSAC. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00704"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Sun, Y., Lv, Y., Song, B., Guo, Y., and Zhou, L. (2021, January 26\u201328). Image Stitching Method of Aerial Image Based on Feature Matching and Iterative Optimization. Proceedings of the 40th Chinese Control Conference (CCC), Shanghai, China.","DOI":"10.23919\/CCC52363.2021.9550213"},{"key":"ref_33","first-page":"714","article-title":"Comparative Analysis of SIFT and SURF and ORB Algorithms Based on OpenC V Environment","volume":"45","author":"Wei","year":"2018","journal-title":"Control. Instrum. Chem. Ind."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zheng, P., Qin, D., Han, B., Ma, L., and Berhane, T.M. (2021). Research on Feature Extraction Method of Indoor Visual Positioning Image Based on Area Division of Foreground and Background. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10060402"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/23\/6013\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:27:49Z","timestamp":1760146069000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/23\/6013"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,27]]},"references-count":34,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["rs14236013"],"URL":"https:\/\/doi.org\/10.3390\/rs14236013","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,27]]}}}