{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:45:48Z","timestamp":1760121948502,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,1,4]],"date-time":"2023-01-04T00:00:00Z","timestamp":1672790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62072212","20220508125RC"],"award-info":[{"award-number":["62072212","20220508125RC"]}]},{"name":"Development Project of Jilin Province of China","award":["62072212","20220508125RC"],"award-info":[{"award-number":["62072212","20220508125RC"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Feature detection and correct matching are the basis of the image stitching process. Whether the matching is correct and the number of matches directly affect the quality of the final stitching results. At present, almost all image stitching methods use SIFT+RANSAC pattern to extract and match feature points. However, it is difficult to obtain sufficient correct matching points in low-textured or repetitively-textured regions, resulting in insufficient matching points in the overlapping region, and this further leads to the warping model being estimated erroneously. In this paper, we propose a novel and flexible approach by increasing feature correspondences and optimizing hybrid terms. It can obtain sufficient correct feature correspondences in the overlapping region with low-textured or repetitively-textured areas to eliminate misalignment. When a weak texture and large parallax coexist in the overlapping region, the alignment and distortion often restrict each other and are difficult to balance. Accurate alignment is often accompanied by projection distortion and perspective distortion. Regarding this, we propose hybrid terms optimization warp, which combines global similarity transformations on the basis of initial global homography and estimates the optimal warping by adjusting various term parameters. By doing this, we can mitigate projection distortion and perspective distortion, while effectively balancing alignment and distortion. The experimental results demonstrate that the proposed method outperforms the state-of-the-art in accurate alignment on images with low-textured areas in the overlapping region, and the stitching results have less perspective and projection distortion.<\/jats:p>","DOI":"10.3390\/e25010106","type":"journal-article","created":{"date-parts":[[2023,1,4]],"date-time":"2023-01-04T05:02:30Z","timestamp":1672808550000},"page":"106","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Feature Correspondences Increase and Hybrid Terms Optimization Warp for Image Stitching"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3126-3079","authenticated-orcid":false,"given":"Yizhi","family":"Cong","sequence":"first","affiliation":[{"name":"Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, School of Artificial Intelligence, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4751-0708","authenticated-orcid":false,"given":"Yan","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, School of Artificial Intelligence, Jilin University, Changchun 130012, China"},{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenju","family":"Hou","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Pang","sequence":"additional","affiliation":[{"name":"School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh EH14 4AS, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/0600000009","article-title":"Image Alignment and Stitching: A Tutorial","volume":"2","author":"Szeliski","year":"2007","journal-title":"Found. Trends Comput. Graph. Vis."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s11263-006-0002-3","article-title":"Automatic Panoramic Image Stitching using Invariant Features","volume":"74","author":"Brown","year":"2006","journal-title":"Int. J. Comput. Vis."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Caesar, H., Bankiti, V., Lang, A.H., Vora, S., Liong, V.E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., and Beijbom, O. (2020, January 13\u201319). nuScenes: A Multimodal Dataset for Autonomous Driving. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01164"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Luan, Y., Han, C., and Wang, B. (2022). An Unsupervised Video Stabilization Algorithm Based on Key Point Detection. Entropy, 24.","DOI":"10.3390\/e24101326"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5620","DOI":"10.1109\/TIP.2019.2921858","article-title":"Subjective and Objective Quality Assessment of Stitched Images for Virtual Reality","volume":"28","author":"Madhusudana","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Chang, C.H., Chen, C.J., and Chuang, Y.Y. (2014, January 24\u201328). Spatially-Varying Image Warps for Scene Alignment. Proceedings of the 2014 22nd International Conference on Pattern Recognition, Stockholm, Sweden.","DOI":"10.1109\/ICPR.2014.21"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lin, W.Y., Liu, S., Matsushita, Y., Ng, T.T., and Cheong, L.F. (2011, January 20\u201325). Smoothly varying affine stitching. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995314"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zaragoza, J., Chin, T.J., Tran, Q.H., Brown, M.S., and Suter, D. (2013, January 23\u201328). As-Projective-As-Possible Image Stitching with Moving DLT. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.303"},{"key":"ref_9","unstructured":"Otaduy, M.A., and Sorkine, O. (2013). Seam-Driven Image Stitching. Proceedings of the Eurographics 2013\u2014Short Papers, The Eurographics Association."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhang, F., and Liu, F. (2014, January 23\u201328). Parallax-Tolerant Image Stitching. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.423"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lin, K., Jiang, N., Cheong, L.F., Do, M.N., and Lu, J. (2016, January 11\u201314). SEAGULL: Seam-Guided Local Alignment for Parallax-Tolerant Image Stitching. Proceedings of the ECCV, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_23"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"6184","DOI":"10.1109\/TIP.2021.3092828","article-title":"Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images","volume":"30","author":"Nie","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhang, L., and Huang, H. (2022). Image Stitching with Manifold Optimization. IEEE Trans. Multimed.","DOI":"10.1109\/TMM.2022.3161839"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4460","DOI":"10.1109\/TCSVT.2021.3125736","article-title":"Depth-Aware Multi-Grid Deep Homography Estimation With Contextual Correlation","volume":"32","author":"Nie","year":"2022","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"LoweDavid","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lin, C.C., Pankanti, S., Ramamurthy, K.N., and Aravkin, A.Y. (2015, January 7\u201312). Adaptive as-natural-as-possible image stitching. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298719"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Li, S., Yuan, L., Sun, J., and Quan, L. (2015, January 7\u201313). Dual-Feature Warping-Based Motion Model Estimation. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.487"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1672","DOI":"10.1109\/TMM.2017.2777461","article-title":"Parallax-Tolerant Image Stitching Based on Robust Elastic Warping","volume":"20","author":"Li","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Jia, Q., Li, Z., Fan, X., Zhao, H., Teng, S., Ye, X., and Latecki, L.J. (2021, January 20\u201325). Leveraging Line-point Consistence to Preserve Structures for Wide Parallax Image Stitching. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01201"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Jia, Q., Gao, X., Fan, X., Luo, Z., Li, H., and Chen, Z. (2016, January 11\u201314). Novel Coplanar Line-Points Invariants for Robust Line Matching Across Views. Proceedings of the ECCV, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46484-8_36"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"724","DOI":"10.1109\/TIP.2019.2934344","article-title":"Single-Perspective Warps in Natural Image Stitching","volume":"29","author":"Liao","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Joo, K., Kim, N., Oh, T.H., and Kweon, I.S. (2015, January 16\u201319). Line meets as-projective-as-possible image stitching with moving DLT. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Bordeaux, France.","DOI":"10.1109\/ICIP.2015.7350985"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5201\/ipol.2012.gjmr-lsd","article-title":"LSD: A Line Segment Detector","volume":"2","author":"Jakubowicz","year":"2012","journal-title":"Image Process. Line"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bian, J., Lin, W.Y., Matsushita, Y., Yeung, S.K., Nguyen, T.D., and Cheng, M.M. (2017, January 21\u201326). GMS: Grid-Based Motion Statistics for Fast, Ultra-Robust Feature Correspondence. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.302"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G.R. (2011, January 25\u201327). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Tokyo, Japan.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_27","unstructured":"Harris, C.G., and Stephens, M.J. (September, January 31). A Combined Corner and Edge Detector. Proceedings of the Alvey Vision Conference, Manchester, UK."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Rosten, E., and Drummond, T. (2006, January 7\u201313). Machine Learning for High-Speed Corner Detection. Proceedings of the ECCV, Graz, Austria.","DOI":"10.1007\/11744023_34"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). SURF: Speeded Up Robust Features. Proceedings of the ECCV, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., Strecha, C., and Fua, P.V. (2010, January 5\u201311). BRIEF: Binary Robust Independent Elementary Features. Proceedings of the ECCV, Crete, Greece.","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Lin, W.Y., Cheng, M.M., Lu, J., Yang, H., Do, M.N., and Torr, P.H.S. (2014, January 6\u201312). Bilateral Functions for Global Motion Modeling. Proceedings of the ECCV, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_23"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2356","DOI":"10.1109\/TIP.2019.2949424","article-title":"Local-Adaptive Image Alignment Based on Triangular Facet Approximation","volume":"29","author":"Li","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Triggs, B., McLauchlan, P.F., Hartley, R.I., and Fitzgibbon, A.W. (1999, January 21\u201322). Bundle Adjustment\u2014A Modern Synthesis. Proceedings of the Workshop on Vision Algorithms, Corfu, Greece.","DOI":"10.1007\/3-540-44480-7_21"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Gao, J., Kim, S.J., and Brown, M.S. (2011, January 20\u201325). Constructing image panoramas using dual-homography warping. Proceedings of the CVPR, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995433"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Chang, C.H., Sato, Y., and Chuang, Y.Y. (2014, January 23\u201328). Shape-Preserving Half-Projective Warps for Image Stitching. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.422"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1145\/1531326.1531350","article-title":"Content-preserving warps for 3D video stabilization","volume":"28","author":"Liu","year":"2009","journal-title":"ACM Trans. Graph."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"967","DOI":"10.1007\/s11760-018-1241-9","article-title":"Perception-based seam cutting for image stitching","volume":"12","author":"Li","year":"2018","journal-title":"Signal Image Video Process."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1109\/TCSVT.2021.3058655","article-title":"Stable Linear Structures and Seam Measurements for Parallax Image Stitching","volume":"32","author":"Xue","year":"2022","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Chen, Y.S., and Chuang, Y.Y. (2016, January 11\u201314). Natural Image Stitching with the Global Similarity Prior. Proceedings of the ECCV, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46454-1_12"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1365","DOI":"10.1109\/TMM.2017.2771566","article-title":"Quasi-Homography Warps in Image Stitching","volume":"20","author":"Li","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"3198","DOI":"10.1109\/TVCG.2020.2965097","article-title":"Content-Preserving Image Stitching With Piecewise Rectangular Boundary Constraints","volume":"27","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_42","first-page":"1","article-title":"Bundled camera paths for video stabilization","volume":"32","author":"Liu","year":"2013","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/1\/106\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T17:58:34Z","timestamp":1760119114000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/1\/106"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,4]]},"references-count":43,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["e25010106"],"URL":"https:\/\/doi.org\/10.3390\/e25010106","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2023,1,4]]}}}