{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T14:27:35Z","timestamp":1766068055580,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,8,18]],"date-time":"2024-08-18T00:00:00Z","timestamp":1723939200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>The conventional feature point-based image stitching algorithm exhibits inconsistencies in the quality of feature points across diverse scenes. This may result in the deterioration of the alignment effect or even the inability to align two images. To address this issue, this paper presents an unsupervised multigrid image alignment method that integrates the conventional feature point-based image alignment algorithm with deep learning techniques. The method postulates that the feature points are uniformly distributed in the image and employs a deep learning network to predict their displacements, thereby enhancing the robustness of the feature points. Furthermore, the precision of image alignment is enhanced through the parameterization of APAP (As-projective-as-possible image stitching with moving DLT) multigrid deformation. Ultimately, based on the symmetry exhibited by the homography matrix and its inverse matrix throughout the projection process, image chunking inverse warping is introduced to obtain the stitched images for the multigrid deep learning network. Additionally, the mesh shape-preserving loss is introduced to constrain the shape of the multigrid. The experimental results demonstrate that in the real-world UDIS-D dataset, the method achieves notable improvements in feature point matching and homography estimation tasks, and exhibits superior alignment performance on the traditional image stitching dataset.<\/jats:p>","DOI":"10.3390\/sym16081064","type":"journal-article","created":{"date-parts":[[2024,8,19]],"date-time":"2024-08-19T03:43:28Z","timestamp":1724039008000},"page":"1064","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Research on Unsupervised Feature Point Prediction Algorithm for Multigrid Image Stitching"],"prefix":"10.3390","volume":"16","author":[{"given":"Jun","family":"Li","sequence":"first","affiliation":[{"name":"College of Computer Science and Cyber Security, Chengdu University of Technology, Chengdu 610059, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yufeng","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Computer Science and Cyber Security, Chengdu University of Technology, Chengdu 610059, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aiming","family":"Mu","sequence":"additional","affiliation":[{"name":"College of Computer Science and Cyber Security, Chengdu University of Technology, Chengdu 610059, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s11263-006-0002-3","article-title":"Automatic panoramic image stitching using invariant features","volume":"74","author":"Brown","year":"2007","journal-title":"Int. J. Comput. Vision"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object recognition from local scale-invariant features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_3","unstructured":"Harris, C., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the Alvey Vision Conference, Manchester, UK."},{"key":"ref_4","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An iterative image registration technique with an application to stereo vision. Proceedings of the IJCAI\u201981: 7th International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vision"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006). Surf: Speeded up robust features. Proceedings, Part I, Computer Vision\u2014ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria, 7\u201313 May 2006, Springer.","DOI":"10.1007\/11744023_32"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Barath, D., Noskova, J., Ivashechkin, M., and Matas, J. (2020, January 13\u201319). MAGSAC++: A fast, reliable and accurate robust estimator. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00138"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Barath, D., Matas, J., and Noskova, J. (2019, January 15\u201320). MAGSAC: Marginalizing sample consensus. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01044"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zaragoza, J., Chin, T.J., Brown, M.S., and Suter, D. (2013, January 23\u201328). As-projective-as-possible image stitching with moving DLT. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.303"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lin, W.Y., Liu, S., Matsushita, Y., Ng, T.T., and Cheong, L.F. (2011, January 20\u201325). Smoothly varying affine stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995314"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1672","DOI":"10.1109\/TMM.2017.2777461","article-title":"Parallax-tolerant image stitching based on robust elastic warping","volume":"20","author":"Li","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1117\/12.146603","article-title":"A thin-plate spline and the decomposition of deformations","volume":"2","author":"Bookstein","year":"1993","journal-title":"Math. Methods Med. Imaging"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2356","DOI":"10.1109\/TIP.2019.2949424","article-title":"Local-adaptive image alignment based on triangular facet approximation","volume":"29","author":"Li","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chang, C.H., Sato, Y., and Chuang, Y.Y. (2014, January 23\u201328). Shape-preserving half-projective warps for image stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.422"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Chen, Y.S., and Chuang, Y.Y. (2016). Natural image stitching with the global similarity prior. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46454-1_12"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lin, C.C., Pankanti, S.U., Natesan Ramamurthy, K., and Aravkin, A.Y. (2015, January 7\u201312). Adaptive as-natural-as-possible image stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298719"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gao, J., Kim, S.J., and Brown, M.S. (2011, January 20\u201325). Constructing image panoramas using dual-homography warping. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995433"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2346","DOI":"10.1109\/LRA.2018.2809549","article-title":"Unsupervised deep homography: A fast and robust homography estimation model","volume":"3","author":"Nguyen","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, J., Wang, C., Liu, S., Jia, L., Ye, N., Wang, J., Zhou, J., and Sun, J. (2020). Content-aware unsupervised deep homography estimation. Proceedings, Part I, Computer Vision\u2014ECCV 2020: 16th European Conference, Glasgow, UK, 23\u201328 August 2020, Springer.","DOI":"10.1007\/978-3-030-58452-8_38"},{"key":"ref_21","unstructured":"Nie, L., Lin, C., Liao, K., and Zhao, Y. (2020). Learning edge-preserved image stitching from large-baseline deep homography. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"6184","DOI":"10.1109\/TIP.2021.3092828","article-title":"Unsupervised deep image stitching: Reconstructing stitched features to images","volume":"30","author":"Nie","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4460","DOI":"10.1109\/TCSVT.2021.3125736","article-title":"Depth-aware multi-grid deep homography estimation with contextual correlation","volume":"32","author":"Nie","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lee, K.Y., and Sim, J.Y. (2020, January 13\u201319). Warping residual based image stitching for large parallax. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00822"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1145\/882262.882264","article-title":"Graphcut textures: Image and video synthesis using graph cuts","volume":"22","author":"Kwatra","year":"2003","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. (2004, January 8\u201312). Interactive digital photomontage. Proceedings of the SIGGRAPH04: Special Interest Group on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA.","DOI":"10.1145\/1186562.1015718"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"108019","DOI":"10.1016\/j.patcog.2021.108019","article-title":"Edge-guided composition network for image stitching","volume":"118","author":"Dai","year":"2021","journal-title":"Pattern Recognit."},{"key":"ref_29","unstructured":"Eden, A., Uyttendaele, M., and Szeliski, R. (2006, January 17\u201322). Seamless image stitching of scenes with large motions and exposure differences. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"967","DOI":"10.1007\/s11760-018-1241-9","article-title":"Perception-based seam cutting for image stitching","volume":"12","author":"Li","year":"2018","journal-title":"Signal Image Video Process."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Nie, L., Lin, C., Liao, K., Liu, S., and Zhao, Y. (2023, January 2\u20133). Parallax-tolerant unsupervised deep image stitching. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Paris, France.","DOI":"10.1109\/ICCV51070.2023.00680"},{"key":"ref_32","first-page":"107","article-title":"Image Stitching of Multi-band Blending Based on Graph Cut","volume":"30","author":"Ouyang","year":"2013","journal-title":"Microelectron. Comput."},{"key":"ref_33","unstructured":"DeTone, D., Malisiewicz, T., and Rabinovich, A. (2016). Deep image homography estimation. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"724","DOI":"10.1109\/TIP.2019.2934344","article-title":"Single-perspective warps in natural image stitching","volume":"29","author":"Liao","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Jia, Q., Li, Z., Fan, X., Zhao, H., Teng, S., Ye, X., and Latecki, L.J. (2021, January 19\u201325). Leveraging line-point consistence to preserve structures for wide parallax image stitching. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01201"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/16\/8\/1064\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:38:30Z","timestamp":1760110710000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/16\/8\/1064"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,18]]},"references-count":36,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["sym16081064"],"URL":"https:\/\/doi.org\/10.3390\/sym16081064","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2024,8,18]]}}}