{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,30]],"date-time":"2025-11-30T13:52:48Z","timestamp":1764510768332,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,8,9]],"date-time":"2021-08-09T00:00:00Z","timestamp":1628467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China under Grant","award":["61701117, 61702101, 61802064"],"award-info":[{"award-number":["61701117, 61702101, 61802064"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Seeking quality feature correspondences (also known as matches) is a foundational step in computer vision. In our work, a novel and effective network with a stable local constraint, named the Local Neighborhood Correlation Network (LNCNet), is proposed to capture abundant contextual information of each correspondence in the local region, followed by calculating the essential matrix and camera pose estimation. Firstly, the k-Nearest Neighbor (KNN) algorithm is used to divide the local neighborhood roughly. Then, we calculate the local neighborhood correlation matrix (LNC) between the selected correspondence and other correspondences in the local region, which is used to filter outliers to obtain more accurate local neighborhood information. We cluster the filtered information into feature vectors containing richer neighborhood contextual information so that they can be used to more accurately determine the probability of correspondences as inliers. Extensive experiments have demonstrated that our proposed LNCNet performs better than some state-of-the-art networks to accomplish outlier rejection and camera pose estimation tasks in complex outdoor and indoor scenes.<\/jats:p>","DOI":"10.3390\/e23081024","type":"journal-article","created":{"date-parts":[[2021,8,9]],"date-time":"2021-08-09T05:17:06Z","timestamp":1628486226000},"page":"1024","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Learning Two-View Correspondences and Geometry via Local Neighborhood Correlation"],"prefix":"10.3390","volume":"23","author":[{"given":"Luanyuan","family":"Dai","sequence":"first","affiliation":[{"name":"College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou 350002, China"}]},{"given":"Xin","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou 350002, China"}]},{"given":"Jingtao","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou 350002, China"}]},{"given":"Changcai","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou 350002, China"}]},{"given":"Riqing","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou 350002, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.inffus.2018.02.004","article-title":"Infrared and visible image fusion methods and applications: A survey","volume":"45","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5216","DOI":"10.1109\/TIP.2020.2980210","article-title":"Cross-weather image alignment via latent generative model with intensity consistency","volume":"29","author":"Zhou","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s11263-006-0002-3","article-title":"Automatic panoramic image stitching using invariant features","volume":"74","author":"Brown","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6469","DOI":"10.1109\/TGRS.2015.2441954","article-title":"Robust feature matching for remote sensing image registration via locally linear transforming","volume":"53","author":"Ma","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1577","DOI":"10.1109\/TGRS.2020.3001089","article-title":"Robust Feature Matching for Remote Sensing Image Registration via Linear Adaptive Filtering","volume":"59","author":"Jiang","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Shah, R., Srivastava, V., and Narayanan, P. (2015, January 5\u20139). Geometry-Aware Feature Matching for Structure from motion Applications. Proceedings of the 2015 IEEE Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.","DOI":"10.1109\/WACV.2015.44"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2262","DOI":"10.1109\/TPAMI.2010.46","article-title":"Point set registration: Coherent point drift","volume":"32","author":"Myronenko","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1706","DOI":"10.1109\/TIP.2014.2307478","article-title":"Robust point matching via vector field consensus","volume":"23","author":"Ma","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1007\/s11263-018-1117-z","article-title":"Locality preserving matching","volume":"127","author":"Ma","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Bian, J., Lin, W.Y., Matsushita, Y., Yeung, S.K., Nguyen, T.D., and Cheng, M.M. (2017, January 21\u201326). Gms: Grid-Based Motion Statistics for Fast, Ultra-Robust Feature Correspondence. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.302"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Moo Yi, K., Trulls, E., Ono, Y., Lepetit, V., Salzmann, M., and Fua, P. (2018, January 18\u201323). Learning to Find Good Correspondences. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00282"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sun, W., Jiang, W., Trulls, E., Tagliasacchi, A., and Yi, K.M. (2020, January 13\u201319). ACNe: Attentive Context Normalization for Robust Permutation-Equivariant Learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01130"},{"key":"ref_14","unstructured":"Zhang, J., Sun, D., Luo, Z., Yao, A., Zhou, L., Shen, T., Chen, Y., Quan, L., and Liao, H. (November, January 27). Learning Two-View Correspondences and Geometry Using Order-Aware Network. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.neucom.2020.04.016","article-title":"Learning to find reliable correspondences with local neighborhood consensus","volume":"406","author":"Wang","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.neucom.2020.12.052","article-title":"SCSA-Net: Presentation of two-view reliable correspondence learning via spatial-channel self-attention","volume":"431","author":"Liu","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_17","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). Pointnet: Deep Learning on Point Sets for 3d Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"DeTone, D., Malisiewicz, T., and Rabinovich, A. (2018, January 18\u201322). Superpoint: Self-Supervised Interest Point Detection and Description. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00060"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s11263-020-01359-2","article-title":"Image matching from handcrafted to deep features: A survey","volume":"129","author":"Ma","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1006\/cviu.1999.0832","article-title":"MLESAC: A new robust estimator with application to estimating image geometry","volume":"78","author":"Torr","year":"2000","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chum, O., Matas, J., and Kittler, J. (2003). Locally optimized RANSAC. Joint Pattern Recognition Symposium, Springer.","DOI":"10.1007\/978-3-540-45243-0_31"},{"key":"ref_23","unstructured":"Barath, D., Ivashechkin, M., and Matas, J. (2019). Progressive NAPSAC: Sampling from gradually growing neighborhoods. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Barath, D., Matas, J., and Noskova, J. (2019, January 15\u201320). MAGSAC: Marginalizing Sample Consensus. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01044"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Barath, D., Noskova, J., Ivashechkin, M., and Matas, J. (2020, January 13\u201319). MAGSAC++, a Fast, Reliable and Accurate Robust Estimator. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00138"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1115","DOI":"10.1109\/TSP.2014.2388434","article-title":"Robust L2E estimation of transformation for non-rigid registration","volume":"63","author":"Ma","year":"2015","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11263-010-0318-x","article-title":"Rejecting mismatches by correspondence function","volume":"89","author":"Li","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3519","DOI":"10.1016\/j.patcog.2013.05.017","article-title":"Regularized vector field learning with sparse approximation for mismatch removal","volume":"46","author":"Ma","year":"2013","journal-title":"Pattern Recognit."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"736","DOI":"10.1109\/TIP.2019.2934572","article-title":"Robust feature matching using spatial clustering with heavy outliers","volume":"29","author":"Jiang","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Brachmann, E., Krull, A., Nowozin, S., Shotton, J., Michel, F., Gumhold, S., and Rother, C. (2017, January 21\u201326). Dsac-Differentiable Ransac for Camera Localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.267"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ranftl, R., and Koltun, V. (2018, January 8\u201314). Deep Fundamental Matrix Estimation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01246-5_18"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4045","DOI":"10.1109\/TIP.2019.2906490","article-title":"LMR: Learning a two-class classifier for mismatch removal","volume":"28","author":"Ma","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_33","unstructured":"Brachmann, E., and Rother, C. (November, January 27). Neural-Guided RANSAC: Learning where to Sample model Hypotheses. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kluger, F., Brachmann, E., Ackermann, H., Rother, C., Yang, M.Y., and Rosenhahn, B. (2020, January 13\u201319). Consac: Robust Multi-Model Fitting by Conditional Sample Consensus. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00469"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Swinburne, R. (2004). Bayes\u2019 Theorem. Rev. Philos. Fr., 194.","DOI":"10.5871\/bacad\/9780197263419.001.0001"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2004). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1145\/2812802","article-title":"YFCC100M: The new data in multimedia research","volume":"59","author":"Thomee","year":"2016","journal-title":"Commun. ACM"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Xiao, J., Owens, A., and Torralba, A. (2013, January 1\u20138). Sun3d: A Database of Big Spaces Reconstructed Using SFM and Object Labels. Proceedings of the IEEE International Conference on Computer Vision, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.458"},{"key":"ref_39","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017, January 21\u201326). Pointnet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/8\/1024\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:42:43Z","timestamp":1760164963000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/8\/1024"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,9]]},"references-count":39,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["e23081024"],"URL":"https:\/\/doi.org\/10.3390\/e23081024","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2021,8,9]]}}}