{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,17]],"date-time":"2026-01-17T20:43:06Z","timestamp":1768682586360,"version":"3.49.0"},"reference-count":46,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T00:00:00Z","timestamp":1694736000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Department of Jilin Province, China","award":["20220201146GX"],"award-info":[{"award-number":["20220201146GX"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Remote sensing image registration has been a very important research topic, especially the registration of heterologous images. In the research of the past few years, numerous registration algorithms for heterogenic images have been developed, especially feature-based matching algorithms, such as point feature-based or line feature-based matching methods. However, there are few matching algorithms that combine line and point features. Therefore, this study proposes a matching algorithm that combines line features and point features while achieving good rotation invariance. It comprises LSD detection of line features, keypoint extraction, and HOG-like feature descriptor construction. The matching performance is compared with state-of-the-art matching algorithms on three heterogeneous image datasets (optical\u2013SAR dataset, optical\u2013infrared dataset, and optical\u2013optical dataset), verifying our method\u2019s rotational invariance by rotating images in each dataset. Finally, the experimental results show that our algorithm outperforms the state-of-the-art algorithms in terms of matching performance while possessing very good rotation invariance.<\/jats:p>","DOI":"10.3390\/rs15184548","type":"journal-article","created":{"date-parts":[[2023,9,17]],"date-time":"2023-09-17T23:32:27Z","timestamp":1694993547000},"page":"4548","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["LPHOG: A Line Feature and Point Feature Combined Rotation Invariant Method for Heterologous Image Registration"],"prefix":"10.3390","volume":"15","author":[{"given":"Jianmeng","family":"He","sequence":"first","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8771-983X","authenticated-orcid":false,"given":"Xin","family":"Jiang","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}]},{"given":"Zhicheng","family":"Hao","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}]},{"given":"Ming","family":"Zhu","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}]},{"given":"Wen","family":"Gao","sequence":"additional","affiliation":[{"name":"BYD Auto Industry Company Ltd., Shenzhen 518118, China"}]},{"given":"Shi","family":"Liu","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1483","DOI":"10.1109\/TGRS.2007.892601","article-title":"ARRSI: Automatic Registration of Remote-Sensing Images","volume":"45","author":"Wong","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/S0262-8856(03)00137-9","article-title":"Image registration methods: A survey","volume":"21","author":"Flusser","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"838","DOI":"10.1016\/j.cageo.2007.10.005","article-title":"A fast and fully automatic registration approach based on point features for multi-source remote-sensing images","volume":"34","author":"Yu","year":"2008","journal-title":"Comput. Geosci."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Liu, S., and Jiang, J. (2019). Registration Algorithm Based on Line-Intersection-Line for Satellite Remote Sensing Images of Urban Areas. Remote Sens., 11.","DOI":"10.3390\/rs11121400"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1109\/LGRS.2017.2660067","article-title":"Robust Optical-to-SAR Image Matching Based on Shape Properties","volume":"14","author":"Ye","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1109\/TGRS.2009.2034842","article-title":"Mutual-Information-Based Registration of TerraSAR-X and Ikonos Imagery in Urban Areas","volume":"48","author":"Suri","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Shu, L., and Tan, T. (October, January 16). SAR and SPOT Image Registration Based on Mutual Information with Contrast Measure. Proceedings of the 2007 IEEE International Conference on Image Processing, San Antonio, TX, USA.","DOI":"10.1109\/ICIP.2007.4379857"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Shi, W., Su, F., Wang, R., and Fan, J. (2012, January 22\u201327). A visual circle based image registration algorithm for optical and SAR imagery. Proceedings of the 2012 IEEE International Geoscience and Remote Sensing Symposium, Munich, Germany.","DOI":"10.1109\/IGARSS.2012.6351089"},{"key":"ref_9","unstructured":"Li, K., and Zhang, X. (2018, January 13\u201315). Review of Research on Registration of SAR and Optical Remote Sensing Image Based on Feature. Proceedings of the 2018 IEEE 3rd International Conference on Signal and Image Processing (ICSIP), Shenzhen, China."},{"key":"ref_10","unstructured":"Moravec, H.P. (1977, January 22\u201325). Towards automatic visual obstacle avoidance. Proceedings of the International Joint Conferences on Artificial Intelligence, Cambridge, MA, USA."},{"key":"ref_11","unstructured":"Harris, C.G., and Stephens, M.J. (September, January 31). A Combined Corner and Edge Detector. Proceedings of the Alvey Vision Conference, Manchester, UK."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1023\/A:1007963824710","article-title":"SUSAN\u2014A New Approach to Low Level Image Processing","volume":"23","author":"Stephen","year":"1997","journal-title":"Int. J. Comput. Vis."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). SURF: Speeded Up Robust Features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1109\/36.7708","article-title":"A statistical and geometrical edge detector for SAR images","volume":"26","author":"Touzi","year":"1988","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jiao, X., and Wen, X. (2009, January 14\u201316). SAR Image Segmentation Based on Markov Random Field Model and Multiscale Technology. Proceedings of the 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery, Tianjin, China.","DOI":"10.1109\/FSKD.2009.544"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2560","DOI":"10.1109\/TIP.2018.2806201","article-title":"A Multi-Region Segmentation Method for SAR Images Based on the Multi-Texture Model with Level Sets","volume":"27","author":"Luo","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5622215","DOI":"10.1109\/TGRS.2022.3167644","article-title":"A Multiscale Framework with Unsupervised Learning for Remote Sensing Image Registration","volume":"60","author":"Ye","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1016\/j.inffus.2023.02.004","article-title":"PCNet: A structure similarity enhancement method for multispectral and multimodal image registration","volume":"94","author":"Cao","year":"2023","journal-title":"Inf. Fusion"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Xu, H., Ma, J., Yuan, J., Le, Z., and Liu, W. (2022, January 19\u201320). RFNet: Unsupervised Network for Mutually Reinforcing Multi-Modal Image Registration and Fusion. Proceedings of the the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01906"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Jia, X., Bartlett, J., Chen, W., Song, S., Zhang, T., Cheng, X., Lu, W., Qiu, Z., and Duan, J. (2023, January 7\u201314). Fourier-Net: Fast Image Registration with Band-Limited Deformation. Proceedings of the the AAAI Conference on Artificial Intelligence, Washington, DC, USA.","DOI":"10.1609\/aaai.v37i1.25182"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/LGRS.2016.2600858","article-title":"Remote Sensing Image Registration with Modified SIFT and Enhanced Feature Matching","volume":"14","author":"Ma","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3078","DOI":"10.1109\/TGRS.2018.2790483","article-title":"OS-SIFT: A Robust SIFT-Like Algorithm for High-Resolution Optical-to-SAR Image Registration in Suburban Areas","volume":"56","author":"Xiang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3296","DOI":"10.1109\/TIP.2019.2959244","article-title":"RIFT: Multi-modal Image Matching Based on Radiation-variation Insensitive Feature Transform","volume":"29","author":"Li","year":"2019","journal-title":"IEEE Trans. Image Proces.s"},{"key":"ref_25","first-page":"5621314","article-title":"LNIFT: Locally Normalized Image for Rotation Invariant Multimodal Feature Matching","volume":"60","author":"Li","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1615","DOI":"10.1109\/TPAMI.2005.188","article-title":"A performance evaluation of local descriptors","volume":"27","author":"Mikolajczyk","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/LGRS.2014.2325970","article-title":"A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration","volume":"12","author":"Wu","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TGRS.2014.2323552","article-title":"SAR-SIFT: A SIFT-Like Algorithm for SAR Images","volume":"53","author":"Dellinger","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1109\/LGRS.2014.2343471","article-title":"An Efficient SIFT-Based Mode-Seeking Algorithm for Sub-Pixel Registration of Remotely Sensed Images","volume":"12","author":"Kupfer","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1109\/36.673672","article-title":"An optimal multiedge detector for SAR image segmentation","volume":"36","author":"Fjortoft","year":"1998","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1109\/LGRS.2012.2216500","article-title":"Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT","volume":"10","author":"Fan","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Shechtman, E., and Irani, M. (2007, January 17\u201322). Matching Local Self-Similarities across Images and Videos. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383198"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1707","DOI":"10.1109\/TBME.2010.2042169","article-title":"A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration","volume":"57","author":"Chen","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_35","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1109\/LGRS.2012.2184521","article-title":"Edge Detector of SAR Images Using Gaussian-Gamma-Shaped Bi-Windows","volume":"9","author":"Shui","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5201\/ipol.2012.gjmr-lsd","article-title":"LSD: A Line Segment Detector","volume":"2","author":"Jakubowicz","year":"2012","journal-title":"Image Process. Line"},{"key":"ref_38","unstructured":"Meng, Z., Han, X., and Li, X. (2017, January 1\u20134). An automatic registration method for SAR and optical images based on line extraction and control points selection. Proceedings of the 2017 International Applied Computational Electromagnetics Society Symposium (ACES), Suzhou, China."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"6058","DOI":"10.1109\/TGRS.2015.2431498","article-title":"Automatic Optical-to-SAR Image Registration by Iterative Line Extraction and Voronoi Integrated Spectral Point Matching","volume":"53","author":"Sui","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1109\/TPAMI.1980.4766994","article-title":"Digital Image Enhancement and Noise Filtering by Use of Local Statistics","volume":"PAMI-2","author":"Lee","year":"1980","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"325","DOI":"10.14358\/PERS.71.3.325","article-title":"Semi-automatic registration of multi-source satellite imagery with varying geometric resolutions","volume":"71","author":"Habib","year":"2005","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1109\/TPAMI.2008.300","article-title":"LSD: A fast line segment detector with a false detection control","volume":"32","author":"Jakubowicz","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1007\/s10851-008-0102-5","article-title":"On Straight Line Segment Detection","volume":"32","author":"Jakubowicz","year":"2008","journal-title":"J. Math. Imaging Vis."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"5847","DOI":"10.1109\/JSTARS.2020.3026162","article-title":"Automatic Registration of Optical and SAR Images Via Improved Phase Congruency Model","volume":"13","author":"Xiang","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TGRS.2018.2858817","article-title":"Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set","volume":"57","author":"Ji","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Wang, L., Sun, M., Liu, J., Cao, L., and Ma, G. (2020). A Robust Algorithm Based on Phase Congruency for Optical and SAR Image Registration in Suburban Areas. Remote Sens., 12.","DOI":"10.3390\/rs12203339"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/18\/4548\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:51:48Z","timestamp":1760129508000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/18\/4548"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,15]]},"references-count":46,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["rs15184548"],"URL":"https:\/\/doi.org\/10.3390\/rs15184548","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,15]]}}}