{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T14:58:25Z","timestamp":1761663505802,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2016,6,22]],"date-time":"2016-06-22T00:00:00Z","timestamp":1466553600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A city is a dynamic entity, which environment is continuously changing over time. Accordingly, its virtual city models also need to be regularly updated to support accurate model-based decisions for various applications, including urban planning, emergency response and autonomous navigation. A concept of continuous city modeling is to progressively reconstruct city models by accommodating their changes recognized in spatio-temporal domain, while preserving unchanged structures. A first critical step for continuous city modeling is to coherently register remotely sensed data taken at different epochs with existing building models. This paper presents a new model-to-image registration method using a context-based geometric hashing (CGH) method to align a single image with existing 3D building models. This model-to-image registration process consists of three steps: (1) feature extraction; (2) similarity measure; and matching, and (3) estimating exterior orientation parameters (EOPs) of a single image. For feature extraction, we propose two types of matching cues: edged corner features representing the saliency of building corner points with associated edges, and contextual relations among the edged corner features within an individual roof. A set of matched corners are found with given proximity measure through geometric hashing, and optimal matches are then finally determined by maximizing the matching cost encoding contextual similarity between matching candidates. Final matched corners are used for adjusting EOPs of the single airborne image by the least square method based on collinearity equations. The result shows that acceptable accuracy of EOPs of a single image can be achievable using the proposed registration approach as an alternative to a labor-intensive manual registration process.<\/jats:p>","DOI":"10.3390\/s16060932","type":"journal-article","created":{"date-parts":[[2016,6,23]],"date-time":"2016-06-23T18:29:50Z","timestamp":1466706590000},"page":"932","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Matching Aerial Images to 3D Building Models Using Context-Based Geometric Hashing"],"prefix":"10.3390","volume":"16","author":[{"given":"Jaewook","family":"Jung","sequence":"first","affiliation":[{"name":"Department of Earth and Space Science and Engineering, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gunho","family":"Sohn","sequence":"additional","affiliation":[{"name":"Department of Earth and Space Science and Engineering, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kiin","family":"Bang","sequence":"additional","affiliation":[{"name":"Department of Earth and Space Science and Engineering, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andreas","family":"Wichmann","sequence":"additional","affiliation":[{"name":"Institute of Geodesy and Geoinformation Science (IGG), Technische Universit\u00e4t Berlin, Stra\u00dfe des 17. Juni 135, 10623 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Costas","family":"Armenakis","sequence":"additional","affiliation":[{"name":"Department of Earth and Space Science and Engineering, York University, 4700 Keele Street, Toronto, ON M3J 1P3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Kada","sequence":"additional","affiliation":[{"name":"Institute of Geodesy and Geoinformation Science (IGG), Technische Universit\u00e4t Berlin, Stra\u00dfe des 17. Juni 135, 10623 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,6,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Sohn, G., Jung, J., Jwa, Y., and Armenakis, C. (2013, January 28\u201331). Sequential modeling of building rooftops by integrating airborne LiDAR data and optical imagery: Preliminary results. Proceedings of the VCM 2013\u2014The ISPRS Workshop on 3D Virtual City Modeling, Regina, SK, Canada.","DOI":"10.5194\/isprsannals-II-3-W1-27-2013"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1145\/146370.146374","article-title":"A survey of image registration techniques","volume":"24","author":"Brown","year":"1992","journal-title":"ACM Comput. Surv."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/S0262-8856(03)00137-9","article-title":"Image registration method: A survey","volume":"21","author":"Zitova","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_4","first-page":"1049","article-title":"Registration techniques for multisensor remotely sensed imagery","volume":"62","author":"Fonseca","year":"1996","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"699","DOI":"10.14358\/PERS.71.6.699","article-title":"Photogrammetric and LiDAR data registration using linear features","volume":"71","author":"Habib","year":"2005","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_6","unstructured":"Lamdan, Y., and Wolfson, H. (1988, January 5\u20138). Geometric hashing: A general and efficient model-based recognition scheme. Proceedings of the Second International Conference on Computer Vision (ICCV\u201988), Tarpon Springs, FL, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"54","DOI":"10.2174\/1875413901205010054","article-title":"A review of optical imagery and airborne LiDAR data registration methods","volume":"5","author":"Mishra","year":"2012","journal-title":"Open Remote Sens. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1165","DOI":"10.1016\/S0031-3203(02)00081-X","article-title":"Using selective correlation coefficient for robust image registration","volume":"36","author":"Kaneko","year":"2003","journal-title":"Pattern Recognit."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"700","DOI":"10.1109\/TPAMI.1987.4767966","article-title":"Registration of translated and rotated images using finite Fourier transform","volume":"9","author":"Castro","year":"1987","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/A:1007958904918","article-title":"Alignment by maximization of mutual information","volume":"24","author":"Viola","year":"1997","journal-title":"Int. J. Comput. Vis."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wunsch, P., and Hirzinger, G. (1996, January 25\u201329). Registration of CAD-models to images by iterative inverse perspective matching. Proceedings of the 13th International Conference on Pattern Recognition (ICPR\u201996), Vienna, Austria.","DOI":"10.1109\/ICPR.1996.545995"},{"key":"ref_12","unstructured":"Avbelj, J., Iwaszczuk, D., and Stilla, U. (2010, January 1\u20133). Matching of 3D wire-frame building models with image features from infrared video sequences taken by helicopters or UAVs. Proceedings of the Proceedings of PCV 2010\u2014Photogrammetric Computer Vision and Image Analysis, Paris, France."},{"key":"ref_13","unstructured":"Frueh, C., Russell, S., and Zakhor, A. (2004, January 6\u20139). Automated texture mapping of 3D city models with oblique aerial imagery. Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission, Thessaloniki, Greece."},{"key":"ref_14","unstructured":"Hsu, S., Samarasekera, S., Kumar, R., and Sawhney, H.S. (2000, January 13\u201315). Pose estimation, model refinement, and enhanced visualization using video. Proceedings of the 2000 IEEE Conference on Computer Society Computer Vision and Pattern Recognition, Hilton Head, SC, USA."},{"key":"ref_15","unstructured":"Eugster, H., and Neibiker, S. (2009, January 21\u201324). Real-time georegistration of video streams from mini or micro UAS using digital 3D city models. Proceedings of the 6th International Symposium on Mobile Mapping Technology, Presidente Prudente, Brazil."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.isprsjprs.2014.05.010","article-title":"Coregistration refinement of hyperspectral images and DSM: An object-based approach using spectral information","volume":"100","author":"Avbelj","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Iwaszczuk, D., Helmholz, P., Belton, D., and Stilla, U. (2013, January 21\u201324). Model-to-image registration and automatic texture mapping using a video sequence taken by a mini UAV. Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Hannover, Germany.","DOI":"10.5194\/isprsarchives-XL-1-W1-151-2013"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1016\/j.isprsjprs.2014.12.025","article-title":"Automatic registration of UAV-borne sequent images and LiDAR data","volume":"101","author":"Yang","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"847","DOI":"10.14358\/PERS.81.11.847","article-title":"Automatic co-registration of pan-tilt-zoom (PTZ) video images with 3D wireframe models","volume":"81","author":"Persad","year":"2015","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_20","unstructured":"Tian, Y., Gerke, M., Vosselman, G., and Zhu, Q. (2008, January 3\u201311). Automatic edge matching across an image sequence based on reliable points. Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Science, Beijing, China."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/0004-3702(87)90070-1","article-title":"Three-dimensional object recognition from single two-dimensional images","volume":"31","author":"Lowe","year":"1987","journal-title":"Artif. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1111\/j.0031-868X.2004.00290.x","article-title":"A model-based approach to semi-automated reconstruction of buildings from aerial images","volume":"19","author":"Khoshelham","year":"2004","journal-title":"Photogramm. Record"},{"key":"ref_23","first-page":"769","article-title":"Mapping by dragging and fitting of wire-frame models","volume":"65","author":"Vosselman","year":"1999","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_24","unstructured":"Ding, M., Lyngbaek, K., and Zakhor, A. (2008, January 24\u201326). Automatic registration of aerial imagery with untextured 3D LiDAR models. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, L., and Neumann, U. (2009, January 22\u201325). A robust approach for automatic registration of aerial images with untextured aerial LiDAR data. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201909), Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206600"},{"key":"ref_26","unstructured":"Kovesi, P.D. MATLAB and Octave Functions for Computer Vision and Image Processing. Available online: http:\/\/www.peterkovesi.com\/matlabfns\/."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.isprsjprs.2012.09.003","article-title":"Matching of straight line segments from aerial stereo images of urban areas","volume":"74","author":"Ok","year":"2012","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/99.641604","article-title":"Geometric hashing: An overview","volume":"4","author":"Wolfson","year":"1997","journal-title":"IEEE Trans. Comput. Sci. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Rottensteiner, F., Sohn, G., Jung, J., Gerke, M., Baillard, C., Benitex, S., and Breitkopf, U. (September, January 25). The ISPRS benchmark on urban object classification and 3D building reconstruction. Proceedings of the ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Melbourne, Australia.","DOI":"10.5194\/isprsannals-I-3-293-2012"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sohn, G., Jwa, Y., Jung, J., and Kim, H.B. (September, January 25). An implicit regularization for 3D building rooftop modeling using airborne data. Proceedings of the ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Melbourne, Australia.","DOI":"10.5194\/isprsannals-I-3-305-2012"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kada, M., and Wichmann, A. (2013, January 12). Feature-driven 3D building modeling using planar halfspaces. Proceedings of the ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Antalya, Turkey.","DOI":"10.5194\/isprsannals-II-3-W3-37-2013"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wichmann, A., and Kada, M. (2014, January 5\u20137). 3D building adjustment using planar half-space regularities. Proceedings of the ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Zurich, Switzerland.","DOI":"10.5194\/isprsannals-II-3-189-2014"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1127\/1432-8364\/2010\/0041","article-title":"The DGPF-test on digital aerial camera evaluation\u2014Overview and test design","volume":"2","author":"Cramer","year":"2010","journal-title":"Photogramm. Fernerkund. Geoinform."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/6\/932\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:24:29Z","timestamp":1760210669000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/6\/932"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,6,22]]},"references-count":34,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2016,6]]}},"alternative-id":["s16060932"],"URL":"https:\/\/doi.org\/10.3390\/s16060932","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2016,6,22]]}}}