{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:02:45Z","timestamp":1760148165312,"version":"build-2065373602"},"reference-count":55,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,4,2]],"date-time":"2023-04-02T00:00:00Z","timestamp":1680393600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41971427","221100211000-4","42-Y30B04-9001-19\/21"],"award-info":[{"award-number":["41971427","221100211000-4","42-Y30B04-9001-19\/21"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Song Shan Laboratory","award":["41971427","221100211000-4","42-Y30B04-9001-19\/21"],"award-info":[{"award-number":["41971427","221100211000-4","42-Y30B04-9001-19\/21"]}]},{"name":"High-Resolution Remote Sensing, Surveying, and Mapping Application Demonstration System","award":["41971427","221100211000-4","42-Y30B04-9001-19\/21"],"award-info":[{"award-number":["41971427","221100211000-4","42-Y30B04-9001-19\/21"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>In the field of geoinformation science, multiview, image-based 3D city modeling has developed rapidly, and image depth estimation is an important step in it. To address the problems of the poor adaptability of training models of existing neural network methods and the long reconstruction time of traditional geometric methods, we propose a general depth estimation method for fast 3D city modeling that combines prior knowledge and information propagation. First, the original image is downsampled and input into the neural network to predict the initial depth value. Then, depth plane fitting and joint optimization are combined with the superpixel information and the superpixel optimized depth value is upsampled to the original resolution. Finally, the depth information propagation is checked pixel-by-pixel to obtain the final depth estimate. Experiments were conducted using multiple image datasets taken from actual indoor and outdoor scenes. Our method was compared and analyzed with a variety of existing widely used methods. The experimental results show that our method maintains high reconstruction accuracy and a fast reconstruction speed, and it achieves better performance. This paper offers a framework to integrate neural networks and traditional geometric methods, which provide a new approach for obtaining geographic information and fast 3D city modeling.<\/jats:p>","DOI":"10.3390\/ijgi12040150","type":"journal-article","created":{"date-parts":[[2023,4,3]],"date-time":"2023-04-03T01:37:05Z","timestamp":1680485825000},"page":"150","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Joint Deep Learning and Information Propagation for Fast 3D City Modeling"],"prefix":"10.3390","volume":"12","author":[{"given":"Yang","family":"Dong","sequence":"first","affiliation":[{"name":"Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiaxuan","family":"Song","sequence":"additional","affiliation":[{"name":"Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dazhao","family":"Fan","sequence":"additional","affiliation":[{"name":"Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Song","family":"Ji","sequence":"additional","affiliation":[{"name":"Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rong","family":"Lei","sequence":"additional","affiliation":[{"name":"Institute of Surveying and Mapping, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo Processing by Semiglobal Matching and Mutual Information","volume":"30","author":"Hirschmuller","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1841","DOI":"10.1109\/LGRS.2020.3008268","article-title":"High-Resolution Satellite Stereo Matching by Object-Based Semiglobal Matching and Iterative Guided Edge-Preserving Filter","volume":"18","author":"Tatar","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1109\/TCSVT.2021.3061200","article-title":"A High-Throughput Depth Estimation Processor for Accurate Semiglobal Stereo Matching Using Pipelined Inter-Pixel Aggregation","volume":"32","author":"Lee","year":"2022","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Khan, M.A.U., Nazir, D., Pagani, A., Mokayed, H., Liwicki, M., Stricker, D., and Afzal, M.Z. (2022). A Comprehensive Survey of Depth Completion Approaches. Sensors, 22.","DOI":"10.20944\/preprints202205.0343.v1"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Liao, Y.H., and Zhang, S. (2022). Semi-Global Matching Assisted Absolute Phase Unwrapping. Sensors, 30.","DOI":"10.1364\/OE.470704"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1145\/1531326.1531330","article-title":"PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing","volume":"28","author":"Barnes","year":"2009","journal-title":"ACM Trans. Graph."},{"key":"ref_7","unstructured":"Bleyer, M., Rhemann, C., and Rother, C. (\u2013, January 29). PatchMatch Stereo-Stereo Matching with Slanted Support Windows. Proceedings of the British Machine Vision Conference, Dundee, UK."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1901","DOI":"10.1109\/TIP.2013.2237921","article-title":"Accurate Multiple View 3D Reconstruction Using Patch-Based Stereo for Large-Scale Scenes","volume":"22","author":"Shen","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zheng, E., Dunn, E., Jojic, V., and Frahm, J.M. (2014, January 23\u201328). PatchMatch Based Joint View Selection and Depthmap Estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.196"},{"key":"ref_10","unstructured":"Xu, Q., and Tao, W. (2018). Multi-View Stereo with Asymmetric Checkerboard Propagation and Multi-Hypothesis Joint View Selection. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Yang, X., and Jiang, G. (2021). A Practical 3D Reconstruction Method for Weak Texture Scenes. Remote Sens., 13.","DOI":"10.3390\/rs13163103"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ji, M., Gall, J., Zheng, H., Liu, Y., and Fang, L. (2017, January 22\u201329). SurfaceNet: An End-to-End 3D Neural Network for Multiview Stereopsis. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.253"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yao, Y., Luo, Z., Li, S., Fang, T., and Quan, L. (2018, January 8\u201314). MVSNet: Depth Inference for Unstructured Multi-view Stereo. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01237-3_47"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2040","DOI":"10.1007\/s11263-022-01628-2","article-title":"Learning Inverse Depth Regression for Pixelwise Visibility-Aware Multi-View Stereo Networks","volume":"130","author":"Xu","year":"2022","journal-title":"Int. J. Comput. Vis."},{"key":"ref_15","unstructured":"Dong, Y. (2020). Spatio-Temporally Coherent 4D Reconstruction from Multiple View Video, Information Engineering University."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1109\/TPAMI.2009.161","article-title":"Accurate, Dense, and Robust Multiview Stereopsis","volume":"32","author":"Furukawa","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hernandez, C., Vogiatzis, G., and Cipolla, R. (2007, January 18\u201323). Probabilistic Visibility for Multi-View Stereo. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383193"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Campbell, N.D.F., Vogiatzis, G., Hern\u00e1ndez, C., and Cipolla, R. (2008, January 12\u201318). Using Multiple Hypotheses to Improve Depth-Maps for Multi-View Stereo. Proceedings of the European Conference on Computer Vision, Marseille, France.","DOI":"10.1007\/978-3-540-88682-2_58"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1109\/TPAMI.2005.44","article-title":"A Quasi-Dense Approach to Surface Reconstruction from Uncalibrated Images","volume":"27","author":"Lhuillier","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Habbecke, M., and Kobbelt, L. (2007, January 18\u201323). A Surface-Growing Approach to Multi-View Stereo Reconstruction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383195"},{"key":"ref_21","unstructured":"Zhu, Z. (2015). Research on Dense 3D Reconstruction from Unordered Images, National University of Defense Technology. Available online: https:\/\/cdmd.cnki.com.cn\/Article\/CDMD-90002-1017834269.htm."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Curless, B., and Levoy, M. (1996, January 4\u20139). A Volumetric Method for Building Complex Models from Range Images. Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA.","DOI":"10.1145\/237170.237269"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zach, C., Pock, T., and Bischof, H. (2007, January 14\u201320). A Globally Optimal Algorithm for Robust TV-L1 Range Image Integration. Proceedings of the IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4408983"},{"key":"ref_24","unstructured":"Vogiatzis, G., Torr, P.H., and Cipolla, R. (2005, January 21\u201323). Multi-View Stereo via Volumetric Graph-Cuts. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Sinha, S.N., Mordohai, P., and Pollefeys, M. (2007, January 14\u201320). Multi-View Stereo via Graph Cuts on the Dual of an Adaptive Tetrahedral Mesh. Proceedings of the IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4408997"},{"key":"ref_26","unstructured":"Furukawa, Y., Curless, B., Seitz, S.M., and Szeliski, R. (October, January 27). Reconstructing Building Interiors from Images. Proceedings of the IEEE International Conference on Computer Vision, Kyoto, Japan."},{"key":"ref_27","unstructured":"Goesele, M., Curless, B., and Seitz, S.M. (2006, January 17\u201322). Multi-View Stereo Revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New York, NY, USA."},{"key":"ref_28","unstructured":"Strecha, C., Fransens, R., and Van Gool, L. (2006, January 17\u201322). Combined Depth and Outlier Estimation in Multi-View Stereo. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New York, NY, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2241","DOI":"10.1109\/TPAMI.2007.70712","article-title":"Multiview Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency","volume":"29","author":"Vogiatzis","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Goesele, M., Snavely, N., Curless, B., Hoppe, H., and Seitz, S.M. (2007, January 14\u201320). Multi-View Stereo for Community Photo Collections. Proceedings of the IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4408933"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hu, X., and Mordohai, P. (2012, January 13\u201315). Least Commitment, Viewpoint-Based, Multi-View Stereo. Proceedings of the International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission, Zurich, Switzerland.","DOI":"10.1109\/3DIMPVT.2012.60"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Bailer, C., Finckh, M., and Lensch, H.P. (2012, January 7\u201313). Scale Robust Multi View Stereo. Proceedings of the European Conference on Computer Vision, Florence, Italy.","DOI":"10.1007\/978-3-642-33712-3_29"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Galliani, S., Lasinger, K., and Schindler, K. (2015, January 7\u201313). Massively Parallel Multiview Stereopsis by Surface Normal Diffusion. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.106"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Schonberger, J.L., Zheng, E., Frahm, J.-M., and Pollefeys, M. (2016, January 11\u201314). Pixelwise View Selection for Unstructured Multi-View Stereo. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_31"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wei, J., Resch, B., and Lensch, H. (2014, January 1\u20135). Multi-View Depth Map Estimation With Cross-View Consistency. Proceedings of the British Machine Vision Conference, Nottingham, UK.","DOI":"10.5244\/C.28.76"},{"key":"ref_36","unstructured":"Romanoni, A., and Matteucci, M. (November, January 27). TAPA-MVS: Textureless-Aware PAtchMatch Multi-View Stereo. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Xu, Z., Liu, Y., Shi, X., Wang, Y., and Zheng, Y. (2020, January 14\u201319). MARMVS: Matching Ambiguity Reduced Multiple View Stereo for Efficient Large Scale Scene Reconstruction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00602"},{"key":"ref_38","first-page":"4945","article-title":"Multi-Scale Geometric Consistency Guided and Planar Prior Assisted Multi-View Stereo","volume":"45","author":"Xu","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Hartmann, W., Galliani, S., Havlena, M., Van Gool, L., and Schindler, K. (2017, January 22\u201329). Learned Multi-patch Similarity. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.176"},{"key":"ref_40","unstructured":"Kar, A., H\u00e4ne, C., and Malik, J. (2017, January 4\u20139). Learning a Multi-View Stereo Machine. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Gu, X., Fan, Z., Zhu, S., Dai, Z., Tan, F., and Tan, P. (2020, January 14\u201319). Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00257"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Wang, F., Galliani, S., Vogel, C., Speciale, P., and Pollefeys, M. (2021, January 19\u201325). PatchmatchNet: Learned Multi-View Patchmatch Stereo. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, virtual.","DOI":"10.1109\/CVPR46437.2021.01397"},{"key":"ref_43","unstructured":"Thomas, S., Johannes, L.S., Silvano, G., Torsten, S., Konrad, S., Marc, P., and Andreas, G. (2022, November 19). ETH3D Benchmark. Available online: https:\/\/www.eth3d.net."},{"key":"ref_44","first-page":"228","article-title":"The Purification Method of Matching Points Based on Principal Component Analysis","volume":"46","author":"Dong","year":"2017","journal-title":"Acta Geod. Cartogr. Sin."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Yamaguchi, K., McAllester, D., and Urtasun, R. (2014, January 6\u201312). Efficient Joint Segmentation, Occlusion Labeling, Stereo and Flow Estimation. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_49"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nberger, J.L., and Frahm, J. (2016, January 27\u201330). Structure-from-Motion Revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Sch\u00f6ps, T., Sattler, T., and Pollefeys, M. (2019, January 16\u201320). BAD SLAM: Bundle Adjusted Direct RGB-D SLAM. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00022"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Sch\u00f6ps, T., Sch\u00f6nberger, J.L., Galliani, S., Sattler, T., Schindler, K., Pollefeys, M., and Geiger, A. (2017, January 21\u201326). A Multi-view Stereo Benchmark with High-Resolution Images and Multi-camera Videos. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.272"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1111\/cgf.13841","article-title":"Pyramid Multi-View Stereo with Local Consistency","volume":"38","author":"Liao","year":"2019","journal-title":"Comput. Graph. Forum"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Locher, A., Perdoch, M., and Van Gool, L. (2016, January 27\u201330). Progressive Prioritized Multi-view Stereo. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.353"},{"key":"ref_51","unstructured":"Fuhrmann, S., Langguth, F., and Goesele, M. (2014, January 6\u20138). MVE\u2014A Multi-View Reconstruction Environment. Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage, Darmstadt, Germany."},{"key":"ref_52","unstructured":"Cernea, D. (2022, November 19). OpenMVS: Multi-View Stereo Reconstruction Library. Available online: https:\/\/cdcseacave.github.io\/openMVS."},{"key":"ref_53","unstructured":"Ren, C., Prisacariu, V., and Reid, I. (2015). gSLICr: SLIC superpixels at over 250Hz. arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","article-title":"SLIC Superpixels Compared to State-of-the-Art Superpixel Methods","volume":"34","author":"Achanta","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1007\/s11263-016-0902-9","article-title":"Large-Scale Data for Multiple-View Stereopsis","volume":"120","author":"Jensen","year":"2016","journal-title":"Int. J. Comput. Vis."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/12\/4\/150\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:08:38Z","timestamp":1760123318000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/12\/4\/150"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,2]]},"references-count":55,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["ijgi12040150"],"URL":"https:\/\/doi.org\/10.3390\/ijgi12040150","relation":{},"ISSN":["2220-9964"],"issn-type":[{"type":"electronic","value":"2220-9964"}],"subject":[],"published":{"date-parts":[[2023,4,2]]}}}