{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T14:36:16Z","timestamp":1773930976889,"version":"3.50.1"},"reference-count":49,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2023,7,31]],"date-time":"2023-07-31T00:00:00Z","timestamp":1690761600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Plan Transfer Payment","award":["2021ZYSF007"],"award-info":[{"award-number":["2021ZYSF007"]}]},{"name":"Science and Technology Plan Transfer Payment","award":["2020CDYB-29"],"award-info":[{"award-number":["2020CDYB-29"]}]},{"name":"Science and Technology Plan Transfer Payment","award":["2021KJT0012-2021YFS0067"],"award-info":[{"award-number":["2021KJT0012-2021YFS0067"]}]},{"name":"Sichuan University and Yibin Municipal People\u2019s Government University","award":["2021ZYSF007"],"award-info":[{"award-number":["2021ZYSF007"]}]},{"name":"Sichuan University and Yibin Municipal People\u2019s Government University","award":["2020CDYB-29"],"award-info":[{"award-number":["2020CDYB-29"]}]},{"name":"Sichuan University and Yibin Municipal People\u2019s Government University","award":["2021KJT0012-2021YFS0067"],"award-info":[{"award-number":["2021KJT0012-2021YFS0067"]}]},{"name":"Key Research and Development Program of Science and Technology Department of Sichuan Province","award":["2021ZYSF007"],"award-info":[{"award-number":["2021ZYSF007"]}]},{"name":"Key Research and Development Program of Science and Technology Department of Sichuan Province","award":["2020CDYB-29"],"award-info":[{"award-number":["2020CDYB-29"]}]},{"name":"Key Research and Development Program of Science and Technology Department of Sichuan Province","award":["2021KJT0012-2021YFS0067"],"award-info":[{"award-number":["2021KJT0012-2021YFS0067"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Neural radiance fields (NeRFs) combining machine learning with differentiable rendering have arisen as one of the most promising approaches for novel view synthesis and depth estimates. However, NeRFs only applies to close-range static imagery and it takes several hours to train the model. The satellites are hundreds of kilometers from the earth. Satellite multi-view images are usually captured over several years, and the scene of images is dynamic in the wild. Therefore, multi-view satellite photogrammetry is far beyond the capabilities of NeRFs. In this paper, we present a new method for multi-view satellite photogrammetry of Earth observation called remote sensing neural radiance fields (RS-NeRFs). It aims to generate novel view images and accurate elevation predictions quickly. For each scene, we train an RS-NeRF using high-resolution optical images without labels or geometric priors and apply image reconstruction losses for self-supervised learning. Multi-date images exhibit significant changes in appearance, mainly due to cars and varying shadows, which brings challenges to satellite photogrammetry. Robustness to these changes is achieved by the input of solar ray direction and the vehicle removal method. NeRFs make it intolerable by requiring a very long time to train an easy scene. In order to significantly reduce the training time of RS-NeRFs, we build a tiny network with HashEncoder and adopted a new sampling technique with our custom CUDA kernels. Compared with previous work, our method performs better on novel view synthesis and elevation estimates, taking several minutes.<\/jats:p>","DOI":"10.3390\/rs15153808","type":"journal-article","created":{"date-parts":[[2023,7,31]],"date-time":"2023-07-31T10:00:15Z","timestamp":1690797615000},"page":"3808","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Remote Sensing Neural Radiance Fields for Multi-View Satellite Photogrammetry"],"prefix":"10.3390","volume":"15","author":[{"given":"Songlin","family":"Xie","sequence":"first","affiliation":[{"name":"College of Electronics and Information Engineering, Sichuan University, Chengdu 610064, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2986-1045","authenticated-orcid":false,"given":"Lei","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Electronics and Information Engineering, Sichuan University, Chengdu 610064, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0651-4278","authenticated-orcid":false,"given":"Gwanggil","family":"Jeon","sequence":"additional","affiliation":[{"name":"Department of Embedded Systems Engineering, Incheon National University, Academyro-119, Incheon 406-772, Republic of Korea"}]},{"given":"Xiaomin","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Electronics and Information Engineering, Sichuan University, Chengdu 610064, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,31]]},"reference":[{"key":"ref_1","first-page":"65","article-title":"Mapping forest aboveground biomass in the reforested Buffelsdraai landfill site using texture combinations computed from SPOT-6 pan-sharpened imagery","volume":"74","author":"Hlatshwayo","year":"2019","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1109\/MGRS.2019.2949679","article-title":"2019 ieee grss data fusion contest: Large-scale semantic 3d reconstruction","volume":"7","author":"Yokoya","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Mag. (GRSM)"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.pss.2016.02.014","article-title":"The High Resolution Stereo Camera (HRSC) of Mars Express and its approach to science analysis and mapping for Mars and its satellites","volume":"126","author":"Gwinner","year":"2016","journal-title":"Planet. Space Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"299","DOI":"10.14358\/PERS.72.3.299","article-title":"Mapping height and biomass of mangrove forests in Everglades National Park with SRTM elevation data","volume":"72","author":"Simard","year":"2006","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Demarez, V., Helen, F., Marais-Sicre, C., and Baup, F. (2019). In-season mapping of irrigated crops using Landsat 8 and Sentinel-1 time series. Remote Sens., 11.","DOI":"10.3390\/rs11020118"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.isprsjprs.2016.09.013","article-title":"3D change detection\u2013approaches and applications","volume":"122","author":"Qin","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo processing by semiglobal matching and mutual information","volume":"30","author":"Hirschmuller","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"d\u2019Angelo, P., and Kuschk, G. (2012, January 22\u201327). Dense multi-view stereo from satellite imagery. Proceedings of the 2012 IEEE International Geoscience and Remote Sensing Symposium, Munich, Germany.","DOI":"10.1109\/IGARSS.2012.6352565"},{"key":"ref_9","first-page":"49","article-title":"An automatic and modular stereo pipeline for pushbroom images","volume":"2","author":"Michel","year":"2014","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Facciolo, G., De Franchis, C., and Meinhardt-Llopis, E. (2017, January 21\u201327). Automatic 3D reconstruction from multi-date satellite images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.198"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"379","DOI":"10.14358\/PERS.85.5.379","article-title":"DSM generation from high resolution multi-view stereo satellite imagery","volume":"85","author":"Gong","year":"2019","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.isprsjprs.2018.03.016","article-title":"3D reconstruction from multi-view VHR-satellite images in MicMac","volume":"139","author":"Rupnik","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.isprsjprs.2016.03.012","article-title":"An automated, open-source pipeline for mass production of digital elevation models (DEMs) from very-high-resolution commercial stereo satellite imagery","volume":"116","author":"Shean","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Mar\u00ed, R., Facciolo, G., and Ehret, T. (2022, January 18\u201324). Sat-NeRF: Learning Multi-View Satellite Photogrammetry with Transient Objects and Shadow Modeling Using RPC Cameras. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPRW56347.2022.00137"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1145\/3503250","article-title":"Nerf: Representing scenes as neural radiance fields for view synthesis","volume":"65","author":"Mildenhall","year":"2021","journal-title":"Commun. ACM"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Barron, J.T., Mildenhall, B., Tancik, M., Hedman, P., Martin-Brualla, R., and Srinivasan, P.P. (2021, January 10\u201317). Mip-nerf: A multiscale representation for anti-aliasing neural radiance fields. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00580"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Martin-Brualla, R., Radwan, N., Sajjadi, M.S., Barron, J.T., Dosovitskiy, A., and Duckworth, D. (2021, January 20\u201325). Nerf in the wild: Neural radiance fields for unconstrained photo collections. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00713"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Park, K., Sinha, U., Barron, J.T., Bouaziz, S., Goldman, D.B., Seitz, S.M., and Martin-Brualla, R. (2021, January 10\u201317). Nerfies: Deformable neural radiance fields. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00581"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"eaaw0863","DOI":"10.1126\/scirobotics.aaw0863","article-title":"AADS: Augmented autonomous driving simulation using data-driven algorithms","volume":"4","author":"Li","year":"2019","journal-title":"Sci. Robot."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ost, J., Mannan, F., Thuerey, N., Knodt, J., and Heide, F. (2021, January 20\u201325). Neural scene graphs for dynamic scenes. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00288"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, Z., Chai, Y., Anguelov, D., Zhou, Y., Sun, P., Erhan, D., Rafferty, S., and Kretzschmar, H. (2020, January 13\u201319). Surfelgan: Synthesizing realistic sensor data for autonomous driving. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01113"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Du, D., Qi, Y., Yu, H., Yang, Y., Duan, K., Li, G., Zhang, W., Huang, Q., and Tian, Q. (2018, January 8\u201314). The unmanned aerial vehicle benchmark: Object detection and tracking. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01249-6_23"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, A., Tucker, R., Jampani, V., Makadia, A., Snavely, N., and Kanazawa, A. (2021, January 10\u201317). Infinite nature: Perpetual view generation of natural scenes from a single image. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01419"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Deng, K., Liu, A., Zhu, J.Y., and Ramanan, D. (2022, January 18\u201324). Depth-supervised nerf: Fewer views and faster training for free. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01254"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tancik, M., Casser, V., Yan, X., Pradhan, S., Mildenhall, B., Srinivasan, P.P., Barron, J.T., and Kretzschmar, H. (2022, January 18\u201324). Block-nerf: Scalable large scene neural view synthesis. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00807"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rematas, K., Liu, A., Srinivasan, P.P., Barron, J.T., Tagliasacchi, A., Funkhouser, T., and Ferrari, V. (2022, January 18\u201324). Urban radiance fields. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01259"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Derksen, D., and Izzo, D. (2021, January 20\u201325). Shadow neural radiance fields for multi-view satellite photogrammetry. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPRW53098.2021.00126"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"M\u00fcller, T., Evans, A., Schied, C., and Keller, A. (2022). Instant neural graphics primitives with a multiresolution hash encoding. arXiv.","DOI":"10.1145\/3528223.3530127"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1145\/2001269.2001293","article-title":"Building rome in a day","volume":"54","author":"Agarwal","year":"2011","journal-title":"Commun. ACM"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/B:VISI.0000027787.82851.b6","article-title":"An automated method for large-scale, ground-based city model acquisition","volume":"60","author":"Zakhor","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Li, X., Wu, C., Zach, C., Lazebnik, S., and Frahm, J.M. (2008, January 12\u201318). Modeling and recognition of landmark image collections using iconic scene graphs. Proceedings of the Computer Vision\u2013ECCV 2008: 10th European Conference on Computer Vision, Marseille, France.","DOI":"10.1007\/978-3-540-88682-2_33"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/s11263-007-0086-4","article-title":"Detailed real-time urban 3d reconstruction from video","volume":"78","author":"Pollefeys","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_33","unstructured":"Snavely, N., Seitz, S.M., and Szeliski, R. (2006). ACM Siggraph 2006 Papers, Association for Computing Machinery."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhu, S., Zhang, R., Zhou, L., Shen, T., Fang, T., Tan, P., and Quan, L. (2018, January 18\u201323). Very large-scale global sfm by distributed motion averaging. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00480"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Schonberger, J.L., and Frahm, J.M. (2016, January 27\u201330). Structure-from-motion revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1029\/2018EA000409","article-title":"The Ames Stereo Pipeline: NASA\u2019s open source software for deriving and processing terrain data","volume":"5","author":"Beyer","year":"2018","journal-title":"Earth Space Sci."},{"key":"ref_38","unstructured":"Rupnik, E., and Deseilligny, M.P. (2019). More surface detail with One-Two-Pixel Matching. [Ph.D. Thesis, Institut G\u00e9ographique National (IGN)]."},{"key":"ref_39","first-page":"15651","article-title":"Neural sparse voxel fields","volume":"33","author":"Liu","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Park, J.J., Florence, P., Straub, J., Newcombe, R., and Lovegrove, S. (2019, January 15\u201320). Deepsdf: Learning continuous signed distance functions for shape representation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00025"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Lombardi, S., Simon, T., Saragih, J., Schwartz, G., Lehrmann, A., and Sheikh, Y. (2019). Neural volumes: Learning dynamic renderable volumes from images. arXiv.","DOI":"10.1145\/3306346.3323020"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1111\/cgf.14507","article-title":"Advances in neural rendering","volume":"Volume 41","author":"Tewari","year":"2022","journal-title":"Computer Graphics Forum"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Xiangli, Y., Xu, L., Pan, X., Zhao, N., Rao, A., Theobalt, C., Dai, B., and Lin, D. (2022, January 23\u201327). Bungeenerf: Progressive neural radiance field for extreme multi-scale scene rendering. Proceedings of the Computer Vision\u2013ECCV 2022: 17th European Conference, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19824-3_7"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Yu, A., Li, R., Tancik, M., Li, H., Ng, R., and Kanazawa, A. (2021, January 10\u201317). Plenoctrees for real-time rendering of neural radiance fields. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00570"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Yang, B., Zhang, Y., Xu, Y., Li, Y., Zhou, H., Bao, H., Zhang, G., and Cui, Z. (2021, January 10\u201317). Learning object-compositional neural radiance field for editable scene rendering. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01352"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3478513.3480500","article-title":"Editable free-viewpoint video using a layered neural representation","volume":"40","author":"Zhang","year":"2021","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zeng, Y., Lin, Z., Lu, H., and Patel, V.M. (2021, January 10\u201317). Cr-fill: Generative image inpainting with auxiliary contextual reconstruction. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01390"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1080\/22797254.2018.1551069","article-title":"Cross-track satellite stereo for 3D modelling of urban areas","volume":"52","author":"Wendt","year":"2019","journal-title":"Eur. J. Remote Sens."},{"key":"ref_49","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/15\/3808\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:23:12Z","timestamp":1760127792000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/15\/3808"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,31]]},"references-count":49,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["rs15153808"],"URL":"https:\/\/doi.org\/10.3390\/rs15153808","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,31]]}}}