{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T11:22:15Z","timestamp":1773055335938,"version":"3.50.1"},"reference-count":54,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2021,9,4]],"date-time":"2021-09-04T00:00:00Z","timestamp":1630713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>We have used high-resolution digital terrain models (DTMs) of two rover landing sites based on mosaicked images from the High-Resolution Imaging Science Experiment (HiRISE) camera as a reference to evaluate DTMs based on High-Resolution Stereo Camera (HRSC) and Context Camera (CTX) images. The Next-Generation Automatic Terrain Extraction (NGATE) matcher in the SOCET SET and GXP\u00ae commercial photogrammetric systems produces DTMs with good (small) horizontal resolution but large vertical error. Somewhat surprisingly, results for NGATE are terrain dependent, with poorer resolution and smaller errors on smoother surfaces. Multiple approaches to smoothing the NGATE DTMs give similar tradeoffs between resolution and error; a 5 \u00d7 5 lowpass filter is near optimal in terms of both combined resolution-error performance and local slope estimation. Smoothing with an area-based matcher, the standard processing for U.S. Geological Survey planetary DTMs, yields similar errors to the 5 \u00d7 5 filter at slightly worse resolution. DTMs from the HRSC team processing pipeline fall within this same trade space but are less sensitive to terrain roughness. DTMs produced with the Ames Stereo Pipeline also fall in this space at resolutions intermediate between NGATE and the team pipeline. Considered individually, resolution and error each varied by approximately a factor of 2. Matching errors were 0.2\u20130.5 pixels but most results fell in the 0.2\u20130.3 pixel range that has been stated as a rule of thumb in multiple prior studies. Horizontal resolutions of 10\u201320 image pixels were found, consistently greater than the 3\u20135 pixel spacing generally used for stereo DTM production. Resolution and precision were inversely correlated; their product varied by \u226420% (4\u20135 pixels squared). Refinement of the stereo DTM by photoclinometry can yield quantitative improvement in resolution (more than a factor of 2), provided that albedo variations over distances smaller than the stereo DTM resolution are not too severe. We offer specific guidance for both producers and users of planetary stereo DTMs, based on our results.<\/jats:p>","DOI":"10.3390\/rs13173511","type":"journal-article","created":{"date-parts":[[2021,9,6]],"date-time":"2021-09-06T13:18:26Z","timestamp":1630934306000},"page":"3511","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Evaluating Stereo Digital Terrain Model Quality at Mars Rover Landing Sites with HRSC, CTX, and HiRISE Images"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0842-9226","authenticated-orcid":false,"given":"Randolph L.","family":"Kirk","sequence":"first","affiliation":[{"name":"U.S. Geological Survey, Astrogeology Science Center, 2255 N. Gemini Dr., Flagstaff, AZ 86001, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8351-1807","authenticated-orcid":false,"given":"David P.","family":"Mayer","sequence":"additional","affiliation":[{"name":"U.S. Geological Survey, Astrogeology Science Center, 2255 N. Gemini Dr., Flagstaff, AZ 86001, USA"}]},{"given":"Robin L.","family":"Fergason","sequence":"additional","affiliation":[{"name":"U.S. Geological Survey, Astrogeology Science Center, 2255 N. Gemini Dr., Flagstaff, AZ 86001, USA"}]},{"given":"Bonnie L.","family":"Redding","sequence":"additional","affiliation":[{"name":"U.S. Geological Survey, Astrogeology Science Center, 2255 N. Gemini Dr., Flagstaff, AZ 86001, USA"}]},{"given":"Donna M.","family":"Galuszka","sequence":"additional","affiliation":[{"name":"U.S. Geological Survey, Astrogeology Science Center, 2255 N. Gemini Dr., Flagstaff, AZ 86001, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8842-389X","authenticated-orcid":false,"given":"Trent M.","family":"Hare","sequence":"additional","affiliation":[{"name":"U.S. Geological Survey, Astrogeology Science Center, 2255 N. Gemini Dr., Flagstaff, AZ 86001, USA"}]},{"given":"Klaus","family":"Gwinner","sequence":"additional","affiliation":[{"name":"Institute of Planetary Research, German Aerospace Center (DLR) Rutherfordstra\u00dfe 2, D-12489 Berlin, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2173","DOI":"10.1016\/j.pss.2007.07.006","article-title":"Evaluating planetary digital terrain models\u2014The HRSC DTM test","volume":"55","author":"Heipke","year":"2007","journal-title":"Planet. Space Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"23689","DOI":"10.1029\/2000JE001364","article-title":"Mars Orbiter Laser Altimeter: Experiment summary after the first year of global mapping of Mars","volume":"106","author":"Smith","year":"2001","journal-title":"J. Geophys. Res."},{"key":"ref_3","unstructured":"Neukum, G., and Jaumann, R. (2004). HRSC: The High Resolution Stereo Camera of Mars Express. Mars Express: The Scientific Payload (ESA SP-1240), ESA Publications Division, ESTEC."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"105077","DOI":"10.1016\/j.pss.2020.105077","article-title":"Assessing stereophotoclinometry by modeling a physical wall representing asteroid Bennu","volume":"193","author":"Craft","year":"2020","journal-title":"Planet. Space Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"103","DOI":"10.5194\/isprs-annals-III-4-103-2016","article-title":"The effect of illumination on stereo DTM quality: Simulations in support of Europa exploration","volume":"III-4","author":"Kirk","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"McEwen, A.S., Eliason, E.M., Bergstrom, J.W., Bridges, N.T., Hansen, C.J., Delamere, W.A., Grant, J.A., Gulick, V.C., Herkenhoff, K.E., and Keszthelyi, L. (2007). Mars Reconnaissance Orbiter\u2019s High Resolution Imaging Science Experiment (HiRISE). J. Geophys. Res., 112.","DOI":"10.1029\/2005JE002605"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Malin, M.C., Bell, J.F., Cantor, B.A., Caplinger, M.A., Calvin, W.M., Clancy, R.T., Edgett, K.S., Edwards, L., Haberle, R.M., and James, P.B. (2007). Context Camera Investigation on board the Mars Reconnaissance Orbiter. J. Geophys. Res., 112.","DOI":"10.1029\/2006JE002808"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1007\/s11214-012-9916-y","article-title":"Selection of the Mars Science Laboratory Landing Site","volume":"170","author":"Golombek","year":"2012","journal-title":"Space Sci. Rev."},{"key":"ref_9","first-page":"EPSC-DPS2011\u20131465","article-title":"Near-complete 1-m topographic models of the MSL candidate landing sites: Site safety and quality evaluation","volume":"6","author":"Kirk","year":"2011","journal-title":"Eur. Planet. Sci. Conf."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"69","DOI":"10.5194\/isprs-archives-XLII-3-W1-69-2017","article-title":"Community tools for cartographic and photogrammetric processing of Mars Express HRSC images","volume":"42","author":"Kirk","year":"2017","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_11","unstructured":"Wu, B., Di, K., Oberst, J., and Karachevtseva, I.P. (2018). Community tools for cartographic and photogrammetric processing of Mars Express HRSC images. Planetary Remote Sensing and Mapping, Taylor & Francis."},{"key":"ref_12","unstructured":"Fergason, R.L., Hare, T.M., Mayer, D.P., Galuszka, D.M., Redding, B.L., Cheng, Y., and Otero, R.E. (2019, January 18\u201320). Mars 2020 Terrain Relative Navigation support: Digital terrain model generation and mosaicking process improvement. Proceedings of the 4th Planetary Data Workshop, Flagstaff, AZ, USA. LPI Contribution 2151."},{"key":"ref_13","first-page":"2020","article-title":"Mars 2020 Terrain Relative Navigation flight product generation: Digital terrain model and orthorectified image mosaic","volume":"51","author":"Fergason","year":"2020","journal-title":"Lunar Planet. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1129","DOI":"10.5194\/isprs-archives-XLIII-B3-2020-1129-2020","article-title":"Evaluating stereo DTM quality at Jezero crater, Mars with HRSC, CTX, and HIRISE images","volume":"43","author":"Kirk","year":"2020","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"659","DOI":"10.5194\/isprs-archives-XLIII-B3-2021-659-2021","article-title":"Further adventures in Mars DTM quality: Smoothing errors, sharpening details","volume":"43","author":"Kirk","year":"2021","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1029\/2018EA000409","article-title":"The Ames Stereo Pipeline: NASA\u2019s open source software for deriving and processing terrain data","volume":"5","author":"Beyer","year":"2018","journal-title":"Earth Space Sci."},{"key":"ref_17","first-page":"2727","article-title":"Regional HRSC multi-orbit digital terrain models for the Mars Science Laboratory candidate landing sites","volume":"41","author":"Gwinner","year":"2010","journal-title":"Lunar Planet. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.pss.2016.02.014","article-title":"The High Resolution Stereo Camera (HRSC) of Mars Express and its approach to science analysis and mapping for Mars and its satellites","volume":"126","author":"Gwinner","year":"2016","journal-title":"Planet. Space Sci."},{"key":"ref_19","first-page":"EGU21\u20132745","article-title":"Topographic mapping of the Mars MC quadrangles using HRSC data","volume":"23","author":"Kersten","year":"2021","journal-title":"EGU Gen. Assem."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"506","DOI":"10.1016\/j.epsl.2009.11.007","article-title":"Topography of Mars from global mapping by HRSC high-resolution digital terrain models and orthoimages: Characteristics and performance","volume":"294","author":"Gwinner","year":"2010","journal-title":"Earth Planet. Sci. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.14358\/PERS.75.9.1127","article-title":"Derivation and validation of high-resolution digital terrain models from Mars Express HRSC-data","volume":"75","author":"Gwinner","year":"2009","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_22","first-page":"2739","article-title":"The USGS Integrated Software for Imagers and Spectrometers (ISIS 3) instrumentsupport, new capabilities, and releases","volume":"48","author":"Sides","year":"2017","journal-title":"Lunar Planet. Sci."},{"key":"ref_23","unstructured":"(2021, July 01). USGS-Astrogeology\/ISIS3. Available online: https:\/\/github.com\/USGS-Astrogeology\/ISIS3."},{"key":"ref_24","first-page":"256","article-title":"Further developments of Leica digital photogrammetric systems by Helava","volume":"3","author":"Miller","year":"1993","journal-title":"ACSM\/ASPRS Annu. Conv. Expo. Tech. Pap."},{"key":"ref_25","first-page":"4","article-title":"Die Entwicklung der digitalen photogrammetrischen Systeme von Leica und Helava","volume":"63","author":"Miller","year":"1995","journal-title":"Z. Photogramm. Fernerkund."},{"key":"ref_26","unstructured":"(2021, July 01). USGS-Astrogeology\/Socet_Set. Available online: https:\/\/github.com\/USGS-Astrogeology\/socet_set."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kirk, R.L., Howington-Kraus, E., Rosiek, M.R., Anderson, J.A., Archinal, B.A., Becker, K.J., Cook, D.A., Galuszka, D.M., Geissler, P.E., and Hare, T.M. (2008). Ultrahigh resolution topographic mapping of Mars with MRO HiRISE stereo images: Meter-scale slopes of candidate Phoenix landing sites. J. Geophys. Res., 113.","DOI":"10.1029\/2007JE003000"},{"key":"ref_28","unstructured":"Zhang, B. (2006, January 26\u201327). Towards a higher level of automation in softcopy photogrammetry: NGATE and LIDAR processing in SOCET SET. Proceedings of the Geocue Corporation 2nd Annual Technical Exchange Conference, Nashville, TN, USA."},{"key":"ref_29","unstructured":"Zhang, B., Miller, S.B., DeVenecia, K., and Walker, A.S. (2006, January 1\u20135). Automatic terrain extraction using multiple image pair and back matching. Proceedings of the ASPRS 2006 Annual Conference, Reno, NV, USA."},{"key":"ref_30","unstructured":"Zhang, B., and Miller, S.B. (1997, January 21\u201325). Adaptive Automatic Terrain Extraction. Proceedings of the SPIE 3072, Integrating Photogrammetric Techniques with Scene Analysis and Machine Vision III, Orlando, FL, USA."},{"key":"ref_31","first-page":"1604","article-title":"An Improved Workflow for Producing Digital Terrain Models of Mars from CTX Stereo Data Using the NASA Ames Stereo Pipeline","volume":"49","author":"Mayer","year":"2018","journal-title":"Lunar Planet. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"8088","DOI":"10.1029\/2003JE002131","article-title":"High-resolution topomapping of candidate MER landing sites with Mars Orbiter Camera narrow-angle images","volume":"108","author":"Kirk","year":"2003","journal-title":"J. Geophys. Res."},{"key":"ref_33","unstructured":"Beyer, R., Alexandrov, O., Scott, M., Broxton, M., Lundy, M., Husmann, K., Edwards, L., Nefian, A., Smith, B., and Shean, D. (2021, September 03). NeoGeographyToolkit\/StereoPipeline 2.7.0. Available online: https:\/\/zenodo.org\/record\/3963341#.YTW1398RVPZ."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo processing by semiglobal matching and mutual information","volume":"30","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","first-page":"305","article-title":"Stereo processing of HRSC Mars Express images by semi-global matching","volume":"36","author":"Meyer","year":"2006","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_36","unstructured":"Facciolo, G., De Franchis, C., and Meinhard, E. A significantly more global matching for stereovision. Proceedings of the British Machine Vision Conf. (BMVC)."},{"key":"ref_37","first-page":"151","article-title":"Non-parametric local transforms for computing visual correspondence","volume":"Volume 801","author":"Eklundh","year":"1994","journal-title":"Computer Vision\u2014ECCV \u201994"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"59","DOI":"10.5194\/isprs-annals-III-3-59-2016","article-title":"Texture-aware dense image matching using ternary census transform","volume":"III-4","author":"Hua","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_39","unstructured":"Kirk, R.L., Barrett, J.M., and Soderblom, L.A. (2003, January 22). Photoclinometry made simple\u2026?. Proceedings of the ISPRS Working Group IV\/9 Workshop \u201cAdvances in Planetary Mapping 2003\u201d, Houston, TX, USA. Available online: https:\/\/astropedia.astrogeology.usgs.gov\/download\/Research\/ISPRS\/Kirk_isprs_mar03.pdf."},{"key":"ref_40","first-page":"487","article-title":"Topomapping of Mars with HRSC images, ISIS, and a commercial stereo workstation","volume":"XXXVI-4","author":"Kirk","year":"2006","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_41","first-page":"2703","article-title":"Criteria for automated identification of stereo image pairs","volume":"46","author":"Becker","year":"2015","journal-title":"Lunar Planet. Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"8072","DOI":"10.1029\/2003JE002074","article-title":"Mars Exploration Rover Landing Site Selection","volume":"108","author":"Golombek","year":"2003","journal-title":"J. Geophys. Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1007\/BF00218156","article-title":"Effect of resolution on the speed and accuracy of particle image velocimetry interrogation","volume":"13","author":"Prasad","year":"1992","journal-title":"Exp. Fluids"},{"key":"ref_44","first-page":"2193","article-title":"How well do we know Europa\u2019s topography? Assessing variability in digital terrain models","volume":"49","author":"Bland","year":"2018","journal-title":"Lunar Planet. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1135","DOI":"10.1016\/S0032-0633(96)00061-X","article-title":"Clementine imagery: Selenographic coverage for cartographic and scientific use","volume":"44","author":"Cook","year":"1996","journal-title":"Planet. Space Sci."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"8868","DOI":"10.1029\/1998JE900012","article-title":"Digital photogrammetric analysis of the IMP camera images: Mapping the Mars Pathfinder landing site in three dimensions","volume":"104","author":"Kirk","year":"1999","journal-title":"J. Geophys. Res."},{"key":"ref_47","unstructured":"Slama, C.C., Theurer, C., and Henriksen, S.W. (1980). Definitions of terms and symbols used in photogrammetry. Manual of Photogrammetry, American Society of Photogrammetry. [4th ed.]."},{"key":"ref_48","unstructured":"Zhang, B. (2021, July 01). Automatic Spatial Modeler (ASM): Elevation by Innovation. BAE Systems White Paper. Available online: https:\/\/www.geospatialexploitationproducts.com\/wp-content\/uploads\/2019\/06\/sgxp_automatic-spatial-modeler.pdf."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.pss.2018.02.012","article-title":"Massive stereo-based DTM production for Mars on cloud computers","volume":"154","author":"Tao","year":"2018","journal-title":"Planet. Space Sci."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"3795","DOI":"10.1016\/j.patcog.2012.03.023","article-title":"Progressively weighted affine adaptive correlation matching for quasi-dense 3D reconstruction","volume":"45","author":"Shin","year":"2012","journal-title":"Pattern Recogn."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/s11214-010-9634-2","article-title":"Lunar Reconnaissance Orbiter Camera (LROC) instrument overview","volume":"150","author":"Robinson","year":"2010","journal-title":"Space Sci. Rev."},{"key":"ref_52","unstructured":"Henriksen, M.R., Manheim, M.R., and Robinson, M.S. (2020, January 28\u201329). LROC NAC Digital Terrain Models: Production and availability. Proceedings of the Lunar Surace Science Workshop, virtual meeting, LPI Contribution 2241."},{"key":"ref_53","first-page":"3065","article-title":"The Europa Imaging System (EIS): High-resolution, 3-D insight into Europa\u2019s geology, iceshell, and potential for current activity","volume":"50","author":"Turtle","year":"2019","journal-title":"Lunar Planet. Sci."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1029\/2018EA000390","article-title":"Multiview shape-from-shading for planetary images","volume":"5","author":"Alexandrov","year":"2018","journal-title":"Earth Space Sci."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/17\/3511\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:56:15Z","timestamp":1760165775000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/17\/3511"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,4]]},"references-count":54,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["rs13173511"],"URL":"https:\/\/doi.org\/10.3390\/rs13173511","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,4]]}}}