{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,17]],"date-time":"2026-02-17T14:20:50Z","timestamp":1771338050472,"version":"3.50.1"},"reference-count":96,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T00:00:00Z","timestamp":1661990400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Multiple scientific disciplines face a so-called crisis of reproducibility and replicability (R&amp;R) in which the validity of methodologies is questioned due to an inability to confirm experimental results. Trust in information technology (IT)-intensive workflows within geographic information science (GIScience), remote sensing, and photogrammetry depends on solutions to R&amp;R challenges affecting multiple computationally driven disciplines. To date, there have only been very limited efforts to overcome R&amp;R-related issues in remote sensing workflows in general, let alone those tied to unmanned aircraft systems (UAS) as a disruptive technology. This review identifies key barriers to, and suggests best practices for, R&amp;R in geospatial UAS workflows as well as broader remote sensing applications. We examine both the relevance of R&amp;R as well as existing support for R&amp;R in remote sensing and photogrammetry assisted UAS workflows. Key barriers include: (1) awareness of time and resource requirements, (2) accessibility of provenance, metadata, and version control, (3) conceptualization of geographic problems, and (4) geographic variability between study areas. R&amp;R in geospatial UAS applications can be facilitated through augmented access to provenance information for authorized stakeholders, and the establishment of R&amp;R as an important aspect of UAS and related research design. Where ethically possible, future work should exemplify best practices for R&amp;R research by publishing access to open data sets and workflows. Future work should also explore new avenues for access to source data, metadata, provenance, and methods to adapt principles of R&amp;R according to geographic variability and stakeholder requirements.<\/jats:p>","DOI":"10.3390\/rs14174304","type":"journal-article","created":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T03:55:38Z","timestamp":1662004538000},"page":"4304","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Context for Reproducibility and Replicability in Geospatial Unmanned Aircraft Systems"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0675-3877","authenticated-orcid":false,"given":"Cassandra","family":"Howe","sequence":"first","affiliation":[{"name":"Department of Geosciences and Center for Advanced Spatial Technologies, University of Arkansas, Fayetteville, AR 72701, USA"}]},{"given":"Jason A.","family":"Tullis","sequence":"additional","affiliation":[{"name":"Department of Geosciences and Center for Advanced Spatial Technologies, University of Arkansas, Fayetteville, AR 72701, USA"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1038\/533452a","article-title":"1500 Scientists Lift the Lid on Reproducibility","volume":"533","author":"Baker","year":"2016","journal-title":"Nat. News"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1111\/phc3.12633","article-title":"Philosophy of Science and the Replicability Crisis","volume":"14","author":"Romero","year":"2019","journal-title":"Philos. Compass"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1038\/s41562-016-0021","article-title":"A Manifesto for Reproducible Science","volume":"1","author":"Munafo","year":"2017","journal-title":"Nat. Hum. Behav."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1111\/j.1740-9713.2015.00827.x","article-title":"The Reproducibility Crisis in Science: A Statistical Counterattack","volume":"12","author":"Peng","year":"2015","journal-title":"Significance"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2628","DOI":"10.1073\/pnas.1708272114","article-title":"Opinion: Is Science Really Facing a Reproducibility Crisis, and Do We Need It To?","volume":"115","author":"Fanelli","year":"2018","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_6","unstructured":"Sexton, K., Ramage, J., Lennertz, L., Warn, S., and McGee, J. (2021, March 06). Research Reproducibility & Replicability Webinar. Available online: https:\/\/scholarworks.uark.edu\/oreievt\/1."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e12403","DOI":"10.1111\/gec3.12403","article-title":"Geography and Computers: Past, Present, and Future","volume":"12","author":"Reades","year":"2018","journal-title":"Geogr. Compass"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1080\/13658816.2018.1508687","article-title":"Computational Reproducibility in Geoscientific Papers: Insights from a Series of Studies with Geoscientists and a Reproduction Study","volume":"33","author":"Konkol","year":"2019","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Tullis, J., Corcoran, K., Ham, R., Kar, B., and Williamson, M. (2019). Multiuser Concepts and Workflow Replicability in SUAS Applications. Applications of Small Unmanned Aircraft Systems, CRC Press.","DOI":"10.1201\/9780429244117-3"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1403","DOI":"10.1126\/science.aac8041","article-title":"Solving Reproducibility","volume":"348","author":"Buck","year":"2015","journal-title":"Science"},{"key":"ref_11","first-page":"1318","article-title":"Where Is the Provenance? Ethical Replicability and Reproducibility in GIScience and Its Critical Applications","volume":"111","author":"Tullis","year":"2021","journal-title":"Ann. Am. Assoc. Geogr."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1507","DOI":"10.1080\/13658816.2015.1137579","article-title":"Establishing a Framework for Open Geographic Information Science","volume":"30","author":"Singleton","year":"2016","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3834","DOI":"10.1109\/JSTARS.2020.3005912","article-title":"Reproducibility and Replicability in SAR Remote Sensing","volume":"13","author":"Balz","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Roco, M., Bainbridge, W., Tonn, B., and Whitesides, G. (2013). Converging Knowledge, Technology, and Society: Beyond Convergence of Nano-Bio-Info-Cognitive Technologies, Springer.","DOI":"10.1007\/978-3-319-02204-8"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yao, H., Qin, R., and Chen, X. (2019). Unmanned Aerial Vehicle for Remote Sensing Applications\u2014A Review. Remote Sens., 11.","DOI":"10.3390\/rs11121443"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"012003","DOI":"10.1088\/1755-1315\/169\/1\/012003","article-title":"Remote Sensing UAV\/Drones and Its Applications for Urban Areas: A Review","volume":"169","author":"Noor","year":"2018","journal-title":"IOP Conf. Ser. Earth Environ. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Adao, T., Hruska, J., Padua, L., Bessa, J., Peres, E., Morais, R., and Sousa, J. (2017). Hyperspectral Imaging: A Review on UAV-Based Sensors, Data Processing and Applications for Agriculture and Forestry. Remote Sens., 9.","DOI":"10.3390\/rs9111110"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Aasen, H., Honkavaara, E., Lucieer, A., and Zarco-Tejada, P. (2018). Quantitative Remote Sensing at Ultra-High Resolution with UAV Spectroscopy: A Review of Sensor Technology, Measurement Procedures, and Data Correction Workflows. Remote Sens., 10.","DOI":"10.3390\/rs10071091"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"41","DOI":"10.5194\/isprs-archives-XLII-2-W6-41-2017","article-title":"Thermal Remote Sensing with UAV-Based Workflows","volume":"XLII-2\/W6","author":"Boesch","year":"2017","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1007\/s11192-010-0202-z","article-title":"The Rate of Growth in Scientific Publication and the Decline in Coverage Provided by Science Citation Index","volume":"84","author":"Larsen","year":"2010","journal-title":"Scientometrics"},{"key":"ref_21","unstructured":"(2021, March 17). Reproducibility, N. OED. Available online: https:\/\/www.oed.com\/view\/Entry\/163100."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"76","DOI":"10.3389\/fninf.2017.00076","article-title":"Reproducibility vs. Replicability: A Brief History of a Confused Terminology","volume":"11","author":"Plesser","year":"2017","journal-title":"Front. Neuroinform."},{"key":"ref_23","unstructured":"Waters, N. (2020). Motivations and Methods for Replication. Ann. Am. Assoc. Geogr., 109."},{"key":"ref_24","unstructured":"National Academies of Sciences, Engineering, and Medicine (2019). Reproducibility and Replicability in Science, The National Academies Press."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1111\/gean.12221","article-title":"Reproducibility and Replicability in Geographical Analysis","volume":"53","author":"Kedron","year":"2019","journal-title":"Geogr. Anal."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1111\/j.1467-9663.1968.tb01703.x","article-title":"The Need for Replication in Human Geography: Some Central Place Examples","volume":"59","author":"Davies","year":"1968","journal-title":"Tijdschr. Econ. Soc. Geogr."},{"key":"ref_27","first-page":"1275","article-title":"Reproducibility and Replicability in the Context of the Contested Identities of Geography","volume":"111","author":"Sui","year":"2021","journal-title":"Ann. Am. Assoc. Geogr."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1002\/2015EA000136","article-title":"Toward the Geoscience Paper of the Future: Best Practices for Documenting and Sharing Research from Data to Software to Provenance","volume":"3","author":"Gil","year":"2016","journal-title":"Earth Space Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1111\/cobi.12370","article-title":"The Effect of Scientific Evidence on Conservation Practitioners\u2019 Management Decisions","volume":"29","author":"Walsh","year":"2015","journal-title":"Soc. Conserv. Biol."},{"key":"ref_30","unstructured":"Goodchild, M. (2019, January 28\u201329). Convergent GIScience. Proceedings of the Convergent GIScience priorities workshop, Fayetteville, AR, USA."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1007\/s13194-019-0269-1","article-title":"The Limits of Replicability","volume":"10","author":"Guttinger","year":"2020","journal-title":"Eur. J. Philos. Sci."},{"key":"ref_32","first-page":"1284","article-title":"Is Critical Human Geography Research Replicable?","volume":"111","author":"Wainwright","year":"2020","journal-title":"Ann. Am. Assoc. Geogr."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Sturdivant, E., Lentz, E., Thieler, E., Farris, A., Weber, K., Remsen, D., Miner, S., and Henderson, R. (2017). UAS-SfM for Coastal Research: Geomorphic Feature Extraction and Land Cover Classification from High-Resolution Elevation and Optical Imagery. Remote Sens., 9.","DOI":"10.3390\/rs9101020"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hunt, E.R., Daughtry, C., Mirsky, S., and Hively, W. (2013, January 12\u201316). Remote Sensing with Unmanned Aircraft Systems for Precision Agriculture Applications. Proceedings of the 2013 Second International Conference on Agro-Geoinformatics, Fairfax, VA, USA.","DOI":"10.1109\/Argo-Geoinformatics.2013.6621894"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Dainelli, R., Toscano, P., Di Gennaro, S.F., and Matese, A. (2021). Recent Advances in Unmanned Aerial Vehicles Forest Remote Sensing\u2014A Systematic Review. Part II: Research Applications. Forests, 12.","DOI":"10.3390\/f12040397"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Stodola, P., Drozd, J., Mazal, J., Hodicky, J., and Prochazka, D. (2019). Cooperative Unmanned Aerial System Reconnaissance in a Complex Urban Environment and Uneven Terrain. Sensors, 19.","DOI":"10.3390\/s19173754"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Yuan, X., Li, W., and Chen, S. (2017). Automatic Power Line Inspection Using UAV Images. Remote Sens., 9.","DOI":"10.3390\/rs9080824"},{"key":"ref_38","first-page":"11069","article-title":"Climate Drones: A New Tool for Oil and Gas Air Emission Monitoring","volume":"46","author":"Satterlee","year":"2016","journal-title":"Environ. Law Report. News Anal."},{"key":"ref_39","unstructured":"Vincenzi, D., Ison, D., and Terwilliger, B. (2014, January 12\u201315). The Role of Unmanned Aircraft Systems (UAS) in Disaster Response and Recovery Efforts: Historical, Current and Future. Proceedings of the AUVSI Unmanned Systems 2014, Orlando, FL, USA. Available online: https:\/\/commons.erau.edu\/publication\/641."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Nahon, A., Molina, P., Blazquez, M., Simeon, J., Capo, S., and Ferrero, C. (2019). Corridor Mapping of Sandy Coastal Foredunes with UAS Photogrammetry and Mobile Laser Scanning. Remote Sens., 11.","DOI":"10.3390\/rs11111352"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"45127","DOI":"10.1038\/srep45127","article-title":"Automated Detection and Enumeration of Marine Wildlife Using Unmanned Aircraft Systems (UAS) and Thermal Imagery","volume":"7","author":"Seymour","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_42","first-page":"102435","article-title":"Integrating Spectral and Textural Information for Identifying the Tasseling Date of Summer Maize Using UAV Based RGB Images","volume":"102","author":"Guo","year":"2021","journal-title":"Int. J. Appl. Earth Obs. Geoinform."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.culher.2017.02.007","article-title":"An UAS-Assisted Multi-Sensor Approach for 3D Modeling and Reconstruction of Cultural Heritage Site","volume":"26","author":"Erenoglu","year":"2017","journal-title":"J. Cult. Herit."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1002\/wsb.1090","article-title":"Evaluating the Use of Drones Equipped with Thermal Sensors as an Effective Method for Estimating Wildlife","volume":"44","author":"Beaver","year":"2020","journal-title":"Wildl. Soc. Bull."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/19475705.2017.1315619","article-title":"Use of Unmanned Aerial Vehicles in Monitoring Application and Management of Natural Hazards","volume":"8","author":"Giordan","year":"2017","journal-title":"Geomat. Nat. Hazards Risk"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Changchun, L., Li, S., Hai-Bo, W., and Tianjie, L. (2010). The Research on Unmanned Aerial Vehicle Remote Sensing and Its Applications, IEEE.","DOI":"10.1109\/ICACC.2010.5486720"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.isprsjprs.2014.02.013","article-title":"Unmanned Aerial Systems for Photogrammetry and Remote Sensing: A Review","volume":"92","author":"Colomina","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Singhal, G., Bansod, B., and Mathew, L. (2018). Unmanned Aerial Vehicle Classification, Applications and Challenges: A Review. Unmanned Aer. Veh., preprints.","DOI":"10.20944\/preprints201811.0601.v1"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1007\/978-981-33-6311-3_76","article-title":"Review of Unmanned Aerial Vehicle Photogrammetry for Aerial Mapping Applications","volume":"Volume 132","author":"Zahari","year":"2021","journal-title":"Lecture Notes in Civil Engineering"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Sigala, A., and Langhals, B. (2020). Applications of Unmanned Aerial Systems (UAS): A Delphi Study Projecting Future UAS Missions and Relevant Challenges. Drones, 4.","DOI":"10.3390\/drones4010008"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Idries, A., Mohamed, N., Jawhar, I., Mohamed, F., and Al-Jaroodi, J. (2015, January 3\u20135). Challenges of Developing UAV Applications: A Project Management View. Proceedings of the 2015 International Conference on Industrial Engineering and Operations Management (IEOM), Dubai, United Arab Emirates.","DOI":"10.1109\/IEOM.2015.7093730"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.geomorph.2015.05.011","article-title":"Reproducibility of UAV-Based Earth Topography Reconstructions Based on Structure-from-Motion Algorithms","volume":"260","author":"Clapuyt","year":"2016","journal-title":"Geomorphology"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Mlambo, R., Woodhouse, I.H., Gerard, F., and Anderson, K. (2017). Structure from Motion (SfM) Photogrammetry with Drone Data: A Low Cost Method for Monitoring Greenhouse Gas Emissions from Forests in Developing Countries. Forests, 8.","DOI":"10.3390\/f8030068"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"922","DOI":"10.3390\/f4040922","article-title":"A Photogrammetric Workflow for the Creation of a Forest Canopy Height Model from Small Unmanned Aerial System Imagery","volume":"4","author":"Lisein","year":"2013","journal-title":"Forests"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1519","DOI":"10.3390\/rs4061519","article-title":"Development of a UAV-LiDAR System with Application to Forest Inventory","volume":"4","author":"Wallace","year":"2012","journal-title":"Remote Sens."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"44","DOI":"10.3389\/fenvs.2017.00044","article-title":"Open-Source Processing and Analysis of Aerial Imagery Acquired with a Low-Cost Unmanned Aerial System to Support Invasive Plant Management","volume":"5","author":"Lehmann","year":"2017","journal-title":"Front. Environ. Sci."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"5059","DOI":"10.1080\/01431161.2018.1446568","article-title":"Accuracy and Effectiveness of Low Cost UASs and Open Source Photogrammetric Software for Fordunes Mapping","volume":"39","author":"Goncalves","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Jaud, M., Passot, S., Le Bivic, R., Delacourt, C., Grandjean, P., and Le Dantec, N. (2016). Assessing the Accuracy of High Resolution Digital Surface Models Computed by PhotoScan\u00ae and MicMac\u00ae in Sub-Optimal Survey Conditions. Remote Sens., 8.","DOI":"10.3390\/rs8060465"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1573","DOI":"10.3390\/rs4061573","article-title":"Assessing the Accuracy of Georeferenced Point Clouds Produced via Multi-View Stereopsis from Unmanned Aerial Vehicle (UAV) Imagery","volume":"4","author":"Harwin","year":"2012","journal-title":"Remote Sens."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Ludwig, M., Runge, C., Friess, N., Koch, T., Richter, S., Seyfried, S., Wraase, L., Lobo, A., Sebastia, M.-T., and Reudenbach, C. (2020). Quality Assessment of Photogrammetric Methods\u2014A Workflow for Reproducible UAS Orthomosaics. Remote Sens., 12.","DOI":"10.3390\/rs12223831"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Park, J.W., Jeong, H.H., Kim, J.S., and Choi, C.U. (2016, January 12\u201319). Development of Open Source-Based Automatic Shooting and Processing UAV Imagery for Orthoimage Using Smart Camera UAV. Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Prague, Czech Republic.","DOI":"10.5194\/isprs-archives-XLI-B7-941-2016"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.isprsjprs.2013.01.015","article-title":"A Comparison of Dense Matching Algorithms for Scaled Surface Reconstruction Using Stereo Camera Rigs","volume":"78","author":"Ahmadabadian","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"2852","DOI":"10.1002\/2015JB012564","article-title":"Application of Open-Source Photogrammetric Software MicMac for Monitoring Surface Deformation in Laboratory Models","volume":"121","author":"Galland","year":"2016","journal-title":"J. Geophys. Res. Sold Earth"},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"12964","DOI":"10.1002\/ece3.5443","article-title":"Structure from Motion Photogrammetry in Ecology: Does the Choice of Software Matter?","volume":"9","author":"Forsmoo","year":"2019","journal-title":"Ecol. Evol."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.ecoinf.2017.05.004","article-title":"Open Data and Open Source for Remote Sensing Training in Ecology","volume":"40","author":"Rocchini","year":"2017","journal-title":"Ecol. Inform."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Benassi, F., Dall\u2019Asta, E., Diotri, F., Forlani, G., di Cella, U., Roncella, R., and Santise, M. (2017). Testing Accuracy and Repeatability of UAV Blocks Oriented with GNSS-Supported Aerial Triangulation. Remote Sens., 9.","DOI":"10.3390\/rs9020172"},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"016011","DOI":"10.1117\/1.JRS.10.016011","article-title":"Comparison of Performance of Object-Based Image Analysis Techniques Available in Open Source Software (Spring and Orfeo Toolbox\/Monteverdi) Considering Very High Spatial Resolution Data","volume":"10","author":"Teodoro","year":"2016","journal-title":"J. Appl. Remote Sens."},{"key":"ref_68","unstructured":"Anders, N., Smith, M., Cammeraat, E., and Keesstrea, S. (2016, January 17\u201322). Reproducibility of UAV-Based Photogrammetric Surface Models. Proceedings of the EGU General Assembly 2016, Vienna, Austria."},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Meng, L., Peng, Z., Zhou, J., Zhang, J., Zhenyu, L., Baumann, A., and Du, Y. (2020). Real-Time Detection of Ground Objects Based on Unmanned Aerial Vehicle Remote Sensing with Deep Learning: Application in Excavator Detection for Pipeline Safety. Remote Sens., 12.","DOI":"10.3390\/rs12010182"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1007\/s10846-021-01383-5","article-title":"The MRS UAV System: Pushing the Frontiers of Reproducible Research, Real-World Deployment, and Education with Autonomous Unmanned Aerial Vehicles","volume":"102","author":"Baca","year":"2021","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Knoth, C., and Nust, D. (2017). Reproducibility and Practical Adoption of GEOBIA with Open-Source Software in Docker Containers. Remote Sens., 9.","DOI":"10.3390\/rs9030290"},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1111\/j.1467-8306.1960.tb00356.x","article-title":"Quantity and Quality in Geography","volume":"50","author":"Spate","year":"1960","journal-title":"Ann. Assoc. Am. Geogr."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"4972","DOI":"10.1128\/IAI.00908-10","article-title":"Reproducible Science","volume":"78","author":"Casadevall","year":"2010","journal-title":"Infect. Immun."},{"key":"ref_74","first-page":"1311","article-title":"A Five-Star Guide for Achieving Replicability and Reproducibility When Working with GIS Software and Algorithms","volume":"111","author":"Wilson","year":"2021","journal-title":"Ann. Am. Assoc. Geogr."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/10095020.2019.1698274","article-title":"Building Geospatial Infrastructure","volume":"23","author":"Dangermond","year":"2020","journal-title":"Geo-Spat. Inf. Sci."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1111\/j.1467-8306.1979.tb01241.x","article-title":"Schaefer and the Science of Geography","volume":"69","author":"Bunge","year":"1979","journal-title":"Ann. Assoc. Am. Geogr."},{"key":"ref_77","first-page":"1300","article-title":"Practical Reproducibility in Geography and Geosciences","volume":"111","author":"Nust","year":"2021","journal-title":"Ann. Am. Assoc. Geogr."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"3181","DOI":"10.1080\/01431161.2016.1259685","article-title":"Open-Source GIS Application for UAV Photogrammetry Based on MicMac","volume":"38","author":"Duarte","year":"2017","journal-title":"Int. J. Remote Sens."},{"key":"ref_79","unstructured":"Moreau, L., and Missier, P. (2022, August 17). PROV-DM: The PROV Data Model. Available online: https:\/\/www.w3.org\/TR\/prov-dm\/."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1002\/rse2.144","article-title":"Mapping of Land Cover with Open-Source Software and Ultra-High-Resolution Imagery Acquired with Unmanned Aerial Vehicles","volume":"6","author":"Horning","year":"2020","journal-title":"Remote Sens. Ecol. Conserv."},{"key":"ref_81","unstructured":"Granell, C., Sileryte, R., and Nust, D. (2020, January 2\u20133). Reproducible Graduate Theses in GIScience. Proceedings of the Paper Presentations, Research Reproducibility, Gainesville, FL, USA."},{"key":"ref_82","unstructured":"Helregel, N. (2020, January 28). Engaging Undergraduates on Issues of Reproducibility. Proceedings of the Librarians Building Momentum for Reproducibility, Online."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"4988","DOI":"10.1109\/JSTARS.2020.3019418","article-title":"A Badging System for Reproducibility and Replicability in Remote Sensing Research","volume":"13","author":"Frery","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_84","first-page":"243180","article-title":"Towards Reproducibility in Scientific Workflows: An Infrastructure-Based Approach","volume":"2015","year":"2015","journal-title":"Sci. Program."},{"key":"ref_85","unstructured":"Bollen, K., Cacioppo, J., Kaplan, R., Krosnick, J., and Olds, J. (2015). Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1186\/s13041-020-0552-2","article-title":"No Raw Data, No Science: Another Possible Source of the Reproducibility Crisis","volume":"13","author":"Miyakawa","year":"2020","journal-title":"Mol. Brain"},{"key":"ref_87","unstructured":"Ohuru, R. (2019). A Method for Enhancing Shareability and Reproducibility of Geoprocessing Workflows. Case Study: Integration of Crowdsourced Geoinformation, Satellite, and in-Situ Data for Water Resource Monitoring. [Master\u2019s Thesis, University of Twente]."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"2261","DOI":"10.1080\/13658816.2014.917313","article-title":"Metadata and Provenance for Spatial Analysis: The Case of Spatial Weights","volume":"28","author":"Anselin","year":"2014","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_89","unstructured":"(2021, March 16). Instructions for Authors|Remote Sensing. Available online: https:\/\/www.mdpi.com\/journal\/remotesensing\/instructions."},{"key":"ref_90","unstructured":"(2021, March 16). Editorial Policies|Nature Portfolio. Available online: https:\/\/www.nature.com\/nature-research\/editorial-policies."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"6384","DOI":"10.1109\/JSTARS.2020.3032100","article-title":"Using the IPOL Journal for Online Reproducible Research in Remote Sensing","volume":"13","author":"Colom","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_92","first-page":"12","article-title":"Opening the Publication Process with Executable Research Compendia","volume":"23","author":"Nust","year":"2017","journal-title":"D-Lib. Mag."},{"key":"ref_93","unstructured":"Nust, D. (2020, January 28). Container Images for Research Librarians 101. Proceedings of the Librarians Building Momentum for Reproducibility, Online."},{"key":"ref_94","unstructured":"Stodden, V. (2009). Enabling Reproducible Research: Open Licensing for Scientific Innovations. Int. J. Commun. Law Policy, 55. Available online: https:\/\/ssrn.com\/abstract=1362040."},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Etienne, A., Ahmad, A., Aggarwal, V., and Saraswat, D. (2021). Deep Learning-Based Object Detection System for Identifying Weeds Using UAS Imagery. Remote Sens., 13.","DOI":"10.3390\/rs13245182"},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1038\/nmeth.3489","article-title":"Clarifying the Terminology That Describes Scientific Reproducibility","volume":"12","author":"Kenett","year":"2015","journal-title":"Nat. Methods"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/17\/4304\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:21:29Z","timestamp":1760142089000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/17\/4304"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,1]]},"references-count":96,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["rs14174304"],"URL":"https:\/\/doi.org\/10.3390\/rs14174304","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,1]]}}}