{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:12:26Z","timestamp":1760242346903,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2017,5,12]],"date-time":"2017-05-12T00:00:00Z","timestamp":1494547200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000104","name":"National Aeronautics and Space Administration","doi-asserted-by":"publisher","award":["NNX12AQ24G"],"award-info":[{"award-number":["NNX12AQ24G"]}],"id":[{"id":"10.13039\/100000104","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DBI-0752017"],"award-info":[{"award-number":["DBI-0752017"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The purpose of this study is to validate the accuracy of abundance map reference data (AMRD) for three airborne imaging spectrometer (IS) scenes. AMRD refers to reference data maps (\u201cground truth\u201d) that are specifically designed to quantitatively assess the performance of spectral unmixing algorithms. While classification algorithms typically label whole pixels as belonging to certain ground cover classes, spectral unmixing allows pixels to be composed of fractions or abundances of each class. The AMRD validated in this paper were generated using our previously-proposed remotely-sensed reference data (RSRD) technique, which spatially aggregates the results of standard classification or unmixing algorithms from fine spatial-scale IS data to produce AMRD for co-located coarse-scale IS data. Validation of the three scenes was accomplished by estimating AMRD in 51 randomly-selected 10 m\u00d710 m plots, using seven independent methods and observers. These independent estimates included field surveys by two observers, imagery analysis by two observers and RSRD by three algorithms. Results indicated statistically-significant differences between all versions of AMRD. Even AMRD from our two field surveys were significantly different for two of the four ground cover classes. These results suggest that all forms of reference data require validation prior to use in assessing the performance of classification and\/or unmixing algorithms. Given the significant differences between the independent versions of AMRD, we propose that the mean of all (MOA) versions of reference data for each plot and class is most likely to represent true abundances. Our independent versions of AMRD were compared to MOA to characterize error and uncertainty. Best case results were achieved by a version of imagery analysis, which had mean coverage area differences of 2.0%, with a standard deviation of 5.6%. One of the RSRD algorithms was nearly as accurate, achieving mean differences of 3.0%, with a standard deviation of 6.3%. Further analysis of statistical equivalence yielded an overall zone of equivalence between     [ \u2212 7.0 % , 7.2 % ]     for this version of RSRD. The relative accuracy of RSRD methods is promising, given their potential to efficiently generate scene-wide AMRD. These results provide the first known validated abundance level reference data for airborne IS data.<\/jats:p>","DOI":"10.3390\/rs9050473","type":"journal-article","created":{"date-parts":[[2017,5,12]],"date-time":"2017-05-12T11:03:53Z","timestamp":1494587033000},"page":"473","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Validation of Abundance Map Reference Data for Spectral Unmixing"],"prefix":"10.3390","volume":"9","author":[{"given":"McKay","family":"Williams","sequence":"first","affiliation":[{"name":"Chester F. Carlson Center for Imaging Science, Rochester Institute of Technology, Rochester, NY 14623, USA"}]},{"given":"Robert","family":"Parody","sequence":"additional","affiliation":[{"name":"School of Mathematical Sciences, Rochester Institute of Technology, Rochester, NY 14623, USA"}]},{"given":"Alexander","family":"Fafard","sequence":"additional","affiliation":[{"name":"Chester F. Carlson Center for Imaging Science, Rochester Institute of Technology, Rochester, NY 14623, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0754-8170","authenticated-orcid":false,"given":"John","family":"Kerekes","sequence":"additional","affiliation":[{"name":"Chester F. Carlson Center for Imaging Science, Rochester Institute of Technology, Rochester, NY 14623, USA"}]},{"given":"Jan","family":"Van Aardt","sequence":"additional","affiliation":[{"name":"Chester F. Carlson Center for Imaging Science, Rochester Institute of Technology, Rochester, NY 14623, USA"}]}],"member":"1968","published-online":{"date-parts":[[2017,5,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/0034-4257(93)90012-M","article-title":"The airborne visible\/infrared imaging spectrometer (AVIRIS)","volume":"44","author":"Vane","year":"1993","journal-title":"Remote Sens. Environ."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/S0034-4257(98)00064-9","article-title":"Imaging spectroscopy and the airborne visible\/infrared imaging spectrometer (AVIRIS)","volume":"65","author":"Green","year":"1998","journal-title":"Remote Sens. Environ."},{"doi-asserted-by":"crossref","unstructured":"Eismann, M.T. (2012). Hyperspectral remote sensing, SPIE Press.","key":"ref_3","DOI":"10.1117\/3.899758"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1126\/science.228.4704.1147","article-title":"Imaging spectrometry for earth remote sensing","volume":"228","author":"Goetz","year":"1985","journal-title":"Science"},{"doi-asserted-by":"crossref","unstructured":"Chang, C.I. (2007). Hyperspectral data exploitation: Theory and applications, John Wiley & Sons.","key":"ref_5","DOI":"10.1002\/0470124628"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/79.974727","article-title":"Spectral unmixing","volume":"19","author":"Keshava","year":"2002","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1109\/JSTARS.2012.2194696","article-title":"Hyperspectral unmixing overview: Geometrical, statistical, and sparse regression-based approaches","volume":"5","author":"Plaza","year":"2012","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1109\/TGRS.2003.815018","article-title":"Hyperion, a space-based imaging spectrometer","volume":"41","author":"Pearlman","year":"2003","journal-title":"IEEE Tran. Geosci. Remote Sens."},{"doi-asserted-by":"crossref","unstructured":"Congalton, R.G., and Green, K. (2008). Assessing the Accuracy of Remotely Sensed Data: Principles and Practices, CRC press.","key":"ref_9","DOI":"10.1201\/9781420055139"},{"unstructured":"Swayze, G., Clark, R.N., Kruse, F., Sutley, S., and Gallagher, A. (1992). Ground-Truthing AVIRIS Mineral Mapping at Cuprite, Nevada, NASA.","key":"ref_10"},{"unstructured":"Baumgardner, M., Biehl, L., and Landgrebe, D. (2015). 220 band aviris hyperspectral image data set: June 12, 1992 Indian pine test site 3. Purdue Univ. Res. Repos., 10.","key":"ref_11"},{"unstructured":"Gamba, P. (2004, January 20\u201324). A collection of data for urban area characterization. Proceedings of the 2004 IEEE International Geoscience and Remote Sensing Symposium, Anchorage, AK, USA.","key":"ref_12"},{"unstructured":"Swayze, G.A. (1997). The Hydrothermal and Structural History of the Cuprite Mining District, Southwestern Nevada: An Integrated Geological and Geophysical Approach. [Ph.D. Thesis, University of Colorado at Boulder].","key":"ref_13"},{"unstructured":"Landgrebe, D. (2017, May 10). Indian Pines Aviris Hyperpsectral Reflectance Data: 92av3c, 296, Available online: http:\/\/makalu.jpl.nasa.gov\/.","key":"ref_14"},{"unstructured":"(2016, November 17). Hyperspectral Remote Sensing Scenes. Available online: http:\/\/www.ehu.eus\/ccwintco\/index.php?title=Hyperspectral_Remote_Sensing_Scenes.","key":"ref_15"},{"doi-asserted-by":"crossref","unstructured":"Winter, M.E. (1999, January 9\u201314). N-FINDR: An algorithm for fast autonomous spectral end-member determination in hyperspectral data. Proceedings of the SPIE\u2019s International Symposium on Optical Science, Engineering, and Instrumentation, San-Diego, CA, USA.","key":"ref_16","DOI":"10.1117\/12.366289"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1109\/TGRS.2005.844293","article-title":"Vertex component analysis: A fast algorithm to unmix hyperspectral data","volume":"43","author":"Nascimento","year":"2005","journal-title":"IEEE Tran. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1109\/MSP.2013.2279177","article-title":"Endmember variability in hyperspectral analysis: Addressing spectral variability during spectral unmixing","volume":"31","author":"Zare","year":"2014","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1016\/j.rse.2006.09.005","article-title":"Sub-pixel mapping of urban land cover using multiple endmember spectral mixture analysis: Manaus, Brazil","volume":"106","author":"Powell","year":"2007","journal-title":"Remote Sens. Environ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.landurbplan.2011.03.017","article-title":"Mapping form and function in urban areas: An approach based on urban metrics and continuous impervious surface data","volume":"102","author":"Jacquet","year":"2011","journal-title":"Landsc. Urban Plan."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1213","DOI":"10.14358\/PERS.74.10.1213","article-title":"Subpixel urban land cover estimation","volume":"74","author":"Walton","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3427","DOI":"10.3390\/rs6043427","article-title":"Estimating fractional shrub cover using simulated EnMAP data: A comparison of three machine learning regression techniques","volume":"6","author":"Schwieder","year":"2014","journal-title":"Remote Sens."},{"doi-asserted-by":"crossref","unstructured":"Williams, M.D., van Aardt, J., and Kerekes, J.P. (2016, January 17). Generation of remotely sensed reference data using low altitude, high spatial resolution hyperspectral imagery. Proceedings of the Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XXII, Baltimore, MD, USA.","key":"ref_23","DOI":"10.1117\/12.2224126"},{"doi-asserted-by":"crossref","unstructured":"Kampe, T.U., Johnson, B.R., Kuester, M., and Keller, M. (2010). NEON: The first continental-scale ecological observatory with airborne remote sensing of vegetation canopy biochemistry and structure. J. Appl. Remote Sens, 4.","key":"ref_24","DOI":"10.1117\/1.3361375"},{"unstructured":"Kampe, T., Leisso, N., Musinsky, J., Petroy, S., Karpowiez, B., Krause, K., Crocker, R.I., DeVoe, M., Penniman, E., and Guadagno, T. (2016, December 01). The NEON 2013 Airborne Campaign at Domain 17 Terrestrial and Aquatic Sites in California. Available online: https:\/\/www.researchgate.net\/profile\/Thomas_Kampe\/publication\/264862121_The_NEON_2013_Airborne_Campaign_at_Domain_17_Terrestrial_and_Aquatic_Sites_in_California\/links\/53f409e70cf2155be354f1cc.pdf.","key":"ref_25"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/S0034-4257(00)00126-7","article-title":"A biogeophysical approach for automated SWIR unmixing of soils and vegetation","volume":"74","author":"Asner","year":"2000","journal-title":"Remote Sens. Environ."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3939","DOI":"10.1080\/01431160110115960","article-title":"Spectral unmixing of vegetation, soil and dry carbon cover in arid regions: Comparing multispectral and hyperspectral observations","volume":"23","author":"Asner","year":"2002","journal-title":"Int. J. Remote Sens."},{"unstructured":"(2016, December 01). Soaproot Saddle\u2014SOAP. Available online: http:\/\/www.neonscience.org\/science-design\/field-sites\/soaproot-saddle.","key":"ref_28"},{"doi-asserted-by":"crossref","unstructured":"Lawson, C.L., and Hanson, R.J. (1995). Solving Least Squares Problems, SIAM.","key":"ref_29","DOI":"10.1137\/1.9781611971217"},{"unstructured":"(2016, December 01). Paired Comparisons. Available online: https:\/\/support.sas.com\/documentation\/cdl\/en\/statug\/63033\/HTML\/default\/viewer.htm#statug_ttest_sect011.htm.","key":"ref_30"},{"unstructured":"(2016, December 01). Equivalence and Noninferiority Testing. Available online: https:\/\/support.sas.com\/resources\/papers\/proceedings15\/SAS1911-2015.pdf.","key":"ref_31"},{"unstructured":"Ott, R.L., and Longnecker, M.T. (2015). An Introduction to Statistical Methods and Data Analysis, Nelson Education.","key":"ref_32"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/5\/473\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:35:38Z","timestamp":1760207738000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/5\/473"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,5,12]]},"references-count":32,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2017,5]]}},"alternative-id":["rs9050473"],"URL":"https:\/\/doi.org\/10.3390\/rs9050473","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2017,5,12]]}}}