{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T22:25:47Z","timestamp":1776464747253,"version":"3.51.2"},"reference-count":57,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2024,1,28]],"date-time":"2024-01-28T00:00:00Z","timestamp":1706400000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NASA ROSES (Research Opportunities for Space and Earth Science) BioSCape program","award":["#80NSSC22K0831"],"award-info":[{"award-number":["#80NSSC22K0831"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Imaging spectroscopy (hyperspectral sensing) is a proven tool for mapping and monitoring the spatial distribution of vegetation species composition. However, there exists a gap when it comes to the availability of high-resolution spatial and spectral imagery for accurate tree species mapping, particularly in complex forest environments, despite the continuous advancements in operational remote sensing and field sensor technologies. Here, we aim to bridge this gap by enhancing our fundamental understanding of imaging spectrometers via complex simulated environments. We used DIRSIG, a physics-based, first-principles simulation approach to model canopy-level reflectance for 3D plant models and species-level leaf reflectance in a synthetic forest scene. We simulated a realistic scene, based on the same species composition, found at Harvard Forest, MA (USA). Our simulation approach allowed us to better understand the interplay between instrument parameters and landscape characteristics, and facilitated comprehensive traceability of error budgets. To enhance our understanding of the impact of sensor design on classification performance, we simulated image samples at different spatial, spectral, and scale resolutions (by modifying the pixel pitch and the total number of pixels in the sensor array, i.e., the focal plane dimension) of the imaging sensor and assessed the performance of a deep learning-based convolutional neural network (CNN) and a traditional machine learning classifier, support vector machines (SVMs), to classify vegetation species. Overall, across all resolutions and species mixtures, the highest classification accuracy varied widely from 50 to 84%, and the number of genus-level species classes identified ranged from 2 to 17, among 24 classes. Harnessing this simulation approach has provided us valuable insights into sensor configurations and the optimization of data collection methodologies to improve the interpretation of spectral signatures for accurate tree species mapping in forest scenes. Note that we used species classification as a proxy for a host of imaging spectroscopy applications. However, this approach can be extended to other ecological scenarios, such as in evaluating the changing ecosystem composition, detecting invasive species, or observing the effects of climate change on ecosystem diversity.<\/jats:p>","DOI":"10.3390\/rs16030498","type":"journal-article","created":{"date-parts":[[2024,1,29]],"date-time":"2024-01-29T12:25:01Z","timestamp":1706531101000},"page":"498","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Exploring the Limits of Species Identification via a Convolutional Neural Network in a Complex Forest Scene through Simulated Imaging Spectroscopy"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7558-1474","authenticated-orcid":false,"given":"Manisha Das","family":"Chaity","sequence":"first","affiliation":[{"name":"Imaging Science Department, Rochester Institute of Technology, Rochester, NY 14623, USA"}]},{"given":"Jan","family":"van Aardt","sequence":"additional","affiliation":[{"name":"Imaging Science Department, Rochester Institute of Technology, Rochester, NY 14623, USA"}]}],"member":"1968","published-online":{"date-parts":[[2024,1,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"7157","DOI":"10.1029\/95JD02138","article-title":"Global vegetation cover changes from coarse resolution satellite data","volume":"101","author":"Nemani","year":"1996","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"14784","DOI":"10.1073\/pnas.261555198","article-title":"A large carbon sink in the woody biomass of Northern forests","volume":"98","author":"Myneni","year":"2001","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2917","DOI":"10.1016\/j.rse.2010.08.027","article-title":"Mapping biomass and stress in the Sierra Nevada using lidar and hyperspectral data fusion","volume":"115","author":"Swatantran","year":"2011","journal-title":"Remote Sens. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1080\/02827581.2013.793386","article-title":"Characterizing forest species composition using multiple remote sensing data sources and inventory approaches","volume":"28","author":"Dalponte","year":"2013","journal-title":"Scand. J. For. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.rse.2016.08.013","article-title":"Review of studies on tree species classification from remotely sensed data","volume":"186","author":"Fassnacht","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zhen, Z., Quackenbush, L.J., and Zhang, L. (2016). Trends in Automatic Individual Tree Crown Detection and Delineation\u2014Evolution of LiDAR Data. Remote Sens., 8.","DOI":"10.3390\/rs8040333"},{"key":"ref_7","unstructured":"Zemek, F. (2014). Airborne Remote Sensing: Theory and Practice in Assessment of Terrestrial Ecosystems, Global Change Research Centre AS CR."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, K., Wang, T., and Liu, X. (2019). A Review: Individual Tree Species Classification Using Integrated Airborne LiDAR and Optical Imagery with a Focus on the Urban Environment. Forests, 10.","DOI":"10.3390\/f10010001"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2661","DOI":"10.3390\/rs4092661","article-title":"Tree Species Classification with Random Forest Using Very High Spatial Resolution 8-Band WorldView-2 Satellite Data","volume":"4","author":"Immitzer","year":"2012","journal-title":"Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2075","DOI":"10.1080\/01431160050021303","article-title":"Using vegetation reflectance variability for species level classification of hyperspectral data","volume":"21","author":"Cochrane","year":"2000","journal-title":"Int. J. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"112405","DOI":"10.1016\/j.rse.2021.112405","article-title":"Understanding limits of species identification using simulated imaging spectroscopy","volume":"259","author":"Frye","year":"2021","journal-title":"Remote Sens. Environ."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"103794","DOI":"10.1016\/j.infrared.2021.103794","article-title":"Design and demonstration of airborne imaging system for target detection based on area-array camera and push-broom hyperspectral imager","volume":"116","author":"Huang","year":"2021","journal-title":"Infrared Phys. Technol."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Nalepa, J., Myller, M., Cwiek, M., Zak, L., Lakota, T., Tulczyjew, L., and Kawulok, M. (2021). Towards on-board hyperspectral satellite image segmentation: Understanding robustness of deep learning through simulating acquisition conditions. Remote Sens., 13.","DOI":"10.3390\/rs13081532"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/j.isprsjprs.2015.05.005","article-title":"Optical remote sensing and the retrieval of terrestrial vegetation bio-geophysical properties\u2014A review","volume":"108","author":"Verrelst","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.isprsjprs.2013.09.012","article-title":"Gaussian processes uncertainty estimates in experimental Sentinel-2 LAI and leaf chlorophyll content retrieval","volume":"86","author":"Verrelst","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/j.isprsjprs.2019.02.013","article-title":"Inversion of rice canopy chlorophyll content and leaf area index based on coupling of radiative transfer and Bayesian network models","volume":"150","author":"Xu","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Nur, N.B., and Bachmann, C.M. (2023). Comparison of soil moisture content retrieval models utilizing hyperspectral goniometer data and hyperspectral imagery from an unmanned aerial system. J. Geophys. Res. Biogeosci., 128.","DOI":"10.1029\/2023JG007381"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.isprsjprs.2020.04.009","article-title":"Towards a semi-automated mapping of Australia native invasive alien Acacia trees using Sentinel-2 and radiative transfer models in South Africa","volume":"166","author":"Masemola","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Miraglio, T., Adeline, K., Huesca, M., Ustin, S., and Briottet, X. (2020). Joint Use of PROSAIL and DART for Fast LUT Building: Application to Gap Fraction and Leaf Biochemistry Estimations over Sparse Oak Stands. Remote Sens., 12.","DOI":"10.3390\/rs12182925"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4818","DOI":"10.1109\/JSTARS.2017.2758964","article-title":"DIRSIG5: Next-generation remote sensing data and image simulation framework","volume":"10","author":"Goodenough","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1016\/j.rse.2018.11.036","article-title":"LESS: LargE-Scale remote sensing data and image simulation framework over heterogeneous 3D scenes","volume":"221","author":"Qi","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2601097.2601199","article-title":"Embree: A kernel framework for efficient CPU ray tracing","volume":"33","author":"Wald","year":"2014","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"946","DOI":"10.1109\/36.508411","article-title":"Three-dimensional forest light interaction model using a Monte Carlo method","volume":"34","author":"North","year":"1996","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wu, J., Van Aardt, J., Asner, G., Mathieu, R., Kennedy-Bowdoin, T., Knapp, D., Wessels, K., Erasmus, B., and Smit, I. (2009, January 12\u201317). Connecting the dots between laser waveforms and herbaceous biomass for assessment of land degradation using small-footprint waveform lidar data. Proceedings of the 2009 IEEE International Geoscience and Remote Sensing Symposium, Cape Town, South Africa.","DOI":"10.1109\/IGARSS.2009.5418078"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2402","DOI":"10.1109\/TGRS.2010.2103080","article-title":"A comparison of signal deconvolution algorithms based on small-footprint LiDAR waveform simulation","volume":"49","author":"Wu","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3242","DOI":"10.1109\/TGRS.2011.2178420","article-title":"A robust signal preprocessing chain for small-footprint waveform lidar","volume":"50","author":"Wu","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"S60","DOI":"10.5589\/m13-015","article-title":"Assessing the impact of broadleaf tree structure on airborne full-waveform small-footprint LiDAR signals through simulation","volume":"39","author":"Romanczyk","year":"2013","journal-title":"Can. J. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yao, W., Kelbe, D., Leeuwen, M.V., Romanczyk, P., and Aardt, J.V. (2016). Towards an improved LAI collection protocol via simulated and field-based PAR sensing. Sensors, 16.","DOI":"10.3390\/s16071092"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4149","DOI":"10.1109\/TGRS.2018.2827376","article-title":"A simulation-based approach to assess subpixel vegetation structural variation impacts on global imaging spectroscopy","volume":"56","author":"Yao","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Maschler, J., Atzberger, C., and Immitzer, M. (2018). Individual tree crown segmentation and classification of 13 tree species using airborne hyperspectral data. Remote Sens., 10.","DOI":"10.3390\/rs10081218"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.rse.2016.03.021","article-title":"Mapping tree species in tropical seasonal semi-deciduous forests with hyperspectral and multispectral data","volume":"179","author":"Ferreira","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Fricker, G.A., Ventura, J.D., Wolf, J.A., North, M.P., Davis, F.W., and Franklin, J. (2019). A convolutional neural network classifier identifies tree species in mixed-conifer forest from hyperspectral imagery. Remote Sens., 11.","DOI":"10.3390\/rs11192326"},{"key":"ref_33","first-page":"49","article-title":"A framework for mapping tree species combining hyperspectral and LiDAR data: Role of selected classifiers and sensor across three spatial scales","volume":"26","author":"Ghosh","year":"2014","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Guo, X., Li, H., Jing, L., and Wang, P. (2022). Individual tree species classification based on convolutional neural networks and multitemporal high-resolution remote sensing images. Sensors, 22.","DOI":"10.3390\/s22093157"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Hsieh, T.-H., and Kiang, J.-F. (2020). Comparison of CNN algorithms on hyperspectral image classification in agricultural lands. Sensors, 20.","DOI":"10.3390\/s20061734"},{"key":"ref_36","unstructured":"Wible, R., Patki, K., Krause, K., and van Aardt, J. (2021, January 28\u201330). Toward a Definitive Assessment of the Impact of Leaf Angle Distributions on LiDAR Structural Metrics. Proceedings of the SilviLaser Conference 2021, Vienna, Austria."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1080\/07038992.1999.10874709","article-title":"An advanced synthetic image generation model and its application to multi\/hyperspectral algorithm development","volume":"25","author":"Schott","year":"1999","journal-title":"Can. J. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1505","DOI":"10.1117\/12.57682","article-title":"Incorporation of a time-dependent thermodynamic model and a radiation propagation model into IR 3D synthetic image generation","volume":"31","author":"Schott","year":"1992","journal-title":"Opt. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Green, R.O., Conel, J.E., and Roberts, D.A. (1993, January 11\u201316). Estimation of aerosol optical depth, pressure elevation, water vapor, and calculation of apparent surface reflectance from radiance measured by the airborne visible\/infrared imaging spectrometer. Proceedings of the Imaging Spectrometry of the Terrestrial Environment, Orlando, FL, USA.","DOI":"10.1117\/12.157054"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1016\/S0034-4257(01)00219-X","article-title":"A VNIR\/SWIR atmospheric correction algorithm for hyperspectral imagery with adjacency effect","volume":"78","author":"Sanders","year":"2001","journal-title":"Remote Sens. Environ."},{"key":"ref_41","unstructured":"Conel, J.E., Green, R.O., Vane, G., Bruegge, C.J., Alley, R.E., and Curtiss, B.J. (1987, January 2\u20134). AIS-2 radiometry and a comparison of methods for the recovery of ground reflectance. Proceedings of the 3rd Airborne Imaging Spectrometer Data Analysis Workshop, Pasadena, CA, USA."},{"key":"ref_42","unstructured":"Binu, D., and Rajakumar, B.R. (2021). Artificial Intelligence in Data Mining, Academic Press."},{"key":"ref_43","unstructured":"Malenovsky, Z. (2006). Quantitative Remote Sensing of Norway Spruce (Picea Abies (L.) Karst.): Spectroscopy from Needles to Crowns to Canopies, Wageningen University and Research."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Safonova, A., Tabik, S., Alcaraz-Segura, D., Rubtsov, A., Maglinets, Y., and Herrera, F. (2019). Detection of fir trees (Abies sibirica) damaged by the bark beetle in unmanned aerial vehicle images with deep learning. Remote Sens., 11.","DOI":"10.3390\/rs11060643"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Egli, S., and H\u00f6pke, M. (2020). CNN-based tree species classification using high resolution RGB image data from automated UAV observations. Remote Sens., 12.","DOI":"10.3390\/rs12233892"},{"key":"ref_46","unstructured":"Agarap, A.F. (2018). Deep learning using rectified linear units (relu). arXiv."},{"key":"ref_47","unstructured":"Gulli, A., and Pal, S. (2017). Deep Learning with Keras, Packt Publishing Ltd."},{"key":"ref_48","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_49","unstructured":"Ruder, S. (2016). An overview of gradient descent optimization algorithms. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/TGRS.2004.831865","article-title":"Classification of hyperspectral remote sensing images with support vector machines","volume":"42","author":"Melgani","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/LGRS.2019.2918719","article-title":"HybridSN: Exploring 3-D\u20132-D CNN feature hierarchy for hyperspectral image classification","volume":"17","author":"Roy","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_52","first-page":"115","article-title":"Principal component analysis for hyperspectral image classification","volume":"62","author":"Rodarmel","year":"2002","journal-title":"Surv. Land Inf. Sci."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.eswa.2018.03.056","article-title":"Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges","volume":"105","author":"Nweke","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Wagle, S.A., Harikrishnan, R., Ali, S.H.M., and Faseehuddin, M. (2021). Classification of plant leaves using new compact convolutional neural network models. Plants, 11.","DOI":"10.3390\/plants11010024"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Mather, P.M., and Koch, M. (2011). Computer Processing of Remotely-Sensed Images: An Introduction, John Wiley & Sons.","DOI":"10.1002\/9780470666517"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"2082","DOI":"10.1016\/j.sigpro.2012.01.020","article-title":"A super-resolution reconstruction algorithm for hyperspectral images","volume":"92","author":"Zhang","year":"2012","journal-title":"Signal Process."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/S0034-4257(98)00084-4","article-title":"Spectroscopic determination of leaf biochemistry using band-depth analysis of absorption features and stepwise multiple linear regression","volume":"67","author":"Kokaly","year":"1999","journal-title":"Remote Sens. Environ."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/3\/498\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:50:34Z","timestamp":1760104234000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/3\/498"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,28]]},"references-count":57,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["rs16030498"],"URL":"https:\/\/doi.org\/10.3390\/rs16030498","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,28]]}}}