{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,26]],"date-time":"2026-04-26T06:29:58Z","timestamp":1777184998955,"version":"3.51.4"},"reference-count":60,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2020,12,5]],"date-time":"2020-12-05T00:00:00Z","timestamp":1607126400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.mdpi.com"],"crossmark-restriction":true},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Shadows are frequently observable in high-resolution images, raising challenges in image interpretation, such as classification and object detection. In this paper, we propose a novel framework for shadow detection and restoration of atmospherically corrected hyperspectral images based on nonlinear spectral unmixing. The mixture model is applied pixel-wise as a nonlinear combination of endmembers related to both pure sunlit and shadowed spectra, where the former are manually selected from scenes and the latter are derived from sunlit spectra following physical assumptions. Shadowed pixels are restored by simulating their exposure to sunlight through a combination of sunlit endmembers spectra, weighted by abundance values. The proposed framework is demonstrated on real airborne hyperspectral images. A comprehensive assessment of the restored images is carried out both visually and quantitatively. With respect to binary shadow masks, our framework can produce soft shadow detection results, keeping the natural transition of illumination conditions on shadow boundaries. Our results show that the framework can effectively detect shadows and restore information in shadowed regions.<\/jats:p>","DOI":"10.3390\/rs12233985","type":"journal-article","created":{"date-parts":[[2020,12,7]],"date-time":"2020-12-07T21:37:42Z","timestamp":1607377062000},"page":"3985","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Shadow Detection and Restoration for Hyperspectral Images Based on Nonlinear Spectral Unmixing"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0617-6459","authenticated-orcid":false,"given":"Guichen","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Photogrammetry and Remote Sensing, German Aerospace Center (DLR), 88234 Wessling, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2984-8315","authenticated-orcid":false,"given":"Daniele","family":"Cerra","sequence":"additional","affiliation":[{"name":"Department of Photogrammetry and Remote Sensing, German Aerospace Center (DLR), 88234 Wessling, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3288-5814","authenticated-orcid":false,"given":"Rupert","family":"M\u00fcller","sequence":"additional","affiliation":[{"name":"Department of Photogrammetry and Remote Sensing, German Aerospace Center (DLR), 88234 Wessling, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1007\/s11769-013-0613-x","article-title":"Review of shadow detection and de-shadowing methods in remote sensing","volume":"23","author":"Shahtahmassebi","year":"2013","journal-title":"Chin. Geogr. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2545","DOI":"10.1109\/TGRS.2013.2262722","article-title":"Shadow detection and reconstruction in high-resolution satellite images via morphological filtering and example-based learning","volume":"52","author":"Song","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"169","DOI":"10.14358\/PERS.71.2.169","article-title":"Shadow analysis in high-resolution satellite imagery of urban areas","volume":"71","author":"Dare","year":"2005","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"69660C","DOI":"10.1117\/12.777153","article-title":"A novel method for illumination suppression in hyperspectral images","volume":"Volume 6966","author":"Ashton","year":"2008","journal-title":"Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XIV"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Polder, G., and Gowen, A. (2020). The hype in spectral imaging. J. Spectr. Imaging, 9.","DOI":"10.1255\/jsi.2020.a4"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MGRS.2013.2244672","article-title":"Hyperspectral remote sensing data analysis and future challenges","volume":"1","author":"Plaza","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.isprsjprs.2013.02.003","article-title":"Shadow detection in very high spatial resolution aerial images: A comparative study","volume":"80","author":"Adeline","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/0146-664X(79)90001-7","article-title":"Region extraction and shape analysis in aerial photographs","volume":"10","author":"Nagao","year":"1979","journal-title":"Comput. Graph. Image Process."},{"key":"ref_9","first-page":"1672","article-title":"Automatic and accurate shadow detection using near-infrared information","volume":"36","author":"Fredembach","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"945","DOI":"10.1007\/s12524-016-0649-3","article-title":"Urban shadow detection and classification using hyperspectral image","volume":"45","author":"Qiao","year":"2017","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1661","DOI":"10.1109\/TGRS.2006.869980","article-title":"A comparative study on shadow compensation of color aerial images in invariant color models","volume":"44","author":"Tsai","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","unstructured":"Sarabandi, P., Yamazaki, F., Matsuoka, M., and Kiremidjian, A. (2004, January 20\u201324). Shadow detection and radiometric restoration in satellite high resolution images. Proceedings of the 2004 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2004, Anchorage, AK, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Han, H., Han, C., Lan, T., Huang, L., Hu, C., and Xue, X. (2020). Automatic shadow detection for multispectral satellite remote sensing images in invariant color spaces. Appl. Sci., 10.","DOI":"10.3390\/app10186467"},{"key":"ref_14","unstructured":"Nakajima, T., Tao, G., and Yasuoka, Y. (2002, January 25\u201329). Simulated recovery of information in shadow areas on IKONOS image by combing ALS data. Proceedings of the Asian conference on remote sensing (ACRS), Kathmandu, Nepal."},{"key":"ref_15","unstructured":"Zhan, Q., Shi, W., and Xiao, Y. (2005, January 14\u201316). Quantitative analysis of shadow effects in high-resolution images of urban areas. Proceedings of the 3nd International Symposium on Remote Sensing and Data Fusion Over Urban Areas, Tempe, AZ, USA."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Tolt, G., Shimoni, M., and Ahlberg, J. (2011, January 24\u201329). A shadow detection method for remote sensing images using VHR hyperspectral and LIDAR data. Proceedings of the 2011 IEEE international geoscience and remote sensing symposium, Vancouver, BC, Canada.","DOI":"10.1109\/IGARSS.2011.6050213"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1117\/12.451691","article-title":"Algorithm for de-shadowing spectral imagery","volume":"Volume 4816","author":"Matthew","year":"2002","journal-title":"Imaging Spectrometry VIII"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3137","DOI":"10.1080\/01431160500114664","article-title":"De-shadowing of satellite\/airborne imagery","volume":"26","author":"Richter","year":"2005","journal-title":"Int. J. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Cameron, M., and Kumar, L. (2018). Diffuse skylight as a surrogate for shadow detection in high-resolution imagery acquired under clear sky conditions. Remote Sens., 10.","DOI":"10.3390\/rs10081185"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.patrec.2004.10.021","article-title":"Removing shadows","volume":"26","author":"Levine","year":"2005","journal-title":"Pattern Recognit. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Vicente, T.F.Y., Hou, L., Yu, C.P., Hoai, M., and Samaras, D. (2016). Large-scale training of shadow detectors with noisily-annotated shadow examples. European Conference on Computer Vision (ECCV), Springer.","DOI":"10.1007\/978-3-319-46466-4_49"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Nguyen, V., Yago Vicente, T.F., Zhao, M., Hoai, M., and Samaras, D. (2017, January 22\u201329). Shadow detection with conditional generative adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.483"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1109\/TPAMI.2006.18","article-title":"On the removal of shadows from images","volume":"28","author":"Finlayson","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"111945","DOI":"10.1016\/j.rse.2020.111945","article-title":"Recurrent Shadow Attention Model (RSAM) for shadow removal in high-resolution urban land-cover mapping","volume":"247","author":"Zhang","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/s11263-009-0243-z","article-title":"Entropy minimization for shadow removal","volume":"85","author":"Finlayson","year":"2009","journal-title":"Int. J. Comput. Vis."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1202","DOI":"10.1109\/TPAMI.2010.157","article-title":"Shadow removal using intensity surfaces and texture anchor points","volume":"33","author":"Arbel","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3440","DOI":"10.1109\/TGRS.2012.2183876","article-title":"A complete processing chain for shadow detection and reconstruction in VHR images","volume":"50","author":"Lorenzi","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4623","DOI":"10.1109\/TIP.2015.2465159","article-title":"Shadow remover: Image shadow removal based on illumination recovering optimization","volume":"24","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Xiao, Y., Tsougenis, E., and Tang, C.K. (2014, January 23\u201328). Shadow removal from single RGB-D images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.385"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1109\/TPAMI.2015.2462355","article-title":"Automatic shadow detection and removal from a single image","volume":"38","author":"Khan","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Qu, L., Tian, J., He, S., Tang, Y., and Lau, R.W. (2017, January 21\u201326). Deshadownet: A multi-context embedding deep network for shadow removal. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.248"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1063\/1.44433","article-title":"The spectral image processing system (SIPS)-interactive visualization and analysis of imaging spectrometer data","volume":"Volume 283","author":"Kruse","year":"1993","journal-title":"AIP Conference Proceedings"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Roussel, G., Weber, C., Ceamanos, X., and Briottet, X. (2016, January 21\u201324). A sun\/shadow approach for the classification of hyperspectral data. Proceedings of the 2016 8th Workshop on Hyperspectral Image and Signal Processing, Evolution in Remote Sensing (WHISPERS), Los Angeles, CA, USA.","DOI":"10.1109\/WHISPERS.2016.8071679"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1109\/TIP.2017.2761542","article-title":"A physics-based deep learning approach to shadow invariant representations of hyperspectral images","volume":"27","author":"Windrim","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Windrim, L., Melkumyan, A., Murphy, R., Chlingaryan, A., and Nieto, J. (2016, January 25\u201328). Unsupervised feature learning for illumination robustness. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533202"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Pauca, V.P., Plemmons, R.J., and Nikic, D.D. (2013, January 25\u201328). Detecting objects under shadows by fusion of hyperspectral and lidar data: A physical model approach. Proceedings of the 2013 5th Workshop on Hyperspectral Image and Signal Processing, Evolution in Remote Sensing (WHISPERS), Gainesville, FL, USA.","DOI":"10.1109\/WHISPERS.2013.8080730"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"81800Q","DOI":"10.1117\/12.898084","article-title":"Illumination and shadow compensation of hyperspectral images using a digital surface model and non-linear least squares estimation","volume":"Volume 8180","author":"Friman","year":"2011","journal-title":"Image and Signal Processing for Remote Sensing XVII"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MSP.2013.2279274","article-title":"Nonlinear unmixing of hyperspectral images: Models and algorithms","volume":"31","author":"Dobigeon","year":"2013","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"650","DOI":"10.1109\/TGRS.2003.820314","article-title":"A quantitative and comparative analysis of endmember extraction algorithms from hyperspectral data","volume":"42","author":"Plaza","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","first-page":"88","article-title":"Fully constrained linear spectral unmixing based global shadow compensation for high resolution satellite imagery of urban areas","volume":"38","author":"Yang","year":"2015","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"74770I","DOI":"10.1117\/12.830492","article-title":"Nonlinear mixture model for hyperspectral unmixing","volume":"Volume 7477","author":"Nascimento","year":"2009","journal-title":"Image and Signal Processing for Remote Sensing XV"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"94821F","DOI":"10.1117\/12.2190066","article-title":"Shadow removal from VNIR hyperspectral remote sensing imagery with endmember signature analysis","volume":"Volume 9482","author":"Omruuzun","year":"2015","journal-title":"Next-Generation Spectroscopic Technologies VIII"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1109\/TGRS.2015.2453915","article-title":"A multilinear mixing model for nonlinear spectral unmixing","volume":"54","author":"Heylen","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Guo, R., Dai, Q., and Hoiem, D. (2011). Single-image shadow detection and removal using paired regions. CVPR 2011, IEEE.","DOI":"10.1109\/CVPR.2011.5995725"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1109\/JSTARS.2017.2787116","article-title":"Deshadowing of urban airborne imagery based on object-oriented automatic shadow detection and regional matching compensation","volume":"11","author":"Mo","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zhang, G., Cerra, D., and Mueller, R. (2019, January 24\u201326). Towards the Spectral Restoration of Shadowed Areas in Hyperspectral Images Based on Nonlinear Unmixing. Proceedings of the 2019 10th Workshop on Hyperspectral Imaging and Signal Processing, Evolution in Remote Sensing (WHISPERS), Amsterdam, The Netherlands.","DOI":"10.1109\/WHISPERS.2019.8920894"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhang, G., Cerra, D., and Mueller, R. (2020, January 16\u201326). Improving the classification in shadowed areas using nonlinear spectral unmixing. Proceedings of the 2020 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Waikoloa Village, HI, USA. in press.","DOI":"10.1109\/IGARSS39084.2020.9324681"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Schott, J.R. (2007). Remote Sensing: The Image Chain Approach, Oxford University Press on Demand.","DOI":"10.1093\/oso\/9780195178173.001.0001"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1844","DOI":"10.1109\/JSTARS.2014.2320576","article-title":"A review of nonlinear hyperspectral unmixing methods","volume":"7","author":"Heylen","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2951","DOI":"10.1080\/01431160802558659","article-title":"Comparative study between a new nonlinear model and common linear model for analysing laboratory simulated-forest hyperspectral data","volume":"30","author":"Fan","year":"2009","journal-title":"Int. J. Remote Sens."},{"key":"ref_51","first-page":"231","article-title":"Photographic systems for remote sensing","volume":"1","author":"Slater","year":"1983","journal-title":"Man. Remote Sens."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1137\/090769521","article-title":"Total generalized variation","volume":"3","author":"Bredies","year":"2010","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_53","first-page":"1","article-title":"Airborne imaging spectrometer hyspex","volume":"2","year":"2016","journal-title":"J. Large Scale Res. Facil. JLSRF"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"2077","DOI":"10.1080\/01431160500486690","article-title":"An automatic atmospheric correction algorithm for visible\/NIR imagery","volume":"27","author":"Richter","year":"2006","journal-title":"Int. J. Remote Sens."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/79.974727","article-title":"Spectral unmixing","volume":"19","author":"Keshava","year":"2002","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Borsoi, R.A., Imbiriba, T., Bermudez, J.C.M., Richard, C., Chanussot, J., Drumetz, L., Tourneret, J.Y., Zare, A., and Jutten, C. (2020). Spectral Variability in Hyperspectral Data Unmixing: A Comprehensive Review. arXiv.","DOI":"10.1109\/MGRS.2021.3071158"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A computational approach to edge detection","volume":"6","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1109\/JSTARS.2011.2181340","article-title":"Automated extraction of image-based endmember bundles for improved spectral unmixing","volume":"5","author":"Somers","year":"2012","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1109\/TGRS.2005.844293","article-title":"Vertex component analysis: A fast algorithm to unmix hyperspectral data","volume":"43","author":"Nascimento","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Cun, X., Pun, C.M., and Shi, C. (2020, January 7\u201312). Towards Ghost-Free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GAN. Proceedings of the AAAI, New York, NY, USA.","DOI":"10.1609\/aaai.v34i07.6695"}],"updated-by":[{"DOI":"10.3390\/rs13030473","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2020,12,5]],"date-time":"2020-12-05T00:00:00Z","timestamp":1607126400000}}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/23\/3985\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,3]],"date-time":"2025-08-03T13:55:00Z","timestamp":1754229300000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/23\/3985"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,5]]},"references-count":60,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["rs12233985"],"URL":"https:\/\/doi.org\/10.3390\/rs12233985","relation":{"correction":[{"id-type":"doi","id":"10.3390\/rs13030473","asserted-by":"object"}]},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,5]]}}}