{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T04:41:31Z","timestamp":1792816891768,"version":"4.5.0"},"reference-count":52,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,6,5]],"date-time":"2024-06-05T00:00:00Z","timestamp":1717545600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Spectral imaging has revolutionisedvarious fields by capturing detailed spatial and spectral information. However, its high cost and complexity limit the acquisition of a large amount of data to generalise processes and methods, thus limiting widespread adoption. To overcome this issue, a body of the literature investigates how to reconstruct spectral information from RGB images, with recent methods reaching a fairly low error of reconstruction, as demonstrated in the recent literature. This article explores the modification of information in the case of RGB-to-spectral reconstruction beyond reconstruction metrics, with a focus on assessing the accuracy of the reconstruction process and its ability to replicate full spectral information. In addition to this, we conduct a colorimetric relighting analysis based on the reconstructed spectra. We investigate the information representation by principal component analysis and demonstrate that, while the reconstruction error of the state-of-the-art reconstruction method is low, the nature of the reconstructed information is different. While it appears that the use in colour imaging comes with very good performance to handle illumination, the distribution of information difference between the measured and estimated spectra suggests that caution should be exercised before generalising the use of this approach.<\/jats:p>","DOI":"10.3390\/s24113666","type":"journal-article","created":{"date-parts":[[2024,6,5]],"date-time":"2024-06-05T10:05:50Z","timestamp":1717581950000},"page":"3666","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Spectral Reconstruction from RGB Imagery: A Potential Option for Infinite Spectral Data?"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-5388-7428","authenticated-orcid":false,"given":"Abdelhamid","family":"Fsian","sequence":"first","affiliation":[{"name":"Imagerie et Vision Artificielle (ImVIA) Laboratory, Department Informatique, Electronique, M\u00e9canique (IEM), Universit\u00e9 de Bourgogne, 21000 Dijon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jean-Baptiste","family":"Thomas","sequence":"additional","affiliation":[{"name":"Imagerie et Vision Artificielle (ImVIA) Laboratory, Department Informatique, Electronique, M\u00e9canique (IEM), Universit\u00e9 de Bourgogne, 21000 Dijon, France"},{"name":"Colourlab, Department of Computer Science, Norwegian University of Science and Technology (NTNU), 2815 Gj\u00f8vik, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1150-2498","authenticated-orcid":false,"given":"Jon","family":"Hardeberg","sequence":"additional","affiliation":[{"name":"Colourlab, Department of Computer Science, Norwegian University of Science and Technology (NTNU), 2815 Gj\u00f8vik, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pierre","family":"Gouton","sequence":"additional","affiliation":[{"name":"Imagerie et Vision Artificielle (ImVIA) Laboratory, Department Informatique, Electronique, M\u00e9canique (IEM), Universit\u00e9 de Bourgogne, 21000 Dijon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1038\/35017638","article-title":"Detection of preinvasive cancer cells","volume":"406","author":"Backman","year":"2000","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3897","DOI":"10.1364\/OL.393213","article-title":"Snapshot multispectral endomicroscopy","volume":"45","author":"Meng","year":"2020","journal-title":"Opt. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Borengasser, M., Hungate, W.S., and Watkins, R. (2007). Hyperspectral Remote Sensing: Principles and Applications, CRC Press.","DOI":"10.1201\/9781420012606"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1963","DOI":"10.1109\/JSTARS.2017.2655112","article-title":"Hyperspectral image superresolution by transfer learning","volume":"10","author":"Yuan","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_5","first-page":"1","article-title":"3D imaging spectroscopy for measuring hyperspectral patterns on solid objects","volume":"31","author":"Kim","year":"2012","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Glatt, O., Ater, Y., Kim, W.S., Werman, S., Berby, O., Zini, Y., Zelinger, S., Lee, S., Choi, H., and Soloveichik, E. (2024, January 3\u20138). Beyond RGB: A Real World Dataset for Multispectral Imaging in Mobile Devices. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.","DOI":"10.1109\/WACV57701.2024.00429"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Arad, B., Ben-Shahar, O., Timofte, R., Van Gool, L., Zhang, L., Yang, M., Xiong, Z., Chen, C., Shi, Z., and Liu, D. (2018, January 18\u201322). NTIRE 2018 challenge on spectral reconstruction from RGB Images. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00138"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Thomas, J.B., Lapray, P.J., Derhak, M., and Farup, I. (2023, January 13\u201317). Standard representation space for spectral imaging. Proceedings of the Color and Imaging Conference, Paris, France.","DOI":"10.2352\/CIC.2023.31.1.35"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"155","DOI":"10.2352\/CIC.2023.31.1.30","article-title":"A general-purpose pipeline for realistic synthetic multispectral image dataset generation","volume":"Volume 31","author":"Buzzelli","year":"2023","journal-title":"Proceedings of the Color and Imaging Conference"},{"key":"ref_11","unstructured":"Chen, Q., Cheung, T., and Westland, S. (2005, January 9\u201313). Physical modelling of spectral reflectance. Proceedings of the 10th Congress of the International Color Association, Granada, Spain."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1109\/MSP.2016.2582378","article-title":"Computational snapshot multispectral cameras: Toward dynamic capture of the spectral world","volume":"33","author":"Cao","year":"2016","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1111\/j.1477-9730.2011.00665.x","article-title":"Review of developments in geometric modelling for high resolution satellite pushbroom sensors","volume":"27","author":"Poli","year":"2012","journal-title":"Photogramm. Rec."},{"key":"ref_14","unstructured":"Du, H., Tong, X., Cao, X., and Lin, S. (October, January 29). A prism-based system for multispectral video acquisition. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"10526","DOI":"10.1364\/OE.21.010526","article-title":"Coded aperture compressive temporal imaging","volume":"21","author":"Llull","year":"2013","journal-title":"Opt. Express"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"B44","DOI":"10.1364\/AO.47.000B44","article-title":"Single disperser design for coded aperture snapshot spectral imaging","volume":"47","author":"Wagadarikar","year":"2008","journal-title":"Appl. Opt."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"6368","DOI":"10.1364\/OE.17.006368","article-title":"Video rate spectral imaging using a coded aperture snapshot spectral imager","volume":"17","author":"Wagadarikar","year":"2009","journal-title":"Opt. Express"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Meng, Z., Ma, J., and Yuan, X. (2020, January 23\u201328). End-to-end low cost compressive spectral imaging with spatial-spectral self-attention. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58592-1_12"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/MSP.2020.3023869","article-title":"Snapshot compressive imaging: Theory, algorithms, and applications","volume":"38","author":"Yuan","year":"2021","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Maloney, L.T., and Wandell, B.A. (1987). Color constancy: A method for recovering surface spectral reflectance. Readings in Computer Vision, Elsevier.","DOI":"10.1016\/B978-0-08-051581-6.50034-9"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1002\/col.20431","article-title":"Reconstruction of reflectance spectra using weighted principal component analysis","volume":"33","author":"Agahian","year":"2008","journal-title":"Color Res. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2444","DOI":"10.1364\/JOSAA.25.002444","article-title":"Evaluation and unification of some methods for estimating reflectance spectra from RGB images","volume":"25","author":"Heikkinen","year":"2008","journal-title":"JOSA A"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"284","DOI":"10.2352\/issn.2169-2629.2019.27.51","article-title":"Exposure invariance in spectral reconstruction from rgb images","volume":"Volume 27","author":"Lin","year":"2019","journal-title":"Proceedings of the Color and Imaging Conference"},{"key":"ref_24","first-page":"65","article-title":"Spectral recovery using polynomial models","volume":"Volume 5667","author":"Connah","year":"2005","journal-title":"Proceedings of the Color Imaging X: Processing"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.1364\/JOSAA.14.001393","article-title":"Bayesian color constancy","volume":"14","author":"Brainard","year":"1997","journal-title":"JOSA A"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1814","DOI":"10.1364\/JOSAA.23.001814","article-title":"Metamer-set-based approach to estimating surface reflectance from camera RGB","volume":"23","author":"Morovic","year":"2006","journal-title":"JOSA A"},{"key":"ref_27","first-page":"480","article-title":"On the spectral dimensionality of object colours","volume":"Volume 1","author":"Hardeberg","year":"2002","journal-title":"Proceedings of the Conference on Colour in Graphics"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chakrabarti, A., and Zickler, T. (2011, January 20\u201325). Statistics of real-world hyperspectral images. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995660"},{"key":"ref_29","unstructured":"Arad, B., Timofte, R., Ben-Shahar, O., Lin, Y.T., and Finlayson, G.D. (2020, January 14\u201319). NTIRE 2020 challenge on spectral reconstruction from an RGB image. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, J., Wu, C., Song, R., Li, Y., and Liu, F. (2020, January 14\u201319). Adaptive weighted attention network with camera spectral sensitivity prior for spectral reconstruction from RGB images. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00239"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"107394","DOI":"10.1016\/j.sigpro.2019.107394","article-title":"CNN based spectral super-resolution of remote sensing images","volume":"169","author":"Arun","year":"2020","journal-title":"Signal Process."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Fubara, B.J., Sedky, M., and Dyke, D. (2020, January 14\u201319). RGB to spectral reconstruction via learned basis functions and weights. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00248"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Shi, Z., Chen, C., Xiong, Z., Liu, D., and Wu, F. (2018, January 18\u201323). HSCNN+: Advanced CNN-based hyperspectral recovery from RGB images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00139"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Po, L.M., Yan, Q., Liu, W., and Lin, T. (2020, January 14\u201319). Hierarchical regression network for spectral reconstruction from RGB images. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00219"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Arad, B., and Ben-Shahar, O. (2016, January 11\u201314). Sparse recovery of hyperspectral signal from natural RGB images. Proceedings of the Computer Vision\u2014ECCV 2016: 14th European Conference, Amsterdam, The Netherlands. Proceedings, Part VII 14.","DOI":"10.1007\/978-3-319-46478-7_2"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Nguyen, R.M., Prasad, D.K., and Brown, M.S. (2014, January 6\u201312). Training-based spectral reconstruction from a single RGB image. Proceedings of the Computer Vision\u2014ECCV 2014: 13th European Conference, Zurich, Switzerland. Proceedings, Part VII 13.","DOI":"10.1007\/978-3-319-10584-0_13"},{"key":"ref_37","first-page":"8","article-title":"Spectrum recovery from colorimetric data for color reproductions","volume":"Volume 4663","author":"Sharma","year":"2001","journal-title":"Proceedings of the Color Imaging: Device-Independent Color"},{"key":"ref_38","first-page":"486","article-title":"Reconstructing spectral reflectances with mixture density networks","volume":"Volume 1","author":"Schmit","year":"2002","journal-title":"Proceedings of the Conference on Colour in Graphics"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Lin, Y.T., and Finlayson, G.D. (2021). On the optimization of regression-based spectral reconstruction. Sensors, 21.","DOI":"10.3390\/s21165586"},{"key":"ref_40","unstructured":"Aeschbacher, J., Wu, J., and Timofte, R. (2017, January 22\u201329). In defense of shallow learned spectral reconstruction from RGB images. Proceedings of the IEEE International Conference on Computer Vision Workshops, Venice, Italy."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Stiebel, T., and Merhof, D. (2020). Brightness invariant deep spectral super-resolution. Sensors, 20.","DOI":"10.3390\/s20205789"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1109\/TIP.2015.2393057","article-title":"Hyperspectral face recognition with spatiospectral information fusion and PLS regression","volume":"24","author":"Uzair","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Parmar, M., Lansel, S., and Wandell, B.A. (2008, January 12\u201315). Spatio-spectral reconstruction of the multispectral datacube using sparse recovery. Proceedings of the 2008 15th IEEE International Conference on Image Processing, San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4711794"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"11905","DOI":"10.1038\/s41598-022-16223-1","article-title":"A survey on computational spectral reconstruction methods from RGB to hyperspectral imaging","volume":"12","author":"Zhang","year":"2022","journal-title":"Sci. Rep."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lin, Y.-T., and Finlayson, G.D. (2020). Physically plausible spectral reconstruction. Sensors, 20.","DOI":"10.3390\/s20216399"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Cai, Y., Lin, J., Lin, Z., Wang, H., Zhang, Y., Pfister, H., Timofte, R., and Van Gool, L. (2022, January 18\u201324). MST++: Multi-stage spectral-wise transformer for efficient spectral reconstruction. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPRW56347.2022.00090"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Lin, Y.T., and Finlayson, G.D. (2023). A rehabilitation of pixel-based spectral reconstruction from RGB images. Sensors, 23.","DOI":"10.3390\/s23084155"},{"key":"ref_48","first-page":"225","article-title":"A database for spectral image quality","volume":"Volume 9396","author":"George","year":"2015","journal-title":"Proceedings of the Image Quality and System Performance XII"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2241","DOI":"10.1109\/TIP.2010.2046811","article-title":"Generalized Assorted Pixel Camera: Post-Capture Control of Resolution, Dynamic Range and Spectrum","volume":"19","author":"Yasuma","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1524","DOI":"10.1038\/s41592-021-01331-z","article-title":"Spectral entropy outperforms MS\/MS dot product similarity for small-molecule compound identification","volume":"18","author":"Li","year":"2021","journal-title":"Nat. Methods"},{"key":"ref_51","unstructured":"CIE (2024, May 09). Technical Report 3rd Edition. Available online: https:\/\/cielab.xyz\/pdf\/cie.15.2004%20colorimetry.pdf."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1002\/col.22384","article-title":"Chromatic adaptation transform by spectral reconstruction","volume":"44","author":"Burns","year":"2019","journal-title":"Color Res. Appl."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3666\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:54:14Z","timestamp":1760108054000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3666"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,5]]},"references-count":52,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["s24113666"],"URL":"https:\/\/doi.org\/10.3390\/s24113666","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,5]]}}}