{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T15:38:40Z","timestamp":1778081920918,"version":"3.51.4"},"reference-count":50,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T00:00:00Z","timestamp":1693526400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T00:00:00Z","timestamp":1693526400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Tampere University including Tampere University Hospital, Tampere University of Applied Sciences"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Vis"],"published-print":{"date-parts":[[2024,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Color constancy is still one of the biggest challenges in camera color processing. Convolutional neural networks have been able to improve the situation but there are still problems in many conditions, especially in scenes where a single color is dominating. In this work, we approach the problem from a slightly different setting. What if we could have some other information than the raw RGB image data. What kind of information would help to bring significant improvements while still be feasible in a mobile device. These questions sparked an idea for a novel approach for computational color constancy. Instead of raw RGB images used by the existing algorithms to estimate the scene white points, our approach is based on the scene\u2019s average color spectra-single pixel spectral measurement. We show that as few as 10\u201314 spectral channels are sufficient. Notably, the sensor output has five orders of magnitude less data than in raw RGB images of a 10MPix camera. The spectral sensor captures the \u201cspectral fingerprints\u201d of different light sources and the illuminant white point can be accurately estimated by a standard regressor. The regressor can be trained with generated measurements using the existing RGB color constancy datasets. For this purpose, we propose a spectral data generation pipeline that can be used if the dataset camera model is known and thus its spectral characterization can be obtained. To verify the results with real data, we collected a real spectral dataset with a commercial spectrometer. On all datasets the proposed Single Pixel Spectral Color Constancy obtains the highest accuracy in the both single and cross-dataset experiments. The method is particularly effective for the difficult scenes for which the average improvements are 40\u201370% compared to state-of-the-arts. The approach can be extended to multi-illuminant case for which the experimental results also provide promising results.<\/jats:p>","DOI":"10.1007\/s11263-023-01867-x","type":"journal-article","created":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T10:02:52Z","timestamp":1693562572000},"page":"287-299","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Single Pixel Spectral Color Constancy"],"prefix":"10.1007","volume":"132","author":[{"given":"Samu","family":"Koskinen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Erman","family":"Acar","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joni-Kristian","family":"K\u00e4m\u00e4r\u00e4inen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,9,1]]},"reference":[{"key":"1867_CR1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995457","author":"B Arad","year":"2016","unstructured":"Arad, B., & Ben-Shahar, O. (2016). High-resolution hyperspectral imaging via matrix factorization. ECCV. https:\/\/doi.org\/10.1109\/CVPR.2011.5995457","journal-title":"ECCV"},{"key":"1867_CR2","unstructured":"Aytekin, \u00c7., Nikkanen, J., & Gabbouj, M. (2017). INTEL-TUT dataset for camera invariant color constancy research. CoRR, abs\/1703.09778, doi10.1109\/TIP.2017.2764264."},{"key":"1867_CR3","doi-asserted-by":"crossref","unstructured":"Bani\u0107, N. & Lon\u010dari\u0107, S. (2017). Unsupervised learning for color constancy. CoRR, doi10.48550\/ arXiv:1712.00436.","DOI":"10.5220\/0006621801810188"},{"key":"1867_CR4","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2002.802531","author":"K Barnard","year":"2002","unstructured":"Barnard, K., Cardei, V., & Funt, B. (2002). A comparison of computational color constancy algorithms-part I: Methodology and experiments with synthesized data. IEEE Signal Processing Society. https:\/\/doi.org\/10.1109\/TIP.2002.802531","journal-title":"IEEE Signal Processing Society"},{"key":"1867_CR5","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.51","author":"JT Barron","year":"2015","unstructured":"Barron, J. T. (2015). Convolutional color constancy. ICCV. https:\/\/doi.org\/10.1109\/ICCV.2015.51","journal-title":"ICCV"},{"key":"1867_CR6","doi-asserted-by":"crossref","unstructured":"Barron, J.\u00a0T. & Tsai, Y. (2017). Fast fourier color constancy. In 2017 IEEE conference on computer vision and pattern recognition (CVPR). 10.1109\/CVPR.2017.735.","DOI":"10.1109\/CVPR.2017.735"},{"issue":"1","key":"1867_CR7","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5\u201332. https:\/\/doi.org\/10.1023\/A:1010933404324","journal-title":"Machine Learning"},{"issue":"1","key":"1867_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0016-0032(80)90058-7","volume":"310","author":"G Buchsbaum","year":"1980","unstructured":"Buchsbaum, G. (1980). A spatial processor model for object colour perception. Journal of the Franklin Institute, 310(1), 1\u201326. https:\/\/doi.org\/10.1016\/0016-0032(80)90058-7","journal-title":"Journal of the Franklin Institute"},{"issue":"8","key":"1867_CR9","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1109\/TPAMI.2011.252","volume":"34","author":"A Chakrabarti","year":"2011","unstructured":"Chakrabarti, A., Hirakawa, K., & Zickler, T. (2011). Color constancy with spatio-temporal statistics. IEEE PAMI, 34(8), 58. https:\/\/doi.org\/10.1109\/TPAMI.2011.252","journal-title":"IEEE PAMI"},{"key":"1867_CR10","unstructured":"Chen, X. (2017). Color Constancy for RGB and Multispectral Images. Thesis (School of Computing Science): Simon Fraser University."},{"issue":"5","key":"1867_CR11","doi-asserted-by":"publisher","first-page":"552","DOI":"10.1364\/JOSAA.31.001049","volume":"31","author":"D Cheng","year":"2014","unstructured":"Cheng, D., Prasad, D. K., & Brown, M. S. (2014). Illuminant estimation for color constancy: Why spatial-domain methods work and the role of the color distribution. Journal of the Optical Society of America A, 31(5), 552. https:\/\/doi.org\/10.1364\/JOSAA.31.001049","journal-title":"Journal of the Optical Society of America A"},{"key":"1867_CR12","unstructured":"Dietz, C. (2011). C &A Application Note No.1: Light sources and illuminants. Technical report, Konica Minolta."},{"issue":"11","key":"1867_CR13","first-page":"552","volume":"32","author":"G Finlayson","year":"2001","unstructured":"Finlayson, G., Hordley, S., & Hubel, P. M. (2001). Color by correlation: A simple, unifying framework for color constancy. IEEE PAMI, 32(11), 552.","journal-title":"IEEE PAMI"},{"key":"1867_CR14","doi-asserted-by":"crossref","unstructured":"Finlayson, G.\u00a0D. (2013). Corrected-moment illuminant estimation. In ICCV (pp. 1904\u20131911). 10.1109\/ICCV.2013.239.","DOI":"10.1109\/ICCV.2013.239"},{"issue":"5","key":"1867_CR15","doi-asserted-by":"publisher","first-page":"1553","DOI":"10.1364\/JOSAA.11.001553","volume":"11","author":"GD Finlayson","year":"1994","unstructured":"Finlayson, G. D., Drew, M. S., & Funt, B. V. (1994). Spectral sharpening: Sensor transformations for improved color constancy. Journal of the Optical Society of America A, 11(5), 1553\u20131563. https:\/\/doi.org\/10.1364\/JOSAA.11.001553","journal-title":"Journal of the Optical Society of America A"},{"issue":"7","key":"1867_CR16","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1109\/TPAMI.2016.2582171","volume":"39","author":"GD Finlayson","year":"2017","unstructured":"Finlayson, G. D., Zakizadeh, R., & Gijsenij, A. (2017). The reproduction angular error for evaluating the performance of illuminant estimation algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(7), 52. https:\/\/doi.org\/10.1109\/TPAMI.2016.2582171","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"10","key":"1867_CR17","doi-asserted-by":"publisher","first-page":"1737","DOI":"10.1109\/TIP.2008.2001399","volume":"17","author":"A Foi","year":"2008","unstructured":"Foi, A., Trimeche, M., Katkovnik, V., & Egiazarian, K. (2008). Practical poissonian-gaussian noise modeling and fitting for single-image raw-data. IEEE Transactions on Image Processing, 17(10), 1737\u20131754. https:\/\/doi.org\/10.1109\/TIP.2008.2001399","journal-title":"IEEE Transactions on Image Processing"},{"issue":"9","key":"1867_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.physrep.2015.12.004","volume":"616","author":"L Gao","year":"2016","unstructured":"Gao, L., & Wang, L. V. (2016). A review of snapshot multidimensional optical imaging: Measuring photon tags in parallel. Physics Reports, 616(9), 1\u201337. https:\/\/doi.org\/10.1016\/j.physrep.2015.12.004","journal-title":"Physics Reports"},{"key":"1867_CR19","doi-asserted-by":"crossref","unstructured":"Gao, S., Han, W., Yang, K., Li, C., & Li, Y. (2014). Efficient color constancy with local surface reflectance statistics. In ECCV (pp. 158\u2013173). 10.1007\/978-3-319-10605-2_11.","DOI":"10.1007\/978-3-319-10605-2_11"},{"key":"1867_CR20","unstructured":"Geoffrey, E.\u00a0H. (1989). Connectionist learning procedures."},{"key":"1867_CR21","doi-asserted-by":"publisher","DOI":"10.5244\/C.14.30","author":"T Gevers","year":"2000","unstructured":"Gevers, T., Stokman, H., & van de Weijer, J. (2000). Color constancy from hyper-spectral data. BMVC. https:\/\/doi.org\/10.5244\/C.14.30","journal-title":"BMVC"},{"key":"1867_CR22","doi-asserted-by":"crossref","unstructured":"Guild, J. & Petavel, J.\u00a0E. (1931). The colorimetric properties of the spectrum. In Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character (vol. 230, pp. 681\u2013693), 10.1098\/rsta.1932.0005.","DOI":"10.1098\/rsta.1932.0005"},{"key":"1867_CR23","unstructured":"Hamamatsu (2019). Image Sensors: Selection guide-November 2019. Hamamatsu Photonics K.K."},{"key":"1867_CR24","doi-asserted-by":"crossref","unstructured":"Hasinoff, S.\u00a0W. (2014). Photon, poisson noise. Springer (pp. 608\u2013610). 10.1007\/978-0-387-31439-6_482.","DOI":"10.1007\/978-0-387-31439-6_482"},{"key":"1867_CR25","doi-asserted-by":"crossref","unstructured":"Hemrit, G., et\u00a0al. (2018). Rehabilitating the colorchecker dataset for illuminant estimation. In Color and Imaging Conference. 10.2352\/ISSN.2169-2629.2018.26.350.","DOI":"10.2352\/ISSN.2169-2629.2018.26.350"},{"key":"1867_CR26","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.43","author":"Y Hu","year":"2017","unstructured":"Hu, Y., Wang, B., & Lin, S. (2017). FC4: Fully convolutional color constancy with confidence-weighted pooling. CVPR. https:\/\/doi.org\/10.1109\/CVPR.2017.43","journal-title":"CVPR"},{"key":"1867_CR27","doi-asserted-by":"crossref","unstructured":"Hui, Z., Chakrabarti, A., Sunkavalli, K., & Sankaranarayanan, A.\u00a0C. (2019). Learning to separate multiple illuminants in a single image. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR). 10.1109\/CVPR.2019.00390.","DOI":"10.1109\/CVPR.2019.00390"},{"key":"1867_CR28","doi-asserted-by":"crossref","unstructured":"Hui, Z., Sunkavalli, K., Hadap, S., & Sankaranarayanan, A.\u00a0C. (2018). Illuminant spectra-based source separation using flash photography. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). 10.1109\/CVPR.2018.00650.","DOI":"10.1109\/CVPR.2018.00650"},{"key":"1867_CR29","unstructured":"International Organization for Standardization (2006). ISO 11664-2 Standard - Colorimetry Part 2: Standard Illuminants for Colorimetry."},{"key":"1867_CR30","unstructured":"International Organization for Standardization (2008). ISO 11664-4 Standard - Colorimetry Part 4: CIE 1976 L*a*b* Colour Space."},{"key":"1867_CR31","unstructured":"Jensen, K. (2020). Chip-scale spectral sensing: understanding the new uses for ultra-precise light-source measurement. Technical report, ams AG."},{"key":"1867_CR32","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.504","author":"Y Jia","year":"2017","unstructured":"Jia, Y., Zheng, Y., Gu, L., Subpa-Asa, A., Lam, A., Sato, Y., & Sato, I. (2017). From RGB to spectrum for natural scenes via manifold-based mapping. ICCV. https:\/\/doi.org\/10.1109\/ICCV.2017.504","journal-title":"ICCV"},{"key":"1867_CR33","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995457","author":"R Kawakami","year":"2011","unstructured":"Kawakami, R., Matsushita, Y., Wright, J., Ben-Ezra, M., Tai, Y.-W., & Ikeuchi, K. (2011). High-resolution hyperspectral imaging via matrix factorization. CVPR. https:\/\/doi.org\/10.1109\/CVPR.2011.5995457","journal-title":"CVPR"},{"issue":"10","key":"1867_CR34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1117\/1.2992621","volume":"47","author":"JP Kerekes","year":"2008","unstructured":"Kerekes, J. P., Strackerjan, K., & Salvaggio, C. (2008). Spectral reflectance and emissivity of man-made surfaces contaminated with environmental effects. Optical Engineering, 47(10), 1\u201310.","journal-title":"Optical Engineering"},{"key":"1867_CR35","doi-asserted-by":"crossref","unstructured":"Keshav, V. & GVSL, T.\u00a0P. (2019). Decoupling semantic context and color correlation with multi-class cross branch regularization. In ICME (pp. 1492\u20131497). 10.1109\/ICME.2019.00258.","DOI":"10.1109\/ICME.2019.00258"},{"issue":"7","key":"1867_CR36","doi-asserted-by":"publisher","first-page":"1085","DOI":"10.1364\/JOSAA.34.001085","volume":"34","author":"HA Khan","year":"2017","unstructured":"Khan, H. A., Thomas, J.-B., Hardeberg, J. Y., & Laligant, O. (2017). Illuminant estimation in multispectral imaging. Journal of the Optical Society of America A, 34(7), 1085\u20131098. https:\/\/doi.org\/10.1364\/JOSAA.34.001085","journal-title":"Journal of the Optical Society of America A"},{"issue":"4","key":"1867_CR37","doi-asserted-by":"publisher","first-page":"526","DOI":"10.1088\/1681-7575\/aacae7","volume":"55","author":"A Kokka","year":"2018","unstructured":"Kokka, A., et al. (2018). Development of white LED illuminants for colorimetry and recommendation of white LED reference spectrum for photometry. Metrologia, 55(4), 526\u2013534. https:\/\/doi.org\/10.1088\/1681-7575\/aacae7","journal-title":"Metrologia"},{"key":"1867_CR38","unstructured":"Koskinen, S., Acar, E., & K\u00e4m\u00e4r\u00e4inen, J.-K. (2021). Single pixel spectral color constancy. In BMVC."},{"key":"1867_CR39","unstructured":"Koskinen, S., Yang, D., & K\u00e4m\u00e4r\u00e4inen, J.-K. (2020). Cross-dataset color constancy revisited using sensor-to-sensor transfer. In BMVC."},{"key":"1867_CR40","unstructured":"Murphy, K. (2012). Machine learning: A probabilistic perspective (Vol. 58). The MIT Press."},{"issue":"9","key":"1867_CR41","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1117\/1.OE.52.9.090901","volume":"52","author":"AH Nathan","year":"2013","unstructured":"Nathan, A. H., & Michael, W. K. (2013). Review of snapshot spectral imaging technologies. Optical Engineering, 52(9), 1\u201323. https:\/\/doi.org\/10.1117\/1.OE.52.9.090901","journal-title":"Optical Engineering"},{"key":"1867_CR42","unstructured":"Orava, J. (1995). The reflectance spectra of 1600 glossy Munsell color chips. https:\/\/sites.uef.fi\/spectral\/databases-software\/spectral-database\/. Accessed 22 July 2022."},{"key":"1867_CR43","unstructured":"Palmer, S.\u00a0E. (1999). Vision science: Photons to phenomenology. The MIT Press."},{"key":"1867_CR44","doi-asserted-by":"crossref","unstructured":"Parkkinen, J., Jaaskelainen, T., & Kuittinen, M. (1988). Spectral representation of color images. In IEEE 9th International Conference on Pattern Recognition (vol. 2, pp. 933\u2013935).","DOI":"10.1109\/ICPR.1988.28405"},{"key":"1867_CR45","doi-asserted-by":"crossref","unstructured":"Qian, Y., K\u00e4m\u00e4r\u00e4inen, J.-K., Nikkanen, J., & Matas, J. (2019). On finding gray pixels. In CVPR (pp. 8054\u20138062). 10.1109\/CVPR.2019.00825.","DOI":"10.1109\/CVPR.2019.00825"},{"key":"1867_CR46","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2005.1530157","author":"J van de Weijer","year":"2005","unstructured":"van de Weijer, J., & Gevers, T. (2005). Color constancy based on the Grey-edge hypothesis. ICIP. https:\/\/doi.org\/10.1109\/ICIP.2005.1530157","journal-title":"ICIP"},{"key":"1867_CR47","unstructured":"von Kries, J. (1970). Influence of adaptation on the effects produced by luminous stimuli. Source of Color Science."},{"issue":"1020","key":"1867_CR48","doi-asserted-by":"publisher","first-page":"560","DOI":"10.1038\/s41467-019-08994-5","volume":"10","author":"Z Wang","year":"2019","unstructured":"Wang, Z., et al. (2019). Single-shot on-chip spectral sensors based on photonic crystal slabs. Nature Communications, 10(1020), 560. https:\/\/doi.org\/10.1038\/s41467-019-08994-5","journal-title":"Nature Communications"},{"issue":"1","key":"1867_CR49","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1108\/02602280010311392","volume":"20","author":"S Westland","year":"2000","unstructured":"Westland, S., Shaw, A., & Owens, H. (2000). Colour statistics of natural and man-made surfaces. Sensor Review, 20(1), 50\u201355. https:\/\/doi.org\/10.1108\/02602280010311392","journal-title":"Sensor Review"},{"key":"1867_CR50","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298838","author":"K-F Yang","year":"2015","unstructured":"Yang, K.-F., Gao, S.-B., & Li, Y.-J. (2015). Efficient illuminant estimation for color constancy using grey pixels. CVPR. https:\/\/doi.org\/10.1109\/CVPR.2015.7298838","journal-title":"CVPR"}],"container-title":["International Journal of Computer Vision"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-023-01867-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11263-023-01867-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-023-01867-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,30]],"date-time":"2024-01-30T07:13:08Z","timestamp":1706598788000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11263-023-01867-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,1]]},"references-count":50,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,2]]}},"alternative-id":["1867"],"URL":"https:\/\/doi.org\/10.1007\/s11263-023-01867-x","relation":{},"ISSN":["0920-5691","1573-1405"],"issn-type":[{"value":"0920-5691","type":"print"},{"value":"1573-1405","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,1]]},"assertion":[{"value":"31 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 July 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}