{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T15:16:58Z","timestamp":1781709418623,"version":"3.54.5"},"reference-count":55,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,6,5]],"date-time":"2023-06-05T00:00:00Z","timestamp":1685923200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001039","name":"National Research Foundation (NRF)","doi-asserted-by":"publisher","award":["NRF-2019R1I1A3A01061844"],"award-info":[{"award-number":["NRF-2019R1I1A3A01061844"]}],"id":[{"id":"10.13039\/501100001039","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>To achieve computer vision color constancy (CVCC), it is vital but challenging to estimate scene illumination from a digital image, which distorts the true color of an object. Estimating illumination as accurately as possible is fundamental to improving the quality of the image processing pipeline. CVCC has a long history of research and has significantly advanced, but it has yet to overcome some limitations such as algorithm failure or accuracy decreasing under unusual circumstances. To cope with some of the bottlenecks, this article presents a novel CVCC approach that introduces a residual-in-residual dense selective kernel network (RiR-DSN). As its name implies, it has a residual network in a residual network (RiR) and the RiR houses a dense selective kernel network (DSN). A DSN is composed of selective kernel convolutional blocks (SKCBs). The SKCBs, or neurons herein, are interconnected in a feed-forward fashion. Every neuron receives input from all its preceding neurons and feeds the feature maps into all its subsequent neurons, which is how information flows in the proposed architecture. In addition, the architecture has incorporated a dynamic selection mechanism into each neuron to ensure that the neuron can modulate filter kernel sizes depending on varying intensities of stimuli. In a nutshell, the proposed RiR-DSN architecture features neurons called SKCBs and a residual block in a residual block, which brings several benefits such as alleviation of the vanishing gradients, enhancement of feature propagation, promotion of the reuse of features, modulation of receptive filter sizes depending on varying intensities of stimuli, and a dramatic drop in the number of parameters. Experimental results highlight that the RiR-DSN architecture performs well above its state-of-the-art counterparts, as well as proving to be camera- and illuminant-invariant.<\/jats:p>","DOI":"10.3390\/s23115341","type":"journal-article","created":{"date-parts":[[2023,6,5]],"date-time":"2023-06-05T04:01:47Z","timestamp":1685937707000},"page":"5341","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["CVCC Model: Learning-Based Computer Vision Color Constancy with RiR-DSN Architecture"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6843-3556","authenticated-orcid":false,"given":"Ho-Hyoung","family":"Choi","sequence":"first","affiliation":[{"name":"School of Dentistry, Advanced Dental Device Development Institute, Kyungpook National University, Jung-gu, Daegu 41940, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ebner, M. (2007). Color Constancy, John Wiley & Sons.","DOI":"10.1002\/9780470510490"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Alsam, A. (2010, January 23\u201326). Colour constant image sharpening. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.1104"},{"key":"ref_3","unstructured":"Barnard, K. (1999). Practical Colour Constancy, Simon Fraser University."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0016-0032(80)90058-7","article-title":"A spatial processor model for object colour perception","volume":"310","author":"Buchsbaum","year":"1980","journal-title":"J. Frankl. Inst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1038\/scientificamerican1277-108","article-title":"The Retinex theory of color vision","volume":"237","author":"Land","year":"1977","journal-title":"Sci. Am."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Banic, N., and Loncaric, S. (2014, January 27\u201330). Improving the white patch method by subsampling. Proceedings of the IEEE International Conference on Image Processing (ICIP), Paris, France.","DOI":"10.1109\/ICIP.2014.7025121"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Finlayson, G.D., and Trezzi, E. (2004, January 9). Shade of gray and color constancy. Proceedings of the IS&T\/SID Color Imaging Conference, Scottsdale, AZ, USA.","DOI":"10.2352\/CIC.2004.12.1.art00008"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2207","DOI":"10.1109\/TIP.2007.901808","article-title":"Edege-based color constancy","volume":"16","author":"Weijer","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"918","DOI":"10.1109\/TPAMI.2011.197","article-title":"Improving color constancy by photometric edge weighting","volume":"34","author":"Gijsenij","year":"2012","journal-title":"IEEE Trans. Patten Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/BF00056770","article-title":"A novel algorithm for color constancy","volume":"5","author":"Forsyth","year":"1990","journal-title":"Int. J. Comput. Vis."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1034","DOI":"10.1109\/34.541413","article-title":"Color in perspective","volume":"18","author":"Finlayson","year":"1996","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1774","DOI":"10.1109\/83.869188","article-title":"Improving gamut mapping color constancy","volume":"9","author":"Finlayson","year":"2000","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","unstructured":"Finlayson, G., and Xu, R. (2003, January 1). Convex programming color constancy. Proceedings of the IEEE Workshop on Color and Photometric Methods in Computer Vision, Online."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Mosny, M., and Funt, B. (2010, January 14\u201317). Cubical gamut mapping colour constancy. Proceedings of the IS&T\u2019s European Conference on Colour in Graphics, Imaging and Vision, Burnaby, BC, Canada.","DOI":"10.2352\/CGIV.2010.5.1.art00073"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/s11263-008-0171-3","article-title":"Generalized gamut mapping using image derivative structure for color constancy","volume":"86","author":"Gijsenij","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Finlayson, G.D., Hordley, S.D., and Xu, R. (2005, January 14). Convex programming color constancy with a diagonal-offset model. Proceedings of the International Conference on Image Processing, Genova, Italy.","DOI":"10.1109\/ICIP.2005.1530550"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1109\/TPAMI.2010.93","article-title":"Color constancy using natural image statistics and scene semantics","volume":"33","author":"Gijsenij","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"576","DOI":"10.1364\/JOSAA.6.000576","article-title":"Standard surface-reflectance model and illuminant estimation","volume":"6","author":"Tominaga","year":"1989","journal-title":"J. Opt. Soc. Amer. A Opt. Image Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/0262-8856(91)90038-Q","article-title":"Estimating spectral reflectance using high lights","volume":"9","author":"Healey","year":"1991","journal-title":"Image Vis. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1364\/JOSAA.21.000321","article-title":"Color constancy through inverse- intensity chromaticity space","volume":"21","author":"Tan","year":"2004","journal-title":"J. Opt. Soc. Amer. A Opt. Image Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1023\/A:1011120214885","article-title":"Solving for colour constancy using a constrained dichromatic reflection model","volume":"42","author":"Finlayson","year":"2001","journal-title":"Int. J. Comput. Vis."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Barron, J.T. (2015, January 7\u201313). Convolutional color constancy. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.51"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bianco, S., Cusano, C., and Schettini, R. (2015, January 7\u201312). Color constancy using CNNs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Boston, MA, USA.","DOI":"10.1109\/CVPRW.2015.7301275"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Fourure, D., Emonet, R., Fromont, E., Muselet, D., Tre, A., and Wolf, C. (2016, January 25\u201328). Mixed pooling neural networks for color constancy. Proceedings of the IEEE International Conference on Image Processing, Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533110"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Drew, M.S., Joze, H.R.V., and Finlayson, G.D. (2012, January 7\u201313). Specularity, the Zeta-image, and information-theoretic illuminant estimation. Proceedings of the ECCV, Florence, Italy.","DOI":"10.1007\/978-3-642-33868-7_41"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1109\/TPAMI.2013.169","article-title":"Exemplar-based color constancy and multiple illumination","volume":"36","author":"Joze","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Xu, N., Lin, W., Zhou, Y., Chen, Y., Chen, Z., and Li, H. (2011, January 6\u20139). A new global-based video enhancement algorithm by fusing features of multiple region-of- interests. Proceedings of the Visual Communications and Image Processing (VCIP), Tainan, Taiwan.","DOI":"10.1109\/VCIP.2011.6115958"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/TCSVT.2012.2203198","article-title":"Intra-and-inter- constraint-based video enhancement based on piecewise tone mapping","volume":"23","author":"Chen","year":"2013","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1973","DOI":"10.1109\/TPAMI.2015.2396053","article-title":"Color constancy using double- opponency","volume":"37","author":"Gao","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1219","DOI":"10.1109\/TIP.2016.2516953","article-title":"Areti- nal mechanism inspired color constancy model","volume":"25","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2081","DOI":"10.1109\/TPAMI.2017.2753239","article-title":"Colour constancy beyond the classical receptive field","volume":"40","author":"Akbarinia","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Conde, M.V., McDonagh, S., Maggioni, M., Leonardis, A., and Perez-Pellitero, E. (2022). Model-based Image Signal Processors Via Learnable Dictionaries. arXiv.","DOI":"10.1609\/aaai.v36i1.19926"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the CVPR, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_34","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). Imagenet classification with deep convolutional neural networks. Proceedings of the NIPS, Red Hook, NY, USA."},{"key":"ref_35","unstructured":"Lee, X., Wang, W., Hu, X., and Yang, J. (2019). Selective Kernel Network. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., and van der Maaten, L. (2018). Densely Connected Convolutional Networks. arXiv.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Gehler, P.V., Rother, C., Blake, A., Minka, T., and Sharp, T. (2008, January 23\u201318). Bayesian color constancy revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska.","DOI":"10.1109\/CVPR.2008.4587765"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Ciurea, F., and Funt, B. (2003, January 13). A large image database for color constancy research. Proceedings of the 11th Color Imaging Conference: Imaging Science and Technology, Rochester, NY, USA.","DOI":"10.2352\/CIC.2003.11.1.art00028"},{"key":"ref_39","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). TensorFlow: Large-scale machine learning on heterogeneous distributed systems. arXiv, Available online: http:\/\/arxiv.org\/abs\/1603.04467."},{"key":"ref_40","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21\u201324). Rectified linear units improve restricted Boltzmann machines. Proceedings of the ICML, Haifa, Israel."},{"key":"ref_41","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating deep network training by reducing internal covariance shit. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Barron, J.T., and Tsai, Y.-T. (2017, January 21\u201326). Fast Fourier color constancy. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.735"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Hu, Y., Wang, B., and Lin, S. (2017, January 21\u201326). FC4: Fully convolutional color constancy with confidence-weighted pooling. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.43"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"26755","DOI":"10.1109\/ACCESS.2021.3057072","article-title":"Iterative convolutional neural network-based illumination estimation","volume":"9","author":"Koscevic","year":"2021","journal-title":"IEEE Access"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Xiao, J., Gu, S., and Zhang, L. (2020, January 14\u201319). Multi-domain learning for accurate and few-shot color constancy. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00332"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.patrec.2022.04.035","article-title":"One-Net: Convolutional color constancy simplified","volume":"159","author":"Domislovic","year":"2022","journal-title":"Pattern Recognit. Lett."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Cheng, D., Price, B., Cohen, S., and Brown, M.S. (2015, January 7\u201312). Effective learning-based illuminant estimation using simple features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298702"},{"key":"ref_48","unstructured":"Barnard, K. (2000). European Conference on Computer Vision, Springer."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1509","DOI":"10.1109\/TPAMI.2011.252","article-title":"Color constancy with spatio-spectral statistics","volume":"34","author":"Chakrabarti","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Qian, Y., Pertuz, S., Nikkanen, J., K\u00e4m\u00e4r\u00e4inen, J.-K., and Matas, J. (2018). Revisiting Gray Pixel for Statistical Illumination Estimation. arXiv, Available online: http:\/\/arxiv.org\/abs\/1803.08326.","DOI":"10.5220\/0007406900002108"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Bianco, S., and Cusano, C. (2019, January 15\u201320). Quasi-unsupervised color constancy. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01249"},{"key":"ref_52","unstructured":"Qiu, J., Xu, H., and Ye, Z. (2018). Color constancy by Reweighting Image Feature Maps. arXiv, Available online: https:\/\/arxiv.org\/pdf\/1806.09248."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Choi, H.H., Kang, H.S., and Yun, B.J. (2020). CNN-based illumination estimation with semantic information. Appl. Sci., 10.","DOI":"10.3390\/app10144806"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"188309","DOI":"10.1109\/ACCESS.2020.3030912","article-title":"Deep learning-based computational color constancy with convoluted mixture of deep experts (CMoDE) fusion technique","volume":"8","author":"Choi","year":"2020","journal-title":"IEEE Access"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"29960","DOI":"10.1109\/ACCESS.2021.3059914","article-title":"Learning-based illuminant estimation model with a persistent memory residual network (PMRN) architecture","volume":"9","author":"Choi","year":"2021","journal-title":"IEEE Access"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/5341\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:48:23Z","timestamp":1760125703000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/5341"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,5]]},"references-count":55,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["s23115341"],"URL":"https:\/\/doi.org\/10.3390\/s23115341","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,5]]}}}