{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:34:28Z","timestamp":1760150068035,"version":"build-2065373602"},"reference-count":51,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,18]],"date-time":"2023-10-18T00:00:00Z","timestamp":1697587200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Education","award":["RS-2023-00240987"],"award-info":[{"award-number":["RS-2023-00240987"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In computational color constancy, regressing illumination is one of the most common approaches to manifesting the original color appearance of an object in a real-life scene. However, this approach struggles with the challenge of accuracy arising from label vagueness, which is caused by unknown light sources, different reflection characteristics of scene objects, and extrinsic factors such as various types of imaging sensors. This article introduces a novel learning-based estimation model, an aggregate residual-in-residual transformation network (ARiRTN) architecture, by combining the inception model with the residual network and embedding residual networks into a residual network. The proposed model has two parts: the feature-map group and the ARiRTN operator. In the ARiRTN operator, all splits perform transformations simultaneously, and the resulting outputs are concatenated into their respective cardinal groups. Moreover, the proposed architecture is designed to develop multiple homogeneous branches for high cardinality, and an increased size of a set of transformations, which extends the network in width and in length. As a result of experimenting with the four most popular datasets in the field, the proposed architecture makes a compelling case that complexity increases accuracy. In other words, the combination of the two complicated networks, residual and inception networks, helps reduce overfitting, gradient distortion, and vanishing problems, and thereby contributes to improving accuracy. Our experimental results demonstrate this model\u2019s outperformance over its most advanced counterparts in terms of accuracy, as well as the robustness of illuminant invariance and camera invariance.<\/jats:p>","DOI":"10.3390\/s23208558","type":"journal-article","created":{"date-parts":[[2023,10,18]],"date-time":"2023-10-18T10:36:56Z","timestamp":1697625416000},"page":"8558","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["ARiRTN: A Novel Learning-Based Estimation Model for Regressing Illumination"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6843-3556","authenticated-orcid":false,"given":"Ho-Hyoung","family":"Choi","sequence":"first","affiliation":[{"name":"School of Dentistry, Advanced Dental Device Development Institute, Kyungpook National University, Daegu 41940, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gi-Seok","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Logos College, Gyeongju University, Gyeongjusi 38065, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Qian, Y., Kamarainen, J.-K., Nikkanen, J., and Matas, J. (2019, January 15\u201320). On finding gray pixels. Proceedings of the Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00825"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.patcog.2018.10.015","article-title":"Cumulative attribute space regression for head pose estimation and color constancy","volume":"87","author":"Chen","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Cheng, D., Price, B., Cohen, S., and Brown, M.S. (2015, January 7\u201312). Effective learning-based illuminant estimation using simple features. Proceedings of the Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298702"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4347","DOI":"10.1109\/TIP.2017.2713044","article-title":"Single and multiple illuminant estimation using convolutional neural networks","volume":"26","author":"Bianco","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Shi, W., Loy, C.C., and Tang, X. (2016, January 11\u201314). Deep specialized network for illuminant estimation. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46493-0_23"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hu, Y., Wang, B., and Lin, S. (2017, January 21\u201326). Fc4: Fully convolutional color constancy with confidence-weighted pooling. Proceedings of the Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.43"},{"key":"ref_7","unstructured":"von Kries, J. (1902). Festschrift der Albrecht-Ludwigs-Universitat, Springer."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Barron, J.T. (2015, January 7\u201313). Convolutional color constancy. Proceedings of the International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.51"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Barron, J.T., and Tsai, Y.-T. (2017, January 21\u201326). Fast fourier color constancy. Proceedings of the Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.735"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the CVPR, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_11","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the ICML, Lille, France."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the CVPR, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., and Vanhoucke, V. (2016, January 2\u20134). Inception-v4, inceptionresnet and the impact of residual connections on learning. Proceedings of the ICLR Workshop, San Juan, Puerto Rico.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0016-0032(80)90058-7","article-title":"A spatial processor model for object colour perception","volume":"310","author":"Buchsbaum","year":"1980","journal-title":"J. Frankl. Inst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Finlayson, G.D., and Trezzi, E. (2004, January 9\u201312). Shade of gray and color constancy. Proceedings of the IS&T\/SID Color Imaging Conference, Scottsdale, AZ, USA.","DOI":"10.2352\/CIC.2004.12.1.art00008"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2207","DOI":"10.1109\/TIP.2007.901808","article-title":"Edge-based color constancy","volume":"16","author":"Gevers","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1364\/JOSA.61.000001","article-title":"Lightness and retinex theory","volume":"61","author":"Land","year":"1971","journal-title":"J. Opt. Soc. Am."},{"key":"ref_18","unstructured":"Funt, B.V., and Shi, L. (2010, January 8\u201312). The rehabilitation of maxrgb. Proceedings of the 18th Color and Imaging Conference, CIC 2010, San Antonio, TX, USA."},{"key":"ref_19","unstructured":"Freeman, W.T., and Brainard, D.H. (June, January ). Bayesian decision theory, the maximum local mass estimate, and color constancy. Proceedings of the Fifth International Conference on Computer Vision (ICCV 95), Massachusetts Institute of Technology, Cambridge, MA, USA."},{"key":"ref_20","unstructured":"Rosenberg, C.R., Minka, T.P., and Lad-sariya, A. (2003, January 8\u201313). Bayesian color constancy with non-gaussian models. Proceedings of the Advances in Neural Information Processing Systems 16, Vancouver, BC, Canada."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gehler, P.V., Rother, C., Blake, A., Minka, T., and Sharp, T. (2008, January 23\u201328). Bayesian color constancy revisited. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587765"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Funt, B.V., and Xiong, W. (2004, January 9\u201312). Estimating illumination chromaticity via support vector regression. Proceedings of the Twelfth Color Imaging Conference: Color Science and Engineering Systems, Technologies, Applications, CIC 2004, Scottsdale, AZ, USA.","DOI":"10.2352\/CIC.2004.12.1.art00010"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2279","DOI":"10.1587\/transinf.E92.D.2279","article-title":"Edge-based color constancy via support vector regression","volume":"92-D","author":"Wang","year":"2009","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Bianco, S., Cusano, C., and Schettini, R. (2015, January 7\u201312). Color constancy using cnns. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2015, Boston, MA, USA.","DOI":"10.1109\/CVPRW.2015.7301275"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lou, Z., Gevers, T., Hu, N., and Lucassen, M.P. (2015, January 7\u201310). Color constancy by deep learning. Proceedings of the British Machine Vision Conference 2015, BMVC 2015, Swansea, UK.","DOI":"10.5244\/C.29.76"},{"key":"ref_26","unstructured":"Gong, H. (2019, January 9\u201312). Convolutional mean: A simple convolutional neural network for illuminant estimation. Proceedings of the British Machine Vision Conference 2019, BMVC 2019, Cardiff, UK."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Choi, H.-H., Kang, H.-S., and Yun, B.-J. (2020). CNN-based illumination estimation with semantic information. Appl. Sci., 10.","DOI":"10.3390\/app10144806"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"188309","DOI":"10.1109\/ACCESS.2020.3030912","article-title":"Deep learning-based computational color constancy with convoluted mixture of deep experts (CMoDE) fusion technique","volume":"8","author":"Choi","year":"2020","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"29960","DOI":"10.1109\/ACCESS.2021.3059914","article-title":"Learning-based illuminant estimation model with a persistent memory residual network (PMRN) architecture","volume":"9","author":"Choi","year":"2021","journal-title":"IEEE Access"},{"key":"ref_30","first-page":"5341","article-title":"CVCC Model: Learning-Based Computer Vision Color Constancy with RiR-DSN Architecture","volume":"3","author":"HChoi","year":"2023","journal-title":"Sensors"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1016\/j.patcog.2016.08.013","article-title":"Approaching the computational color constancy as a classification problem through deep learning","volume":"61","author":"Oh","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_32","unstructured":"Afifi, M., and Brown, M. (2019, January 9\u201312). Sensor-Independent Illumination Estimation for DNN Models. Proceedings of the British Machine Vision Conference 2019, BMVC 2019, Cardiff, UK."},{"key":"ref_33","unstructured":"McDonagh, S., Parisot, S., Li, Z., and Slabaugh, G.G. (2018). Meta-learning for few-shot camera-adaptive color constancy. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Bianco, S., and Cusano, C. (2019, January 15\u201320). Quasi-unsupervised color constancy. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01249"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Doll\u00e1r, P., Tu, Z., and He, K. (2017, January 21\u201326). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Li, X., Wang, W., Hu, X., and Yang, J. (2019, January 15\u201320). Selective kernel networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00060"},{"key":"ref_38","unstructured":"Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., Sun, Y., He, T., Mueller, J., and Manmatha, R. (2020). ResNest: Splite-Attention Networks. arXiv."},{"key":"ref_39","unstructured":"Ciurea, F., and Funt, B. (2003, January 4\u20137). A large image database for color constancy research. Proceedings of the Eleventh Color Imaging Conference: Color Science and Engineering Systems, Technologies, Applications, CIC 2003, Scottsdale, AZ, USA."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"227511","DOI":"10.1109\/ACCESS.2020.3045066","article-title":"The Cube++ illumination Estimation Dataset","volume":"8","author":"Ershov","year":"2020","journal-title":"IEEE Access"},{"key":"ref_41","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). TensorFlow: Large-scale machine learning on heterogeneous distributed systems. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1038\/scientificamerican1277-108","article-title":"The Retinex theory of color vision","volume":"237","author":"Land","year":"1977","journal-title":"Sci. Am."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"26755","DOI":"10.1109\/ACCESS.2021.3057072","article-title":"Iterative convolutional neural network-based illumination estimation","volume":"9","author":"Koscevic","year":"2021","journal-title":"IEEE Access"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Xiao, J., Gu, S., and Zhang, L. (2020, January 13\u201319). Multi-domain learning for accurate and few-shot color constancy. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00332"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.patrec.2022.04.035","article-title":"One-Net: Convolutional color constancy simplified","volume":"159","year":"2022","journal-title":"Pattern Recognit. Lett."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/TCSVT.2012.2203198","article-title":"Intra-and-inter-constraint-based video enhancement based on piecewise tone mapping","volume":"23","author":"Chen","year":"2013","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1109\/TPAMI.2010.93","article-title":"Color constancy using natural image statistics and scene semantics","volume":"33","author":"Gijsenij","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_48","unstructured":"Barnard, K. (2000). European Conference on Computer Vision, Springer."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1509","DOI":"10.1109\/TPAMI.2011.252","article-title":"Color constancy with spatio-spectral statistics","volume":"34","author":"Chakrabarti","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Qian, Y., Pertuz, S., Nikkanen, J., Ka, J.-K., and Matas, J. (2018). Revisiting Gray Pixel for Statistical Illumination Estimation. arXiv.","DOI":"10.5220\/0007406900002108"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Qiu, J., Xu, H., and Ye, Z. (2020). Color Constancy by Reweighting Image Feature Maps. arXiv.","DOI":"10.1109\/TIP.2020.2985296"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8558\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:09:10Z","timestamp":1760130550000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8558"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,18]]},"references-count":51,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23208558"],"URL":"https:\/\/doi.org\/10.3390\/s23208558","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,10,18]]}}}