{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T15:53:05Z","timestamp":1761061985576,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2024,6,26]],"date-time":"2024-06-26T00:00:00Z","timestamp":1719360000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"IEETA","award":["UIDB\/00127\/2020","2020.07345.BD"],"award-info":[{"award-number":["UIDB\/00127\/2020","2020.07345.BD"]}]},{"DOI":"10.13039\/501100001871","name":"National Funds through the FCT - Foundation for Science and Technology","doi-asserted-by":"publisher","award":["UIDB\/00127\/2020","2020.07345.BD"],"award-info":[{"award-number":["UIDB\/00127\/2020","2020.07345.BD"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the rise in popularity of different human-centred applications using 3D reconstruction data, the problem of generating photo-realistic models has become an important task. In a multiview acquisition system, particularly for large indoor scenes, the acquisition conditions will differ along the environment, causing colour differences between captures and unappealing visual artefacts in the produced models. We propose a novel neural-based approach to colour correction for indoor 3D reconstruction. It is a lightweight and efficient approach that can be used to harmonize colour from sparse captures over complex indoor scenes. Our approach uses a fully connected deep neural network to learn an implicit representation of the colour in 3D space, while capturing camera-dependent effects. We then leverage this continuous function as reference data to estimate the required transformations to regenerate pixels in each capture. Experiments to evaluate the proposed method on several scenes of the MP3D dataset show that it outperforms other relevant state-of-the-art approaches.<\/jats:p>","DOI":"10.3390\/s24134141","type":"journal-article","created":{"date-parts":[[2024,6,26]],"date-time":"2024-06-26T09:29:33Z","timestamp":1719394173000},"page":"4141","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Neural Colour Correction for Indoor 3D Reconstruction Using RGB-D Data"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1335-0803","authenticated-orcid":false,"given":"Tiago","family":"Madeira","sequence":"first","affiliation":[{"name":"Institute of Electronics and Informatics Engineering of Aveiro (IEETA), Intelligent System Associate Laboratory (LASI), University of Aveiro, 3810-193 Aveiro, Portugal"},{"name":"Department of Electronics, Telecommunications and Informatics (DETI), University of Aveiro, 3810-193 Aveiro, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9288-5058","authenticated-orcid":false,"given":"Miguel","family":"Oliveira","sequence":"additional","affiliation":[{"name":"Institute of Electronics and Informatics Engineering of Aveiro (IEETA), Intelligent System Associate Laboratory (LASI), University of Aveiro, 3810-193 Aveiro, Portugal"},{"name":"Department of Mechanical Engineering (DEM), University of Aveiro, 3810-193 Aveiro, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3754-2749","authenticated-orcid":false,"given":"Paulo","family":"Dias","sequence":"additional","affiliation":[{"name":"Institute of Electronics and Informatics Engineering of Aveiro (IEETA), Intelligent System Associate Laboratory (LASI), University of Aveiro, 3810-193 Aveiro, Portugal"},{"name":"Department of Electronics, Telecommunications and Informatics (DETI), University of Aveiro, 3810-193 Aveiro, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s11263-006-0002-3","article-title":"Automatic Panoramic Image Stitching using Invariant Features","volume":"74","author":"Brown","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Xia, M., Yao, J., Xie, R., Zhang, M., and Xiao, J. (2017, January 11\u201317). Color Consistency Correction Based on Remapping Optimization for Image Stitching. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada.","DOI":"10.1109\/ICCVW.2017.351"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2006","DOI":"10.1109\/LGRS.2020.3009671","article-title":"Grid Model-Based Global Color Correction for Multiple Image Mosaicking","volume":"18","author":"Li","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2461912.2461997","article-title":"Optimizing color consistency in photo collections","volume":"32","author":"HaCohen","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Pitie, F., Kokaram, A., and Dahyot, R. (2005, January 17\u201320). N-dimensional probability density function transfer and its application to color transfer. Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV\u201905), Washington, DC, USA.","DOI":"10.1109\/ICCV.2005.166"},{"key":"ref_6","unstructured":"Su, Z., Deng, D., Yang, X., and Luo, X. (November, January 29). Color transfer based on multiscale gradient-aware decomposition and color distribution mapping. Proceedings of the 20th ACM International Conference on Multimedia, Nara, Japan."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/S0895-7177(01)00060-7","article-title":"Polynomials arising in factoring generalized Vandermonde determinants: An algorithm for computing their coefficients","volume":"34","year":"2001","journal-title":"Math. Comput. Model."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hwang, Y., Lee, J.Y., Kweon, I.S., and Kim, S.J. (2014, January 23\u201328). Color Transfer Using Probabilistic Moving Least Squares. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.427"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liu, X., Zhu, L., Xu, S., and Du, S. (2021, January 23\u201326). Palette-Based Recoloring of Natural Images Under Different Illumination. Proceedings of the 2021 IEEE 6th International Conference on Computer and Communication Systems (ICCCS), Chengdu, China.","DOI":"10.1109\/ICCCS52626.2021.9449228"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1111\/cgf.12008","article-title":"Content-based colour transfer","volume":"32","author":"Wu","year":"2013","journal-title":"Comput. Graph. Forum"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1460","DOI":"10.1109\/TIP.2015.2405336","article-title":"Color Correction Using Root-Polynomial Regression","volume":"24","author":"Finlayson","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2018.11.001","article-title":"Probabilistic moving least squares with spatial constraints for nonlinear color transfer between images","volume":"180","author":"Hwang","year":"2019","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1109\/TCSVT.2019.2897123","article-title":"Visually Consistent Color Correction for Stereoscopic Images and Videos","volume":"30","author":"Niu","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/38.946629","article-title":"Color transfer between images","volume":"21","author":"Reinhard","year":"2001","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1879","DOI":"10.1111\/j.1467-8659.2009.01566.x","article-title":"Gradient-Preserving Color Transfer","volume":"28","author":"Xiao","year":"2009","journal-title":"Comput. Graph. Forum"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1111\/cgf.12500","article-title":"Illuminant aware gamut-based color transfer","volume":"33","author":"Nguyen","year":"2014","journal-title":"Comput. Graph. Forum"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3292482","article-title":"Progressive Color Transfer With Dense Semantic Correspondences","volume":"38","author":"He","year":"2019","journal-title":"ACM Trans. Graph."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"104884","DOI":"10.1109\/ACCESS.2020.3000065","article-title":"Color Transfer With Salient Features Mapping via Attention Maps Between Images","volume":"8","author":"Wu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2129","DOI":"10.1007\/s00371-020-01921-6","article-title":"Deep color transfer using histogram analogy","volume":"36","author":"Lee","year":"2020","journal-title":"Vis. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3074","DOI":"10.1109\/JSTARS.2022.3167264","article-title":"Global Color Consistency Correction for Large-Scale Images in 3-D Reconstruction","volume":"15","author":"Li","year":"2022","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_21","unstructured":"Li, Y., Fang, C., Yang, J., Wang, Z., Lu, X., and Yang, M.H. (2017, January 4\u20139). Universal style transfer via feature transforms. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.cageo.2014.08.007","article-title":"Parallel relative radiometric normalisation for remote sensing image mosaics","volume":"73","author":"Chen","year":"2014","journal-title":"Comput. Geosci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Dal\u2019Col, L., Coelho, D., Madeira, T., Dias, P., and Oliveira, M. (2023). A Sequential Color Correction Approach for Texture Mapping of 3D Meshes. Sensors, 23.","DOI":"10.3390\/s23020607"},{"key":"ref_24","unstructured":"Xiong, Y., and Pulli, K. (2010, January 25\u201329). Color matching of image sequences with combined gamma and linear corrections. Proceedings of the International Conference on Multimedia, Firenze Italy."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2017.08.002","article-title":"An auto-adapting global-to-local color balancing method for optical imagery mosaic","volume":"132","author":"Yu","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.isprsjprs.2017.11.012","article-title":"Guided color consistency optimization for image mosaicking","volume":"135","author":"Xie","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_27","unstructured":"Moulon, P., Duisit, B., and Monasse, P. (December, January 30). Global multiple-view color consistency. Proceedings of the Conference on Visual Media Production, London, UK."},{"key":"ref_28","unstructured":"Shen, T., Wang, J., Fang, T., Zhu, S., and Quan, L. (2016, January 20\u201324). Color Correction for Image-Based Modeling in the Large. Proceedings of the Asian Conference on Computer Vision, Taipei, Taiwan."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Park, J., Tai, Y.W., Sinha, S.N., and Kweon, I.S. (2016, January 27\u201330). Efficient and Robust Color Consistency for Community Photo Collections. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.53"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/j.isprsjprs.2020.12.011","article-title":"Efficient global color correction for large-scale multiple-view images in three-dimensional reconstruction","volume":"173","author":"Yang","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Park, J.J., Florence, P., Straub, J., Newcombe, R., and Lovegrove, S. (2019, January 15\u201320). Deepsdf: Learning continuous signed distance functions for shape representation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00025"},{"key":"ref_32","unstructured":"Tancik, M., Srinivasan, P.P., Mildenhall, B., Fridovich-Keil, S., Raghavan, N., Singhal, U., Ramamoorthi, R., Barron, J.T., and Ng, R. (2020, January 6\u201312). Fourier features let networks learn high frequency functions in low dimensional domains. Proceedings of the 34th International Conference on Neural Information Processing Systems, Online."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1145\/3503250","article-title":"Nerf: Representing scenes as neural radiance fields for view synthesis","volume":"65","author":"Mildenhall","year":"2021","journal-title":"Commun. ACM"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1002\/col.20070","article-title":"The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations","volume":"30","author":"Sharma","year":"2005","journal-title":"Color Res. Appl."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Xu, W., and Mulligan, J. (2010, January 13\u201318). Performance evaluation of color correction approaches for automatic multi-view image and video stitching. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540202"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chang, A., Dai, A., Funkhouser, T., Halber, M., Niessner, M., Savva, M., Song, S., Zeng, A., and Zhang, Y. (2017, January 10\u201312). Matterport3D: Learning from RGB-D Data in Indoor Environments. Proceedings of the International Conference on 3D Vision (3DV), Qingdao, China.","DOI":"10.1109\/3DV.2017.00081"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/13\/4141\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:04:48Z","timestamp":1760108688000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/13\/4141"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,26]]},"references-count":36,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["s24134141"],"URL":"https:\/\/doi.org\/10.3390\/s24134141","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2024,6,26]]}}}