{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:32:46Z","timestamp":1760146366606,"version":"build-2065373602"},"reference-count":63,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,10,29]],"date-time":"2024-10-29T00:00:00Z","timestamp":1730160000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["42301401","62301497","GZC20232385","2024T170823"],"award-info":[{"award-number":["42301401","62301497","GZC20232385","2024T170823"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"China Postdoctoral Science Foundation","award":["42301401","62301497","GZC20232385","2024T170823"],"award-info":[{"award-number":["42301401","62301497","GZC20232385","2024T170823"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Color transfer, an essential technique in image editing, has recently received significant attention. However, achieving a balance between holistic color style transfer and local detail refinement remains a challenging task. This paper proposes an innovative color transfer method, named BHL, which stands for Balanced consideration of both Holistic transformation and Local refinement. The BHL method employs a statistical framework to address the challenge of achieving a balance between holistic color transfer and the preservation of fine details during the color transfer process. Holistic color transformation is achieved using optimal transport theory within the generalized Gaussian modeling framework. The local refinement module adjusts color and texture details on a per-pixel basis using a Gaussian Mixture Model (GMM). To address the high computational complexity inherent in complex statistical modeling, a parameter estimation method called the unit-wise Riemannian information gradient (uRIG) method is introduced. The uRIG method significantly reduces the computational burden through the second-order acceleration effect of the Fisher information metric. Comprehensive experiments demonstrate that the BHL method outperforms state-of-the-art techniques in both visual quality and objective evaluation criteria, even under stringent time constraints. Remarkably, the BHL method processes high-resolution images in an average of 4.874 s, achieving the fastest processing time compared to the baselines. The BHL method represents a significant advancement in the field of color transfer, offering a balanced approach that combines holistic transformation and local refinement while maintaining efficiency and high visual quality.<\/jats:p>","DOI":"10.3390\/e26110918","type":"journal-article","created":{"date-parts":[[2024,10,29]],"date-time":"2024-10-29T08:42:09Z","timestamp":1730191329000},"page":"918","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Comprehensive Method for Example-Based Color Transfer with Holistic\u2013Local Balancing and Unit-Wise Riemannian Information Gradient Acceleration"],"prefix":"10.3390","volume":"26","author":[{"given":"Zeyu","family":"Wang","sequence":"first","affiliation":[{"name":"School of Electrical and Information Engineering, Zhengzhou University, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4192-1327","authenticated-orcid":false,"given":"Jialun","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Zhengzhou University, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Song","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Zhengzhou University, Zhengzhou 450001, China"},{"name":"Department of Computer Science, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ning","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Zhengzhou University, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,29]]},"reference":[{"key":"ref_1","unstructured":"Kotovenko, D., Sanakoyeu, A., Lang, S., and Ommer, B. (November, January 27). Content and style disentanglement for artistic style transfer. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Li, Y., Liu, M.Y., Li, X., Yang, M.H., and Kautz, J. (2018, January 8\u201314). A closed-form solution to photorealistic image stylization. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01219-9_28"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Nam, S., Ma, C., Chai, M., Brendel, W., Xu, N., and Kim, S.J. (2019, January 15\u201320). End-to-end time-lapse video synthesis from a single outdoor image. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00150"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2508363.2508419","article-title":"Data-driven hallucination of different times of day from a single outdoor photo","volume":"32","author":"Shih","year":"2013","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4376","DOI":"10.1109\/TIP.2019.2955241","article-title":"An underwater image enhancement benchmark dataset and beyond","volume":"29","author":"Li","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2561","DOI":"10.1109\/TCSVT.2022.3225376","article-title":"Beyond single reference for training: Underwater image enhancement via comparative learning","volume":"33","author":"Li","year":"2022","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/38.946629","article-title":"Color transfer between images","volume":"21","author":"Reinhard","year":"2001","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Xiao, X., and Ma, L. (2006, January 14\u201317). Color transfer in correlated color space. Proceedings of the 2006 ACM International Conference on Virtual Reality Continuum and Its Applications, Hong Kong, China.","DOI":"10.1145\/1128923.1128974"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.cviu.2006.11.011","article-title":"Automated colour grading using colour distribution transfer","volume":"107","author":"Kokaram","year":"2007","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Pitie, F., and Kokaram, A. (2007, January 27\u201328). The linear Monge-Kantorovitch linear colour mapping for example-based colour transfer. Proceedings of the 4th European Conference on Visual Media Production, London, UK.","DOI":"10.1049\/cp:20070055"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1853","DOI":"10.1137\/130929886","article-title":"Regularized discrete optimal transport","volume":"7","author":"Ferradans","year":"2014","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Frigo, O., Sabater, N., Demoulin, V., and Hellier, P. (2014, January 1\u20135). Optimal transportation for example-guided color transfer. Proceedings of the Asian Conference on Computer Vision, Singapore.","DOI":"10.1007\/978-3-319-16811-1_43"},{"key":"ref_13","unstructured":"Rabin, J., and Papadakis, N. (2015). Non-convex relaxation of optimal transport for color transfer between images. Proceedings of the Geometric Science of Information: Second International Conference (GSI 2015), Palaiseau, France, 28\u201330 October 2015, Springer. Proceedings 2."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2813","DOI":"10.1109\/TVCG.2017.2769050","article-title":"Transformation of the multivariate generalized Gaussian distribution for image editing","volume":"24","author":"Hristova","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_15","unstructured":"Tai, Y.W., Jia, J., and Tang, C.K. (2005, January 20\u201325). Local color transfer via probabilistic segmentation by expectation-maximization. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1520","DOI":"10.1109\/TPAMI.2007.1168","article-title":"Soft color segmentation and its applications","volume":"29","author":"Tai","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1016\/j.patrec.2009.01.004","article-title":"Selective color transfer with multi-source images","volume":"30","author":"Xiang","year":"2009","journal-title":"Pattern Recognit. Lett."},{"key":"ref_18","unstructured":"Hristova, H., Le Meur, O., Cozot, R., and Bouatouch, K. (2015, January 20\u201322). Style-aware robust color transfer. Proceedings of the CAe@ Expressive, Istanbul, Turkey."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1111\/cgf.12008","article-title":"Content-based colour transfer","volume":"Volume 32","author":"Wu","year":"2013","journal-title":"Proceedings of the Computer Graphics Forum"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1109\/TMM.2016.2608000","article-title":"Cartoon and texture decomposition-based color transfer for fabric images","volume":"19","author":"Han","year":"2016","journal-title":"IEEE Trans. Multimed."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Giraud, R., Ta, V.T., and Papadakis, N. (2017, January 17\u201320). Superpixel-based color transfer. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296371"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.cviu.2019.02.002","article-title":"L2 divergence for robust colour transfer","volume":"181","author":"Grogan","year":"2019","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2461912.2461939","article-title":"Example-based video color grading","volume":"32","author":"Bonneel","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"988","DOI":"10.1109\/TMM.2014.2305914","article-title":"Corruptive artifacts suppression for example-based color transfer","volume":"16","author":"Su","year":"2014","journal-title":"IEEE Trans. Multimed."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Hwang, Y., Lee, J.Y., So Kweon, I., and Joo Kim, S. (2014, January 23\u201328). Color transfer using probabilistic moving least squares. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.427"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1111\/cgf.12500","article-title":"Illuminant aware gamut-based color transfer","volume":"Volume 33","author":"Nguyen","year":"2014","journal-title":"Proceedings of the Computer Graphics Forum"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Gong, H., Finlayson, G.D., and Fisher, R.B. (2016). Recoding color transfer as a color homography. arXiv.","DOI":"10.5244\/C.30.17"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1007\/s00371-017-1462-x","article-title":"3D color homography model for photo-realistic color transfer re-coding","volume":"35","author":"Gong","year":"2019","journal-title":"Vis. Comput."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1111\/cgf.13275","article-title":"L0 gradient-preserving color transfer","volume":"Volume 36","author":"Wang","year":"2017","journal-title":"Proceedings of the Computer Graphics Forum"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Oskarsson, M. (2021, January 20\u201325). Robust image-to-image color transfer using optimal inlier maximization. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPRW53098.2021.00088"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Luan, F., Paris, S., Shechtman, E., and Bala, K. (2017, January 21\u201326). Deep photo style transfer. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.740"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.patrec.2018.03.015","article-title":"Emotional image color transfer via deep learning","volume":"110","author":"Liu","year":"2018","journal-title":"Pattern Recognit. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2129","DOI":"10.1007\/s00371-020-01921-6","article-title":"Deep color transfer using histogram analogy","volume":"36","author":"Lee","year":"2020","journal-title":"Vis. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Barnes, C., Shechtman, E., and Amirghodsi, S. (2021, January 20\u201325). Transfill: Reference-guided image inpainting by merging multiple color and spatial transformations. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00230"},{"key":"ref_35","unstructured":"Xia, X., Zhang, M., Xue, T., Sun, Z., Fang, H., Kulis, B., and Chen, J. (2020). Joint bilateral learning for real-time universal photorealistic style transfer. Proceedings of the Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK, 23\u201328 August 2020, Springer. Proceedings, Part VIII 16."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"107338","DOI":"10.1016\/j.patcog.2020.107338","article-title":"Deep quantization generative networks","volume":"105","author":"Wan","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Liao, J., Yao, Y., Yuan, L., Hua, G., and Kang, S.B. (2017). Visual attribute transfer through deep image analogy. arXiv.","DOI":"10.1145\/3072959.3073683"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3292482","article-title":"Progressive color transfer with dense semantic correspondences","volume":"38","author":"He","year":"2019","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_39","first-page":"1","article-title":"Deep exemplar-based colorization","volume":"37","author":"He","year":"2018","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1109\/TMM.2020.2981994","article-title":"Learning representations for high-dynamic-range image color transfer in a self-supervised way","volume":"23","author":"Huang","year":"2020","journal-title":"IEEE Trans. Multimed."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Tang, F., Dong, W., Huang, H., Ma, C., Lee, T.Y., and Xu, C. (2022, January 7\u201311). Domain enhanced arbitrary image style transfer via contrastive learning. Proceedings of the ACM SIGGRAPH 2022 Conference Proceedings, Vancouver, BC, Canada.","DOI":"10.1145\/3528233.3530736"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"8482","DOI":"10.1109\/TNNLS.2022.3230084","article-title":"Exploring the temporal consistency of arbitrary style transfer: A channelwise perspective","volume":"35","author":"Kong","year":"2023","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_43","first-page":"1","article-title":"A Survey of Color Mapping and its Applications","volume":"3","author":"Faridul","year":"2014","journal-title":"Eurographics (State Art Rep.)"},{"key":"ref_44","unstructured":"Liu, S. (2022). An overview of color transfer and style transfer for images and videos. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Fang, K. (2018). Symmetric Multivariate and Related Distributions, CRC Press.","DOI":"10.1201\/9781351077040"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"108716","DOI":"10.1016\/j.patcog.2022.108716","article-title":"Example-based color transfer with Gaussian mixture modeling","volume":"129","author":"Gu","year":"2022","journal-title":"Pattern Recognit."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Absil, P.A., Mahony, R., and Sepulchre, R. (2008). Optimization on Matrix Manifolds. Optimization Algorithms on Matrix Manifolds, Princeton University Press.","DOI":"10.1515\/9781400830244"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Amari, S.I. (2016). Information Geometry and Its Applications, Springer.","DOI":"10.1007\/978-4-431-55978-8"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1162\/089976698300017746","article-title":"Natural gradient works efficiently in learning","volume":"10","author":"Amari","year":"1998","journal-title":"Neural Comput."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1006\/jmva.1997.1690","article-title":"Geodesic estimation in elliptical distributions","volume":"63","author":"Berkane","year":"1997","journal-title":"J. Multivar. Anal."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1130","DOI":"10.1109\/LSP.2013.2281914","article-title":"On the Fisher information matrix for multivariate elliptically contoured distributions","volume":"20","author":"Besson","year":"2013","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Verdoolaege, G., De Backer, S., and Scheunders, P. (2008, January 12\u201315). Multiscale colour texture retrieval using the geodesic distance between multivariate generalized Gaussian models. Proceedings of the 2008 15th IEEE International Conference on Image Processing, San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4711718"},{"key":"ref_53","unstructured":"Ollivier, Y. (2013). Riemannian metrics for neural networks. Inf. Inference J. IMA, 2."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s11263-005-3222-z","article-title":"A Riemannian framework for tensor computing","volume":"66","author":"Pennec","year":"2006","journal-title":"Int. J. Comput. Vis."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1007\/s11263-011-0448-9","article-title":"Geodesics on the Manifold of Multivariate Generalized Gaussian Distributions with an Application to Multicomponent Texture Discrimination","volume":"95","author":"Verdoolaege","year":"2011","journal-title":"Int. J. Comput. Vis."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Zhou, J., and Said, S. (2019). Fast, Asymptotically Efficient, Recursive Estimation in a Riemannian Manifold. Entropy, 21.","DOI":"10.3390\/e21101021"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Burt, P.J., and Adelson, E.H. (1987). The Laplacian pyramid as a compact image code. Readings in Computer Vision, Elsevier.","DOI":"10.1016\/B978-0-08-051581-6.50065-9"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_59","unstructured":"Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., and Hochreiter, S. (2017). Gans trained by a two time-scale update rule converge to a local nash equilibrium. Adv. Neural Inf. Process. Syst., 30."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1977","DOI":"10.1109\/TMI.2021.3069874","article-title":"Unpaired stain transfer using pathology-consistent constrained generative adversarial networks","volume":"40","author":"Liu","year":"2021","journal-title":"IEEE Trans. Med Imaging"},{"key":"ref_61","unstructured":"Alaoui, M. (2021). Fuzzy TOPSIS: Logic, Approaches, and Case Studies, CRC Press."},{"key":"ref_62","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"2217","DOI":"10.1109\/TAC.2013.2254619","article-title":"Stochastic gradient descent on Riemannian manifolds","volume":"58","author":"Bonnabel","year":"2013","journal-title":"IEEE Trans. Autom. Control"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/11\/918\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:23:07Z","timestamp":1760113387000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/11\/918"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,29]]},"references-count":63,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["e26110918"],"URL":"https:\/\/doi.org\/10.3390\/e26110918","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2024,10,29]]}}}