{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T04:48:18Z","timestamp":1773550098666,"version":"3.50.1"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"3","funder":[{"name":"National Science and Technology Council, Taiwan","award":["NSTC-112-2628-E-002-033-MY4 and NSTC-114-2634-F-002-004"],"award-info":[{"award-number":["NSTC-112-2628-E-002-033-MY4 and NSTC-114-2634-F-002-004"]}]},{"name":"Center of Data Intelligence: Technologies, Applications, and Systems, National Taiwan University","award":["114L900901\/114L900902\/114L900903"],"award-info":[{"award-number":["114L900901\/114L900902\/114L900903"]}]},{"name":"Ministry of Culture, Sports and Tourism in 2024","award":["RS-2024-00398413"],"award-info":[{"award-number":["RS-2024-00398413"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2026,3,31]]},"abstract":"<jats:p>Color splash is a widely used image editing effect that highlights selected regions by retaining color while rendering the rest of the image in grayscale. However, existing tools often struggle with achieving high precision, efficiency, and user flexibility in controlling the effect. In this article, we propose Semantic-Guided Multimodal Color Splash Effects (SeCo), a novel framework for generating stylized and customizable color splash effects from natural language instructions and color palettes. SeCo decomposes the task into two key components: Semantic-Guided Object Isolation (SGOI) and Palette-Driven Color Adjustment (PDCA). SGOI accurately identifies and isolates user-referred objects with fine-grained transparency, while the PDCA module recolors the isolated regions under user-specified palette guidance. Our approach supports arbitrary object selection, handles transparency, and enables diverse stylization patterns. Experimental results on both synthetic and real-world datasets demonstrate that SeCo outperforms existing methods in precision and controllability, offering a practical and expressive solution for visual editing and content creation.<\/jats:p>","DOI":"10.1145\/3785154","type":"journal-article","created":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T11:23:08Z","timestamp":1767612188000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["SeCo: Semantic-Guided Multimodal Color Splash Effects"],"prefix":"10.1145","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-5935-9031","authenticated-orcid":false,"given":"Jing-Xuan","family":"Chen","sequence":"first","affiliation":[{"name":"National Yang Ming Chiao Tung University, Hsinchu, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9471-8528","authenticated-orcid":false,"given":"Ling","family":"Lo","sequence":"additional","affiliation":[{"name":"National Yang Ming Chiao Tung University, Hsinchu, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5282-8977","authenticated-orcid":false,"given":"Si-Yu","family":"Lu","sequence":"additional","affiliation":[{"name":"National Taiwan University, Taipei, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-9639-5133","authenticated-orcid":false,"given":"Ling","family":"Zou","sequence":"additional","affiliation":[{"name":"National Taiwan University, Taipei, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4662-7875","authenticated-orcid":false,"given":"Wen-Huang","family":"Cheng","sequence":"additional","affiliation":[{"name":"National Taiwan University, Taipei, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1103-8309","authenticated-orcid":false,"given":"Jungwoo","family":"Huh","sequence":"additional","affiliation":[{"name":"Yonsei University, Seoul, Korea (the Republic of)"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9895-5347","authenticated-orcid":false,"given":"Sanghoon","family":"Lee","sequence":"additional","affiliation":[{"name":"Yonsei University, Seoul, Korea (the Republic of)"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2026,2,27]]},"reference":[{"issue":"4","key":"e_1_3_2_2_2","first-page":"363","article-title":"The Bhattacharyya metric as an absolute similarity measure for frequency coded data","volume":"34","author":"Aherne Frank J.","year":"1998","unstructured":"Frank J. Aherne, Neil A. Thacker, and Peter I. Rockett. 1998. The Bhattacharyya metric as an absolute similarity measure for frequency coded data. Kybernetika 34, 4 (1998), 363\u2013368.","journal-title":"Kybernetika"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.00846"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01764"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.18034\/ajase.v8i1.9"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/2766978"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/1077399.1077408"},{"key":"e_1_3_2_8_2","volume-title":"37th Conference on Neural Information Processing Systems (NeurIPS)","author":"Chang Zheng","year":"2023","unstructured":"Zheng Chang, Shuchen Weng, Yu Li, Si Li, and Boxin Shi. 2023. L-CAD: Language-based colorization with any-level descriptions using diffusion priors. In 37th Conference on Neural Information Processing Systems (NeurIPS)."},{"key":"e_1_3_2_9_2","unstructured":"Liang-Chieh Chen George Papandreou Florian Schroff and Hartwig Adam. 2017. Rethinking atrous convolution for semantic image segmentation. arXiv:1706.05587. Retrieved from https:\/\/arxiv.org\/abs\/1706.05587"},{"key":"e_1_3_2_10_2","first-page":"2984","volume-title":"Asian Conference on Computer Vision","author":"Chen Xiangguang","year":"2022","unstructured":"Xiangguang Chen, Ye Zhu, Yu Li, Bingtao Fu, Lei Sun, Ying Shan, and Shan Liu. 2022. Robust human matting via semantic guidance. In Asian Conference on Computer Vision, 2984\u20132999."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447239"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.143"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2733373.2806385"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3713075"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01525"},{"key":"e_1_3_2_16_2","unstructured":"Fotor. 2025. Fotor\u2014AI Color Splash Editor. Retrieved March 15 2025 from https:\/\/www.fotor.com\/photo-editor-app\/editor\/ai\/color-splash"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00423"},{"key":"e_1_3_2_19_2","unstructured":"iPiccy. 2025. iPiccy\u2014Online Photo Editor. Retrieved March 15 2025 from https:\/\/ipiccy.com\/app#editor"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3664647.3680936"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00037"},{"issue":"4","key":"e_1_3_2_22_2","first-page":"1","article-title":"Dynamic closest color warping to sort and compare palettes","volume":"40","author":"Kim Suzi","year":"2021","unstructured":"Suzi Kim and Sunghee Choi. 2021. Dynamic closest color warping to sort and compare palettes. ACM Transactions on Graphics 40, 4 (2021), 1\u201315.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00371"},{"key":"e_1_3_2_24_2","volume-title":"International Conference on Learning Representations (ICLR)","author":"Kumar Manoj","year":"2021","unstructured":"Manoj Kumar, Dirk Weissenborn, and Nal Kalchbrenner. 2021. Colorization transformer. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015780"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2024.112133"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.02150"},{"key":"e_1_3_2_28_2","unstructured":"Zhexin Liang Chengyan Zhang Jiantao Tan Guanglin Xu Jingwen Li Huiyuan Li Mingming Zhou Xiaolong Xu Gensheng Cao and Liang Wang. 2024. Control color: Multimodal diffusion-based interactive image colorization. arXiv:2402.10855. Retrieved from https:\/\/arxiv.org\/abs\/2402.10855"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141936"},{"key":"e_1_3_2_30_2","unstructured":"Hanyuan Liu Jinbo Zhang Xinbo Zhu Runtao Jin Tien-Tsin Zhao Yongjian Ai Qing Yan and Binqiang Guo. 2023. Improved diffusion-based image colorization via piggybacked models. arXiv:2304.11105. Retrieved from https:\/\/arxiv.org\/abs\/2304.11105"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01789"},{"key":"e_1_3_2_32_2","volume-title":"IEEE International Conference on Computer Vision","author":"Lo Ling","year":"2025","unstructured":"Ling Lo, Kelvin C. K. Chan, Wen-Huang Cheng, and Ming-Hsuan Yang. 2025. From prompt to progression: Taming video diffusion models for seamless attribute transition. In IEEE International Conference on Computer Vision."},{"key":"e_1_3_2_33_2","unstructured":"Laszlo Neumann and Attila Neumann. 2005. Color style transfer techniques using hue lightness and saturation histogram matching. In Computational Aesthetics in Graphics Visualization and Imaging 111\u2013122."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3588432.3591500"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3588432.3591513"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.166"},{"key":"e_1_3_2_37_2","first-page":"8748","volume-title":"International Conference on Machine Learning","author":"Radford Alec","year":"2021","unstructured":"Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In International Conference on Machine Learning. PMLR, 8748\u20138763."},{"issue":"5","key":"e_1_3_2_38_2","first-page":"34","article-title":"Color transfer between images","volume":"21","author":"Reinhard Erik","year":"2002","unstructured":"Erik Reinhard, Michael Adhikhmin, Bruce Gooch, and Peter Shirley. 2002. Color transfer between images. IEEE Computer Graphics and Applications 21, 5 (2002), 34\u201341.","journal-title":"IEEE Computer Graphics and Applications"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.00844"},{"key":"e_1_3_2_40_2","first-page":"747","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition","volume":"1","author":"Tai Yu-Wing","year":"2005","unstructured":"Yu-Wing Tai, Jiaya Jia, and Chi-Keung Tang. 2005. Local color transfer via probabilistic segmentation by expectation-maximization. In IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1. IEEE, 747\u2013754."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v39i7.32801"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3548688"},{"issue":"1","key":"e_1_3_2_43_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3604557","article-title":"Language-guided residual graph attention network and data augmentation for visual grounding","volume":"20","author":"Wang Jia","year":"2023","unstructured":"Jia Wang, Hong-Han Shuai, Yung-Hui Li, and Wen-Huang Cheng. 2023. Language-guided residual graph attention network and data augmentation for visual grounding. ACM Transactions on Multimedia Computing, Communications, and Applications 20, 1 (2023), 1\u201323.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01139"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.41"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01471"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01762"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_5"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00121"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3610548.3618180"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2017.2671779"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00068"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.244"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3785154","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T03:49:12Z","timestamp":1773546552000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3785154"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,27]]},"references-count":52,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,3,31]]}},"alternative-id":["10.1145\/3785154"],"URL":"https:\/\/doi.org\/10.1145\/3785154","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,27]]},"assertion":[{"value":"2025-07-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-11-28","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}