{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T08:00:47Z","timestamp":1767168047207,"version":"build-2238731810"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,7,19]],"date-time":"2021-07-19T00:00:00Z","timestamp":1626652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61822204,61521002,61863031"],"award-info":[{"award-number":["61822204,61521002,61863031"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"United States National Science Foundation","award":["IIS-1453018"],"award-info":[{"award-number":["IIS-1453018"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>Color correction and color grading are important steps in film production. Recent palette-based approaches to image recoloring have shown that a small set of representative colors provide an intuitive set of handles for color adjustment. However, a single, static palette cannot represent the time-varying colors in a video. We introduce a spatial-temporal geometry-based approach to video recoloring. Specifically, its core is a 4D skew polytope with a few vertices that approximately encloses the video pixels in color and time, which implicitly defines time-varying palettes through slicing of the 4D skew polytope at specific time values. Our geometric palette is compact, descriptive, and provides a correspondence between colors throughout the video, including topological changes when colors merge or split. Experiments show that our method produces natural, artifact-free recoloring.<\/jats:p>","DOI":"10.1145\/3450626.3459675","type":"journal-article","created":{"date-parts":[[2021,7,19]],"date-time":"2021-07-19T20:04:26Z","timestamp":1626725066000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Video recoloring via spatial-temporal geometric palettes"],"prefix":"10.1145","volume":"40","author":[{"given":"Zheng-Jun","family":"Du","sequence":"first","affiliation":[{"name":"Tsinghua University, China and Qinghai University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kai-Xiang","family":"Lei","sequence":"additional","affiliation":[{"name":"Tsinghua University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kun","family":"Xu","sequence":"additional","affiliation":[{"name":"Tsinghua University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianchao","family":"Tan","sequence":"additional","affiliation":[{"name":"Kwai Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yotam","family":"Gingold","sequence":"additional","affiliation":[{"name":"George Mason University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,7,19]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Pigment identification of paintings based on Kubelka-Munk theory and spectral images","author":"Abed Farhad Moghareh","unstructured":"Farhad Moghareh Abed . 2014. Pigment identification of paintings based on Kubelka-Munk theory and spectral images . Rochester Institute of Technology . Farhad Moghareh Abed. 2014. Pigment identification of paintings based on Kubelka-Munk theory and spectral images. Rochester Institute of Technology."},{"key":"e_1_2_2_2_1","unstructured":"Adobe. 2020. Premiere Pro CC. https:\/\/www.adobe.com\/products\/premiere.html  Adobe. 2020. Premiere Pro CC. https:\/\/www.adobe.com\/products\/premiere.html"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1049\/el.2019.0064"},{"key":"e_1_2_2_4_1","doi-asserted-by":"crossref","unstructured":"Elad Aharoni-Mack Yakov Shambik and Dani Lischinski. 2017. Pigment-Based Recoloring of Watercolor Paintings. In NPAR (Los Angeles USA).  Elad Aharoni-Mack Yakov Shambik and Dani Lischinski. 2017. Pigment-Based Recoloring of Watercolor Paintings. In NPAR (Los Angeles USA).","DOI":"10.1145\/3092919.3092926"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3002176"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360639"},{"key":"e_1_2_2_7_1","volume-title":"Human Vision, Visual Processing, and Digital Display II","author":"Balasubramanian Raja","unstructured":"Raja Balasubramanian and Jan P Allebach . 1991. New approach to palette selection for color images . In Human Vision, Visual Processing, and Digital Display II , Vol. 1453 . International Society for Optics and Photonics , 58--69. Raja Balasubramanian and Jan P Allebach. 1991. New approach to palette selection for color images. In Human Vision, Visual Processing, and Digital Display II, Vol. 1453. International Society for Optics and Photonics, 58--69."},{"key":"e_1_2_2_8_1","volume-title":"RGB Point Cloud Manipulation with Triangular Structures for Artistic Image Recoloring. arXiv preprint arXiv:1912.04583","author":"Baptiste Delos","year":"2019","unstructured":"Delos Baptiste , Mellado Nicolas , Vanderhaeghe David , and Cozot Remi . 2019. RGB Point Cloud Manipulation with Triangular Structures for Artistic Image Recoloring. arXiv preprint arXiv:1912.04583 ( 2019 ). Delos Baptiste, Mellado Nicolas, Vanderhaeghe David, and Cozot Remi. 2019. RGB Point Cloud Manipulation with Triangular Structures for Artistic Image Recoloring. arXiv preprint arXiv:1912.04583 (2019)."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461939"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3139295.3139296"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2010.10.002"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766978"},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2366145.2366151","article-title":"Manifold preserving edit propagation","volume":"31","author":"Chen Xiaowu","year":"2012","unstructured":"Xiaowu Chen , Dongqing Zou , Qinping Zhao , and Ping Tan . 2012 . Manifold preserving edit propagation . ACM Transactions on Graphics (TOG) 31 , 6 (2012), 1 -- 7 . Xiaowu Chen, Dongqing Zou, Qinping Zhao, and Ping Tan. 2012. Manifold preserving edit propagation. ACM Transactions on Graphics (TOG) 31, 6 (2012), 1--7.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_14_1","volume-title":"An Illumination Insensitive and Structure-Aware Image Color Layer Decomposition Method. In International Conference on Multimedia Modeling. Springer, 163--175","author":"Cheng Wengang","year":"2020","unstructured":"Wengang Cheng , Pengli Dou , and Dengwen Zhou . 2020 . An Illumination Insensitive and Structure-Aware Image Color Layer Decomposition Method. In International Conference on Multimedia Modeling. Springer, 163--175 . Wengang Cheng, Pengli Dou, and Dengwen Zhou. 2020. An Illumination Insensitive and Structure-Aware Image Color Layer Decomposition Method. In International Conference on Multimedia Modeling. Springer, 163--175."},{"key":"e_1_2_2_15_1","volume-title":"Color quantization of compressed video sequences","author":"Cheung Wan-Fung","year":"2003","unstructured":"Wan-Fung Cheung and Yuk-Hee Chan . 2003. Color quantization of compressed video sequences . IEEE transactions on circuits and systems for video technology 13, 3 ( 2003 ), 270--276. Wan-Fung Cheung and Yuk-Hee Chan. 2003. Color quantization of compressed video sequences. IEEE transactions on circuits and systems for video technology 13, 3 (2003), 270--276."},{"key":"e_1_2_2_16_1","volume-title":"Proceedings of the 8th ACM\/Eurographics Expressive Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering","author":"DiVerdi Stephen","unstructured":"Stephen DiVerdi , Jingwan Lu , Jose Echevarria , and Maria Shugrina . 2019. Generating playful palettes from images . In Proceedings of the 8th ACM\/Eurographics Expressive Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering . Eurographics Association , 69--78. Stephen DiVerdi, Jingwan Lu, Jose Echevarria, and Maria Shugrina. 2019. Generating playful palettes from images. In Proceedings of the 8th ACM\/Eurographics Expressive Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering. Eurographics Association, 69--78."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3092919.3092927"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-30645-8_17"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2017.07.043"},{"key":"e_1_2_2_20_1","volume-title":"Mean value coordinates in 3D. Computer Aided Geometric Design","author":"Floater Michael S.","year":"2005","unstructured":"Michael S. Floater , Geza Kos , and Martin Reimers . 2005. Mean value coordinates in 3D. Computer Aided Geometric Design ( 2005 ). Michael S. Floater, Geza Kos, and Martin Reimers. 2005. Mean value coordinates in 3D. Computer Aided Geometric Design (2005)."},{"key":"e_1_2_2_21_1","volume-title":"New trends in computer graphics","author":"Gervautz Michael","unstructured":"Michael Gervautz and Werner Purgathofer . 1988. A simple method for color quantization: Octree quantization . In New trends in computer graphics . Springer , 219--231. Michael Gervautz and Werner Purgathofer. 1988. A simple method for color quantization: Octree quantization. In New trends in computer graphics. Springer, 219--231."},{"key":"e_1_2_2_22_1","unstructured":"Gary R Greenfield and Donald H House. 2003. Image recoloring induced by palette color associations. (2003).  Gary R Greenfield and Donald H House. 2003. Image recoloring induced by palette color associations. (2003)."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/2381219.2381233"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3429341.3429354"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292482"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2015.2513599"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2020.2981994"},{"key":"e_1_2_2_28_1","volume-title":"Computer Graphics Forum","author":"Jeong Taehong","unstructured":"Taehong Jeong , Myunghyun Yang , and Hyun Joon Shin . 2019. Succinct Palette and Color Model Generation and Manipulation Using Hierarchical Representation . In Computer Graphics Forum , Vol. 38 . Wiley Online Library , 1--10. Taehong Jeong, Myunghyun Yang, and Hyun Joon Shin. 2019. Succinct Palette and Color Model Generation and Manipulation Using Hierarchical Representation. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 1--10."},{"key":"e_1_2_2_29_1","unstructured":"Steven G. Johnson. [n.d.]. The NLopt nonlinear-optimization package. http:\/\/github.com\/stevengj\/nlopt  Steven G. Johnson. [n.d.]. The NLopt nonlinear-optimization package. http:\/\/github.com\/stevengj\/nlopt"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073229"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372278.3390685"},{"key":"e_1_2_2_32_1","volume-title":"Computer Graphics Forum","author":"Koyama Yuki","unstructured":"Yuki Koyama and Masataka Goto . 2018. Decomposing images into layers with advanced color blending . In Computer Graphics Forum , Vol. 37 . Wiley Online Library , 397--407. Yuki Koyama and Masataka Goto. 2018. Decomposing images into layers with advanced color blending. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 397--407."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.302432"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015780"},{"key":"e_1_2_2_35_1","volume-title":"LayerBuilder: Layer Decomposition for Interactive Image and Video Color Editing. CoRR abs\/1701.03754","author":"Lin Sharon","year":"2017","unstructured":"Sharon Lin , Matthew Fisher , Angela Dai , and Pat Hanrahan . 2017. LayerBuilder: Layer Decomposition for Interactive Image and Video Color Editing. CoRR abs\/1701.03754 ( 2017 ). arXiv:1701.03754 http:\/\/arxiv.org\/abs\/1701.03754 Sharon Lin, Matthew Fisher, Angela Dai, and Pat Hanrahan. 2017. LayerBuilder: Layer Decomposition for Interactive Image and Video Color Editing. CoRR abs\/1701.03754 (2017). arXiv:1701.03754 http:\/\/arxiv.org\/abs\/1701.03754"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466424"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141936"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.740"},{"key":"e_1_2_2_39_1","volume-title":"Live Illumination Decomposition of Videos. arXiv preprint arXiv:1908.01961","author":"Meka Abhimitra","year":"2019","unstructured":"Abhimitra Meka , Mohammad Shafiei , Michael Zollhoefer , Christian Richardt , and Christian Theobalt . 2019. Live Illumination Decomposition of Videos. arXiv preprint arXiv:1908.01961 ( 2019 ). Abhimitra Meka, Mohammad Shafiei, Michael Zollhoefer, Christian Richardt, and Christian Theobalt. 2019. Live Illumination Decomposition of Videos. arXiv preprint arXiv:1908.01961 (2019)."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073650"},{"key":"e_1_2_2_41_1","volume-title":"Computer Graphics Forum","author":"Nguyen RMH","unstructured":"RMH Nguyen , B Price , S Cohen , and MS Brown . 2017. Group-Theme Recoloring for Multi-Image Color Consistency . In Computer Graphics Forum , Vol. 36 . Wiley Online Library , 83--92. RMH Nguyen, B Price, S Cohen, and MS Brown. 2017. Group-Theme Recoloring for Multi-Image Color Consistency. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 83--92."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964958"},{"key":"e_1_2_2_43_1","doi-asserted-by":"crossref","unstructured":"Michael T Orchard Charles A Bouman etal 1991. Color quantization of images. IEEE transactions on signal processing 39 12 (1991) 2677--2690.  Michael T Orchard Charles A Bouman et al. 1991. Color quantization of images. IEEE transactions on signal processing 39 12 (1991) 2677--2690.","DOI":"10.1109\/78.107417"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.15388\/Informatica.2014.25"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276444"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.946629"},{"key":"e_1_2_2_47_1","volume-title":"Computer Graphics Forum","author":"Richardt Christian","unstructured":"Christian Richardt , Jorge Lopez-Moreno , Adrien Bousseau , Maneesh Agrawala , and George Drettakis . 2014. Vectorising bitmaps into semi-transparent gradient layers . In Computer Graphics Forum , Vol. 33 . Wiley Online Library , 11--19. Christian Richardt, Jorge Lopez-Moreno, Adrien Bousseau, Maneesh Agrawala, and George Drettakis. 2014. Vectorising bitmaps into semi-transparent gradient layers. In Computer Graphics Forum, Vol. 33. Wiley Online Library, 11--19."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/2945.466721"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392461"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2858238"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766960"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275054"},{"key":"e_1_2_2_53_1","volume-title":"Palette-based image decomposition, harmonization, and color transfer. arXiv preprint arXiv:1804.01225","author":"Tan Jianchao","year":"2018","unstructured":"Jianchao Tan , Jose Echevarria , and Yotam Gingold . 2018b. Palette-based image decomposition, harmonization, and color transfer. arXiv preprint arXiv:1804.01225 ( 2018 ). Jianchao Tan, Jose Echevarria, and Yotam Gingold. 2018b. Palette-based image decomposition, harmonization, and color transfer. arXiv preprint arXiv:1804.01225 (2018)."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2988229"},{"key":"e_1_2_2_55_1","volume-title":"Computer Graphics Forum","author":"Wang Yili","unstructured":"Yili Wang , Yifan Liu , and Kun Xu. 2019. An Improved Geometric Approach for Palette-based Image Decomposition and Recoloring . In Computer Graphics Forum , Vol. 38 . Wiley Online Library , 11--22. Yili Wang, Yifan Liu, and Kun Xu. 2019. An Improved Geometric Approach for Palette-based Image Decomposition and Recoloring. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 11--22."},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566576"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1186\/1687-6180-2011-118"},{"key":"e_1_2_2_58_1","unstructured":"Wikipedia. 2020. Regular skew polyhedron. https:\/\/en.wikipedia.org\/wiki\/Regular_skew_polyhedron  Wikipedia. 2020. Regular skew polyhedron. https:\/\/en.wikipedia.org\/wiki\/Regular_skew_polyhedron"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/146443.146475"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618464"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2008.24"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2021.3067463"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2017.2671779"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459675","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3450626.3459675","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:17:16Z","timestamp":1750177036000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459675"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,19]]},"references-count":63,"aliases":["10.1145\/3476576.3476730"],"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3450626.3459675"],"URL":"https:\/\/doi.org\/10.1145\/3450626.3459675","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,19]]},"assertion":[{"value":"2021-07-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}