{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T17:46:33Z","timestamp":1772905593644,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":60,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,7,23]],"date-time":"2023-07-23T00:00:00Z","timestamp":1690070400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,7,23]]},"DOI":"10.1145\/3588432.3591549","type":"proceedings-article","created":{"date-parts":[[2023,7,19]],"date-time":"2023-07-19T13:34:52Z","timestamp":1689773692000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Modulating Pretrained Diffusion Models for Multimodal Image Synthesis"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-2686-052X","authenticated-orcid":false,"given":"Cusuh","family":"Ham","sequence":"first","affiliation":[{"name":"Georgia Institute of Technology, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7016-4252","authenticated-orcid":false,"given":"James","family":"Hays","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3598-9918","authenticated-orcid":false,"given":"Jingwan","family":"Lu","sequence":"additional","affiliation":[{"name":"Adobe Research, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8066-6835","authenticated-orcid":false,"given":"Krishna Kumar","family":"Singh","sequence":"additional","affiliation":[{"name":"Adobe Research, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0466-9548","authenticated-orcid":false,"given":"Zhifei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Adobe Research, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1354-1562","authenticated-orcid":false,"given":"Tobias","family":"Hinz","sequence":"additional","affiliation":[{"name":"Adobe Research, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,7,23]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"SpaText: Spatio-Textual Representation for Controllable Image Generation. arXiv preprint arXiv:2211.14305","author":"Avrahami Omri","year":"2022","unstructured":"Omri Avrahami , Thomas Hayes , Oran Gafni , Sonal Gupta , Yaniv Taigman , Devi Parikh , Dani Lischinski , Ohad Fried , and Xi Yin . 2022. SpaText: Spatio-Textual Representation for Controllable Image Generation. arXiv preprint arXiv:2211.14305 ( 2022 ). Omri Avrahami, Thomas Hayes, Oran Gafni, Sonal Gupta, Yaniv Taigman, Devi Parikh, Dani Lischinski, Ohad Fried, and Xi Yin. 2022. SpaText: Spatio-Textual Representation for Controllable Image Generation. arXiv preprint arXiv:2211.14305 (2022)."},{"key":"e_1_3_2_2_2_1","volume-title":"ediffi: Text-to-image diffusion models with an ensemble of expert denoisers. arXiv preprint arXiv:2211.01324","author":"Balaji Yogesh","year":"2022","unstructured":"Yogesh Balaji , Seungjun Nah , Xun Huang , Arash Vahdat , Jiaming Song , Karsten Kreis , Miika Aittala , Timo Aila , Samuli Laine , Bryan Catanzaro , 2022. ediffi: Text-to-image diffusion models with an ensemble of expert denoisers. arXiv preprint arXiv:2211.01324 ( 2022 ). Yogesh Balaji, Seungjun Nah, Xun Huang, Arash Vahdat, Jiaming Song, Karsten Kreis, Miika Aittala, Timo Aila, Samuli Laine, Bryan Catanzaro, 2022. ediffi: Text-to-image diffusion models with an ensemble of expert denoisers. arXiv preprint arXiv:2211.01324 (2022)."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Rodrigo Benenson Stefan Popov and Vittorio Ferrari. 2019. Large-scale interactive object segmentation with human annotators. In CVPR.  Rodrigo Benenson Stefan Popov and Vittorio Ferrari. 2019. Large-scale interactive object segmentation with human annotators. In CVPR.","DOI":"10.1109\/CVPR.2019.01197"},{"key":"e_1_3_2_2_4_1","volume-title":"Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs","author":"Chen Liang-Chieh","year":"2017","unstructured":"Liang-Chieh Chen , George Papandreou , Iasonas Kokkinos , Kevin Murphy , and Alan\u00a0 L Yuille . 2017 . Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs . IEEE transactions on pattern analysis and machine intelligence 40, 4 (2017), 834\u2013848. Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos, Kevin Murphy, and Alan\u00a0L Yuille. 2017. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE transactions on pattern analysis and machine intelligence 40, 4 (2017), 834\u2013848."},{"key":"e_1_3_2_2_5_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 11472\u201311481","author":"Choi Jooyoung","year":"2022","unstructured":"Jooyoung Choi , Jungbeom Lee , Chaehun Shin , Sungwon Kim , Hyunwoo Kim , and Sungroh Yoon . 2022 . Perception Prioritized Training of Diffusion Models . In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 11472\u201311481 . Jooyoung Choi, Jungbeom Lee, Chaehun Shin, Sungwon Kim, Hyunwoo Kim, and Sungroh Yoon. 2022. Perception Prioritized Training of Diffusion Models. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 11472\u201311481."},{"key":"e_1_3_2_2_6_1","first-page":"8780","article-title":"Diffusion models beat gans on image synthesis","volume":"34","author":"Dhariwal Prafulla","year":"2021","unstructured":"Prafulla Dhariwal and Alexander Nichol . 2021 . Diffusion models beat gans on image synthesis . Advances in Neural Information Processing Systems 34 (2021), 8780 \u2013 8794 . Prafulla Dhariwal and Alexander Nichol. 2021. Diffusion models beat gans on image synthesis. Advances in Neural Information Processing Systems 34 (2021), 8780\u20138794.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01268"},{"key":"e_1_3_2_2_8_1","volume-title":"Improving Text-to-Image Diffusion Model with Knowledge-Enhanced Mixture-of-Denoising-Experts. arXiv preprint arXiv:2210.15257","author":"Feng Zhida","year":"2022","unstructured":"Zhida Feng , Zhenyu Zhang , Xintong Yu , Yewei Fang , Lanxin Li , Xuyi Chen , Yuxiang Lu , Jiaxiang Liu , Weichong Yin , Shikun Feng , 2022. ERNIE-Vi LG 2.0 : Improving Text-to-Image Diffusion Model with Knowledge-Enhanced Mixture-of-Denoising-Experts. arXiv preprint arXiv:2210.15257 ( 2022 ). Zhida Feng, Zhenyu Zhang, Xintong Yu, Yewei Fang, Lanxin Li, Xuyi Chen, Yuxiang Lu, Jiaxiang Liu, Weichong Yin, Shikun Feng, 2022. ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model with Knowledge-Enhanced Mixture-of-Denoising-Experts. arXiv preprint arXiv:2210.15257 (2022)."},{"key":"e_1_3_2_2_9_1","volume-title":"Make-a-scene: Scene-based text-to-image generation with human priors. arXiv preprint arXiv:2203.13131","author":"Gafni Oran","year":"2022","unstructured":"Oran Gafni , Adam Polyak , Oron Ashual , Shelly Sheynin , Devi Parikh , and Yaniv Taigman . 2022 . Make-a-scene: Scene-based text-to-image generation with human priors. arXiv preprint arXiv:2203.13131 (2022). Oran Gafni, Adam Polyak, Oron Ashual, Shelly Sheynin, Devi Parikh, and Yaniv Taigman. 2022. Make-a-scene: Scene-based text-to-image generation with human priors. arXiv preprint arXiv:2203.13131 (2022)."},{"key":"e_1_3_2_2_10_1","volume-title":"European Conference on Computer Vision","author":"Ham Cusuh","year":"2022","unstructured":"Cusuh Ham , Gemma\u00a0Canet Tarres , Tu Bui , James Hays , Zhe Lin , and John Collomosse . 2022 . CoGS: Controllable Generation and Search from Sketch and Style . European Conference on Computer Vision (2022). Cusuh Ham, Gemma\u00a0Canet Tarres, Tu Bui, James Hays, Zhe Lin, and John Collomosse. 2022. CoGS: Controllable Generation and Search from Sketch and Style. European Conference on Computer Vision (2022)."},{"key":"e_1_3_2_2_11_1","volume-title":"GANs trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems 30","author":"Heusel Martin","year":"2017","unstructured":"Martin Heusel , Hubert Ramsauer , Thomas Unterthiner , Bernhard Nessler , and Sepp Hochreiter . 2017. GANs trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems 30 ( 2017 ). Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. 2017. GANs trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_3_2_2_12_1","first-page":"6840","article-title":"Denoising diffusion probabilistic models","volume":"33","author":"Ho Jonathan","year":"2020","unstructured":"Jonathan Ho , Ajay Jain , and Pieter Abbeel . 2020 . Denoising diffusion probabilistic models . Advances in Neural Information Processing Systems 33 (2020), 6840 \u2013 6851 . Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems 33 (2020), 6840\u20136851.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_13_1","volume-title":"Composer: Creative and controllable image synthesis with composable conditions. arXiv preprint arXiv:2302.09778","author":"Huang Lianghua","year":"2023","unstructured":"Lianghua Huang , Di Chen , Yu Liu , Yujun Shen , Deli Zhao , and Jingren Zhou . 2023 . Composer: Creative and controllable image synthesis with composable conditions. arXiv preprint arXiv:2302.09778 (2023). Lianghua Huang, Di Chen, Yu Liu, Yujun Shen, Deli Zhao, and Jingren Zhou. 2023. Composer: Creative and controllable image synthesis with composable conditions. arXiv preprint arXiv:2302.09778 (2023)."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Xun Huang Arun Mallya Ting-Chun Wang and Ming-Yu Liu. 2022. Multimodal Conditional Image Synthesis with Product-of-Experts GANs. In ECCV.  Xun Huang Arun Mallya Ting-Chun Wang and Ming-Yu Liu. 2022. Multimodal Conditional Image Synthesis with Product-of-Experts GANs. In ECCV.","DOI":"10.1007\/978-3-031-19787-1_6"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.632"},{"key":"e_1_3_2_2_16_1","volume-title":"International Conference on Learning Representations (ICLR).","author":"Karras Tero","year":"2018","unstructured":"Tero Karras , Timo Aila , Samuli Laine , and Jaakko Lehtinen . 2018 . Progressive growing of gans for improved quality, stability, and variation . International Conference on Learning Representations (ICLR). Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen. 2018. Progressive growing of gans for improved quality, stability, and variation. International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_2_17_1","volume-title":"Proc. NeurIPS.","author":"Karras Tero","year":"2020","unstructured":"Tero Karras , Miika Aittala , Janne Hellsten , Samuli Laine , Jaakko Lehtinen , and Timo Aila . 2020 a. Training Generative Adversarial Networks with Limited Data . In Proc. NeurIPS. Tero Karras, Miika Aittala, Janne Hellsten, Samuli Laine, Jaakko Lehtinen, and Timo Aila. 2020a. Training Generative Adversarial Networks with Limited Data. In Proc. NeurIPS."},{"key":"e_1_3_2_2_18_1","volume-title":"Proc. NeurIPS.","author":"Karras Tero","year":"2021","unstructured":"Tero Karras , Miika Aittala , Samuli Laine , Erik H\u00e4rk\u00f6nen , Janne Hellsten , Jaakko Lehtinen , and Timo Aila . 2021 . Alias-Free Generative Adversarial Networks . In Proc. NeurIPS. Tero Karras, Miika Aittala, Samuli Laine, Erik H\u00e4rk\u00f6nen, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. 2021. Alias-Free Generative Adversarial Networks. In Proc. NeurIPS."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00453"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"e_1_3_2_2_21_1","volume-title":"Imagic: Text-based real image editing with diffusion models. arXiv preprint arXiv:2210.09276","author":"Kawar Bahjat","year":"2022","unstructured":"Bahjat Kawar , Shiran Zada , Oran Lang , Omer Tov , Huiwen Chang , Tali Dekel , Inbar Mosseri , and Michal Irani . 2022 . Imagic: Text-based real image editing with diffusion models. arXiv preprint arXiv:2210.09276 (2022). Bahjat Kawar, Shiran Zada, Oran Lang, Omer Tov, Huiwen Chang, Tali Dekel, Inbar Mosseri, and Michal Irani. 2022. Imagic: Text-based real image editing with diffusion models. arXiv preprint arXiv:2210.09276 (2022)."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-020-01316-z"},{"key":"e_1_3_2_2_23_1","volume-title":"MaskGAN: Towards Diverse and Interactive Facial Image Manipulation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Lee Cheng-Han","year":"2020","unstructured":"Cheng-Han Lee , Ziwei Liu , Lingyun Wu , and Ping Luo . 2020 . MaskGAN: Towards Diverse and Interactive Facial Image Manipulation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Cheng-Han Lee, Ziwei Liu, Lingyun Wu, and Ping Luo. 2020. MaskGAN: Towards Diverse and Interactive Facial Image Manipulation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_3_2_2_24_1","volume-title":"Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. arXiv preprint arXiv:2201.12086","author":"Li Junnan","year":"2022","unstructured":"Junnan Li , Dongxu Li , Caiming Xiong , and Steven Hoi . 2022 . Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. arXiv preprint arXiv:2201.12086 (2022). Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. 2022. Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. arXiv preprint arXiv:2201.12086 (2022)."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_2_2_26_1","article-title":"ASSET: Autoregressive Semantic Scene Editing with Transformers at High Resolutions","volume":"41","author":"Liu Difan","year":"2022","unstructured":"Difan Liu , Sandesh Shetty , Tobias Hinz , Matthew Fisher , Richard Zhang , Taesung Park , and Evangelos Kalogerakis . 2022 . ASSET: Autoregressive Semantic Scene Editing with Transformers at High Resolutions . ACM Trans. Graph. 41 , 4 (2022). Difan Liu, Sandesh Shetty, Tobias Hinz, Matthew Fisher, Richard Zhang, Taesung Park, and Evangelos Kalogerakis. 2022. ASSET: Autoregressive Semantic Scene Editing with Transformers at High Resolutions. ACM Trans. Graph. 41, 4 (2022).","journal-title":"ACM Trans. Graph."},{"key":"e_1_3_2_2_27_1","volume-title":"Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision. 289\u2013299","author":"Liu Xihui","year":"2023","unstructured":"Xihui Liu , Dong\u00a0Huk Park , Samaneh Azadi , Gong Zhang , Arman Chopikyan , Yuxiao Hu , Humphrey Shi , Anna Rohrbach , and Trevor Darrell . 2023 . More control for free! image synthesis with semantic diffusion guidance . In Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision. 289\u2013299 . Xihui Liu, Dong\u00a0Huk Park, Samaneh Azadi, Gong Zhang, Arman Chopikyan, Yuxiao Hu, Humphrey Shi, Anna Rohrbach, and Trevor Darrell. 2023. More control for free! image synthesis with semantic diffusion guidance. In Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision. 289\u2013299."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.425"},{"key":"e_1_3_2_2_29_1","volume-title":"SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations. In International Conference on Learning Representations.","author":"Meng Chenlin","year":"2022","unstructured":"Chenlin Meng , Yutong He , Yang Song , Jiaming Song , Jiajun Wu , Jun-Yan Zhu , and Stefano Ermon . 2022 . SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations. In International Conference on Learning Representations. Chenlin Meng, Yutong He, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, and Stefano Ermon. 2022. SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations. In International Conference on Learning Representations."},{"key":"e_1_3_2_2_30_1","volume-title":"T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models. arXiv preprint arXiv:2302.08453","author":"Mou Chong","year":"2023","unstructured":"Chong Mou , Xintao Wang , Liangbin Xie , Jian Zhang , Zhongang Qi , Ying Shan , and Xiaohu Qie . 2023. T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models. arXiv preprint arXiv:2302.08453 ( 2023 ). Chong Mou, Xintao Wang, Liangbin Xie, Jian Zhang, Zhongang Qi, Ying Shan, and Xiaohu Qie. 2023. T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models. arXiv preprint arXiv:2302.08453 (2023)."},{"key":"e_1_3_2_2_31_1","volume-title":"Glide: Towards photorealistic image generation and editing with text-guided diffusion models. arXiv preprint arXiv:2112.10741","author":"Nichol Alex","year":"2021","unstructured":"Alex Nichol , Prafulla Dhariwal , Aditya Ramesh , Pranav Shyam , Pamela Mishkin , Bob McGrew , Ilya Sutskever , and Mark Chen . 2021 . Glide: Towards photorealistic image generation and editing with text-guided diffusion models. arXiv preprint arXiv:2112.10741 (2021). Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, and Mark Chen. 2021. Glide: Towards photorealistic image generation and editing with text-guided diffusion models. arXiv preprint arXiv:2112.10741 (2021)."},{"key":"e_1_3_2_2_32_1","volume-title":"International Conference on Machine Learning. PMLR, 8162\u20138171","author":"Nichol Alexander\u00a0Quinn","year":"2021","unstructured":"Alexander\u00a0Quinn Nichol and Prafulla Dhariwal . 2021 . Improved denoising diffusion probabilistic models . In International Conference on Machine Learning. PMLR, 8162\u20138171 . Alexander\u00a0Quinn Nichol and Prafulla Dhariwal. 2021. Improved denoising diffusion probabilistic models. In International Conference on Machine Learning. PMLR, 8162\u20138171."},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00244"},{"key":"e_1_3_2_2_34_1","unstructured":"Taesung Park Jun-Yan Zhu Oliver Wang Jingwan Lu Eli Shechtman Alexei\u00a0A. Efros and Richard Zhang. 2020. Swapping Autoencoder for Deep Image Manipulation. In Advances in Neural Information Processing Systems.  Taesung Park Jun-Yan Zhu Oliver Wang Jingwan Lu Eli Shechtman Alexei\u00a0A. Efros and Richard Zhang. 2020. Swapping Autoencoder for Deep Image Manipulation. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_2_35_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 10619\u201310629","author":"Preechakul Konpat","year":"2022","unstructured":"Konpat Preechakul , Nattanat Chatthee , Suttisak Wizadwongsa , and Supasorn Suwajanakorn . 2022 . Diffusion autoencoders: Toward a meaningful and decodable representation . In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 10619\u201310629 . Konpat Preechakul, Nattanat Chatthee, Suttisak Wizadwongsa, and Supasorn Suwajanakorn. 2022. Diffusion autoencoders: Toward a meaningful and decodable representation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 10619\u201310629."},{"key":"e_1_3_2_2_36_1","volume-title":"Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125","author":"Ramesh Aditya","year":"2022","unstructured":"Aditya Ramesh , Prafulla Dhariwal , Alex Nichol , Casey Chu , and Mark Chen . 2022. Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125 ( 2022 ). Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022. Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125 (2022)."},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00232"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"e_1_3_2_2_39_1","volume-title":"U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI 2015: 18th International Conference","author":"Ronneberger Olaf","year":"2015","unstructured":"Olaf Ronneberger , Philipp Fischer , and Thomas Brox . 2015 . U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI 2015: 18th International Conference , Munich, Germany, October 5-9, 2015, Proceedings, Part III 18. Springer , 234\u2013241. Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18. Springer, 234\u2013241."},{"key":"e_1_3_2_2_40_1","volume-title":"Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation. arXiv preprint arXiv:2208.12242","author":"Ruiz Nataniel","year":"2022","unstructured":"Nataniel Ruiz , Yuanzhen Li , Varun Jampani , Yael Pritch , Michael Rubinstein , and Kfir Aberman . 2022 . Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation. arXiv preprint arXiv:2208.12242 (2022). Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, and Kfir Aberman. 2022. Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation. arXiv preprint arXiv:2208.12242 (2022)."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528233.3530757"},{"key":"e_1_3_2_2_42_1","volume-title":"Burcu\u00a0Karagol Ayan, S\u00a0Sara Mahdavi","author":"Saharia Chitwan","year":"2022","unstructured":"Chitwan Saharia , William Chan , Saurabh Saxena , Lala Li , Jay Whang , Emily Denton , Seyed Kamyar\u00a0Seyed Ghasemipour , Burcu\u00a0Karagol Ayan, S\u00a0Sara Mahdavi , Rapha\u00a0Gontijo Lopes, 2022 b. Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding . arXiv preprint arXiv:2205.11487 (2022). Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar\u00a0Seyed Ghasemipour, Burcu\u00a0Karagol Ayan, S\u00a0Sara Mahdavi, Rapha\u00a0Gontijo Lopes, 2022b. Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding. arXiv preprint arXiv:2205.11487 (2022)."},{"key":"e_1_3_2_2_43_1","volume-title":"Image super-resolution via iterative refinement","author":"Saharia Chitwan","year":"2022","unstructured":"Chitwan Saharia , Jonathan Ho , William Chan , Tim Salimans , David\u00a0 J Fleet , and Mohammad Norouzi . 2022c. Image super-resolution via iterative refinement . IEEE Transactions on Pattern Analysis and Machine Intelligence ( 2022 ). Chitwan Saharia, Jonathan Ho, William Chan, Tim Salimans, David\u00a0J Fleet, and Mohammad Norouzi. 2022c. Image super-resolution via iterative refinement. IEEE Transactions on Pattern Analysis and Machine Intelligence (2022)."},{"key":"e_1_3_2_2_44_1","volume-title":"Stylegan-xl: Scaling stylegan to large diverse datasets. arXiv preprint arXiv:2202.00273","author":"Sauer Axel","year":"2022","unstructured":"Axel Sauer , Katja Schwarz , and Andreas Geiger . 2022 . Stylegan-xl: Scaling stylegan to large diverse datasets. arXiv preprint arXiv:2202.00273 (2022). Axel Sauer, Katja Schwarz, and Andreas Geiger. 2022. Stylegan-xl: Scaling stylegan to large diverse datasets. arXiv preprint arXiv:2202.00273 (2022)."},{"key":"e_1_3_2_2_45_1","volume-title":"Laion-5b: An open large-scale dataset for training next generation image-text models. arXiv preprint arXiv:2210.08402","author":"Schuhmann Christoph","year":"2022","unstructured":"Christoph Schuhmann , Romain Beaumont , Richard Vencu , Cade Gordon , Ross Wightman , Mehdi Cherti , Theo Coombes , Aarush Katta , Clayton Mullis , Mitchell Wortsman , 2022. Laion-5b: An open large-scale dataset for training next generation image-text models. arXiv preprint arXiv:2210.08402 ( 2022 ). Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, 2022. Laion-5b: An open large-scale dataset for training next generation image-text models. arXiv preprint arXiv:2210.08402 (2022)."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925972"},{"key":"e_1_3_2_2_47_1","volume-title":"International Conference on Machine Learning. PMLR, 2256\u20132265","author":"Sohl-Dickstein Jascha","year":"2015","unstructured":"Jascha Sohl-Dickstein , Eric Weiss , Niru Maheswaranathan , and Surya Ganguli . 2015 . Deep unsupervised learning using nonequilibrium thermodynamics . In International Conference on Machine Learning. PMLR, 2256\u20132265 . Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli. 2015. Deep unsupervised learning using nonequilibrium thermodynamics. In International Conference on Machine Learning. PMLR, 2256\u20132265."},{"key":"e_1_3_2_2_48_1","volume-title":"Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502","author":"Song Jiaming","year":"2020","unstructured":"Jiaming Song , Chenlin Meng , and Stefano Ermon . 2020. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502 ( 2020 ). Jiaming Song, Chenlin Meng, and Stefano Ermon. 2020. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502 (2020)."},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-022-01673-x"},{"key":"e_1_3_2_2_50_1","volume-title":"Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation. arXiv preprint arXiv:2211.12572","author":"Tumanyan Narek","year":"2022","unstructured":"Narek Tumanyan , Michal Geyer , Shai Bagon , and Tali Dekel . 2022. Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation. arXiv preprint arXiv:2211.12572 ( 2022 ). Narek Tumanyan, Michal Geyer, Shai Bagon, and Tali Dekel. 2022. Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation. arXiv preprint arXiv:2211.12572 (2022)."},{"key":"e_1_3_2_2_51_1","volume-title":"Sketch-Guided Text-to-Image Diffusion Models. arXiv preprint arXiv:2211.13752","author":"Voynov Andrey","year":"2022","unstructured":"Andrey Voynov , Kfir Aberman , and Daniel Cohen-Or . 2022. Sketch-Guided Text-to-Image Diffusion Models. arXiv preprint arXiv:2211.13752 ( 2022 ). Andrey Voynov, Kfir Aberman, and Daniel Cohen-Or. 2022. Sketch-Guided Text-to-Image Diffusion Models. arXiv preprint arXiv:2211.13752 (2022)."},{"key":"e_1_3_2_2_52_1","volume-title":"Pretraining is all you need for image-to-image translation. arXiv preprint arXiv:2205.12952","author":"Wang Tengfei","year":"2022","unstructured":"Tengfei Wang , Ting Zhang , Bo Zhang , Hao Ouyang , Dong Chen , Qifeng Chen , and Fang Wen . 2022. Pretraining is all you need for image-to-image translation. arXiv preprint arXiv:2205.12952 ( 2022 ). Tengfei Wang, Ting Zhang, Bo Zhang, Hao Ouyang, Dong Chen, Qifeng Chen, and Fang Wen. 2022. Pretraining is all you need for image-to-image translation. arXiv preprint arXiv:2205.12952 (2022)."},{"key":"e_1_3_2_2_53_1","volume-title":"Proceedings, Part XVI. Springer, 720\u2013736","author":"Wu Chenfei","year":"2022","unstructured":"Chenfei Wu , Jian Liang , Lei Ji , Fan Yang , Yuejian Fang , Daxin Jiang , and Nan Duan . 2022 . N\u00fcwa: Visual synthesis pre-training for neural visual world creation. In Computer Vision\u2013ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23\u201327, 2022 , Proceedings, Part XVI. Springer, 720\u2013736 . Chenfei Wu, Jian Liang, Lei Ji, Fan Yang, Yuejian Fang, Daxin Jiang, and Nan Duan. 2022. N\u00fcwa: Visual synthesis pre-training for neural visual world creation. In Computer Vision\u2013ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23\u201327, 2022, Proceedings, Part XVI. Springer, 720\u2013736."},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00229"},{"key":"e_1_3_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.164"},{"key":"e_1_3_2_2_56_1","volume-title":"SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model. arXiv preprint arXiv:2212.05034","author":"Xie Shaoan","year":"2022","unstructured":"Shaoan Xie , Zhifei Zhang , Zhe Lin , Tobias Hinz , and Kun Zhang . 2022. SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model. arXiv preprint arXiv:2212.05034 ( 2022 ). Shaoan Xie, Zhifei Zhang, Zhe Lin, Tobias Hinz, and Kun Zhang. 2022. SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model. arXiv preprint arXiv:2212.05034 (2022)."},{"key":"e_1_3_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01261-8_20"},{"key":"e_1_3_2_2_58_1","volume-title":"Adding conditional control to text-to-image diffusion models. arXiv preprint arXiv:2302.05543","author":"Zhang Lvmin","year":"2023","unstructured":"Lvmin Zhang and Maneesh Agrawala . 2023. Adding conditional control to text-to-image diffusion models. arXiv preprint arXiv:2302.05543 ( 2023 ). Lvmin Zhang and Maneesh Agrawala. 2023. Adding conditional control to text-to-image diffusion models. arXiv preprint arXiv:2302.05543 (2023)."},{"key":"e_1_3_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00068"},{"key":"e_1_3_2_2_60_1","volume-title":"M6-ufc: Unifying multi-modal controls for conditional image synthesis. arXiv preprint arXiv:2105.14211","author":"Zhang Zhu","year":"2021","unstructured":"Zhu Zhang , Jianxin Ma , Chang Zhou , Rui Men , Zhikang Li , Ming Ding , Jie Tang , Jingren Zhou , and Hongxia Yang . 2021. M6-ufc: Unifying multi-modal controls for conditional image synthesis. arXiv preprint arXiv:2105.14211 ( 2021 ). Zhu Zhang, Jianxin Ma, Chang Zhou, Rui Men, Zhikang Li, Ming Ding, Jie Tang, Jingren Zhou, and Hongxia Yang. 2021. M6-ufc: Unifying multi-modal controls for conditional image synthesis. arXiv preprint arXiv:2105.14211 (2021)."}],"event":{"name":"SIGGRAPH '23: Special Interest Group on Computer Graphics and Interactive Techniques Conference","location":"Los Angeles CA USA","acronym":"SIGGRAPH '23","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Proceedings"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3588432.3591549","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:47:11Z","timestamp":1750178831000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3588432.3591549"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,23]]},"references-count":60,"alternative-id":["10.1145\/3588432.3591549","10.1145\/3588432"],"URL":"https:\/\/doi.org\/10.1145\/3588432.3591549","relation":{},"subject":[],"published":{"date-parts":[[2023,7,23]]},"assertion":[{"value":"2023-07-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}