{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:10:14Z","timestamp":1750219814893,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":36,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,29]],"date-time":"2023-10-29T00:00:00Z","timestamp":1698537600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,11,2]]},"DOI":"10.1145\/3607827.3616838","type":"proceedings-article","created":{"date-parts":[[2023,10,26]],"date-time":"2023-10-26T22:09:13Z","timestamp":1698358153000},"page":"15-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["SAT: Self-Attention Control for Diffusion Models Training"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-5651-9033","authenticated-orcid":false,"given":"Jing","family":"Huang","sequence":"first","affiliation":[{"name":"Huawei Singapore Research Center, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-8140-2199","authenticated-orcid":false,"given":"Tianyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Huawei Singapore Research Center, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-2717-4192","authenticated-orcid":false,"given":"Wei","family":"Shi","sequence":"additional","affiliation":[{"name":"Huawei Singapore Research Center, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,29]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2211.01324"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2301.13826"},{"key":"e_1_3_2_1_3_1","volume-title":"Li","author":"Chen Yuanqi","year":"2021","unstructured":"Yuanqi Chen , Ge Li , Cece Jin , Shan Liu , and Thomas H . Li . 2021 . SSD-GAN: Measuring the Realness in the Spatial and Spectral Domains. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2--9, 2021. AAAI Press , 1105--1112. https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/16196 Yuanqi Chen, Ge Li, Cece Jin, Shan Liu, and Thomas H. Li. 2021. SSD-GAN: Measuring the Realness in the Spatial and Spectral Domains. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2--9, 2021. AAAI Press, 1105--1112. https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/16196"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2209.04747"},{"key":"e_1_3_2_1_5_1","volume-title":"Tutorial on Variational Autoencoders. CoRR","author":"Doersch Carl","year":"2016","unstructured":"Carl Doersch . 2016. Tutorial on Variational Autoencoders. CoRR , Vol. abs\/ 1606 .05908 ( 2016 ). showeprint[arXiv]1606.05908 http:\/\/arxiv.org\/abs\/1606.05908 Carl Doersch. 2016. Tutorial on Variational Autoencoders. CoRR , Vol. abs\/1606.05908 (2016). showeprint[arXiv]1606.05908 http:\/\/arxiv.org\/abs\/1606.05908"},{"key":"e_1_3_2_1_6_1","unstructured":"Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly Jakob Uszkoreit and Neil Houlsby. 2021. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. (2021). https:\/\/openreview.net\/forum?id=YicbFdNTTy  Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly Jakob Uszkoreit and Neil Houlsby. 2021. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. (2021). https:\/\/openreview.net\/forum?id=YicbFdNTTy"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01268"},{"key":"e_1_3_2_1_8_1","volume-title":"Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis. In The Eleventh International Conference on Learning Representations, ICLR 2023","author":"Feng Weixi","year":"2023","unstructured":"Weixi Feng , Xuehai He , Tsu-Jui Fu , Varun Jampani , Arjun R. Akula , Pradyumna Narayana , Sugato Basu , Xin Eric Wang , and William Yang Wang . 2023 . Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis. In The Eleventh International Conference on Learning Representations, ICLR 2023 , Kigali, Rwanda, May 1--5 , 2023. OpenReview.net. https:\/\/openreview.net\/pdf?id=PUIqjT4rzq7 Weixi Feng, Xuehai He, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, Xin Eric Wang, and William Yang Wang. 2023. Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1--5, 2023. OpenReview.net. https:\/\/openreview.net\/pdf?id=PUIqjT4rzq7"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-031--19784-0_6"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3422622"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1256"},{"key":"e_1_3_2_1_12_1","unstructured":"Jonathan Ho Ajay Jain and Pieter Abbeel. 2020. Denoising Diffusion Probabilistic Models. (2020). https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/4c5bcfec8584af0d967f1ab10179ca4b-Abstract.html  Jonathan Ho Ajay Jain and Pieter Abbeel. 2020. Denoising Diffusion Probabilistic Models. (2020). https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/4c5bcfec8584af0d967f1ab10179ca4b-Abstract.html"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2210.00939"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2209.05557"},{"key":"e_1_3_2_1_15_1","unstructured":"Edward J. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang and Weizhu Chen. 2022. LoRA: Low-Rank Adaptation of Large Language Models. (2022). https:\/\/openreview.net\/forum?id=nZeVKeeFYf9  Edward J. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang and Weizhu Chen. 2022. LoRA: Low-Rank Adaptation of Large Language Models. (2022). https:\/\/openreview.net\/forum?id=nZeVKeeFYf9"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528223.3530104"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2207.11192"},{"key":"e_1_3_2_1_18_1","unstructured":"Sangyun Lee Hyungjin Chung Jaehyeon Kim and Jong Chul Ye. 2022b. Progressive Deblurring of Diffusion Models for Coarse-to-Fine Image Synthesis. (2022). arxiv: 2207.11192 [cs.CV]  Sangyun Lee Hyungjin Chung Jaehyeon Kim and Jong Chul Ye. 2022b. Progressive Deblurring of Diffusion Models for Coarse-to-Fine Image Synthesis. (2022). arxiv: 2207.11192 [cs.CV]"},{"key":"e_1_3_2_1_19_1","volume-title":"BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation. In International Conference on Machine Learning, ICML 2022","volume":"12900","author":"Li Junnan","year":"2022","unstructured":"Junnan Li , Dongxu Li , Caiming Xiong , and Steven C. H. Hoi . 2022 . BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation. In International Conference on Machine Learning, ICML 2022 , 17--23 July 2022 , Baltimore, Maryland, USA (Proceedings of Machine Learning Research , Vol. 162), Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesv\u00e1 ri, Gang Niu, and Sivan Sabato (Eds.). PMLR, 12888-- 12900 . https:\/\/proceedings.mlr.press\/v162\/li22n.html Junnan Li, Dongxu Li, Caiming Xiong, and Steven C. H. Hoi. 2022. BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation. In International Conference on Machine Learning, ICML 2022, 17--23 July 2022, Baltimore, Maryland, USA (Proceedings of Machine Learning Research, Vol. 162), Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesv\u00e1 ri, Gang Niu, and Sivan Sabato (Eds.). PMLR, 12888--12900. https:\/\/proceedings.mlr.press\/v162\/li22n.html"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501825"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2212.07501"},{"key":"e_1_3_2_1_22_1","volume-title":"GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models. CoRR","author":"Nichol Alex","year":"2021","unstructured":"Alex Nichol , Prafulla Dhariwal , Aditya Ramesh , Pranav Shyam , Pamela Mishkin , Bob McGrew , Ilya Sutskever , and Mark Chen . 2021 . GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models. CoRR , Vol. abs\/ 2112 .10741 (2021). showeprint[arXiv]2112.10741 https:\/\/arxiv.org\/abs\/2112.10741 Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, and Mark Chen. 2021. GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models. CoRR , Vol. abs\/2112.10741 (2021). showeprint[arXiv]2112.10741 https:\/\/arxiv.org\/abs\/2112.10741"},{"key":"e_1_3_2_1_23_1","volume-title":"Improved Denoising Diffusion Probabilistic Models","author":"Nichol Alexander Quinn","year":"2021","unstructured":"Alexander Quinn Nichol and Prafulla Dhariwal . 2021. Improved Denoising Diffusion Probabilistic Models . , Vol. 139 ( 2021 ), 8162--8171. http:\/\/proceedings.mlr.press\/v139\/nichol21a.html Alexander Quinn Nichol and Prafulla Dhariwal. 2021. Improved Denoising Diffusion Probabilistic Models. , Vol. 139 (2021), 8162--8171. http:\/\/proceedings.mlr.press\/v139\/nichol21a.html"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.3929\/ethz-a-005506634"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2204.06125"},{"key":"e_1_3_2_1_26_1","unstructured":"Severi Rissanen Markus Heinonen and Arno Solin. 2023. Generative Modelling with Inverse Heat Dissipation. (2023). https:\/\/openreview.net\/pdf?id=4PJUBT9f2Ol  Severi Rissanen Markus Heinonen and Arno Solin. 2023. Generative Modelling with Inverse Heat Dissipation. (2023). https:\/\/openreview.net\/pdf?id=4PJUBT9f2Ol"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--319--24574--4_28"},{"key":"e_1_3_2_1_29_1","volume-title":"Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, Jonathan Ho, David J. Fleet, and Mohammad Norouzi.","author":"Saharia Chitwan","year":"2022","unstructured":"Chitwan Saharia , William Chan , Saurabh Saxena , Lala Li , Jay Whang , Emily L. Denton , Seyed Kamyar Seyed Ghasemipour , Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, Jonathan Ho, David J. Fleet, and Mohammad Norouzi. 2022 . Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding . (2022). http:\/\/papers.nips.cc\/paper_files\/paper\/2022\/hash\/ec795aeadae0b7d230fa35cbaf04c041-Abstract-Conference.html Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L. Denton, Seyed Kamyar Seyed Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, Jonathan Ho, David J. Fleet, and Mohammad Norouzi. 2022. Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding. (2022). http:\/\/papers.nips.cc\/paper_files\/paper\/2022\/hash\/ec795aeadae0b7d230fa35cbaf04c041-Abstract-Conference.html"},{"key":"e_1_3_2_1_30_1","volume-title":"Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N. Gomez , Lukasz Kaiser , and Illia Polosukhin . 2017 . Attention is All you Need . In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017 , December 4 --9 , 2017, Long Beach, CA, USA, , Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 5998--6008. https:\/\/proceedings.neurips.cc\/paper\/2017\/hash\/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4--9, 2017, Long Beach, CA, USA, , Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 5998--6008. https:\/\/proceedings.neurips.cc\/paper\/2017\/hash\/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2305.13921"},{"key":"e_1_3_2_1_32_1","unstructured":"Zijie J. Wang Evan Montoya David Munechika Haoyang Yang Benjamin Hoover and Duen Horng Chau. 2023 b. DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models. (2023) 893--911. https:\/\/aclanthology.org\/2023.acl-long.51  Zijie J. Wang Evan Montoya David Munechika Haoyang Yang Benjamin Hoover and Duen Horng Chau. 2023 b. DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models. (2023) 893--911. https:\/\/aclanthology.org\/2023.acl-long.51"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-031--26293--7_11"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2209.00796"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-031--19784-0_1"},{"key":"e_1_3_2_1_36_1","unstructured":"Han Zhang Ian J. Goodfellow Dimitris N. Metaxas and Augustus Odena. 2019. Self-Attention Generative Adversarial Networks. bibinfonumpages7354--7363 pages. http:\/\/proceedings.mlr.press\/v97\/zhang19d.html io  Han Zhang Ian J. Goodfellow Dimitris N. Metaxas and Augustus Odena. 2019. Self-Attention Generative Adversarial Networks. bibinfonumpages7354--7363 pages. http:\/\/proceedings.mlr.press\/v97\/zhang19d.html io"}],"event":{"name":"MM '23: The 31st ACM International Conference on Multimedia","sponsor":["SIGMM ACM Special Interest Group on Multimedia"],"location":"Ottawa ON Canada","acronym":"MM '23"},"container-title":["Proceedings of the 1st Workshop on Large Generative Models Meet Multimodal Applications"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3607827.3616838","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3607827.3616838","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:05Z","timestamp":1750178765000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3607827.3616838"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,29]]},"references-count":36,"alternative-id":["10.1145\/3607827.3616838","10.1145\/3607827"],"URL":"https:\/\/doi.org\/10.1145\/3607827.3616838","relation":{},"subject":[],"published":{"date-parts":[[2023,10,29]]},"assertion":[{"value":"2023-10-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}