{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T21:53:54Z","timestamp":1775080434551,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":43,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T00:00:00Z","timestamp":1665360000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"the National Natural Science Foundation of China","award":["62172020"],"award-info":[{"award-number":["62172020"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,10]]},"DOI":"10.1145\/3503161.3547790","type":"proceedings-article","created":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T15:43:01Z","timestamp":1665416581000},"page":"4282-4290","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["AI Illustrator: Translating Raw Descriptions into Images by Prompt-based Cross-Modal Generation"],"prefix":"10.1145","author":[{"given":"Yiyang","family":"Ma","sequence":"first","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huan","family":"Yang","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bei","family":"Liu","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianlong","family":"Fu","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiaying","family":"Liu","sequence":"additional","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,10,10]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv preprint arXiv:1810.04805","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2018 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv preprint arXiv:1810.04805 (2018). Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv preprint arXiv:1810.04805 (2018)."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.608"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.476"},{"key":"e_1_3_2_2_4_1","volume-title":"StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generators. arXiv preprint arXiv:2108.00946","author":"Gal Rinon","year":"2021","unstructured":"Rinon Gal , Or Patashnik , Haggai Maron , Gal Chechik , and Daniel Cohen-Or . 2021. StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generators. arXiv preprint arXiv:2108.00946 ( 2021 ). Rinon Gal, Or Patashnik, Haggai Maron, Gal Chechik, and Daniel Cohen-Or. 2021. StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generators. arXiv preprint arXiv:2108.00946 (2021)."},{"key":"e_1_3_2_2_5_1","volume-title":"Advances in Neural Information Processing Systems","volume":"27","author":"Goodfellow Ian","year":"2014","unstructured":"Ian Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014 . Generative Adversarial Nets . Advances in Neural Information Processing Systems , Vol. 27 (2014). Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. Advances in Neural Information Processing Systems, Vol. 27 (2014)."},{"key":"e_1_3_2_2_6_1","volume-title":"Advances in Neural Information Processing Systems","volume":"30","author":"Heusel Martin","year":"2017","unstructured":"Martin Heusel , Hubert Ramsauer , Thomas Unterthiner , Bernhard Nessler , and Sepp Hochreiter . 2017 . GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium . Advances in Neural Information Processing Systems , Vol. 30 (2017). Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. 2017. GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Advances in Neural Information Processing Systems, Vol. 30 (2017)."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00453"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"e_1_3_2_2_9_1","volume-title":"Advances in Neural Information Processing Systems","volume":"32","author":"Li Bowen","year":"2019","unstructured":"Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , and Philip Torr . 2019 a. Controllable Text-to-Image Generation . Advances in Neural Information Processing Systems , Vol. 32 (2019). Bowen Li, Xiaojuan Qi, Thomas Lukasiewicz, and Philip Torr. 2019a. Controllable Text-to-Image Generation. Advances in Neural Information Processing Systems, Vol. 32 (2019)."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00790"},{"key":"e_1_3_2_2_11_1","first-page":"22020","article-title":"Lightweight Generative Adversarial Networks for Text-Guided Image Manipulation","volume":"33","author":"Li Bowen","year":"2020","unstructured":"Bowen Li , Xiaojuan Qi , Philip Torr , and Thomas Lukasiewicz . 2020 b. Lightweight Generative Adversarial Networks for Text-Guided Image Manipulation . Advances in Neural Information Processing Systems , Vol. 33 (2020), 22020 -- 22031 . Bowen Li, Xiaojuan Qi, Philip Torr, and Thomas Lukasiewicz. 2020b. Lightweight Generative Adversarial Networks for Text-Guided Image Manipulation. Advances in Neural Information Processing Systems, Vol. 33 (2020), 22020--22031.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01245"},{"key":"e_1_3_2_2_13_1","volume-title":"Prefix-Tuning: Optimizing Continuous Prompts for Generation. arXiv preprint arXiv:2101.00190","author":"Li Xiang Lisa","year":"2021","unstructured":"Xiang Lisa Li and Percy Liang . 2021. Prefix-Tuning: Optimizing Continuous Prompts for Generation. arXiv preprint arXiv:2101.00190 ( 2021 ). Xiang Lisa Li and Percy Liang. 2021. Prefix-Tuning: Optimizing Continuous Prompts for Generation. arXiv preprint arXiv:2101.00190 (2021)."},{"key":"e_1_3_2_2_14_1","volume-title":"A Systematic Survey of Prompting Methods in Natural Language Processing. arXiv preprint arXiv:2107.13586","author":"Liu Pengfei","year":"2021","unstructured":"Pengfei Liu , Weizhe Yuan , Jinlan Fu , Zhengbao Jiang , Hiroaki Hayashi , and Graham Neubig . 2021a. Pre-train, Prompt, and Predict : A Systematic Survey of Prompting Methods in Natural Language Processing. arXiv preprint arXiv:2107.13586 ( 2021 ). Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2021a. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing. arXiv preprint arXiv:2107.13586 (2021)."},{"key":"e_1_3_2_2_15_1","volume-title":"arXiv preprint arXiv:2103.10385","author":"Liu Xiao","year":"2021","unstructured":"Xiao Liu , Yanan Zheng , Zhengxiao Du , Ming Ding , Yujie Qian , Zhilin Yang , and Jie Tang . 2021b. GPT Understands , Too. arXiv preprint arXiv:2103.10385 ( 2021 ). Xiao Liu, Yanan Zheng, Zhengxiao Du, Ming Ding, Yujie Qian, Zhilin Yang, and Jie Tang. 2021b. GPT Understands, Too. arXiv preprint arXiv:2103.10385 (2021)."},{"key":"e_1_3_2_2_16_1","volume-title":"Conditional Generative Adversarial Nets. arXiv preprint arXiv:1411.1784","author":"Mirza Mehdi","year":"2014","unstructured":"Mehdi Mirza and Simon Osindero . 2014. Conditional Generative Adversarial Nets. arXiv preprint arXiv:1411.1784 ( 2014 ). Mehdi Mirza and Simon Osindero. 2014. Conditional Generative Adversarial Nets. arXiv preprint arXiv:1411.1784 (2014)."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00209"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00160"},{"key":"e_1_3_2_2_19_1","volume-title":"International Conference on Machine Learning. 8748--8763","author":"Radford Alec","year":"2021","unstructured":"Alec Radford , Jong Wook Kim , Chris Hallacy , Aditya Ramesh , Gabriel Goh , Sandhini Agarwal , Girish Sastry , Amanda Askell , Pamela Mishkin , Jack Clark , 2021 . Learning Transferable Visual Models from Natural Language Supervision . In International Conference on Machine Learning. 8748--8763 . Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning Transferable Visual Models from Natural Language Supervision. In International Conference on Machine Learning. 8748--8763."},{"key":"e_1_3_2_2_20_1","volume-title":"Zero-Shot Text-to-Image Generation. In International Conference on Machine Learning. 8821--8831","author":"Ramesh Aditya","year":"2021","unstructured":"Aditya Ramesh , Mikhail Pavlov , Gabriel Goh , Scott Gray , Chelsea Voss , Alec Radford , Mark Chen , and Ilya Sutskever . 2021 . Zero-Shot Text-to-Image Generation. In International Conference on Machine Learning. 8821--8831 . Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. 2021. Zero-Shot Text-to-Image Generation. In International Conference on Machine Learning. 8821--8831."},{"key":"e_1_3_2_2_21_1","volume-title":"International Conference on Machine Learning. 1060--1069","author":"Reed Scott","year":"2016","unstructured":"Scott Reed , Zeynep Akata , Xinchen Yan , Lajanugen Logeswaran , Bernt Schiele , and Honglak Lee . 2016 . Generative Adversarial Text to Image Synthesis . In International Conference on Machine Learning. 1060--1069 . Scott Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, and Honglak Lee. 2016. Generative Adversarial Text to Image Synthesis. In International Conference on Machine Learning. 1060--1069."},{"key":"e_1_3_2_2_22_1","volume-title":"Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1--7.","author":"Reynolds Laria","year":"2021","unstructured":"Laria Reynolds and Kyle McDonell . 2021 . Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1--7. Laria Reynolds and Kyle McDonell. 2021. Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1--7."},{"key":"e_1_3_2_2_23_1","volume-title":"Advances in Neural Information Processing Systems","volume":"29","author":"Salimans Tim","year":"2016","unstructured":"Tim Salimans , Ian Goodfellow , Wojciech Zaremba , Vicki Cheung , Alec Radford , and Xi Chen . 2016 . Improved Techniques for Training GANs . Advances in Neural Information Processing Systems , Vol. 29 (2016). Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. 2016. Improved Techniques for Training GANs. Advances in Neural Information Processing Systems, Vol. 29 (2016)."},{"key":"e_1_3_2_2_24_1","volume-title":"It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners. arXiv preprint arXiv:2009.07118","author":"Schick Timo","year":"2020","unstructured":"Timo Schick and Hinrich Sch\u00fctze . 2020. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners. arXiv preprint arXiv:2009.07118 ( 2020 ). Timo Schick and Hinrich Sch\u00fctze. 2020. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners. arXiv preprint arXiv:2009.07118 (2020)."},{"key":"e_1_3_2_2_25_1","volume-title":"Eric Wallace, and Sameer Singh.","author":"Shin Taylor","year":"2020","unstructured":"Taylor Shin , Yasaman Razeghi , Robert L Logan IV , Eric Wallace, and Sameer Singh. 2020 . AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts . arXiv preprint arXiv:2010.15980 (2020). Taylor Shin, Yasaman Razeghi, Robert L Logan IV, Eric Wallace, and Sameer Singh. 2020. AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts. arXiv preprint arXiv:2010.15980 (2020)."},{"key":"e_1_3_2_2_26_1","volume-title":"DF-GAN: Deep Fusion Generative Adversarial Networks for Text-to-Image Synthesis. arXiv preprint arXiv:2008.05865","author":"Tao Ming","year":"2020","unstructured":"Ming Tao , Hao Tang , Songsong Wu , Nicu Sebe , Xiao-Yuan Jing , Fei Wu , and Bingkun Bao . 2020. DF-GAN: Deep Fusion Generative Adversarial Networks for Text-to-Image Synthesis. arXiv preprint arXiv:2008.05865 ( 2020 ). Ming Tao, Hao Tang, Songsong Wu, Nicu Sebe, Xiao-Yuan Jing, Fei Wu, and Bingkun Bao. 2020. DF-GAN: Deep Fusion Generative Adversarial Networks for Text-to-Image Synthesis. arXiv preprint arXiv:2008.05865 (2020)."},{"key":"e_1_3_2_2_27_1","volume-title":"Advances in Neural Information Processing Systems","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , \u0141ukasz Kaiser , and Illia Polosukhin . 2017 . Attention is All You Need . Advances in Neural Information Processing Systems , Vol. 30 (2017). Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All You Need. Advances in Neural Information Processing Systems, Vol. 30 (2017)."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00811"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00229"},{"key":"e_1_3_2_2_30_1","volume-title":"Towards Open-World Text-Guided Face Image Generation and Manipulation. arXiv preprint arXiv: 2104.08910","author":"Xia Weihao","year":"2021","unstructured":"Weihao Xia , Yujiu Yang , Jing-Hao Xue , and Baoyuan Wu. 2021b. Towards Open-World Text-Guided Face Image Generation and Manipulation. arXiv preprint arXiv: 2104.08910 ( 2021 ). Weihao Xia, Yujiu Yang, Jing-Hao Xue, and Baoyuan Wu. 2021b. Towards Open-World Text-Guided Face Image Generation and Manipulation. arXiv preprint arXiv: 2104.08910 (2021)."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00143"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00583"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00243"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58517-4_31"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00158"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2022.3156949"},{"key":"e_1_3_2_2_37_1","first-page":"21125","article-title":"Improving Visual Quality of Image Synthesis by a Token-based Generator with Transformers","volume":"34","author":"Zeng Yanhong","year":"2021","unstructured":"Yanhong Zeng , Huan Yang , Hongyang Chao , Jianbo Wang , and Jianlong Fu . 2021 . Improving Visual Quality of Image Synthesis by a Token-based Generator with Transformers . Advances in Neural Information Processing Systems , Vol. 34 (2021), 21125 -- 21137 . Yanhong Zeng, Huan Yang, Hongyang Chao, Jianbo Wang, and Jianlong Fu. 2021. Improving Visual Quality of Image Synthesis by a Token-based Generator with Transformers. Advances in Neural Information Processing Systems, Vol. 34 (2021), 21125--21137.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.629"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2856256"},{"key":"e_1_3_2_2_40_1","volume-title":"MetroGAN: Simulating Urban Morphology with Generative Adversarial Network. arXiv preprint arXiv:2207.02590","author":"Zhang Weiyu","year":"2022","unstructured":"Weiyu Zhang , Yiyang Ma , Di Zhu , Lei Dong , and Yu Liu . 2022. MetroGAN: Simulating Urban Morphology with Generative Adversarial Network. arXiv preprint arXiv:2207.02590 ( 2022 ). Weiyu Zhang, Yiyang Ma, Di Zhu, Lei Dong, and Yu Liu. 2022. MetroGAN: Simulating Urban Morphology with Generative Adversarial Network. arXiv preprint arXiv:2207.02590 (2022)."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00649"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.557"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00595"}],"event":{"name":"MM '22: The 30th ACM International Conference on Multimedia","location":"Lisboa Portugal","acronym":"MM '22","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["Proceedings of the 30th ACM International Conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503161.3547790","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3503161.3547790","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:34Z","timestamp":1750186954000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503161.3547790"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,10]]},"references-count":43,"alternative-id":["10.1145\/3503161.3547790","10.1145\/3503161"],"URL":"https:\/\/doi.org\/10.1145\/3503161.3547790","relation":{},"subject":[],"published":{"date-parts":[[2022,10,10]]},"assertion":[{"value":"2022-10-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}