{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T05:53:25Z","timestamp":1777614805745,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":42,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,12,14]],"date-time":"2021-12-14T00:00:00Z","timestamp":1639440000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,12,14]]},"DOI":"10.1145\/3486622.3493968","type":"proceedings-article","created":{"date-parts":[[2022,4,14]],"date-time":"2022-04-14T01:18:53Z","timestamp":1649899133000},"page":"262-269","source":"Crossref","is-referenced-by-count":1,"title":["A Text Generation Model that Maintains the Order of Words, Topics, and Parts of Speech via Their Embedding Representations and Neural Language Models"],"prefix":"10.1145","author":[{"given":"Noriaki","family":"Kawamae","sequence":"first","affiliation":[{"name":"NTT Comware, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,4,13]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"A Neural Probabilistic Language Model. J. Mach. Learn. Res. 3 (Mar","author":"Bengio Yoshua","year":"2003","unstructured":"Yoshua Bengio , R\u00e9jean Ducharme , Pascal Vincent , and Christian Janvin . 2003. A Neural Probabilistic Language Model. J. Mach. Learn. Res. 3 (Mar 2003 ), 1137\u20131155. Yoshua Bengio, R\u00e9jean Ducharme, Pascal Vincent, and Christian Janvin. 2003. A Neural Probabilistic Language Model. J. Mach. Learn. Res. 3 (Mar 2003), 1137\u20131155."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944937"},{"key":"e_1_3_2_1_3_1","volume-title":"Natural Language Processing (Almost) from Scratch. J. Mach. Learn. Res. 12 (nov","author":"Collobert Ronan","year":"2011","unstructured":"Ronan Collobert , Jason Weston , L\u00e9on Bottou , Michael Karlen , Koray Kavukcuoglu , and Pavel Kuksa . 2011. Natural Language Processing (Almost) from Scratch. J. Mach. Learn. Res. 12 (nov 2011 ), 2493\u20132537. Ronan Collobert, Jason Weston, L\u00e9on Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural Language Processing (Almost) from Scratch. J. Mach. Learn. Res. 12 (nov 2011), 2493\u20132537."},{"key":"e_1_3_2_1_4_1","unstructured":"Rajarshi Das Manzil Zaheer and Chris Dyer. 2015. Gaussian LDA for Topic Models with Word Embeddings. In ACL. 795\u2013804. Rajarshi Das Manzil Zaheer and Chris Dyer. 2015. Gaussian LDA for Topic Models with Word Embeddings. In ACL. 795\u2013804."},{"key":"e_1_3_2_1_5_1","unstructured":"Adji\u00a0B. Dieng Chong Wang Jianfeng Gao and John\u00a0William Paisley. 2016. TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency. CoRR abs\/1611.01702(2016). Adji\u00a0B. Dieng Chong Wang Jianfeng Gao and John\u00a0William Paisley. 2016. TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency. CoRR abs\/1611.01702(2016)."},{"key":"e_1_3_2_1_6_1","unstructured":"Yarin Gal and Zoubin Ghahramani. 2016. A Theoretically Grounded Application of Dropout in Recurrent Neural Networks. In NIPS. 1027\u20131035. Yarin Gal and Zoubin Ghahramani. 2016. A Theoretically Grounded Application of Dropout in Recurrent Neural Networks. In NIPS. 1027\u20131035."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/3176748.3176757"},{"key":"e_1_3_2_1_8_1","unstructured":"Ruining He and Julian McAuley. 2016. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. In WWW. 507\u2013517. Ruining He and Julian McAuley. 2016. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. In WWW. 507\u2013517."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Aur\u00e9lie Herbelot and Eva\u00a0Maria Vecchi. 2015. Building a shared world: mapping distributional to model-theoretic semantic spaces. In EMNLP. 22\u201332. Aur\u00e9lie Herbelot and Eva\u00a0Maria Vecchi. 2015. Building a shared world: mapping distributional to model-theoretic semantic spaces. In EMNLP. 22\u201332.","DOI":"10.18653\/v1\/D15-1003"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Y. Hu Y. Koren and C. Volinsky. 2008. Collaborative Filtering for Implicit Feedback Datasets. In ICDM. 263\u2013272. Y. Hu Y. Koren and C. Volinsky. 2008. Collaborative Filtering for Implicit Feedback Datasets. In ICDM. 263\u2013272.","DOI":"10.1109\/ICDM.2008.22"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Nal Kalchbrenner Edward Grefenstette and Phil Blunsom. 2014. A Convolutional Neural Network for Modelling Sentences. In ACL. 655\u2013665. Nal Kalchbrenner Edward Grefenstette and Phil Blunsom. 2014. A Convolutional Neural Network for Modelling Sentences. In ACL. 655\u2013665.","DOI":"10.3115\/v1\/P14-1062"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Noriaki Kawamae. 2016. N-gram over Context. In WWW. 1045\u20131055. Noriaki Kawamae. 2016. N-gram over Context. In WWW. 1045\u20131055.","DOI":"10.1145\/2872427.2882981"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Noriaki Kawamae. 2019. Topic Structure-Aware Neural Language Model: Unified language model that maintains word and topic ordering by their embedded representations. In WWW. 2900\u20132906. Noriaki Kawamae. 2019. Topic Structure-Aware Neural Language Model: Unified language model that maintains word and topic ordering by their embedded representations. In WWW. 2900\u20132906.","DOI":"10.1145\/3308558.3313757"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In EMNLP. 1746\u20131751. Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In EMNLP. 1746\u20131751.","DOI":"10.3115\/v1\/D14-1181"},{"key":"e_1_3_2_1_16_1","volume-title":"Kingma and Jimmy Ba","author":"P.","year":"2015","unstructured":"Diederik\u00a0 P. Kingma and Jimmy Ba . 2015 . Adam : A Method for Stochastic Optimization. In ICLR. Diederik\u00a0P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10898-014-0247-2"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Jey\u00a0Han Lau Timothy Baldwin and Trevor Cohn. 2017. Topically Driven Neural Language Model. In ACL. 355\u2013365. Jey\u00a0Han Lau Timothy Baldwin and Trevor Cohn. 2017. Topically Driven Neural Language Model. In ACL. 355\u2013365.","DOI":"10.18653\/v1\/P17-1033"},{"key":"e_1_3_2_1_19_1","volume-title":"LTSG: Latent Topical Skip-Gram for Mutually Learning Topic Model and Vector Representations. CoRR","author":"Law Jarvan","year":"2017","unstructured":"Jarvan Law , Hankz\u00a0Hankui Zhuo , Junhua He , and Erhu Rong . 2017 . LTSG: Latent Topical Skip-Gram for Mutually Learning Topic Model and Vector Representations. CoRR (2017). Jarvan Law, Hankz\u00a0Hankui Zhuo, Junhua He, and Erhu Rong. 2017. LTSG: Latent Topical Skip-Gram for Mutually Learning Topic Model and Vector Representations. CoRR (2017)."},{"key":"e_1_3_2_1_20_1","volume-title":"Le and Tomas Mikolov","author":"V.","year":"2014","unstructured":"Quoc\u00a0 V. Le and Tomas Mikolov . 2014 . Distributed Representations of Sentences and Documents. In ICML. 1188\u20131196. Quoc\u00a0V. Le and Tomas Mikolov. 2014. Distributed Representations of Sentences and Documents. In ICML. 1188\u20131196."},{"key":"e_1_3_2_1_21_1","volume-title":"Learning the parts of objects by nonnegative matrix factorization. Nature 401, 6755","author":"Lee D.","year":"1999","unstructured":"Daniel\u00a0 D. Lee and H.\u00a0 Sebastian Seung . 1999. Learning the parts of objects by nonnegative matrix factorization. Nature 401, 6755 ( 1999 ), 788\u2013791. Daniel\u00a0D. Lee and H.\u00a0Sebastian Seung. 1999. Learning the parts of objects by nonnegative matrix factorization. Nature 401, 6755 (1999), 788\u2013791."},{"key":"e_1_3_2_1_22_1","unstructured":"Omer Levy and Yoav Goldberg. 2014. Neural Word Embedding As Implicit Matrix Factorization. In NIPS. 2177\u20132185. Omer Levy and Yoav Goldberg. 2014. Neural Word Embedding As Implicit Matrix Factorization. In NIPS. 2177\u20132185."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Dawen Liang Jaan Altosaar Laurent Charlin and David\u00a0M Blei. 2016. Factorization Meets the Item Embedding: Regularizing Matrix Factorization with Item Co-occurrence. In RecSys. 59\u201366. Dawen Liang Jaan Altosaar Laurent Charlin and David\u00a0M Blei. 2016. Factorization Meets the Item Embedding: Regularizing Matrix Factorization with Item Co-occurrence. In RecSys. 59\u201366.","DOI":"10.1145\/2959100.2959182"},{"key":"e_1_3_2_1_24_1","unstructured":"Robert\u00a0V. Lindsey William\u00a0P. Headden III and Michael\u00a0J Stipicevic. 2012. A phrase-discovering topic model using hierarchical Pitman-Yor processes. In EMNLP-CoNLL. 214\u2013222. Robert\u00a0V. Lindsey William\u00a0P. Headden III and Michael\u00a0J Stipicevic. 2012. A phrase-discovering topic model using hierarchical Pitman-Yor processes. In EMNLP-CoNLL. 214\u2013222."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Yang Liu Zhiyuan Liu Tat-Seng Chua and Maosong Sun. 2015. Topical Word Embeddings. In AAAI. 2418\u20132424. Yang Liu Zhiyuan Liu Tat-Seng Chua and Maosong Sun. 2015. Topical Word Embeddings. In AAAI. 2418\u20132424.","DOI":"10.1609\/aaai.v29i1.9522"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Julian McAuley Christopher Targett Qinfeng Shi and Anton van\u00a0den Hengel. 2015. Image-Based Recommendations on Styles and Substitutes. In SIGIR. 43\u201352. Julian McAuley Christopher Targett Qinfeng Shi and Anton van\u00a0den Hengel. 2015. Image-Based Recommendations on Styles and Substitutes. In SIGIR. 43\u201352.","DOI":"10.1145\/2766462.2767755"},{"key":"e_1_3_2_1_27_1","volume-title":"Efficient Estimation of Word Representations in Vector Space. CoRR","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov , Kai Chen , Greg Corrado , and Jeffrey Dean . 2013. Efficient Estimation of Word Representations in Vector Space. CoRR ( 2013 ). Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. CoRR (2013)."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Tomas Mikolov Martin Karafi\u00e1t Luk\u00e1s Burget Jan Cernock\u00fd and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In INTERSPEECH. 1045\u20131048. Tomas Mikolov Martin Karafi\u00e1t Luk\u00e1s Burget Jan Cernock\u00fd and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In INTERSPEECH. 1045\u20131048.","DOI":"10.21437\/Interspeech.2010-343"},{"key":"e_1_3_2_1_29_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Gregory\u00a0S. Corrado and Jeffrey Dean. 2013. Distributed Representations of Words and Phrases and their Compositionality. In NIPS. 3111\u20133119. Tomas Mikolov Ilya Sutskever Kai Chen Gregory\u00a0S. Corrado and Jeffrey Dean. 2013. Distributed Representations of Words and Phrases and their Compositionality. In NIPS. 3111\u20133119."},{"key":"e_1_3_2_1_30_1","unstructured":"David Mimno Hanna\u00a0M. Wallach Edmund Talley Miriam Leenders and Andrew McCallum. 2010. Optimizing Semantic Coherence in Topic Models. In EMNLP. 262\u2013272. David Mimno Hanna\u00a0M. Wallach Edmund Talley Miriam Leenders and Andrew McCallum. 2010. Optimizing Semantic Coherence in Topic Models. In EMNLP. 262\u2013272."},{"key":"e_1_3_2_1_31_1","unstructured":"Christopher\u00a0E. Moody. 2016. Mixing Dirichlet Topic Models and Word Embeddings to Make lda2vec. CoRR abs\/1605.02019(2016). Christopher\u00a0E. Moody. 2016. Mixing Dirichlet Topic Models and Word Embeddings to Make lda2vec. CoRR abs\/1605.02019(2016)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00140"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Liqiang Niu Xinyu Dai Jianbing Zhang and Jiajun Chen. 2015. Topic2Vec: Learning distributed representations of topics. In IALP. 193\u2013196. Liqiang Niu Xinyu Dai Jianbing Zhang and Jiajun Chen. 2015. Topic2Vec: Learning distributed representations of topics. In IALP. 193\u2013196.","DOI":"10.1109\/IALP.2015.7451564"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Bei Shi Wai Lam Shoaib Jameel Steven Schockaert and Kwun\u00a0Ping Lai. 2017. Jointly Learning Word Embeddings and Latent Topics. In SIGIR. 375\u2013384. Bei Shi Wai Lam Shoaib Jameel Steven Schockaert and Kwun\u00a0Ping Lai. 2017. Jointly Learning Word Embeddings and Latent Topics. In SIGIR. 375\u2013384.","DOI":"10.1145\/3077136.3080806"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Tian Shi Kyeongpil Kang Jaegul Choo and Chandan\u00a0K. Reddy. 2018. Short-Text Topic Modeling via Non-negative Matrix Factorization Enriched with Local Word-Context Correlations. In WWW. 1105\u20131114. Tian Shi Kyeongpil Kang Jaegul Choo and Chandan\u00a0K. Reddy. 2018. Short-Text Topic Modeling via Non-negative Matrix Factorization Enriched with Local Word-Context Correlations. In WWW. 1105\u20131114.","DOI":"10.1145\/3178876.3186009"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2670313"},{"key":"e_1_3_2_1_37_1","unstructured":"Hendrik Strobelt Sebastian Gehrmann Bernd Huber Hanspeter Pfister and Alexander\u00a0M. Rush. 2016. Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks. CoRR abs\/1606.07461(2016). Hendrik Strobelt Sebastian Gehrmann Bernd Huber Hanspeter Pfister and Alexander\u00a0M. Rush. 2016. Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks. CoRR abs\/1606.07461(2016)."},{"key":"e_1_3_2_1_38_1","volume-title":"Sentence Level Recurrent Topic Model: Letting Topics Speak for Themselves. CoRR","author":"Tian Fei","year":"2016","unstructured":"Fei Tian , Bin Gao , Di He , and Tie-Yan Liu . 2016. Sentence Level Recurrent Topic Model: Letting Topics Speak for Themselves. CoRR ( 2016 ). Fei Tian, Bin Gao, Di He, and Tie-Yan Liu. 2016. Sentence Level Recurrent Topic Model: Letting Topics Speak for Themselves. CoRR (2016)."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Guangxu Xun Yaliang Li Jing Gao and Aidong Zhang. 2017. Collaboratively Improving Topic Discovery and Word Embeddings by Coordinating Global and Local Contexts. In KDD. 535\u2013543. Guangxu Xun Yaliang Li Jing Gao and Aidong Zhang. 2017. Collaboratively Improving Topic Discovery and Word Embeddings by Coordinating Global and Local Contexts. In KDD. 535\u2013543.","DOI":"10.1145\/3097983.3098009"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"crossref","unstructured":"Zijun Yao Yifan Sun Weicong Ding Nikhil Rao and Hui Xiong. 2018. Dynamic Word Embeddings for Evolving Semantic Discovery. In WSDM. 673\u2013681. Zijun Yao Yifan Sun Weicong Ding Nikhil Rao and Hui Xiong. 2018. Dynamic Word Embeddings for Evolving Semantic Discovery. In WSDM. 673\u2013681.","DOI":"10.1145\/3159652.3159703"},{"key":"e_1_3_2_1_41_1","unstructured":"Manzil Zaheer Amr Ahmed and Alexander\u00a0J. Smola. 2017. Latent LSTM Allocation: Joint Clustering and Non-Linear Dynamic Modeling of Sequence Datay. In ICML. 3967\u20133976. Manzil Zaheer Amr Ahmed and Alexander\u00a0J. Smola. 2017. Latent LSTM Allocation: Joint Clustering and Non-Linear Dynamic Modeling of Sequence Datay. In ICML. 3967\u20133976."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"crossref","unstructured":"Jianwen Zhang Yangqiu Song Changshui Zhang and Shixia Liu. 2010. Evolutionary hierarchical dirichlet processes for multiple correlated time-varying corpora. In KDD. 1079\u20131088. Jianwen Zhang Yangqiu Song Changshui Zhang and Shixia Liu. 2010. Evolutionary hierarchical dirichlet processes for multiple correlated time-varying corpora. In KDD. 1079\u20131088.","DOI":"10.1145\/1835804.1835940"}],"event":{"name":"WI-IAT '21: IEEE\/WIC\/ACM International Conference on Web Intelligence","location":"ESSENDON VIC Australia","acronym":"WI-IAT '21","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence"]},"container-title":["IEEE\/WIC\/ACM International Conference on Web Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486622.3493968","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3486622.3493968","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:05Z","timestamp":1750191125000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486622.3493968"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,14]]},"references-count":42,"alternative-id":["10.1145\/3486622.3493968","10.1145\/3486622"],"URL":"https:\/\/doi.org\/10.1145\/3486622.3493968","relation":{},"subject":[],"published":{"date-parts":[[2021,12,14]]}}}