{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,3]],"date-time":"2026-02-03T20:29:17Z","timestamp":1770150557497,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T00:00:00Z","timestamp":1697846400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,10,21]]},"DOI":"10.1145\/3583780.3615474","type":"proceedings-article","created":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T07:45:42Z","timestamp":1697874342000},"page":"4488-4494","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Enhancing E-commerce Product Search through Reinforcement Learning-Powered Query Reformulation"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-7658-7532","authenticated-orcid":false,"given":"Sanjay","family":"Agrawal","sequence":"first","affiliation":[{"name":"Amazon.com Inc., Bengaluru, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7849-9743","authenticated-orcid":false,"given":"Srujana","family":"Merugu","sequence":"additional","affiliation":[{"name":"Amazon.com Inc., Bengaluru, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6787-1383","authenticated-orcid":false,"given":"Vivek","family":"Sembium","sequence":"additional","affiliation":[{"name":"Amazon.com Inc., Bengaluru, India"}]}],"member":"320","published-online":{"date-parts":[[2023,10,21]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.4380220902"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2742739"},{"key":"e_1_3_2_1_3_1","volume-title":"Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and\/or summarization. 65--72","author":"Banerjee Satanjeev","year":"2005","unstructured":"Satanjeev Banerjee and Alon Lavie . 2005 . METEOR: An automatic metric for MT evaluation with improved correlation with human judgments . In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and\/or summarization. 65--72 . Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and\/or summarization. 65--72."},{"key":"e_1_3_2_1_4_1","volume-title":"Exploring Fluent Query Reformulations with Text-to-Text Transformers and Reinforcement Learning. arXiv preprint arXiv:2012.10033","author":"Chen Jerry Zikun","year":"2020","unstructured":"Jerry Zikun Chen , Shi Yu , and Haoran Wang . 2020. Exploring Fluent Query Reformulations with Text-to-Text Transformers and Reinforcement Learning. arXiv preprint arXiv:2012.10033 ( 2020 ). Jerry Zikun Chen, Shi Yu, and Haoran Wang. 2020. Exploring Fluent Query Reformulations with Text-to-Text Transformers and Reinforcement Learning. arXiv preprint arXiv:2012.10033 (2020)."},{"key":"e_1_3_2_1_5_1","volume-title":"Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio.","author":"Cho Kyunghyun","year":"2014","unstructured":"Kyunghyun Cho , Bart Van Merri\u00ebnboer , Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014 . Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014). Kyunghyun Cho, Bart Van Merri\u00ebnboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3023421"},{"key":"e_1_3_2_1_7_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. CoRR","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2018 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. CoRR , Vol. abs\/ 1810 .04805 (2018). arxiv: 1810.04805 http:\/\/arxiv.org\/abs\/1810.04805 Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. CoRR, Vol. abs\/1810.04805 (2018). arxiv: 1810.04805 http:\/\/arxiv.org\/abs\/1810.04805"},{"key":"e_1_3_2_1_8_1","volume-title":"Proceedings of EMNLP.","author":"Gao Jianfeng","year":"2012","unstructured":"Jianfeng Gao , Shasha Xie , Xiaodong He , and Alnur Ali . 2012 . Learning lexicon models from search logs for query expansion . In Proceedings of EMNLP. Jianfeng Gao, Shasha Xie, Xiaodong He, and Alnur Ali. 2012. Learning lexicon models from search logs for query expansion. In Proceedings of EMNLP."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767709"},{"key":"e_1_3_2_1_10_1","volume-title":"Can neural machine translation be improved with user feedback? arXiv preprint arXiv:1804.05958","author":"Kreutzer Julia","year":"2018","unstructured":"Julia Kreutzer , Shahram Khadivi , Evgeny Matusov , and Stefan Riezler . 2018. Can neural machine translation be improved with user feedback? arXiv preprint arXiv:1804.05958 ( 2018 ). Julia Kreutzer, Shahram Khadivi, Evgeny Matusov, and Stefan Riezler. 2018. Can neural machine translation be improved with user feedback? arXiv preprint arXiv:1804.05958 (2018)."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219850"},{"key":"e_1_3_2_1_12_1","volume-title":"A diversity-promoting objective function for neural conversation models. arXiv preprint arXiv:1510.03055","author":"Li Jiwei","year":"2015","unstructured":"Jiwei Li , Michel Galley , Chris Brockett , Jianfeng Gao , and Bill Dolan . 2015. A diversity-promoting objective function for neural conversation models. arXiv preprint arXiv:1510.03055 ( 2015 ). Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2015. A diversity-promoting objective function for neural conversation models. arXiv preprint arXiv:1510.03055 (2015)."},{"key":"e_1_3_2_1_13_1","unstructured":"Yijiang Lian Zhijie Chen Jinlong Hu Kefeng Zhang Chunwei Yan Muchenxuan Tong Wenying Han Hanju Guan Ying Li Ying Cao etal 2019. An end-to-end Generative Retrieval Method for Sponsored Search Engine--Decoding Efficiently into a Closed Target Domain. arXiv preprint arXiv:1902.00592 (2019).  Yijiang Lian Zhijie Chen Jinlong Hu Kefeng Zhang Chunwei Yan Muchenxuan Tong Wenying Han Hanju Guan Ying Li Ying Cao et al. 2019. An end-to-end Generative Retrieval Method for Sponsored Search Engine--Decoding Efficiently into a Closed Target Domain. arXiv preprint arXiv:1902.00592 (2019)."},{"key":"e_1_3_2_1_14_1","volume-title":"Query reformulation using query history for passage retrieval in conversational search. arXiv preprint arXiv:2005.02230","author":"Lin Sheng-Chieh","year":"2020","unstructured":"Sheng-Chieh Lin , Jheng-Hong Yang , Rodrigo Nogueira , Ming-Feng Tsai , Chuan-Ju Wang , and Jimmy Lin . 2020. Query reformulation using query history for passage retrieval in conversational search. arXiv preprint arXiv:2005.02230 ( 2020 ). Sheng-Chieh Lin, Jheng-Hong Yang, Rodrigo Nogueira, Ming-Feng Tsai, Chuan-Ju Wang, and Jimmy Lin. 2020. Query reformulation using query history for passage retrieval in conversational search. arXiv preprint arXiv:2005.02230 (2020)."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467202"},{"key":"e_1_3_2_1_16_1","volume-title":"Hal Daum\u00e9 III, and Jordan Boyd-Graber","author":"Nguyen Khanh","year":"2017","unstructured":"Khanh Nguyen , Hal Daum\u00e9 III, and Jordan Boyd-Graber . 2017 . Reinforcement learning for bandit neural machine translation with simulated human feedback. arXiv preprint arXiv:1707.07402 (2017). Khanh Nguyen, Hal Daum\u00e9 III, and Jordan Boyd-Graber. 2017. Reinforcement learning for bandit neural machine translation with simulated human feedback. arXiv preprint arXiv:1707.07402 (2017)."},{"key":"e_1_3_2_1_17_1","volume-title":"Task-oriented query reformulation with reinforcement learning. arXiv preprint arXiv:1704.04572","author":"Nogueira Rodrigo","year":"2017","unstructured":"Rodrigo Nogueira and Kyunghyun Cho . 2017. Task-oriented query reformulation with reinforcement learning. arXiv preprint arXiv:1704.04572 ( 2017 ). Rodrigo Nogueira and Kyunghyun Cho. 2017. Task-oriented query reformulation with reinforcement learning. arXiv preprint arXiv:1704.04572 (2017)."},{"key":"e_1_3_2_1_18_1","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing.","author":"Palmer Martha","year":"2017","unstructured":"Martha Palmer , Rebecca Hwa , and Sebastian Riedel . 2017 . Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing . In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Martha Palmer, Rebecca Hwa, and Sebastian Riedel. 2017. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing."},{"key":"e_1_3_2_1_19_1","volume-title":"Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 311--318","author":"Papineni Kishore","year":"2002","unstructured":"Kishore Papineni , Salim Roukos , Todd Ward , and Wei-Jing Zhu . 2002 . Bleu: a method for automatic evaluation of machine translation . In Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 311--318 . Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 311--318."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-99736-6_27"},{"key":"e_1_3_2_1_21_1","volume-title":"Prophetnet: Predicting future n-gram for sequence-to-sequence pre-training. arXiv preprint arXiv:2001.04063","author":"Qi Weizhen","year":"2020","unstructured":"Weizhen Qi , Yu Yan , Yeyun Gong , Dayiheng Liu , Nan Duan , Jiusheng Chen , Ruofei Zhang , and Ming Zhou . 2020 . Prophetnet: Predicting future n-gram for sequence-to-sequence pre-training. arXiv preprint arXiv:2001.04063 (2020). Weizhen Qi, Yu Yan, Yeyun Gong, Dayiheng Liu, Nan Duan, Jiusheng Chen, Ruofei Zhang, and Ming Zhou. 2020. Prophetnet: Predicting future n-gram for sequence-to-sequence pre-training. arXiv preprint arXiv:2001.04063 (2020)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE51399.2021.00276"},{"key":"e_1_3_2_1_23_1","unstructured":"Alec Radford Jeffrey Wu Rewon Child David Luan Dario Amodei Ilya Sutskever etal 2019. Language models are unsupervised multitask learners. OpenAI blog Vol. 1 8 (2019) 9.  Alec Radford Jeffrey Wu Rewon Child David Luan Dario Amodei Ilya Sutskever et al. 2019. Language models are unsupervised multitask learners. OpenAI blog Vol. 1 8 (2019) 9."},{"key":"e_1_3_2_1_24_1","volume-title":"Liu","author":"Raffel Colin","year":"2019","unstructured":"Colin Raffel , Noam Shazeer , Adam Roberts , Katherine Lee , Sharan Narang , Michael Matena , Yanqi Zhou , Wei Li , and Peter J . Liu . 2019 . Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer . arXiv e-prints (2019). arxiv: 1910.10683 Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2019. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. arXiv e-prints (2019). arxiv: 1910.10683"},{"key":"e_1_3_2_1_25_1","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel , Noam Shazeer , Adam Roberts , Katherine Lee , Sharan Narang , Michael Matena , Yanqi Zhou , Wei Li , Peter J Liu , 2020 . Exploring the limits of transfer learning with a unified text-to-text transformer . J. Mach. Learn. Res. , Vol. 21 , 140 (2020), 1 -- 67 . Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J Liu, et al. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res., Vol. 21, 140 (2020), 1--67.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_1_26_1","unstructured":"Chandan K. Reddy Llu\u00eds M\u00e0rquez Fran Valero Nikhil Rao Hugo Zaragoza Sambaran Bandyopadhyay Arnab Biswas Anlu Xing and Karthik Subbian. 2022. Shopping Queries Dataset: A Large-Scale ESCI Benchmark for Improving Product Search. arxiv: 2206.06588  Chandan K. Reddy Llu\u00eds M\u00e0rquez Fran Valero Nikhil Rao Hugo Zaragoza Sambaran Bandyopadhyay Arnab Biswas Anlu Xing and Karthik Subbian. 2022. Shopping Queries Dataset: A Large-Scale ESCI Benchmark for Improving Product Search. arxiv: 2206.06588"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30950-2_116"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00347"},{"key":"e_1_3_2_1_29_1","first-page":"3008","article-title":"Learning to summarize with human feedback","volume":"33","author":"Stiennon Nisan","year":"2020","unstructured":"Nisan Stiennon , Long Ouyang , Jeffrey Wu , Daniel Ziegler , Ryan Lowe , Chelsea Voss , Alec Radford , Dario Amodei , and Paul F Christiano . 2020 . Learning to summarize with human feedback . Advances in Neural Information Processing Systems , Vol. 33 (2020), 3008 -- 3021 . Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul F Christiano. 2020. Learning to summarize with human feedback. Advances in Neural Information Processing Systems, Vol. 33 (2020), 3008--3021.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_30_1","volume-title":"Diverse beam search: Decoding diverse solutions from neural sequence models. arXiv preprint arXiv:1610.02424","author":"Vijayakumar Ashwin K","year":"2016","unstructured":"Ashwin K Vijayakumar , Michael Cogswell , Ramprasath R Selvaraju , Qing Sun , Stefan Lee , David Crandall , and Dhruv Batra . 2016. Diverse beam search: Decoding diverse solutions from neural sequence models. arXiv preprint arXiv:1610.02424 ( 2016 ). Ashwin K Vijayakumar, Michael Cogswell, Ramprasath R Selvaraju, Qing Sun, Stefan Lee, David Crandall, and Dhruv Batra. 2016. Diverse beam search: Decoding diverse solutions from neural sequence models. arXiv preprint arXiv:1610.02424 (2016)."},{"key":"e_1_3_2_1_31_1","volume-title":"Deep reinforced query reformulation for information retrieval. arXiv preprint arXiv:2007.07987","author":"Wang Xiao","year":"2020","unstructured":"Xiao Wang , Craig Macdonald , and Iadh Ounis . 2020. Deep reinforced query reformulation for information retrieval. arXiv preprint arXiv:2007.07987 ( 2020 ). Xiao Wang, Craig Macdonald, and Iadh Ounis. 2020. Deep reinforced query reformulation for information retrieval. arXiv preprint arXiv:2007.07987 (2020)."},{"key":"e_1_3_2_1_32_1","volume-title":"Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning","author":"Williams Ronald J","year":"1992","unstructured":"Ronald J Williams . 1992. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning , Vol. 8 , 3 ( 1992 ), 229--256. Ronald J Williams. 1992. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning, Vol. 8, 3 (1992), 229--256."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11987"},{"key":"e_1_3_2_1_34_1","volume-title":"Acm sigir forum","author":"Xu Jinxi","unstructured":"Jinxi Xu and W Bruce Croft . 2017. Quary expansion using local and global document analysis . In Acm sigir forum , Vol. 51 . ACM New York, NY , USA , 168--175. Jinxi Xu and W Bruce Croft. 2017. Quary expansion using local and global document analysis. In Acm sigir forum, Vol. 51. ACM New York, NY, USA, 168--175."},{"key":"e_1_3_2_1_35_1","volume-title":"Relation classification via recurrent neural network. arXiv preprint arXiv:1508.01006","author":"Zhang Dongxu","year":"2015","unstructured":"Dongxu Zhang and Dong Wang . 2015. Relation classification via recurrent neural network. arXiv preprint arXiv:1508.01006 ( 2015 ). Dongxu Zhang and Dong Wang. 2015. Relation classification via recurrent neural network. arXiv preprint arXiv:1508.01006 (2015)."},{"key":"e_1_3_2_1_36_1","volume-title":"BERT-QE: contextualized query expansion for document re-ranking. arXiv preprint arXiv:2009.07258","author":"Zheng Zhi","year":"2020","unstructured":"Zhi Zheng , Kai Hui , Ben He , Xianpei Han , Le Sun , and Andrew Yates . 2020. BERT-QE: contextualized query expansion for document re-ranking. arXiv preprint arXiv:2009.07258 ( 2020 ). Zhi Zheng, Kai Hui, Ben He, Xianpei Han, Le Sun, and Andrew Yates. 2020. BERT-QE: contextualized query expansion for document re-ranking. arXiv preprint arXiv:2009.07258 (2020)."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313570"}],"event":{"name":"CIKM '23: The 32nd ACM International Conference on Information and Knowledge Management","location":"Birmingham United Kingdom","acronym":"CIKM '23","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 32nd ACM International Conference on Information and Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3583780.3615474","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3583780.3615474","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:54Z","timestamp":1750178214000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3583780.3615474"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,21]]},"references-count":37,"alternative-id":["10.1145\/3583780.3615474","10.1145\/3583780"],"URL":"https:\/\/doi.org\/10.1145\/3583780.3615474","relation":{},"subject":[],"published":{"date-parts":[[2023,10,21]]},"assertion":[{"value":"2023-10-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}