{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T11:21:06Z","timestamp":1761218466500,"version":"3.41.0"},"reference-count":152,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,3,9]],"date-time":"2022-03-09T00:00:00Z","timestamp":1646784000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSF CAREER","award":["IIS-1453721"],"award-info":[{"award-number":["IIS-1453721"]}]},{"name":"DARPA Memex Program","award":["FA8750-14-2-0226"],"award-info":[{"award-number":["FA8750-14-2-0226"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2022,10,31]]},"abstract":"<jats:p>This article presents a re-classification of information seeking (IS) tasks, concepts, and algorithms. The proposed taxonomy provides new dimensions to look into information seeking tasks and methods. The new dimensions include number of search iterations, search goal types, and procedures to reach these goals. Differences along these dimensions for the information seeking tasks call for suitable computational solutions. The article then reviews machine learning solutions that match each new category. The article ends with a review of evaluation campaigns for IS systems.<\/jats:p>","DOI":"10.1145\/3497875","type":"journal-article","created":{"date-parts":[[2022,3,10]],"date-time":"2022-03-10T04:49:38Z","timestamp":1646887778000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["A Re-classification of Information Seeking Tasks and Their Computational Solutions"],"prefix":"10.1145","volume":"40","author":[{"given":"Zhiwen","family":"Tang","sequence":"first","affiliation":[{"name":"InfoSense, Department of Computer Science, Georgetown University, Washington, DC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Grace Hui","family":"Yang","sequence":"additional","affiliation":[{"name":"InfoSense, Department of Computer Science, Georgetown University, Washington, DC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,3,9]]},"reference":[{"key":"e_1_3_2_2_2","volume-title":"TREC\u201911","author":"Adeyanju Ibrahim","year":"2011","unstructured":"Ibrahim Adeyanju, Dawei Song, Franco Maria Nardini, M-Dyaa Albakour, and Udo Kruschwitz. 2011. RGU-ISTI-Essex at TREC 2011 session track. In TREC\u201911."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.2307\/1427934"},{"key":"e_1_3_2_4_2","doi-asserted-by":"crossref","unstructured":"Wafa Aissa Laure Soulier and Ludovic Denoyer. 2018. A reinforcement learning-driven translation model for search-oriented conversational systems. In Proceedings of the 2nd International Workshop on Search-Oriented Conversational AI SCAI@EMNLP 2018 .","DOI":"10.18653\/v1\/W18-5705"},{"key":"e_1_3_2_5_2","volume-title":"TREC\u201911","author":"Albakour M.-Dyaa","year":"2011","unstructured":"M.-Dyaa Albakour, Udo Kruschwitz, Brendan Neville, Deirdre Lungley, Maria Fasli, and Nikolaos Nanas. 2011. University of essex at the TREC 2011 session track. In TREC\u201911."},{"key":"e_1_3_2_6_2","volume-title":"TREC\u201912","author":"Albakour M.-Dyaa","year":"2012","unstructured":"M.-Dyaa Albakour and Udo Kruschwitz. 2012. University of essex at the TREC 2012 session track. In TREC\u201912."},{"key":"e_1_3_2_7_2","volume-title":"Personality Dynamics: Key Concepts in Reversal Theory","author":"Apter Michael J.","year":"2005","unstructured":"Michael J. Apter. 2005. Personality Dynamics: Key Concepts in Reversal Theory. Apter International."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23617"},{"key":"e_1_3_2_9_2","volume-title":"CIKM\u201915","author":"Athukorala Kumaripaba","year":"2015","unstructured":"Kumaripaba Athukorala, Alan Medlar, Kalle Ilves, and Dorota Glowacka. 2015. Balancing exploration and exploitation: Empirical parameterization of exploratory search systems. In CIKM\u201915."},{"key":"e_1_3_2_10_2","article-title":"Using confidence bounds for exploitation-exploration trade-offs","volume":"3","author":"Auer Peter","year":"2002","unstructured":"Peter Auer. 2002. Using confidence bounds for exploitation-exploration trade-offs. JMLR 3 (2002), 397\u2013422.","journal-title":"JMLR"},{"key":"e_1_3_2_11_2","volume-title":"SIGIR\u201911","author":"Azzopardi Leif","year":"2011","unstructured":"Leif Azzopardi. 2011. The economics in interactive information retrieval. In SIGIR\u201911."},{"key":"e_1_3_2_12_2","volume-title":"SIGIR\u201914","author":"Azzopardi Leif","year":"2014","unstructured":"Leif Azzopardi. 2014. Modelling interaction with economic models of search. In SIGIR\u201914."},{"key":"e_1_3_2_13_2","volume-title":"TREC\u201914","author":"Bah Ashraf","year":"2014","unstructured":"Ashraf Bah, Karankumar Sabhnani, Mustafa Zengin, and Ben Carterette. 2014. University of delaware at TREC 2014. In TREC\u201914."},{"key":"e_1_3_2_14_2","volume-title":"ICLR\u201915","author":"Bahdanau Dzmitry","year":"2015","unstructured":"Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In ICLR\u201915."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1108\/eb024320"},{"key":"e_1_3_2_16_2","volume-title":"NIPS\u201901","author":"Blei David M.","year":"2001","unstructured":"David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2001. Latent dirichlet allocation. In NIPS\u201901."},{"key":"e_1_3_2_17_2","volume-title":"ICLR\u201917","author":"Bordes Antoine","year":"2017","unstructured":"Antoine Bordes, Y.-Lan Boureau, and Jason Weston. 2017. Learning end-to-end goal-oriented dialog. In ICLR\u201917."},{"key":"e_1_3_2_18_2","volume-title":"SIGIR\u201918","author":"Borisov Alexey","year":"2018","unstructured":"Alexey Borisov, Martijn Wardenaar, Ilya Markov, and Maarten de Rijke. 2018. A click sequence model for web search. In SIGIR\u201918."},{"issue":"10","key":"e_1_3_2_19_2","article-title":"The concept of relevance in IR","volume":"54","author":"Borlund Pia","year":"2003","unstructured":"Pia Borlund. 2003. The concept of relevance in IR. J. Assoc. Inf. Sci. Technol. 54, 10 (2003), 913\u2013925.","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2011.07.005"},{"key":"e_1_3_2_21_2","volume-title":"TREC\u201910","author":"Bron Marc","year":"2010","unstructured":"Marc Bron, Jiyin He, Katja Hofmann, Edgar Meij, Maarten de Rijke, Manos Tsagkias, and Wouter Weerkamp. 2010. The university of amsterdam at TREC 2010: Session, entity and relevance feedback. In TREC\u201910."},{"key":"e_1_3_2_22_2","volume-title":"SIGIR\u201998","author":"Carbonell Jaime G.","year":"1998","unstructured":"Jaime G. Carbonell and Jade Goldstein. 1998. The use of MMR, diversity-based reranking for reordering documents and producing summaries. In SIGIR\u201998."},{"key":"e_1_3_2_23_2","volume-title":"TREC\u201911","author":"Carterette Ben","year":"2011","unstructured":"Ben Carterette and Praveen Chandar. 2011. Implicit Feedback and Document Filtering for Retrieval Over Query Sessions. In TREC\u201911."},{"key":"e_1_3_2_24_2","volume-title":"SIGIR\u201916","author":"Carterette Ben","year":"2016","unstructured":"Ben Carterette, Paul D. Clough, Mark M. Hall, Evangelos Kanoulas, and Mark Sanderson. 2016. Evaluating Retrieval over Sessions: The TREC Session Track 2011-2014. In SIGIR\u201916."},{"key":"e_1_3_2_25_2","volume-title":"TREC\u201913","author":"Carterette Ben","year":"2013","unstructured":"Ben Carterette, Evangelos Kanoulas, Mark Hall, Ashraf Bah, and Paul D. Clough. 2013. Overview of the TREC 2013 Session Track. In TREC\u201913."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-011-9167-7"},{"key":"e_1_3_2_27_2","volume-title":"Proceedings of the 4th Artificial Intelligence and Interactive Digital Entertainment Conference","author":"Chaslot Guillaume","year":"2008","unstructured":"Guillaume Chaslot, Sander Bakkes, Istvan Szita, and Pieter Spronck. 2008. Monte-Carlo tree search: A new framework for game AI. In Proceedings of the 4th Artificial Intelligence and Interactive Digital Entertainment Conference."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401200"},{"key":"e_1_3_2_29_2","volume-title":"WSDM\u201919","author":"Chen Minmin","year":"2019","unstructured":"Minmin Chen, Alex Beutel, Paul Covington, Sagar Jain, Francois Belletti, and Ed H. Chi. 2019. Top-K off-policy correction for a REINFORCE recommender system. In WSDM\u201919."},{"key":"e_1_3_2_30_2","volume-title":"SIGIR\u201908","author":"Clarke Charles L. A.","year":"2008","unstructured":"Charles L. A. Clarke, Maheedhar Kolla, Gordon V. Cormack, Olga Vechtomova, Azin Ashkan, Stefan B\u00fcttcher, and Ian MacKinnon. 2008. Novelty and diversity in information retrieval evaluation. In SIGIR\u201908."},{"key":"e_1_3_2_31_2","volume-title":"SIGIR\u201907","author":"Craswell Nick","year":"2007","unstructured":"Nick Craswell and Martin Szummer. 2007. Random walks on the click graph. In SIGIR\u201907."},{"key":"e_1_3_2_32_2","doi-asserted-by":"crossref","unstructured":"Jeffrey Dalton Chenyan Xiong and Jamie Callan. 2020. TREC CAsT 2019: The conversational assistance track overview. In TREC\u201919 .","DOI":"10.6028\/NIST.SP.1266.cast-overview"},{"key":"e_1_3_2_33_2","volume-title":"ICLR\u201919","author":"Das Rajarshi","year":"2019","unstructured":"Rajarshi Das, Shehzaad Dhuliawala, Manzil Zaheer, and Andrew McCallum. 2019. Multi-step retriever-reader interaction for scalable open-domain question answering. In ICLR\u201919."},{"key":"e_1_3_2_34_2","volume-title":"CIKM\u201917","author":"Dehghani Mostafa","year":"2017","unstructured":"Mostafa Dehghani, Sascha Rothe, Enrique Alfonseca, and Pascal Fleury. 2017. Learning to attend, copy, and generate for session-based query suggestion. In CIKM\u201917."},{"key":"e_1_3_2_35_2","volume-title":"ICML\u201911","author":"Deisenroth Marc Peter","year":"2011","unstructured":"Marc Peter Deisenroth and Carl Edward Rasmussen. 2011. PILCO: A model-based and data-efficient approach to policy search. In ICML\u201911."},{"key":"e_1_3_2_36_2","volume-title":"ACL\u201917","author":"Dhingra Bhuwan","year":"2017","unstructured":"Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, and Li Deng. 2017. Towards end-to-end reinforcement learning of dialogue agents for information access. In ACL\u201917."},{"key":"e_1_3_2_37_2","volume-title":"TREC\u201905","author":"Dumais Susan","year":"2005","unstructured":"Susan Dumais and Nicholas J. Belkin. 2005. The TREC interactive tracks: Putting the user into search. In TREC\u201905."},{"key":"e_1_3_2_38_2","volume-title":"TREC\u201914","author":"Feild Henry","year":"2014","unstructured":"Henry Feild. 2014. Endicott college at 2014 TREC session track. In TREC\u201914."},{"key":"e_1_3_2_39_2","volume-title":"SIGIR\u201918","author":"Feng Yue","year":"2018","unstructured":"Yue Feng, Jun Xu, Yanyan Lan, Jiafeng Guo, Wei Zeng, and Xueqi Cheng. 2018. From greedy selection to exploratory decision-making: Diverse ranking with policy-value networks. In SIGIR\u201918."},{"issue":"2","key":"e_1_3_2_40_2","article-title":"Neural approaches to conversational AI","volume":"13","author":"Gao Jianfeng","year":"2019","unstructured":"Jianfeng Gao, Michel Galley, and Lihong Li. 2019. Neural approaches to conversational AI. Found. Trends Inf. Retriev. 13, 2\u20133 (2019), 127\u2013298.","journal-title":"Found. Trends Inf. Retriev."},{"key":"e_1_3_2_41_2","volume-title":"CIKM\u201918","author":"Geyik Sahin Cem","year":"2018","unstructured":"Sahin Cem Geyik, Vijay Dialani, Meng Meng, and Ryan Smith. 2018. In-session personalization for talent search. In CIKM\u201918."},{"key":"e_1_3_2_42_2","volume-title":"SIGIR\u201913","author":"Guan Dongyi","year":"2013","unstructured":"Dongyi Guan, Sicong Zhang, and Hui Yang. 2013. Utilizing query change for session search. In SIGIR\u201913."},{"key":"e_1_3_2_43_2","volume-title":"TREC\u201913","author":"Hagen Matthias","year":"2013","unstructured":"Matthias Hagen, Michael V\u00f6lske, Jakob Gomoll, Marie Bornemann, Lene Ganschow, Florian Kneist, Abdul Hamid Sabri, and Benno Stein. 2013. Webis at TREC 2013-session and web track. In TREC\u201913."},{"key":"e_1_3_2_44_2","volume-title":"WWW\u201915","author":"Halfaker Aaron","year":"2015","unstructured":"Aaron Halfaker, Oliver Keyes, Daniel Kluver, Jacob Thebault-Spieker, Tien T. Nguyen, Kenneth Shores, Anuradha Uduwage, and Morten Warncke-Wang. 2015. User session identification based on strong regularities in inter-activity time. In WWW\u201915."},{"key":"e_1_3_2_45_2","volume-title":"TREC\u201900","author":"Hawking David","year":"2000","unstructured":"David Hawking. 2000. Overview of the TREC-9 web track. In TREC\u201900."},{"key":"e_1_3_2_46_2","volume-title":"TREC\u201911","author":"He Jiyin","year":"2011","unstructured":"Jiyin He, Vera Hollink, Corrado Boscarino, Arjen P. de Vries, and Roberto Cornacchia. 2011. CWI at TREC 2011: Session, web, and medical. In TREC\u201911."},{"key":"e_1_3_2_47_2","volume-title":"SIGIR\u201907","author":"Huffman Scott B.","year":"2007","unstructured":"Scott B. Huffman and Michael Hochster. 2007. How well does result relevance predict session satisfaction? In SIGIR\u201907."},{"key":"e_1_3_2_48_2","volume-title":"TREC\u201911","author":"Huurnink Bouke","year":"2011","unstructured":"Bouke Huurnink, Richard Berendsen, Katja Hofmann, Edgar Meij, and Maarten de Rijke. 2011. The university of amsterdam at the TREC 2011 session track. In TREC\u201911."},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582418"},{"key":"e_1_3_2_50_2","volume-title":"ECIR\u201908","author":"J\u00e4rvelin Kalervo","year":"2008","unstructured":"Kalervo J\u00e4rvelin, Susan L. Price, Lois M. L. Delcambre, and Marianne Lykke Nielsen. 2008. Discounted cumulated gain based evaluation of multiple-query IR sessions. In ECIR\u201908."},{"key":"e_1_3_2_51_2","unstructured":"Zongcheng Ji Zhengdong Lu and Hang Li. 2014. An information retrieval approach to short text conversation. CoRR abs\/1408.6988 (2014). http:\/\/arxiv.org\/abs\/1408.6988"},{"key":"e_1_3_2_52_2","volume-title":"TREC\u201913","author":"Jiang Jiepu","year":"2013","unstructured":"Jiepu Jiang and Daqing He. 2013. Pitt at TREC 2013: Different effects of click-through and past queries on whole-session search performance. In TREC\u201913."},{"key":"e_1_3_2_53_2","volume-title":"TREC\u201912","author":"Jiang Jiepu","year":"2012","unstructured":"Jiepu Jiang, Daqing He, and Shuguang Han. 2012. On duplicate results in a search session. In TREC\u201912."},{"key":"e_1_3_2_54_2","volume-title":"WWW\u201913","author":"Jin Xiaoran","year":"2013","unstructured":"Xiaoran Jin, Marc Sloan, and Jun Wang. 2013. Interactive exploratory search for multi page search results. In WWW\u201913."},{"key":"e_1_3_2_55_2","doi-asserted-by":"crossref","DOI":"10.1145\/1460007","volume-title":"CIKM\u201908","author":"Jones Rosie","year":"2008","unstructured":"Rosie Jones and Kristina Lisa Klinkner. 2008. Beyond the session timeout: Automatic hierarchical segmentation of search topics in query logs. In CIKM\u201908."},{"key":"e_1_3_2_56_2","volume-title":"CLEF\u201918","author":"Kanoulas Evangelos","year":"2018","unstructured":"Evangelos Kanoulas, Leif Azzopardi, and Grace Hui Yang. 2018. Overview of the CLEF dynamic search evaluation lab 2018. In CLEF\u201918."},{"key":"e_1_3_2_57_2","volume-title":"TREC\u201911","author":"Kanoulas Evangelos","year":"2011","unstructured":"Evangelos Kanoulas, Ben Carterette, Mark Hall, Paul Clough, and Mark Sanderson. 2011. Overview of the TREC 2011 session track. In TREC\u201911."},{"key":"e_1_3_2_58_2","volume-title":"TREC\u201912","author":"Kanoulas Evangelos","year":"2012","unstructured":"Evangelos Kanoulas, Ben Carterette, Mark Hall, Paul Clough, and Mark Sanderson. 2012. Overview of the TREC 2012 session track. In TREC\u201912."},{"key":"e_1_3_2_59_2","volume-title":"TREC\u201910","author":"Kanoulas Evangelos","year":"2010","unstructured":"Evangelos Kanoulas, Paul D. Clough, Ben Carterette, and Mark Sanderson. 2010. Session track at TREC 2010. In TREC\u201910."},{"key":"e_1_3_2_60_2","doi-asserted-by":"crossref","unstructured":"David B. D\u2019Ambrosio Kenneth O. Stanley and Jason Gauci. 2009. A hypercube-based indirect encoding for evolving large-scale neural networks. Artificial Life 15 2 (2009) 185\u2013212.","DOI":"10.1162\/artl.2009.15.2.15202"},{"key":"e_1_3_2_61_2","unstructured":"Joel Lehman Kenneth O. Stanley and Lisa Soros. 2017. Open-endedness: The last grand challenge you\u2019ve never heard of O\u2019Reilly Online (2017). https:\/\/www.oreilly.com\/radar\/open-endedness-the-last-grand-challenge-youve-neverheard-of\/."},{"key":"e_1_3_2_62_2","unstructured":"Tom Kenter and Maarten de Rijke. 2017. Attentive memory networks: Efficient machine reading for conversational search. CoRR abs\/1712.07229 (2017). http:\/\/arxiv.org\/abs\/1712.07229"},{"key":"e_1_3_2_63_2","volume-title":"TREC\u201910","author":"King Benjamin","year":"2010","unstructured":"Benjamin King and Ivan Provalov. 2010. Cengage learning at the TREC 2010 session track. In TREC\u201910."},{"key":"e_1_3_2_64_2","unstructured":"W. B. Langdon. 2005. Pfeiffer\u2014A distributed open-ended evolutionary system. In AISB\u201905 ."},{"key":"e_1_3_2_65_2","volume-title":"SIGIR\u201901","author":"Lavrenko Victor","year":"2001","unstructured":"Victor Lavrenko and W. Bruce Croft. 2001. Relevance-based language models. In SIGIR\u201901."},{"key":"e_1_3_2_66_2","volume-title":"CIKM\u201900","author":"Leuski Anton","year":"2000","unstructured":"Anton Leuski. 2000. Relevance and reinforcement in interactive browsing. In CIKM\u201900."},{"key":"e_1_3_2_67_2","volume-title":"SIGIR\u201917","author":"Levine Nir","year":"2017","unstructured":"Nir Levine, Haggai Roitman, and Doron Cohen. 2017. An extended relevance model for session search. In SIGIR\u201917."},{"key":"e_1_3_2_68_2","volume-title":"ICML\u201913","author":"Levine Sergey","year":"2013","unstructured":"Sergey Levine and Vladlen Koltun. 2013. Guided policy search. In ICML\u201913."},{"key":"e_1_3_2_69_2","volume-title":"CIKM\u201916","author":"Li Cheng","year":"2016","unstructured":"Cheng Li, Paul Resnick, and Qiaozhu Mei. 2016. Multiple queries as bandit arms. In CIKM\u201916."},{"key":"e_1_3_2_70_2","volume-title":"ACL\u201916","author":"Li Jiwei","year":"2016","unstructured":"Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, and William B. Dolan. 2016. A persona-based neural conversation model. In ACL\u201916."},{"key":"e_1_3_2_71_2","volume-title":"EMNLP\u201916","author":"Li Jiwei","year":"2016","unstructured":"Jiwei Li, Will Monroe, Alan Ritter, Dan Jurafsky, Michel Galley, and Jianfeng Gao. 2016. Deep reinforcement learning for dialogue generation. In EMNLP\u201916."},{"key":"e_1_3_2_72_2","volume-title":"WWW\u201910","author":"Li Lihong","year":"2010","unstructured":"Lihong Li, Wei Chu, John Langford, and Robert E. Schapire. 2010. A contextual-bandit approach to personalized news article recommendation. In WWW\u201910."},{"key":"e_1_3_2_73_2","volume-title":"ICLR\u201916","author":"Lillicrap Timothy P.","year":"2016","unstructured":"Timothy P. Lillicrap, Jonathan J. Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2016. Continuous control with deep reinforcement learning. In ICLR\u201916."},{"key":"e_1_3_2_74_2","volume-title":"SIGIR\u201912","author":"Liu Chang","year":"2012","unstructured":"Chang Liu, Nicholas J. Belkin, and Michael J. Cole. 2012. Personalization of search results using interaction behaviors in search sessions. In SIGIR\u201912."},{"key":"e_1_3_2_75_2","volume-title":"TREC\u201912","author":"Liu Chang","year":"2012","unstructured":"Chang Liu, Michael J. Cole, Eun Baik, and Nicholas J. Belkin. 2012. Rutgers at the TREC 2012 session track. In TREC\u201912."},{"key":"e_1_3_2_76_2","volume-title":"SIGIR\u201918","author":"Liu Mengyang","year":"2018","unstructured":"Mengyang Liu, Yiqun Liu, Jiaxin Mao, Cheng Luo, and Shaoping Ma. 2018. Towards designing better session search evaluation metrics. In SIGIR\u201918."},{"key":"e_1_3_2_77_2","volume-title":"TREC\u201911","author":"Liu Wenfei","year":"2011","unstructured":"Wenfei Liu, Hongfei Lin, Yunlong Ma, and Tianshu Chang. 2011. DUTIR at the session track in TREC 2011. In TREC\u201911."},{"key":"e_1_3_2_78_2","volume-title":"WSDM\u201911","author":"Lucchese Claudio","year":"2011","unstructured":"Claudio Lucchese, Salvatore Orlando, Raffaele Perego, Fabrizio Silvestri, and Gabriele Tolomei. 2011. Identifying task-based sessions in search engine query logs. In WSDM\u201911."},{"key":"e_1_3_2_79_2","volume-title":"ICTIR\u201915","author":"Luo Jiyun","year":"2015","unstructured":"Jiyun Luo, Xuchu Dong, and Hui Yang. 2015. Session search by direct policy learning. In ICTIR\u201915."},{"key":"e_1_3_2_80_2","volume-title":"CIKM\u201913","author":"Luo Jiyun","year":"2013","unstructured":"Jiyun Luo, Christopher Wing, Hui Yang, and Marti A. Hearst. 2013. The water filling model and the cube test: Multi-dimensional evaluation for professional search. In CIKM\u201913."},{"key":"e_1_3_2_81_2","volume-title":"SIGIR\u201914","author":"Luo Jiyun","year":"2014","unstructured":"Jiyun Luo, Sicong Zhang, and Hui Yang. 2014. Win-win search: Dual-agent stochastic game in session search. In SIGIR\u201914."},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/1121949.1121979"},{"key":"e_1_3_2_83_2","volume-title":"CIKM\u201918","author":"Medlar Alan","year":"2018","unstructured":"Alan Medlar and Dorota Glowacka. 2018. How consistent is relevance feedback in exploratory search? In CIKM\u201918."},{"issue":"42","key":"e_1_3_2_84_2","first-page":"17","article-title":"Reversal theory: A new approach to motivation, emotion and personality","author":"Michael J.","year":"1989","unstructured":"J. Michael et\u00a0al. 1989. Reversal theory: A new approach to motivation, emotion and personality. UB J. Psychol.42, 3 (1989), 17\u201329.","journal-title":"UB J. Psychol."},{"key":"e_1_3_2_85_2","volume-title":"NIPS\u201913","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov, Ilya Sutskever, Kai Chen, Gregory S. Corrado, and Jeffrey Dean. 2013. Distributed representations of words and phrases and their compositionality. In NIPS\u201913."},{"key":"e_1_3_2_86_2","volume-title":"SIGIR\u201915","author":"Mitra Bhaskar","year":"2015","unstructured":"Bhaskar Mitra. 2015. Exploring session context using distributed representations of queries and reformulations. In SIGIR\u201915."},{"key":"e_1_3_2_87_2","volume-title":"ICML\u201916","author":"Mnih Volodymyr","year":"2016","unstructured":"Volodymyr Mnih, Adri\u00e0 Puigdom\u00e8nech Badia, Mehdi Mirza, Alex Graves, Timothy P. Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. 2016. Asynchronous methods for deep reinforcement learning. In ICML\u201916."},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"issue":"2","key":"e_1_3_2_89_2","article-title":"Autopoiesis, the immune system, and adaptive information filtering","volume":"8","author":"Nanas Nikolaos","year":"2009","unstructured":"Nikolaos Nanas and Anne N. De Roeck. 2009. Autopoiesis, the immune system, and adaptive information filtering. Natur. Comput. 8, 2 (2009).","journal-title":"Natur. Comput."},{"key":"e_1_3_2_90_2","volume-title":"EMNLP\u201917","author":"Nogueira Rodrigo","year":"2017","unstructured":"Rodrigo Nogueira and Kyunghyun Cho. 2017. Task-oriented query reformulation with reinforcement learning. In EMNLP\u201917."},{"issue":"1","key":"e_1_3_2_91_2","article-title":"An algorithmic perspective on imitation learning","volume":"7","author":"Osa Takayuki","year":"2018","unstructured":"Takayuki Osa, Joni Pajarinen, Gerhard Neumann, J. Andrew Bagnell, Pieter Abbeel, and Jan Peters. 2018. An algorithmic perspective on imitation learning. Found. Trends Robot. 7, 1-2 (2018).","journal-title":"Found. Trends Robot."},{"key":"e_1_3_2_92_2","volume-title":"TREC\u201998","author":"Over Paul","year":"1998","unstructured":"Paul Over. 1998. TREC-7 interactive track report. In TREC\u201998."},{"key":"e_1_3_2_93_2","volume-title":"CIKM\u201911","author":"Ozertem Umut","year":"2011","unstructured":"Umut Ozertem, Emre Velipasaoglu, and Larry Lai. 2011. Suggestion set utility maximization using session logs. In CIKM\u201911."},{"key":"e_1_3_2_94_2","volume-title":"CIKM\u201918","author":"Patidar Mayur","year":"2018","unstructured":"Mayur Patidar, Puneet Agarwal, Lovekesh Vig, and Gautam Shroff. 2018. Automatic conversational helpdesk solution using Seq2Seq and slot-filling models. In CIKM\u201918."},{"key":"e_1_3_2_95_2","volume-title":"ACL\u201918","author":"Qiu Minghui","year":"2018","unstructured":"Minghui Qiu, Liu Yang, Feng Ji, Wei Zhou, Jun Huang, Haiqing Chen, W. Bruce Croft, and Wei Lin. 2018. Transfer learning for context-aware question matching in information-seeking conversations in E-commerce. In ACL\u201918."},{"key":"e_1_3_2_96_2","volume-title":"CHIIR\u201917","author":"Radlinski Filip","year":"2017","unstructured":"Filip Radlinski and Nick Craswell. 2017. A theoretical framework for conversational search. In CHIIR\u201917."},{"key":"e_1_3_2_97_2","unstructured":"Ashwin Ram Rohit Prasad Chandra Khatri Anu Venkatesh Raefer Gabriel Qing Liu Jeff Nunn Behnam Hedayatnia Ming Cheng Ashish Nagar Eric King Kate Bland Amanda Wartick Yi Pan Han Song Sk Jayadevan Gene Hwang and Art Pettigrue. 2018. Conversational AI: The science behind the alexa prize. CoRR abs\/1801.03604 (2018). http:\/\/arxiv.org\/abs\/1801.03604"},{"key":"e_1_3_2_98_2","volume-title":"SIGIR\u201913","author":"Raman Karthik","year":"2013","unstructured":"Karthik Raman, Paul N. Bennett, and Kevyn Collins-Thompson. 2013. Toward whole-session relevance: Exploring intrinsic diversity in web search. In SIGIR\u201913."},{"key":"e_1_3_2_99_2","volume-title":"WWW\u201918","author":"Ren Gary","year":"2018","unstructured":"Gary Ren, Xiaochuan Ni, Manish Malik, and Qifa Ke. 2018. Conversational query understanding using sequence to sequence modeling. In WWW\u201918."},{"issue":"3","key":"e_1_3_2_100_2","article-title":"Relevance weighting of search terms","volume":"27","author":"Robertson Stephen E.","year":"1976","unstructured":"Stephen E. Robertson and Karen Sp\u00e4rck Jones. 1976. Relevance weighting of search terms. J. Assoc. Inf. Sci. Technol. 27, 3 (1976), 129\u2013146.","journal-title":"J. Assoc. Inf. Sci. Technol."},{"issue":"4","key":"e_1_3_2_101_2","article-title":"The probabilistic relevance framework: BM25 and beyond","volume":"3","author":"Robertson Stephen E.","year":"2009","unstructured":"Stephen E. Robertson and Hugo Zaragoza. 2009. The probabilistic relevance framework: BM25 and beyond. Found. Trends Inf. Retriev. 3, 4 (2009), 333\u2013389.","journal-title":"Found. Trends Inf. Retriev."},{"key":"e_1_3_2_102_2","article-title":"Relevance feedback in information retrieval","author":"Rocchio Joseph John","year":"1971","unstructured":"Joseph John Rocchio. 1971. Relevance feedback in information retrieval. The SMART Retrieval System: Experiments in Automatic Document Processing. Prentice-Hall Inc., 313\u2013323.","journal-title":"The SMART Retrieval System: Experiments in Automatic Document Processing"},{"key":"e_1_3_2_103_2","unstructured":"St\u00e9phane Ross Geoffrey J. Gordon and J. Andrew Bagnell. 2010. No-regret reductions for imitation learning and structured prediction. CoRR abs\/1011.0686 (2010). http:\/\/arxiv.org\/abs\/1011.0686."},{"key":"e_1_3_2_104_2","doi-asserted-by":"publisher","DOI":"10.1002\/aris.2008.1440420109"},{"key":"e_1_3_2_105_2","volume-title":"SIGIR\u201913","author":"Sakai Tetsuya","year":"2013","unstructured":"Tetsuya Sakai and Zhicheng Dou. 2013. Summaries, ranked retrieval and sessions: A unified framework for information access evaluation. In SIGIR\u201913."},{"key":"e_1_3_2_106_2","volume-title":"ICML\u201915","author":"Schulman John","year":"2015","unstructured":"John Schulman, Sergey Levine, Pieter Abbeel, Michael I. Jordan, and Philipp Moritz. 2015. Trust region policy optimization. In ICML\u201915."},{"key":"e_1_3_2_107_2","unstructured":"John Schulman Filip Wolski Prafulla Dhariwal Alec Radford and Oleg Klimov. 2017. Proximal policy optimization algorithms. CoRR abs\/1707.06347 (2017). http:\/\/arxiv.org\/abs\/1707.06347."},{"key":"e_1_3_2_108_2","volume-title":"AAAI\u201916","author":"Serban Iulian Vlad","year":"2016","unstructured":"Iulian Vlad Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C. Courville, and Joelle Pineau. 2016. Building end-to-end dialogue systems using generative hierarchical neural network models. In AAAI\u201916."},{"key":"e_1_3_2_109_2","volume-title":"SIGIR\u201918","author":"Shalaby Walid","year":"2018","unstructured":"Walid Shalaby and Wlodek Zadrozny. 2018. Toward an interactive patent retrieval framework based on distributed representations. In SIGIR\u201918."},{"key":"e_1_3_2_110_2","volume-title":"ACL\u201915","author":"Shang Lifeng","year":"2015","unstructured":"Lifeng Shang, Zhengdong Lu, and Hang Li. 2015. Neural responding machine for short-text conversation. In ACL\u201915."},{"key":"e_1_3_2_111_2","volume-title":"WWW\u201914","author":"Shen Yelong","year":"2014","unstructured":"Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, and Gr\u00e9goire Mesnil. 2014. Learning semantic representations using convolutional neural networks for web search. In WWW\u201914."},{"key":"e_1_3_2_112_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature16961"},{"key":"e_1_3_2_113_2","volume-title":"SIGIR\u201912","author":"Smucker Mark D.","year":"2012","unstructured":"Mark D. Smucker and Charles L. A. Clarke. 2012. Time-based calibration of effectiveness measures. In SIGIR\u201912."},{"key":"e_1_3_2_114_2","doi-asserted-by":"crossref","unstructured":"Alessandro Sordoni Yoshua Bengio Hossein Vahabi Christina Lioma Jakob Grue Simonsen and Jian-Yun Nie. 2015. A hierarchical recurrent encoder-decoder for generative context-aware query suggestion. In CIKM\u201915 .","DOI":"10.1145\/2806416.2806493"},{"key":"e_1_3_2_115_2","volume-title":"NAACL HLT\u201915","author":"Sordoni Alessandro","year":"2015","unstructured":"Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Margaret Mitchell, Jian-Yun Nie, Jianfeng Gao, and Bill Dolan. 2015. A neural network approach to context-sensitive generation of conversational responses. In NAACL HLT\u201915."},{"key":"e_1_3_2_116_2","doi-asserted-by":"crossref","unstructured":"Russell K. Standish. 2003. Open-ended artificial evolution. International Journal of Computational Intelligence and Applications 3 2 (2003) 167\u2013175.","DOI":"10.1142\/S1469026803000914"},{"key":"e_1_3_2_117_2","doi-asserted-by":"publisher","DOI":"10.5555\/551283"},{"key":"e_1_3_2_118_2","volume-title":"ICTIR\u201917","author":"Tang Zhiwen","year":"2017","unstructured":"Zhiwen Tang and Grace Hui Yang. 2017. Investigating per topic upper bound for session search evaluation. In ICTIR\u201917."},{"key":"e_1_3_2_119_2","volume-title":"TREC\u201917","author":"Tang Zhiwen","year":"2017","unstructured":"Zhiwen Tang and Grace Hui Yang. 2017. A reinforcement learning approach for dynamic search. In TREC\u201917."},{"key":"e_1_3_2_120_2","volume-title":"SIGIR\u201911","author":"Tian Aibo","year":"2011","unstructured":"Aibo Tian and Matthew Lease. 2011. Active learning to maximize accuracy vs. effort in interactive information retrieval. In SIGIR\u201911."},{"key":"e_1_3_2_121_2","volume-title":"ACL\u201917","author":"Tian Zhiliang","year":"2017","unstructured":"Zhiliang Tian, Rui Yan, Lili Mou, Yiping Song, Yansong Feng, and Dongyan Zhao. 2017. How to make context more useful? An empirical study on context-aware neural conversational models. In ACL\u201917."},{"key":"e_1_3_2_122_2","volume-title":"NIPS\u201917","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In NIPS\u201917."},{"key":"e_1_3_2_123_2","unstructured":"Oriol Vinyals and Quoc V. Le. 2015. A neural conversational model. CoRR abs\/1506.05869 (2015). http:\/\/arxiv.org\/abs\/1506.05869."},{"key":"e_1_3_2_124_2","volume-title":"TREC\u201902","author":"Voorhees Ellen M.","year":"2002","unstructured":"Ellen M. Voorhees. 2002. Overview of TREC 2002. In TREC\u201902."},{"key":"e_1_3_2_125_2","volume-title":"TREC\u201904","author":"Voorhees Ellen M.","year":"2004","unstructured":"Ellen M. Voorhees. 2004. Overview of the TREC 2004 robust track. In TREC\u201904."},{"key":"e_1_3_2_126_2","volume-title":"WWW\u201913","author":"Wang Hongning","year":"2013","unstructured":"Hongning Wang, Yang Song, Ming-Wei Chang, Xiaodong He, Ryen W. White, and Wei Chu. 2013. Learning to extract cross-session search tasks. In WWW\u201913."},{"key":"e_1_3_2_127_2","volume-title":"AAAI\u201917","author":"Wang Huazheng","year":"2017","unstructured":"Huazheng Wang, Qingyun Wu, and Hongning Wang. 2017. Factorization bandits for interactive recommendation. In AAAI\u201917."},{"key":"e_1_3_2_128_2","unstructured":"Rui Wang Joel Lehman Jeff Clune and Kenneth O. Stanley. 2019. Paired open-ended trailblazer (POET): Endlessly generating increasingly complex and diverse learning environments and their solutions. CoRR abs\/1901.01753 (2019). http:\/\/arxiv.org\/abs\/1901.01753."},{"key":"e_1_3_2_129_2","unstructured":"Rui Wang Joel Lehman Jeff Clune and Kenneth O. Stanley. 2019. Paired open-ended trailblazer (POET): Endlessly generating increasingly complex and diverse learning environments and their solutions. CoRR abs\/1901.01753 (2019). http:\/\/arxiv.org\/abs\/1901.01753."},{"key":"e_1_3_2_130_2","doi-asserted-by":"crossref","unstructured":"Rui Wang Joel Lehman Aditya Rawal Jiale Zhi Yulun Li Jeff Clune and Kenneth O. Stanley. 2020. Enhanced POET: Open-ended reinforcement learning through unbounded invention of learning challenges and their solutions. In ICML\u201920 .","DOI":"10.1145\/3321707.3321799"},{"key":"e_1_3_2_131_2","volume-title":"WSDM\u201918","author":"Wang Sheng","year":"2018","unstructured":"Sheng Wang, Zhifeng Bao, Shixun Huang, and Rui Zhang. 2018. A unified processing paradigm for interactive location-based web search. In WSDM\u201918."},{"key":"e_1_3_2_132_2","doi-asserted-by":"publisher","DOI":"10.1145\/365153.365168"},{"issue":"4","key":"e_1_3_2_133_2","article-title":"Supporting exploratory search, introduction, special issue, communications of the ACM","volume":"49","author":"White Ryen W.","year":"2006","unstructured":"Ryen W. White, Bill Kules, Steven M. Drucker, et\u00a0al. 2006. Supporting exploratory search, introduction, special issue, communications of the ACM. Commun. ACM 49, 4 (2006), 36\u201339.","journal-title":"Commun. ACM"},{"key":"e_1_3_2_134_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992696"},{"key":"e_1_3_2_135_2","volume-title":"ACL\u201917","author":"Wu Yu","year":"2017","unstructured":"Yu Wu, Wei Wu, Chen Xing, Ming Zhou, and Zhoujun Li. 2017. Sequential matching network: A new architecture for multi-turn response selection in retrieval-based chatbots. In ACL\u201917."},{"key":"e_1_3_2_136_2","volume-title":"TREC\u201914","author":"Xue Yuanhai","year":"2014","unstructured":"Yuanhai Xue, Guoxin Cui, Xiaoming Yu, Yue Liu, and Xueqi Cheng. 2014. ICTNET at session track TREC2014. In TREC\u201914."},{"key":"e_1_3_2_137_2","volume-title":"SIGIR\u201916","author":"Yan Rui","year":"2016","unstructured":"Rui Yan, Yiping Song, and Hua Wu. 2016. Learning to respond with deep neural networks for retrieval-based human-computer conversation system. In SIGIR\u201916."},{"key":"e_1_3_2_138_2","volume-title":"ICTIR\u201917","author":"Yang Angela","year":"2017","unstructured":"Angela Yang and Grace Hui Yang. 2017. A contextual bandit approach to dynamic search. In ICTIR\u201917."},{"key":"e_1_3_2_139_2","doi-asserted-by":"publisher","DOI":"10.5555\/3055857"},{"key":"e_1_3_2_140_2","volume-title":"TREC\u201916","author":"Yang Grace Hui","year":"2016","unstructured":"Grace Hui Yang and Ian Soboroff. 2016. TREC\u201916 dynamic domain track overview. In TREC\u201916."},{"key":"e_1_3_2_141_2","volume-title":"TREC\u201917","author":"Yang Grace Hui","year":"2017","unstructured":"Grace Hui Yang, Zhiwen Tang, and Ian Soboroff. 2017. TREC\u201917 dynamic domain track overview. In TREC\u201917."},{"key":"e_1_3_2_142_2","volume-title":"TREC\u201915","author":"Yang Hui","year":"2015","unstructured":"Hui Yang, John Frank, and Ian Soboroff. 2015. TREC\u201915 dynamic domain track overview. In TREC\u201915."},{"key":"e_1_3_2_143_2","volume-title":"SIGIR\u201914","author":"Yang Hui","year":"2014","unstructured":"Hui Yang, Marc Sloan, and Jun Wang. 2014. Dynamic information retrieval modeling. In SIGIR\u201914."},{"key":"e_1_3_2_144_2","volume-title":"SIGIR\u201918","author":"Yang Liu","year":"2018","unstructured":"Liu Yang, Minghui Qiu, Chen Qu, Jiafeng Guo, Yongfeng Zhang, W. Bruce Croft, Jun Huang, and Haiqing Chen. 2018. Response ranking with deep matching networks and external knowledge in information-seeking conversation systems. In SIGIR\u201918."},{"key":"e_1_3_2_145_2","volume-title":"CIKM\u201918","author":"Yang Yunlun","year":"2018","unstructured":"Yunlun Yang, Yu Gong, and Xi Chen. 2018. Query tracking for e-commerce conversational search: A machine comprehension perspective. In CIKM\u201918."},{"key":"e_1_3_2_146_2","volume-title":"ICTIR\u201909","author":"Yang Yiming","year":"2009","unstructured":"Yiming Yang and Abhimanyu Lad. 2009. Modeling expected utility of multi-session information distillation. In ICTIR\u201909."},{"key":"e_1_3_2_147_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380294"},{"key":"e_1_3_2_148_2","volume-title":"TREC\u201912","author":"Yuan Xiaojun","year":"2012","unstructured":"Xiaojun Yuan, Jingling Liu, and Ning Sa. 2012. U. Albany & USC at the TREC 2012 session track. In TREC\u201912."},{"key":"e_1_3_2_149_2","volume-title":"TREC\u201912","author":"Zhang Chuang","year":"2012","unstructured":"Chuang Zhang, Xiaotian Wang, Songlin Wen, and Runze Li. 2012. BUPT_PRIS at TREC 2012 session track. In TREC\u201912."},{"key":"e_1_3_2_150_2","volume-title":"CIKM\u201918","author":"Zhang Yongfeng","year":"2018","unstructured":"Yongfeng Zhang, Xu Chen, Qingyao Ai, Liu Yang, and W. Bruce Croft. 2018. Towards conversational search and recommendation: System ask, user respond. In CIKM\u201918."},{"key":"e_1_3_2_151_2","volume-title":"SIGIR\u201916","author":"Zhang Yinan","year":"2016","unstructured":"Yinan Zhang and ChengXiang Zhai. 2016. A sequential decision formulation of the interface card model for interactive IR. In SIGIR\u201916."},{"key":"e_1_3_2_152_2","volume-title":"WWW\u201918","author":"Zheng Guanjie","year":"2018","unstructured":"Guanjie Zheng, Fuzheng Zhang, Zihan Zheng, Yang Xiang, Nicholas Jing Yuan, Xing Xie, and Zhenhui Li. 2018. DRN: A deep reinforcement learning framework for news recommendation. In WWW\u201918."},{"key":"e_1_3_2_153_2","volume-title":"EMNLP\u201916","author":"Zhou Xiangyang","year":"2016","unstructured":"Xiangyang Zhou, Daxiang Dong, Hua Wu, Shiqi Zhao, Dianhai Yu, Hao Tian, Xuan Liu, and Rui Yan. 2016. Multi-view response selection for human-computer conversation. In EMNLP\u201916."}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3497875","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3497875","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:04Z","timestamp":1750188604000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3497875"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,9]]},"references-count":152,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,10,31]]}},"alternative-id":["10.1145\/3497875"],"URL":"https:\/\/doi.org\/10.1145\/3497875","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"type":"print","value":"1046-8188"},{"type":"electronic","value":"1558-2868"}],"subject":[],"published":{"date-parts":[[2022,3,9]]},"assertion":[{"value":"2020-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}