{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T03:49:40Z","timestamp":1775533780933,"version":"3.50.1"},"publisher-location":"New York, New York, USA","reference-count":31,"publisher":"ACM Press","license":[{"start":{"date-parts":[[2018,1,1]],"date-time":"2018-01-01T00:00:00Z","timestamp":1514764800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018]]},"DOI":"10.1145\/3178876.3186065","type":"proceedings-article","created":{"date-parts":[[2018,4,13]],"date-time":"2018-04-13T15:53:48Z","timestamp":1523634828000},"page":"1533-1542","source":"Crossref","is-referenced-by-count":29,"title":["\"Satisfaction with Failure\" or \"Unsatisfied Success\""],"prefix":"10.1145","author":[{"given":"Mengyang","family":"Liu","sequence":"first","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yiqun","family":"Liu","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiaxin","family":"Mao","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheng","family":"Luo","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Min","family":"Zhang","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shaoping","family":"Ma","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","reference":[{"key":"key-10.1145\/3178876.3186065-1","doi-asserted-by":"crossref","unstructured":"Mikhail Ageev, Qi Guo, Dmitry Lagun, and Eugene Agichtein . 2011. Find it if you can: a game for modeling different types of web search success using interaction data. In Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, July 25--29, 2011. 345--354. https:\/\/doi.org\/10.1145\/2009916.2009965","DOI":"10.1145\/2009916.2009965"},{"key":"key-10.1145\/3178876.3186065-2","doi-asserted-by":"crossref","unstructured":"Azzah Al-Maskari, Mark Sanderson, and Paul D. Clough . 2007. The relationship between IR effectiveness measures and user satisfaction SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23--27, 2007. 773--774. https:\/\/doi.org\/10.1145\/1277741.1277902","DOI":"10.1145\/1277741.1277902"},{"key":"key-10.1145\/3178876.3186065-3","doi-asserted-by":"crossref","unstructured":"Rashid Ali and Mirza Mohd. Sufyan Beg . 2011. An overview of Web search evaluation methods. Computers &#38; Electrical Engineering Vol. 37, 6 (2011), 835--848. https:\/\/doi.org\/10.1016\/j.compeleceng.2011.10.005","DOI":"10.1016\/j.compeleceng.2011.10.005"},{"key":"key-10.1145\/3178876.3186065-4","doi-asserted-by":"crossref","unstructured":"Ahmed Hassan Awadallah, Rosie Jones, and Kristina Lisa Klinkner . 2010. Beyond DCG: user behavior as a predictor of a successful search Proceedings of the Third International Conference on Web Search and Web Data Mining, WSDM 2010, New York, NY, USA, February 4--6, 2010. 221--230. https:\/\/doi.org\/10.1145\/1718487.1718515","DOI":"10.1145\/1718487.1718515"},{"key":"key-10.1145\/3178876.3186065-5","doi-asserted-by":"crossref","unstructured":"Ahmed Hassan Awadallah, Ryen W. White, Susan T. Dumais, and Yi-Min Wang . 2014. Struggling or exploring?: disambiguating long search sessions Seventh ACM International Conference on Web Search and Data Mining, WSDM 2014, New York, NY, USA, February 24--28, 2014. 53--62. https:\/\/doi.org\/10.1145\/2556195.2556221","DOI":"10.1145\/2556195.2556221"},{"key":"key-10.1145\/3178876.3186065-6","doi-asserted-by":"crossref","unstructured":"Charles L. A. Clarke, Maheedhar Kolla, Gordon V. Cormack, Olga Vechtomova, Azin Ashkan, Stefan B&#252;ttcher, and Ian MacKinnon . 2008. Novelty and diversity in information retrieval evaluation Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, Singapore, July 20--24, 2008. 659--666. https:\/\/doi.org\/10.1145\/1390334.1390446","DOI":"10.1145\/1390334.1390446"},{"key":"key-10.1145\/3178876.3186065-7","doi-asserted-by":"crossref","unstructured":"Henry Allen Feild, James Allan, and Rosie Jones . 2010. Predicting searcher frustration. In Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2010, Geneva, Switzerland, July 19--23, 2010. 34--41. https:\/\/doi.org\/10.1145\/1835449.1835458","DOI":"10.1145\/1835449.1835458"},{"key":"key-10.1145\/3178876.3186065-8","doi-asserted-by":"crossref","unstructured":"Steve Fox, Kuldeep Karnawat, Mark Mydland, Susan T. Dumais, and Thomas White . 2005. Evaluating implicit measures to improve web search. ACM Trans. Inf. Syst. Vol. 23, 2 (2005), 147--168. https:\/\/doi.org\/10.1145\/1059981.1059982","DOI":"10.1145\/1059981.1059982"},{"key":"key-10.1145\/3178876.3186065-9","unstructured":"Jerome H Friedman . 2001. Greedy function approximation: a gradient boosting machine. Annals of statistics (2001), 1189--1232."},{"key":"key-10.1145\/3178876.3186065-10","doi-asserted-by":"crossref","unstructured":"Qi Guo, Shuai Yuan, and Eugene Agichtein . 2011. Detecting success in mobile search from interaction Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, July 25--29, 2011. 1229--1230. https:\/\/doi.org\/10.1145\/2009916.2010133","DOI":"10.1145\/2009916.2010133"},{"key":"key-10.1145\/3178876.3186065-11","doi-asserted-by":"crossref","unstructured":"Chathra Hendahewa and Chirag Shah . 2017. Evaluating user search trails in exploratory search tasks. Inf. Process. Manage. Vol. 53, 4 (2017), 905--922. https:\/\/doi.org\/10.1016\/j.ipm.2017.04.001","DOI":"10.1016\/j.ipm.2017.04.001"},{"key":"key-10.1145\/3178876.3186065-12","doi-asserted-by":"crossref","unstructured":"Scott B. Huffman and Michael Hochster . 2007. How well does result relevance predict session satisfaction? SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, July 23--27, 2007. 567--574. https:\/\/doi.org\/10.1145\/1277741.1277839","DOI":"10.1145\/1277741.1277839"},{"key":"key-10.1145\/3178876.3186065-13","unstructured":"Kalervo J\"arvelin, Susan L. Price, Lois M. L. Delcambre, and Marianne Lykke Nielsen . 2008. Discounted Cumulated Gain Based Evaluation of Multiple-Query IR Sessions Advances in Information Retrieval , 30th European Conference on IR Research, ECIR 2008, Glasgow, UK, March 30-April 3, 2008. Proceedings. 4--15. https:\/\/doi.org\/10.1007\/978--3--540--78646--7_4"},{"key":"key-10.1145\/3178876.3186065-14","doi-asserted-by":"crossref","unstructured":"Jiepu Jiang, Ahmed Hassan Awadallah, Xiaolin Shi, and Ryen W. White . 2015. Understanding and Predicting Graded Search Satisfaction Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, WSDM 2015, Shanghai, China, February 2--6, 2015. 57--66. https:\/\/doi.org\/10.1145\/2684822.2685319","DOI":"10.1145\/2684822.2685319"},{"key":"key-10.1145\/3178876.3186065-15","doi-asserted-by":"crossref","unstructured":"Jiepu Jiang, Daqing He, and James Allan . 2017. Comparing In Situ and Multidimensional Relevance Judgments Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7--11, 2017. 405--414. https:\/\/doi.org\/10.1145\/3077136.3080840","DOI":"10.1145\/3077136.3080840"},{"key":"key-10.1145\/3178876.3186065-16","doi-asserted-by":"crossref","unstructured":"Diane Kelly . 2009. Methods for Evaluating Interactive Information Retrieval Systems with Users. Foundations and Trends in Information Retrieval, Vol. 3, 1--2 (2009), 1--224. https:\/\/doi.org\/10.1561\/1500000012","DOI":"10.1561\/1500000012"},{"key":"key-10.1145\/3178876.3186065-17","doi-asserted-by":"crossref","unstructured":"Youngho Kim, Ahmed Hassan Awadallah, Ryen W. White, and Imed Zitouni . 2014. Modeling dwell time to predict click-level satisfaction Seventh ACM International Conference on Web Search and Data Mining, WSDM 2014, New York, NY, USA, February 24--28, 2014. 193--202. https:\/\/doi.org\/10.1145\/2556195.2556220","DOI":"10.1145\/2556195.2556220"},{"key":"key-10.1145\/3178876.3186065-18","unstructured":"J Richard Landis and Gary G Koch . 1977. The measurement of observer agreement for categorical data. biometrics (1977), 159--174."},{"key":"key-10.1145\/3178876.3186065-19","doi-asserted-by":"crossref","unstructured":"Xin Li, Yiqun Liu, Rongjie Cai, and Shaoping Ma . 2017. Investigation of User Search Behavior While Facing Heterogeneous Search Services Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, WSDM 2017, Cambridge, United Kingdom, February 6--10, 2017. 161--170. http:\/\/dl.acm.org\/citation.cfm?id=3018673","DOI":"10.1145\/3018661.3018673"},{"key":"key-10.1145\/3178876.3186065-20","unstructured":"Chang Liu, Jingjing Liu, Michael Cole, Nicholas J Belkin, and Xiangmin Zhang . 2012. Task difficulty and domain knowledge effects on information search behaviors. Proceedings of the Association for Information Science and Technology, Vol. 49, 1 (2012), 1--10."},{"key":"key-10.1145\/3178876.3186065-21","doi-asserted-by":"crossref","unstructured":"Chang Liu, Xiangmin Zhang, and Wei Huang . 2016. The exploration of objective task difficulty and domain knowledge effects on users' query formulation. Proceedings of the Association for Information Science and Technology, Vol. 53, 1 (2016), 1--9.","DOI":"10.1002\/pra2.2016.14505301063"},{"key":"key-10.1145\/3178876.3186065-22","doi-asserted-by":"crossref","unstructured":"Yiqun Liu, Ye Chen, Jinhui Tang, Jiashen Sun, Min Zhang, Shaoping Ma, and Xuan Zhu . 2015. Different Users, Different Opinions: Predicting Search Satisfaction with Mouse Movement Information. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9--13, 2015. 493--502. https:\/\/doi.org\/10.1145\/2766462.2767721","DOI":"10.1145\/2766462.2767721"},{"key":"key-10.1145\/3178876.3186065-23","doi-asserted-by":"crossref","unstructured":"Jiaxin Mao, Yiqun Liu, Ke Zhou, Jian-Yun Nie, Jingtao Song, Min Zhang, Shaoping Ma, Jiashen Sun, and Hengliang Luo . 2016. When does Relevance Mean Usefulness and User Satisfaction in Web Search? Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17--21, 2016. 463--472. https:\/\/doi.org\/10.1145\/2911451.2911507","DOI":"10.1145\/2911451.2911507"},{"key":"key-10.1145\/3178876.3186065-24","doi-asserted-by":"crossref","unstructured":"Gary Marchionini . 2006. Exploratory search: from finding to understanding. Commun. ACM, Vol. 49, 4 (2006), 41--46. https:\/\/doi.org\/10.1145\/1121949.1121979","DOI":"10.1145\/1121949.1121979"},{"key":"key-10.1145\/3178876.3186065-25","doi-asserted-by":"crossref","unstructured":"Daan Odijk, Ryen W. White, Ahmed Hassan Awadallah, and Susan T. Dumais . 2015. Struggling and Success in Web Search. In Proceedings of the 24th ACM International Conference on Information and Knowledge Management, CIKM 2015, Melbourne, VIC, Australia, October 19 - 23, 2015. 1551--1560. https:\/\/doi.org\/10.1145\/2806416.2806488","DOI":"10.1145\/2806416.2806488"},{"key":"key-10.1145\/3178876.3186065-26","doi-asserted-by":"crossref","unstructured":"Frances A Pogacar, Amira Ghenai, Mark D Smucker, and Charles LA Clarke . 2017. The Positive and Negative Influence of Search Results on People's Decisions about the Efficacy of Medical Treatments. (2017).","DOI":"10.1145\/3121050.3121074"},{"key":"key-10.1145\/3178876.3186065-27","doi-asserted-by":"crossref","unstructured":"Rohail Syed and Kevyn Collins-Thompson . 2017. Retrieval Algorithms Optimized for Human Learning. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7--11, 2017. 555--564. https:\/\/doi.org\/10.1145\/3077136.3080835","DOI":"10.1145\/3077136.3080835"},{"key":"key-10.1145\/3178876.3186065-28","doi-asserted-by":"crossref","unstructured":"Hongning Wang, Yang Song, Ming-Wei Chang, Xiaodong He, Ahmed Hassan Awadallah, and Ryen W. White . 2014. Modeling action-level satisfaction for search task satisfaction prediction The 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '14, Gold Coast , QLD, Australia - July 06 - 11, 2014. 123--132. https:\/\/doi.org\/10.1145\/2600428.2609607","DOI":"10.1145\/2600428.2609607"},{"key":"key-10.1145\/3178876.3186065-29","unstructured":"Ryen W White, Bill Kules, Steven M Drucker, et almbox. . 2006. Supporting exploratory search, introduction, special issue, communications of the ACM. Commun. ACM Vol. 49, 4 (2006), 36--39."},{"key":"key-10.1145\/3178876.3186065-30","doi-asserted-by":"crossref","unstructured":"Ryen W. White and Resa A. Roth . 2009. Exploratory Search: Beyond the Query-Response Paradigm. Morgan &#38; Claypool Publishers. https:\/\/doi.org\/10.2200\/S00174ED1V01Y200901ICR003","DOI":"10.2200\/S00174ED1V01Y200901ICR003"},{"key":"key-10.1145\/3178876.3186065-31","doi-asserted-by":"crossref","unstructured":"Eileen Wood, Domenica De Pasquale, Julie Lynn Mueller, Karin Archer, Lucia Zivcakova, Kathleen Walkey, and Teena Willoughby . 2016. Exploration of the relative contributions of domain knowledge and search expertise for conducting internet searches. The Reference Librarian Vol. 57, 3 (2016), 182--204.","DOI":"10.1080\/02763877.2015.1122559"}],"event":{"name":"the 2018 World Wide Web Conference","location":"Lyon, France","acronym":"WWW '18","number":"2018","sponsor":["SIGWEB, ACM Special Interest Group on Hypertext, Hypermedia, and Web","IW3C2, International World Wide Web Conference Committee"],"start":{"date-parts":[[2018,4,23]]},"end":{"date-parts":[[2018,4,27]]}},"container-title":["Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3178876.3186065","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/dl.acm.org\/ft_gateway.cfm?id=3186065&ftid=1957408&dwn=1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:11:28Z","timestamp":1750212688000},"score":1,"resource":{"primary":{"URL":"http:\/\/dl.acm.org\/citation.cfm?doid=3178876.3186065"}},"subtitle":["Investigating the Relationship between Search Success and User Satisfaction"],"proceedings-subject":"World Wide Web","short-title":[],"issued":{"date-parts":[[2018]]},"references-count":31,"URL":"https:\/\/doi.org\/10.1145\/3178876.3186065","relation":{},"subject":[],"published":{"date-parts":[[2018]]}}}