{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,27]],"date-time":"2026-09-27T03:16:56Z","timestamp":1790479016906,"version":"4.1.0"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2019,5,8]],"date-time":"2019-05-08T00:00:00Z","timestamp":1557273600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61622208, 61732008, 61532011"],"award-info":[{"award-number":["61622208, 61732008, 61532011"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"the National Key Research and Development Program of China","award":["2018YFC0831700"],"award-info":[{"award-number":["2018YFC0831700"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2019,7,31]]},"abstract":"<jats:p>\n            Diversity has been taken into consideration by existing Web image search engines in ranking search results. However, there is no thorough investigation of how diversity affects user satisfaction in image search. In this article, we address the following questions: (1) How do different factors, such as content and visual presentations, affect users\u2019 perception of diversity? (2) How does search result diversity affect user satisfaction with different search intents? To answer those questions, we conduct a set of laboratory user studies to collect users\u2019 perceived diversity annotations and search satisfaction. We find that the existence of nearly duplicated image results has the largest impact on users\u2019 perceived diversity, followed by the similarity in content and visual presentations. Besides these findings, we also investigate the relationship between diversity and satisfaction in image search. Specifically, we find that users\u2019 preference for diversity varies across different search intents. When users want to collect information or save images for further usage (the\n            <jats:italic>Locate<\/jats:italic>\n            search tasks), more diversified result lists lead to higher satisfaction levels. The insights may help commercial image search engines to design better result ranking strategies and evaluation metrics.\n          <\/jats:p>","DOI":"10.1145\/3320118","type":"journal-article","created":{"date-parts":[[2019,5,9]],"date-time":"2019-05-09T12:19:02Z","timestamp":1557404342000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Does Diversity Affect User Satisfaction in Image Search"],"prefix":"10.1145","volume":"37","author":[{"given":"Zhijing","family":"Wu","sequence":"first","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ke","family":"Zhou","sequence":"additional","affiliation":[{"name":"University of Nottingham 8 Nokia Bell Labs, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiqun","family":"Liu","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Min","family":"Zhang","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shaoping","family":"Ma","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,5,8]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1498759.1498766"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03658-3_40"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10844-013-0252-9"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/792550.792552"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291025"},{"key":"e_1_2_1_6_1","volume-title":"Large scale online learning of image similarity through ranking. J. Mach. Learn. Res. 11 (Mar","author":"Chechik Gal","year":"2010","unstructured":"Gal Chechik , Varun Sharma , Uri Shalit , and Samy Bengio . 2010. Large scale online learning of image similarity through ranking. J. Mach. Learn. Res. 11 (Mar . 2010 ), 1109--1135. http:\/\/dl.acm.org\/citation.cfm?id&equals;1756006.1756042 Gal Chechik, Varun Sharma, Uri Shalit, and Samy Bengio. 2010. Large scale online learning of image similarity through ranking. J. Mach. Learn. Res. 11 (Mar. 2010), 1109--1135. http:\/\/dl.acm.org\/citation.cfm?id&equals;1756006.1756042"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148245"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080804"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.177"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401916"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1646396.1646443"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1059981.1059982"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 309--316","author":"Guillaumin Matthieu","year":"2010","unstructured":"Matthieu Guillaumin , Thomas Mensink , Jakob Verbeek , and Cordelia Schmid . 2010 . TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation . In Proceedings of the IEEE International Conference on Computer Vision. 309--316 . Matthieu Guillaumin, Thomas Mensink, Jakob Verbeek, and Cordelia Schmid. 2010. TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation. In Proceedings of the IEEE International Conference on Computer Vision. 309--316."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2396761.2398570"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461466.2461513"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718487.1718515"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2505682"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1108\/00220410810844169"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/281250.281253"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000012"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609468"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609631"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_1_25_1","volume-title":"Diversity in photo retrieval: Overview of the ImageCLEFPhoto task","author":"Paramita Monica Lestari","year":"2009","unstructured":"Monica Lestari Paramita , Mark Sanderson , and Paul Clough . 2010. Diversity in photo retrieval: Overview of the ImageCLEFPhoto task 2009 . In Multilingual Information Access Evaluation II. Multimedia Experiments, Carol Peters , Barbara Caputo, Julio Gonzalo, Gareth J. F. Jones, Jayashree Kalpathy-Cramer, Henning M\u00fcller, and Theodora Tsikrika (Eds.). Springer , 45--59. Monica Lestari Paramita, Mark Sanderson, and Paul Clough. 2010. Diversity in photo retrieval: Overview of the ImageCLEFPhoto task 2009. In Multilingual Information Access Evaluation II. Multimedia Experiments, Carol Peters, Barbara Caputo, Julio Gonzalo, Gareth J. F. Jones, Jayashree Kalpathy-Cramer, Henning M\u00fcller, and Theodora Tsikrika (Eds.). Springer, 45--59."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767721"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753846.1754078"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080833"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911532"},{"key":"e_1_2_1_31_1","first-page":"285","article-title":"Satisfaction: A behavioral perspective on the consumer","volume":"2","author":"Oliver Richard L.","year":"1997","unstructured":"Richard L. Oliver . 1997 . Satisfaction: A behavioral perspective on the consumer . Asia Pac. J. Manage. 2 , 2 (1997), 285 -- 286 . Richard L. Oliver. 1997. Satisfaction: A behavioral perspective on the consumer. Asia Pac. J. Manage. 2, 2 (1997), 285--286.","journal-title":"Asia Pac. J. Manage."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702527"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1108\/14684520510628864"},{"key":"e_1_2_1_34_1","first-page":"1","article-title":"Image re-ranking based on topic diversity","volume":"99","author":"Qian X.","year":"2017","unstructured":"X. Qian , D. Lu , Y. Wang , L. Zhu , Y. Y. Tang , and M. Wang . 2017 . Image re-ranking based on topic diversity . IEEE Trans. Image Process. PP , 99 (2017), 1 -- 1 . X. Qian, D. Lu, Y. Wang, L. Zhu, Y. Y. Tang, and M. Wang. 2017. Image re-ranking based on topic diversity. IEEE Trans. Image Process. PP, 99 (2017), 1--1.","journal-title":"IEEE Trans. Image Process. PP"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1670564.1670572"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148320"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911996.2911998"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2009.417"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772780"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1871437.1871586"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2009997"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/331403.331405"},{"key":"e_1_2_1_43_1","unstructured":"C. R. Snyder and S. J. Lopez. 2009. The Oxford Handbook of Positive Psychology. Oxford library of psychology.  C. R. Snyder and S. J. Lopez. 2009. The Oxford Handbook of Positive Psychology. Oxford library of psychology."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2671188.2749334"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(92)90007-M"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1080\/13506280902764539"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2020408.2020573"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1080\/17470210500416342"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526756"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2006.262509"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 428--435","author":"Wang Gang","year":"2010","unstructured":"Gang Wang , Derek Hoiem , and David Forsyth . 2010 . Learning image similarity from flickr groups using stochastic intersection kernel MAchines . In Proceedings of the IEEE International Conference on Computer Vision. 428--435 . Gang Wang, Derek Hoiem, and David Forsyth. 2010. Learning image similarity from flickr groups using stochastic intersection kernel MAchines. In Proceedings of the IEEE International Conference on Computer Vision. 428--435."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609607"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-68699-8_6"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159686"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080799"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-014-0419-4"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210059"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995528"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3320118","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3320118","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:04:52Z","timestamp":1750273492000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3320118"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,8]]},"references-count":58,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,7,31]]}},"alternative-id":["10.1145\/3320118"],"URL":"https:\/\/doi.org\/10.1145\/3320118","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,5,8]]},"assertion":[{"value":"2018-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-05-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}