{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T07:01:04Z","timestamp":1775199664653,"version":"3.50.1"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2014,10,28]],"date-time":"2014-10-28T00:00:00Z","timestamp":1414454400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2014,10,28]]},"abstract":"<jats:p>\n            With the development of image search technology, users are no longer satisfied with searching for images using just metadata and textual descriptions. Instead, more search demands are focused on retrieving images based on similarities in their contents (textures, colors, shapes etc.). Nevertheless, one image may deliver rich or complex content and multiple interests. Sometimes users do not sufficiently define or describe their seeking demands for images even when general search interests appear, owing to a lack of specific knowledge to express their intents. A new form of information seeking activity, referred to as exploratory search, is emerging in the research community, which generally combines browsing and searching content together to help users gain additional knowledge and form accurate queries, thereby assisting the users with their seeking and investigation activities. However, there have been few attempts at addressing integrated exploratory search solutions when image browsing is incorporated into the exploring loop. In this work, we investigate the challenges of understanding users' search interests from the images being browsed and infer their actual search intentions. We develop a novel system to explore an effective and efficient way for allowing users to seamlessly switch between browse and search processes, and naturally complete visual-based exploratory search tasks. The system, called\n            <jats:italic>Browse-to-Search<\/jats:italic>\n            enables users to specify their visual search interests by circling any visual objects in the webpages being browsed, and then the system automatically forms the visual entities to represent users' underlying intent. One visual entity is not limited by the original image content, but also encapsulated by the textual-based browsing context and the associated heterogeneous attributes. We use large-scale image search technology to find the associated textual attributes from the repository. Users can then utilize the encapsulated visual entities to complete search tasks. The Browse-to-Search system is one of the first attempts to integrate\n            <jats:italic>browse<\/jats:italic>\n            and\n            <jats:italic>search<\/jats:italic>\n            activities for a visual-based exploratory search, which is characterized by four unique properties: (1) in session\u2014searching is performed during browsing session and search results naturally accompany with browsing content; (2) in context\u2014the pages being browsed provide text-based contextual cues for searching; (3) in focus\u2014users can focus on the visual content of interest without worrying about the difficulties of query formulation, and visual entities will be automatically formed; and (4) intuitiveness\u2014a touch and visual search-based user interface provides a natural user experience. We deploy the Browse-to-Search system on tablet devices and evaluate the system performance using millions of images. We demonstrate that it is effective and efficient in facilitating the user's exploratory search compared to the conventional image search methods and, more importantly, provides users with more robust results to satisfy their exploring experience.\n          <\/jats:p>","DOI":"10.1145\/2630420","type":"journal-article","created":{"date-parts":[[2014,10,29]],"date-time":"2014-10-29T18:05:55Z","timestamp":1414605955000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Browse-to-Search"],"prefix":"10.1145","volume":"32","author":[{"given":"Shiyang","family":"Lu","sequence":"first","affiliation":[{"name":"The University of Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tao","family":"Mei","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingdong","family":"Wang","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Technology, Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhiyong","family":"Wang","sequence":"additional","affiliation":[{"name":"The University of Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shipeng","family":"Li","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,10,28]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124965"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1998076.1998084"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00799-012-0100-5"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1571945"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874299"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision and Pattern Recoginition (CVPR). 2504--2511","author":"Chandrasekhar V.","unstructured":"V. Chandrasekhar , G. Takacs , D. M. Chen , S. S. Tsai , R. Grzeszczuk , and B. Girod . 2009. CHoG: Compressed histogram of gradients A low bit-rate feature descriptor . In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recoginition (CVPR). 2504--2511 . V. Chandrasekhar, G. Takacs, D. M. Chen, S. S. Tsai, R. Grzeszczuk, and B. Girod. 2009. CHoG: Compressed histogram of gradients A low bit-rate feature descriptor. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recoginition (CVPR). 2504--2511."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2009.2017128"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2344416.2344420"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1719998"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2212776.2223712"},{"key":"e_1_2_1_11_1","unstructured":"Google Related. 2012. http:\/\/www.google.com\/related.  Google Related. 2012. http:\/\/www.google.com\/related."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2072372"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1416950.1416955"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2007.07.014"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729694"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 48th Annual Meeting of the ACL (ACL). 1337--1345","author":"Li X.","year":"2010","unstructured":"X. Li . 2010 . Understanding the semantic structure of noun phrase queries . In Proceedings of the 48th Annual Meeting of the ACL (ACL). 1337--1345 . X. Li. 2010. Understanding the semantic structure of noun phrase queries. In Proceedings of the 48th Annual Meeting of the ACL (ACL). 1337--1345."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1572027"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2063576.2063649"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2396465"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2072365"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1121949.1121979"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1045\/december2002-marchionini"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2536798"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961209.1961213"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1378889.1378922"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518795"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/606658.606660"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995373"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2013.2268052"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of (CVPR).","author":"Schindler G.","unstructured":"G. Schindler , M. Brown , and R. Szeliski . 2007. City-scale location recognition . In Proceedings of (CVPR). G. Schindler, M. Brown, and R. Szeliski. 2007. City-scale location recognition. In Proceedings of (CVPR)."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148196"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 2nd International Conference on Semantic and Digital Media Technologies (SAMT). Lecture Notes in Computer Science","volume":"4816","author":"Smith D. A.","unstructured":"D. A. Smith , A. Owens , M. C. Schraefel , P. Sinclair , P. Andr\u00e9 , M. Wilson , A. Russell , K. Martinez , and P. Lewis . 2007. Challenges in supporting faceted semantic browsing of multimedia collections . In Proceedings of the 2nd International Conference on Semantic and Digital Media Technologies (SAMT). Lecture Notes in Computer Science , Vol. 4816 . Springer, Berlin, 280--283. D. A. Smith, A. Owens, M. C. Schraefel, P. Sinclair, P. Andr\u00e9, M. Wilson, A. Russell, K. Martinez, and P. Lewis. 2007. Challenges in supporting faceted semantic browsing of multimedia collections. In Proceedings of the 2nd International Conference on Semantic and Digital Media Technologies (SAMT). Lecture Notes in Computer Science, Vol. 4816. Springer, Berlin, 280--283."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2393378"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1121949.1121978"},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"R. W. White and R. A. Roth. 2009. Exploratory search: Beyond the query-response paradigm. Morgan & Claypool Publishers.   R. W. White and R. A. Roth. 2009. Exploratory search: Beyond the query-response paradigm. Morgan & Claypool Publishers.","DOI":"10.1007\/978-3-031-02260-9"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1449715.1449754"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2009.10.001"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835497"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126424"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/243199.243202"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2072301"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1631272.1631278"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2422956.2422960"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2630420","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2630420","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:19:36Z","timestamp":1750231176000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2630420"}},"subtitle":["Interactive Exploratory Search with Visual Entities"],"short-title":[],"issued":{"date-parts":[[2014,10,28]]},"references-count":44,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2014,10,28]]}},"alternative-id":["10.1145\/2630420"],"URL":"https:\/\/doi.org\/10.1145\/2630420","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,10,28]]},"assertion":[{"value":"2013-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-10-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}