{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T22:03:14Z","timestamp":1780610594689,"version":"3.54.1"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2017,7,12]],"date-time":"2017-07-12T00:00:00Z","timestamp":1499817600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Microsoft Research in Silicon Valley"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2017,9,30]]},"abstract":"<jats:p>Access to diverse perspectives nurtures an informed citizenry. Google and Bing have emerged as the duopoly that largely arbitrates which English-language documents are seen by web searchers. We present our empirical study over the search results produced by Google and Bing that shows a large overlap. Thus, citizens may not gain different perspectives by simultaneously probing them for the same query. Fortunately, our study also shows that by mining Twitter data, one can obtain search results that are quite distinct from those produced by Google, Bing, and Bing News. Additionally, the users found those results to be quite informative.<\/jats:p>\n                  <jats:p>We also present two novel tools we designed for this study. One uses tensor analysis to derive low-dimensional compact representation of search results and study their behavior over time. The other uses machine learning and quantifies the similarity of results between two search engines by framing it as a prediction problem. Although these tools have different underpinnings, the analytical results obtained using them corroborate each other, which reinforces the confidence one can place in them for finding meaningful insights from big data.<\/jats:p>","DOI":"10.1145\/3057731","type":"journal-article","created":{"date-parts":[[2017,7,13]],"date-time":"2017-07-13T10:29:57Z","timestamp":1499941797000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Homogeneity in Web Search Results"],"prefix":"10.1145","volume":"8","author":[{"given":"Rakesh","family":"Agrawal","sequence":"first","affiliation":[{"name":"Data Insights Laboratories, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Behzad","family":"Golshan","sequence":"additional","affiliation":[{"name":"Boston University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3411-8483","authenticated-orcid":false,"given":"Evangelos E.","family":"Papalexakis","sequence":"additional","affiliation":[{"name":"University of California, Riverside, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,7,12]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Amazon. 2011. Amazon Mechanical Turk Requester Best Practices Guide. Amazon Web Services."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1498759.1498766"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2743060"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788571"},{"key":"e_1_2_1_5_1","volume-title":"SIGIR Crowdsourcing for Search Evaluation Workshop.","author":"Alonso Omar","unstructured":"Omar Alonso, Chad Carson, David Gerster, Xiang Ji, and Shubha U. Nabar. 2010. Detecting uninteresting content in text streams. In SIGIR Crowdsourcing for Search Evaluation Workshop."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2697055"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1963405.1963505"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/383952.384007"},{"key":"e_1_2_1_9_1","volume-title":"Kolda","author":"Bader Brett W.","year":"2007","unstructured":"Brett W. Bader and Tamara G. Kolda. 2007. Matlab tensor toolbox version 2.2. Sandia National Laboratories. Albuquerque, NM (2007)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-10874-1_9"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1462148.1462151"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIS.2013.6607883"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7552(98)00127-5"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944937"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/792550.792552"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chemolab.2005.05.004"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2012.149"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1963405.1963500"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1137\/110859063"},{"key":"e_1_2_1_20_1","first-page":"127","article-title":"Search engines for the world wide web: A comparative study and evaluation methodology","volume":"33","author":"Chu Heting","year":"1996","unstructured":"Heting Chu and Marilyn Rosenthal. 1996. Search engines for the world wide web: A comparative study and evaluation methodology. In American Society for Information Science, Vol. 33. 127--135.","journal-title":"American Society for Information Science"},{"key":"e_1_2_1_21_1","volume-title":"Overview of the TREC 2011 Web Track. Technical Report. NIST.","author":"Clarke Charles L. A.","unstructured":"Charles L. A. Clarke, Nick Craswell, Ian Soboroff, and Ellen M. Voorhees. 2011. Overview of the TREC 2011 Web Track. Technical Report. NIST."},{"key":"e_1_2_1_22_1","volume-title":"ASIS Annual Meeting","volume":"33","author":"Ding Wei","year":"1996","unstructured":"Wei Ding and Gary Marchionini. 1996. A comparative study of web search service performance. In ASIS Annual Meeting, Vol. 33. ERIC, 136--42."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772725"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/1873781.1873815"},{"key":"e_1_2_1_25_1","unstructured":"W. H. DuBay. 2004. The Principles of Readability. Impact Information."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","unstructured":"Eric Enge Stephan Spencer Jessie Stricchiola and Rand Fishkin. 2012. The Art of SEO. O\u2019Reilly.","DOI":"10.5555\/2462657"},{"key":"e_1_2_1_27_1","volume-title":"Editor","author":"Federal Communications Commission","year":"1949","unstructured":"Federal Communications Commission. 1949. Editorializing by Broadcast Licensees. Washington, DC: GPO. (1949)."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"e_1_2_1_29_1","volume-title":"1st World Conference of the Web Society.","author":"Gauch Susan","year":"1996","unstructured":"Susan Gauch and Guijun Wang. 1996. Information fusion with ProFusion. In 1st World Conference of the Web Society."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240691"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1062745.1062840"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488435"},{"key":"e_1_2_1_33_1","unstructured":"Richard A. Harshman. 1970. Foundations of the Parafac Procedure: Models and Conditions for an\u201c Explanatory\u201d Multimodal Factor Analysis. Technical Report. UCLA."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339583"},{"key":"e_1_2_1_35_1","unstructured":"G. R. Klare and B. Buck. 1954. Know Your Reader: The Scientific Approach to Readability. Heritage House."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1137\/07070111X"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772751"},{"key":"e_1_2_1_38_1","unstructured":"F. W. Lancaster and E. G. Fayen. 1973. Information Retrieval On-Line. Melville Publishing Co."},{"key":"e_1_2_1_39_1","volume-title":"Proc. of SSM Conference.","author":"Lauw Hady W.","year":"2010","unstructured":"Hady W. Lauw, Alexandros Ntoulas, and Krishnaram Kenthapadi. 2010. Estimating the quality of postings in the real-time web. In Proc. of SSM Conference."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.280.5360.98"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/11424826_115"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772753"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1108\/S1876-0562(2012)4"},{"key":"e_1_2_1_44_1","volume-title":"On the Interdisciplinary Foundations of Diversity","author":"Maltese Vincenzo","unstructured":"Vincenzo Maltese, Fausto Giunchiglia, Kerstin Denecke, Paul Lewis, Cornelia Wallner, Anthony Baldry, and Devika Madalli. 2009. On the Interdisciplinary Foundations of Diversity. University of Trento."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.3145\/epi.2010.jul.03"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.12.015"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/505282.505284"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348412"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611974348.80"},{"key":"e_1_2_1_50_1","volume-title":"The effectiveness of web search engines to index new sites from different countries. Inf. Res. 14, 2","author":"Pirkola Ari","year":"2009","unstructured":"Ari Pirkola. 2009. The effectiveness of web search engines to index new sites from different countries. Inf. Res. 14, 2 (2009)."},{"key":"e_1_2_1_51_1","volume-title":"Search Engine Use","author":"Purcell Kristin","year":"2012","unstructured":"Kristin Purcell, Joanna Brenner, and Lee Rainie. 2012. Search Engine Use 2012. Pew Internet 8 American Life Project."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/2362793.2362825"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23808-6_2"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772905"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-01854-6_46"},{"key":"e_1_2_1_56_1","volume-title":"4th International Conference on World Wide Web.","author":"Selberg Erik","year":"1995","unstructured":"Erik Selberg and Oren Etzioni. 1995. Multi-service search and comparison using the MetaCrawler. In 4th International Conference on World Wide Web."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2005.11.001"},{"key":"e_1_2_1_58_1","volume-title":"14th Australasian World Wide Web Conference.","author":"Spink Amanda","year":"2008","unstructured":"Amanda Spink, Bernard J. Jansen, and Changru Wang. 2008. Comparison of major web search engine overlap: 2005 and 2007. In 14th Australasian World Wide Web Conference."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835643"},{"key":"e_1_2_1_60_1","first-page":"605","article-title":"Exposure to news and diverse views in the internet age","volume":"8","author":"Stroud Natalie Jomini","year":"2012","unstructured":"Natalie Jomini Stroud and Ashley Muddiman. 2012. Exposure to news and diverse views in the internet age. ISJLP 8 (2012), 605.","journal-title":"ISJLP"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2396761.2398642"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31753-8_11"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/1935826.1935842"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2063576.2063941"},{"key":"e_1_2_1_65_1","unstructured":"William M. Webberley. 2014. Inferring Interestingness in Online Social Networks. Ph.D. Dissertation. Cardiff University."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1645967"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.lisr.2013.04.006"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348475"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2013.12.051"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3057731","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3057731","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T21:01:34Z","timestamp":1780606894000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3057731"}},"subtitle":["Diagnosis and Mitigation"],"short-title":[],"issued":{"date-parts":[[2017,7,12]]},"references-count":69,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2017,9,30]]}},"alternative-id":["10.1145\/3057731"],"URL":"https:\/\/doi.org\/10.1145\/3057731","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,7,12]]},"assertion":[{"value":"2016-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-02-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-07-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}