{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T13:23:16Z","timestamp":1780579396265,"version":"3.54.1"},"reference-count":49,"publisher":"Emerald","issue":"2","license":[{"start":{"date-parts":[[2019,12,5]],"date-time":"2019-12-05T00:00:00Z","timestamp":1575504000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["OIR"],"published-print":{"date-parts":[[2019,12,5]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>Survey-based studies suggest that search engines are trusted more than social media or even traditional news, although cases of false information or defamation are known. The purpose of this paper is to analyze query suggestion features of three search engines to see if these features introduce some bias into the query and search process that might compromise this trust. The authors test the approach on person-related search suggestions by querying the names of politicians from the German Bundestag before the German federal election of 2017.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>This study introduces a framework to systematically examine and automatically analyze the varieties in different query suggestions for person names offered by major search engines. To test the framework, the authors collected data from the Google, Bing and DuckDuckGo query suggestion APIs over a period of four months for 629 different names of German politicians. The suggestions were clustered and statistically analyzed with regards to different biases, like gender, party or age and with regards to the stability of the suggestions over time.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>By using the framework, the authors located three semantic clusters within the data set: suggestions related to politics and economics, location information and personal and other miscellaneous topics. Among other effects, the results of the analysis show a small bias in the form that male politicians receive slightly fewer suggestions on \u201cpersonal and misc\u201d topics. The stability analysis of the suggested terms over time shows that some suggestions are prevalent most of the time, while other suggestions fluctuate more often.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>This study proposes a novel framework to automatically identify biases in web search engine query suggestions for person-related searches. Applying this framework on a set of person-related query suggestions shows first insights into the influence search engines can have on the query process of users that seek out information on politicians.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/oir-11-2018-0341","type":"journal-article","created":{"date-parts":[[2019,12,23]],"date-time":"2019-12-23T05:42:02Z","timestamp":1577079722000},"page":"365-381","source":"Crossref","is-referenced-by-count":24,"title":["An investigation of biases in web search engine query suggestions"],"prefix":"10.1108","volume":"44","author":[{"given":"Malte","family":"Bonart","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anastasiia","family":"Samokhina","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gernot","family":"Heisenberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8817-4632","authenticated-orcid":false,"given":"Philipp","family":"Schaer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"140","reference":[{"issue":"4","key":"key2020062510440035600_ref001","article-title":"The impact of search engine selection and sorting criteria on vaccination beliefs and attitudes: two experiments manipulating Google output","volume":"16","year":"2014","journal-title":"Journal of Medical Internet Research"},{"issue":"6","key":"key2020062510440035600_ref002","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1145\/3209581","article-title":"Bias on the web","volume":"61","year":"2018","journal-title":"Communications of the ACM"},{"issue":"2","key":"key2020062510440035600_ref003","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1108\/eb026722","article-title":"Ask for information retrieval: Part I. Background and theory","volume":"38","year":"1982","journal-title":"Journal of Documentation"},{"key":"key2020062510440035600_ref004","article-title":"Enriching word vectors with subword information","year":"2016"},{"issue":"4","key":"key2020062510440035600_ref005","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1561\/1500000055","article-title":"A survey of query auto completion in information retrieval","volume":"10","year":"2016","journal-title":"Foundations and Trends\u00ae in Information Retrieval"},{"issue":"1","key":"key2020062510440035600_ref006","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1108\/14684521111113560","article-title":"Term suggestion with similarity measure based on semantic analysis techniques in query logs","volume":"35","year":"2011","journal-title":"Online Information Review"},{"issue":"2","key":"key2020062510440035600_ref007","first-page":"1","article-title":"Beta regression in r","volume":"34","year":"2010","journal-title":"Journal of Statistical Software"},{"issue":"33","key":"key2020062510440035600_ref008","doi-asserted-by":"crossref","first-page":"E4512","DOI":"10.1073\/pnas.1419828112","article-title":"The search engine manipulation effect (seme) and its possible impact on the outcomes of elections","volume":"112","year":"2015","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"key2020062510440035600_ref009","first-page":"1","article-title":"Suppressing the search engine manipulation effect (SEME)","year":"2017"},{"issue":"34","key":"key2020062510440035600_ref010","doi-asserted-by":"crossref","first-page":"12684","DOI":"10.1073\/pnas.0605525103","article-title":"Topical interests and the mitigation of search engine bias","volume":"103","year":"2006","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"3","key":"key2020062510440035600_ref011","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1145\/230538.230561","article-title":"Bias in computer systems","volume":"14","year":"1996","journal-title":"ACM Transactions on Information Systemsis"},{"key":"key2020062510440035600_ref012","first-page":"368","article-title":"Lemmatisation as a tagging task","year":"2012"},{"key":"key2020062510440035600_ref013","unstructured":"Harary, A., Bersoff, D.M., Adkins, S., Bruening, J., Lvovich, S., Bonifaz, G. and Heume, K. (2017), \u201c2017 Edelman Trust Barometer \u2013 global results\u201d, Business, Edelman Intelligence, available at: www.slideshare.net\/EdelmanInsights\/2017-edelman-trust-barometer-global-results-71035413 (accessed September 24, 2019)."},{"key":"key2020062510440035600_ref014","volume-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction: With 200 Full-Color Illustrations","year":"2001"},{"key":"key2020062510440035600_ref015","unstructured":"Hiemstra, D. (2017), \u201cQuery autocompletions considered harmful\u201d, available at: http:\/\/searsia.org\/blog\/2017-02-09-autocomplete\/ (accessed September 24, 2019)."},{"key":"key2020062510440035600_ref016","doi-asserted-by":"crossref","unstructured":"Hienert, D., Schaer, P., Schaible, J. and Mayr, P. (2011), \u201cA novel combined term suggestion service for domain-specific digital libraries\u201d, in Gradmann, S., Borri, F., Meghini, C. and Schuldt, H. (Eds), Research and Advanced Technology for Digital Libraries \u2013 International Conference on Theory and Practice of Digital Libraries, September 26\u201328, Proceedings\u2019, Vol. 6966 of Lecture Notes in Computer Science, Springer, Berlin, September 26\u201328, Proceedings\u2019, Vol. 6966 of Lecture Notes in Computer Science, pp. 192-203.","DOI":"10.1007\/978-3-642-24469-8_21"},{"issue":"3","key":"key2020062510440035600_ref017","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1080\/01972240050133634","article-title":"Shaping the web: why the politics of search engines matters","volume":"16","year":"2000","journal-title":"The Information Society"},{"issue":"7","key":"key2020062510440035600_ref018","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1109\/TPAMI.2002.1017616","article-title":"An efficient k-means clustering algorithm: analysis and implementation","volume":"24","year":"2002","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"6","key":"key2020062510440035600_ref019","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1007\/s10791-012-9216-x","article-title":"When do people use query suggestion? A query suggestion log analysis","volume":"16","year":"2013","journal-title":"Information Retrieval"},{"key":"key2020062510440035600_ref020","first-page":"371","article-title":"A comparison of query and term suggestion features for interactive searching","year":"2009"},{"issue":"1","key":"key2020062510440035600_ref021","first-page":"188","article-title":"Search bias quantification: investigating political bias in social media and web search","volume":"22","year":"2018","journal-title":"Information Retrieval Journal"},{"key":"key2020062510440035600_ref022","unstructured":"Larcinese, V. and Miner, L. (2017), \u201cThe political impact of the internet on US Presidential Elections\u201d, STICERD \u2013 Economic Organisation and Public Policy Discussion Papers Series 63, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE, available at: https:\/\/ideas.repec.org\/p\/cep\/stieop\/63.html (accessed September 24, 2019)."},{"issue":"3","key":"key2020062510440035600_ref023","article-title":"Living in a world of biased search engines","volume":"39","year":"2015","journal-title":"Online Information Review"},{"key":"key2020062510440035600_ref024","unstructured":"Matsa, K.E. and Lu, K. (2016), \u201c10 facts about the changing digital news landscape\u201d, Technical report, Pew Research Center, available at: www.pewresearch.org\/fact-tank\/2016\/09\/14\/facts-about-the-changing-digital-news-landscape\/ (accessed September 24, 2019)."},{"key":"key2020062510440035600_ref025","article-title":"Efficient estimation of word representations in vector space","year":"2013"},{"issue":"1","key":"key2020062510440035600_ref026","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/S0306-4573(01)00020-6","article-title":"Assessing bias in search engines","volume":"38","year":"2002","journal-title":"Information Processing & Management"},{"issue":"5","key":"key2020062510440035600_ref027","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1016\/j.ipm.2004.05.005","article-title":"Measuring search engine bias","volume":"41","year":"2005","journal-title":"Information Processing & Management"},{"key":"key2020062510440035600_ref028","unstructured":"Mueller, A. (2015), \u201cGermanWordEmbeddings\u201d, available at: http:\/\/devmount.github.io\/GermanWordEmbeddings\/ (accessed September 24, 2019)."},{"key":"key2020062510440035600_ref029","unstructured":"Mysen, C.C. and Schwartz, S.E. (2011), \u201cDynamic query suggestion\u201d, Patent number US8027990B1, available at: https:\/\/patents.google.com\/patent\/US8027990B1\/en (accessed September 24, 2019)."},{"key":"key2020062510440035600_ref030","volume-title":"Algorithms of Oppression: How Search Engines Reinforce Racism","year":"2018","edition":"1st ed."},{"key":"key2020062510440035600_ref031","first-page":"933","article-title":"Investigating user perception of gender bias in image search: the role of sexism","year":"2018"},{"key":"key2020062510440035600_ref032","unstructured":"Parkinson, H.J. (2016), \u201cClick and elect: how fake news helped Donald Trump win a real election j Hannah Jane Parkinson\u201d, The Guardian, November 14, available at: www.theguardian.com\/commentisfree\/2016\/nov\/14\/fake-news-donald-trump-election-alt-right-social-media-tech-companies (accessed September 24, 2019)."},{"key":"key2020062510440035600_ref033","article-title":"A picture of search","year":"2006"},{"key":"key2020062510440035600_ref034","first-page":"727","article-title":"X-means: extending k-means with efficient estimation of the number of clusters","year":"2000"},{"issue":"4","key":"key2020062510440035600_ref035","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1145\/3186549.3186553","article-title":"On measuring bias in online information","volume":"46","year":"2018","journal-title":"ACM SIGMOD Record"},{"key":"key2020062510440035600_ref036","first-page":"45","article-title":"Software framework for topic modelling with large corpora","year":"2010"},{"key":"key2020062510440035600_ref037","first-page":"1","article-title":"Auditing partisan audience bias within Google search","year":"2018"},{"issue":"1","key":"key2020062510440035600_ref038","first-page":"53","article-title":"Silhouettes: a graphical aid to the interpretation and validation of cluster analysis","volume":"20","year":"1987","journal-title":"Journal of Computational and Applied Mathematics"},{"key":"key2020062510440035600_ref039","unstructured":"Samokhina, A., Bonart, M., Schaer, P. and Heisenberg, G. (2019), \u201cQuery autocompletions for German politicians of the 18th Bundestag\u201d, available at: https:\/\/doi.org\/10.5281\/zenodo.3462046 (accessed September 24, 2019)."},{"key":"key2020062510440035600_ref040","article-title":"Auditing algorithms: research methods for detecting discrimination on internet platforms","year":"2014"},{"key":"key2020062510440035600_ref041","unstructured":"Schiffmann, B. (2008), \u201cThe reason for the Obama victory: it\u2019s the internet, stupid\u201d, WIRED, available at: www.wired.com\/2008\/11\/the-obama-victo\/ (accessed September 24, 2019)."},{"key":"key2020062510440035600_ref042","article-title":"Adding manual constraints and lexical lookup to a brill-tagger for german","year":"1998"},{"key":"key2020062510440035600_ref043","unstructured":"Sullivan, D. (2018), \u201cHow google autocomplete works in search\u201d, available at: https:\/\/blog.google\/products\/search\/how-google-autocomplete-works-search\/ (accessed March 3, 2019)."},{"issue":"4","key":"key2020062510440035600_ref044","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1016\/S0306-4573(03)00063-3","article-title":"Search engine coverage bias: evidence and possible causes","volume":"40","year":"2004","journal-title":"Information Processing & Management"},{"issue":"4","key":"key2020062510440035600_ref045","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1852102.1852106","article-title":"A similarity measure for indefinite rankings","volume":"28","year":"2010","journal-title":"ACM Transactions on Information Systems"},{"key":"key2020062510440035600_ref046","first-page":"2375","article-title":"Algorithmic bias: do good systems make relevant documents more retrievable?","year":"2017"},{"key":"key2020062510440035600_ref047","doi-asserted-by":"crossref","unstructured":"Yenala, H., Chinnakotla, M. and Goyal, J. (2017), \u201cConvolutional Bi-directional LSTM for detecting inappropriate query suggestions in web search\u201d, in Kim, J., Shim, K., Cao, L., Lee, J.-G., Lin, X. and Moon, Y.-S. (Eds), Advances in Knowledge Discovery and Data Mining, Lecture Notes in Computer Science, Springer International Publishing, New York, NY, pp. 3-16.","DOI":"10.1007\/978-3-319-57454-7_1"},{"key":"key2020062510440035600_ref048","first-page":"123","article-title":"Estimating embedding vectors for queries","year":"2016"},{"key":"key2020062510440035600_ref049","unstructured":"Zweig, K. (2017), \u201cWatching the watchers: epstein and Robertson\u2019s search engine manipulation effect\u201d, available at: https:\/\/algorithmwatch.org\/en\/watching-the-watchers-epstein-and-robertsons-search-engine-manipulation-effect\/ (accessed September 24, 2019)."}],"container-title":["Online Information Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/OIR-11-2018-0341\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/OIR-11-2018-0341\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:44:15Z","timestamp":1753397055000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/oir\/article\/44\/2\/365-381\/320710"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,5]]},"references-count":49,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,12,5]]}},"alternative-id":["10.1108\/OIR-11-2018-0341"],"URL":"https:\/\/doi.org\/10.1108\/oir-11-2018-0341","relation":{},"ISSN":["1468-4527"],"issn-type":[{"value":"1468-4527","type":"print"}],"subject":[],"published":{"date-parts":[[2019,12,5]]}}}