{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T17:22:49Z","timestamp":1778692969103,"version":"3.51.4"},"publisher-location":"Cham","reference-count":42,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031264375","type":"print"},{"value":"9783031264382","type":"electronic"}],"license":[{"start":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T00:00:00Z","timestamp":1672531200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,2,23]],"date-time":"2023-02-23T00:00:00Z","timestamp":1677110400000},"content-version":"vor","delay-in-days":53,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Personalisation in search has improved performance, focus, and user experience to a great extent, however, it also arguably polarises informational perspectives. This paper seeks to illustrate an experimental methodology to quantify how three situational user variables affect personalisation across two search engines: Google and DuckDuckGo. We find that the presence of cookies and prior search history markedly affect the first page of search results on both platforms, but that prior (shallow) browsing history has no observable effect. We also find that there is very little in common between the results of both search engines. We argue that these results advocate more consideration of how personalisation fosters filter biases.<\/jats:p>","DOI":"10.1007\/978-3-031-26438-2_39","type":"book-chapter","created":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T06:32:56Z","timestamp":1677047576000},"page":"502-513","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Personalised Filter Bias with\u00a0Google and\u00a0DuckDuckGo: An Exploratory Study"],"prefix":"10.1007","author":[{"given":"Awais","family":"Akbar","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simon","family":"Caton","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ralf","family":"Bierig","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,2,23]]},"reference":[{"key":"39_CR1","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1561\/106.00000005","volume":"2","author":"R Agrawal","year":"2016","unstructured":"Agrawal, R., Golshan, B., Papalexakis, E.: Overlap in the web search results of google and Bing. J. Web Sci. 2, 17\u201330 (2016). https:\/\/doi.org\/10.1561\/106.00000005","journal-title":"J. Web Sci."},{"key":"39_CR2","doi-asserted-by":"publisher","unstructured":"Baeza-Yates, R.: Bias on the web. Commun. ACM 61(6), 54\u201361 (2018). https:\/\/doi.org\/10.1145\/3209581, https:\/\/dl.acm.org\/doi\/10.1145\/3209581","DOI":"10.1145\/3209581"},{"key":"39_CR3","doi-asserted-by":"publisher","unstructured":"Bar-Ilan, J., Keenoy, K., Yaari, E., Levene, M.: User rankings of search engine results. J. Am. Soc. Inf. Sci. Technol. 58(9), 1254\u20131266 (2007). https:\/\/doi.org\/10.1002\/asi.20608, http:\/\/doi.wiley.com\/10.1002\/asi.20608","DOI":"10.1002\/asi.20608"},{"key":"39_CR4","doi-asserted-by":"publisher","unstructured":"Bierig, R., Caton, S.: Special issue on de-personalisation, diversification, filter bubbles and search. Inf. Retr. J. 22(5), 419\u2013421 (2019). https:\/\/doi.org\/10.1007\/s10791-019-09365-w, http:\/\/link.springer.com\/10.1007\/s10791-019-09365-w","DOI":"10.1007\/s10791-019-09365-w"},{"key":"39_CR5","doi-asserted-by":"publisher","unstructured":"Bourgeois, D., Rappaz, J., Aberer, K.: Selection bias in news coverage: learning it, fighting it. In: The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018, pp. 535\u2013543. Association for Computing Machinery, Inc., April 2018. https:\/\/doi.org\/10.1145\/3184558.3188724","DOI":"10.1145\/3184558.3188724"},{"key":"39_CR6","doi-asserted-by":"publisher","unstructured":"Bozdag, E.: Bias in algorithmic filtering and personalization. Ethics Inf. Technol. 15(3), 209\u2013227 (2013). https:\/\/doi.org\/10.1007\/s10676-013-9321-6, http:\/\/link.springer.com\/10.1007\/s10676-013-9321-6","DOI":"10.1007\/s10676-013-9321-6"},{"key":"39_CR7","doi-asserted-by":"publisher","unstructured":"Brusilovsky, P., Maybury, M.T.: Special issue: from adaptive hypermedia to the adaptive web. Commun. ACM 45(5), 30\u201333 (2002). https:\/\/doi.org\/10.1145\/506218.506239","DOI":"10.1145\/506218.506239"},{"key":"39_CR8","doi-asserted-by":"publisher","unstructured":"Clarke, C.L., et al.: Novelty and diversity in information retrieval evaluation. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR 2008, p. 659. ACM Press, New York, New York, USA (2008). https:\/\/doi.org\/10.1145\/1390334.1390446, http:\/\/portal.acm.org\/citation.cfm?doid=1390334.1390446","DOI":"10.1145\/1390334.1390446"},{"key":"39_CR9","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1485","author":"C Cooper","year":"2021","unstructured":"Cooper, C., Lorenc, T., Schauberger, U.: What you see depends on where you sit: the effect of geographical location on web-searching for systematic reviews: a case study. Res. Synth. Methods (2021). https:\/\/doi.org\/10.1002\/jrsm.1485","journal-title":"Res. Synth. Methods"},{"key":"39_CR10","doi-asserted-by":"publisher","unstructured":"Dillahunt, T.R., Brooks, C.A., Gulati, S.: Detecting and visualizing filter bubbles in google and Bing. In: Conference on Human Factors in Computing Systems - Proceedings, vol. 18, pp. 1851\u20131856. Association for Computing Machinery, New York, New York, USA, April 2015. https:\/\/doi.org\/10.1145\/2702613.2732850, http:\/\/dl.acm.org\/citation.cfm?doid=2702613.2732850","DOI":"10.1145\/2702613.2732850"},{"key":"39_CR11","unstructured":"Ding, W., Marchionini, G.: A comparative study of web search service performance. In: ASIS Annual Meeting, pp. 136\u201342 (1996)"},{"key":"39_CR12","doi-asserted-by":"publisher","unstructured":"Epstein, R., Robertson, R.E.: The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections. Proc. Natl. Acad. Sci. U. S. A. 112(33), E4512\u2013E4521 (2015). https:\/\/doi.org\/10.1073\/pnas.1419828112, https:\/\/www.pnas.org\/content\/112\/33\/E4512","DOI":"10.1073\/pnas.1419828112"},{"key":"39_CR13","unstructured":"Google: Google\u2019s Privacy Policies. https:\/\/policies.google.com\/privacy\/archive?hl=en-US"},{"key":"39_CR14","doi-asserted-by":"publisher","unstructured":"Haim, M., Graefe, A., Brosius, H.B.: Burst of the filter bubble?: Effects of personalization on the diversity of google news. Digit. Journal. 6(3), 330\u2013343 (2018). https:\/\/doi.org\/10.1080\/21670811.2017.1338145","DOI":"10.1080\/21670811.2017.1338145"},{"key":"39_CR15","doi-asserted-by":"publisher","unstructured":"Hannak, A., et al.: Measuring personalization of web search. In: WWW 2013\u2013Proceedings of the 22nd International Conference on World Wide Web, pp. 527\u2013537. ACM Press, New York, New York, USA (2013). https:\/\/doi.org\/10.1145\/2488388.2488435, http:\/\/dl.acm.org\/citation.cfm?doid=2488388.2488435","DOI":"10.1145\/2488388.2488435"},{"key":"39_CR16","doi-asserted-by":"publisher","unstructured":"Hoang, V.T., Spognardi, A., Tiezzi, F., Petrocchi, M., De Nicola, R.: Domain-specific queries and web search personalization: some investigations. In: Electronic Proceedings in Theoretical Computer Science, EPTCS, vol. 188, pp. 51\u201358. Open Publishing Association, August 2015. https:\/\/doi.org\/10.4204\/EPTCS.188.6","DOI":"10.4204\/EPTCS.188.6"},{"issue":"3","key":"39_CR17","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1080\/01972240050133634","volume":"16","author":"LD Introna","year":"2000","unstructured":"Introna, L.D., Nissenbaum, H.: Shaping the web: why the politics of search engines matters. Inf. Soc. 16(3), 169\u2013185 (2000). https:\/\/doi.org\/10.1080\/01972240050133634","journal-title":"Inf. Soc."},{"key":"39_CR18","doi-asserted-by":"publisher","unstructured":"Kliman-Silver, C., Hannak, A., Lazer, D., Wilson, C., Mislove, A.: Location, location, location: the impact of geolocation on web search personalization. In: Proceedings of the 2015 Internet Measurement Conference, pp. 121\u2013127. IMC 2015, Association for Computing Machinery, New York, NY, USA (2015). https:\/\/doi.org\/10.1145\/2815675.2815714","DOI":"10.1145\/2815675.2815714"},{"key":"39_CR19","doi-asserted-by":"publisher","unstructured":"Knoche, M., Popovi\u0107, R., Lemmerich, F., Strohmaier, M., Stroh-maier, M.: Identifying biases in politically biased wikis through word embeddings. In: Proceedings of the 30th ACM Conference on Hypertext and Social Media. ACM, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3342220.3343658","DOI":"10.1145\/3342220.3343658"},{"key":"39_CR20","doi-asserted-by":"publisher","unstructured":"Krafft, T.D., Gamer, M., Anna, K.: What did you see? A study to measure personalization in Google\u2019s search. EPJ Data Sci. 8, 1\u201323 (2019). https:\/\/doi.org\/10.1140\/epjds\/s13688-019-0217-5, https:\/\/epjdatascience.springeropen.com\/articles\/10.1140\/epjds\/s13688-019-0217-5","DOI":"10.1140\/epjds\/s13688-019-0217-5"},{"key":"39_CR21","doi-asserted-by":"publisher","unstructured":"Kulshrestha, J., et al.: Search bias quantification: investigating political bias in social media and web search. Inf. Retr. J. 22(1\u20132), 188\u2013227 (2019). https:\/\/doi.org\/10.1007\/s10791-018-9341-2, https:\/\/link.springer.com\/article\/10.1007\/s10791-018-9341-2","DOI":"10.1007\/s10791-018-9341-2"},{"key":"39_CR22","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1007\/978-3-030-34971-4_17","volume-title":"Social Informatics","author":"C Lai","year":"2019","unstructured":"Lai, C., Luczak-Roesch, M.: You can\u2019t see what you can\u2019t see: experimental evidence for how much relevant information may be missed due to Google\u2019s web search personalisation. In: Weber, I., et al. (eds.) SocInfo 2019. LNCS, vol. 11864, pp. 253\u2013266. Springer, Cham (2019). https:\/\/doi.org\/10.1007\/978-3-030-34971-4_17"},{"key":"39_CR23","doi-asserted-by":"publisher","unstructured":"Le, H., Maragh, R., Ekdale, B., High, A., Havens, T., Shafiq, Z.: Measuring political personalization of google news search. In: The World Wide Web Conference on\u2013WWW 2019, pp. 2957\u20132963. Association for Computing Machinery (ACM), New York, New York, USA (2019). https:\/\/doi.org\/10.1145\/3308558.3313682, http:\/\/dl.acm.org\/citation.cfm?doid=3308558.3313682","DOI":"10.1145\/3308558.3313682"},{"key":"39_CR24","unstructured":"Martinovic, M.: Exploring the effect of search engine personalization on politically biased search results (2018)"},{"key":"39_CR25","doi-asserted-by":"publisher","unstructured":"McCown, F., Nelson, M.L.: Agreeing to disagree: Search engines and their public interfaces. In: Proceedings of the ACM International Conference on Digital Libraries, pp. 309\u2013318. ACM Press, New York, New York, USA (2007). https:\/\/doi.org\/10.1145\/1255175.1255237, http:\/\/portal.acm.org\/citation.cfm?doid=1255175.1255237","DOI":"10.1145\/1255175.1255237"},{"key":"39_CR26","doi-asserted-by":"publisher","unstructured":"Micarelli, A., Gasparetti, F., Sciarrone, F., Gauch, S.: Personalized search on the world wide web. In: Brusilovsky, P., Kobsa, A., Nejdl, W. (eds.) The Adaptive Web. LNCS, vol. 4321, pp. 195\u2013230. Springer, Berlin, Heidelberg (2007). https:\/\/doi.org\/10.1007\/978-3-540-72079-9_6","DOI":"10.1007\/978-3-540-72079-9_6"},{"key":"39_CR27","doi-asserted-by":"publisher","unstructured":"Paramita, M.L., Orphanou, K., Christoforou, E., Otterbacher, J., Hopfgartner, F.: Do you see what i see? Images of the COVID-19 pandemic through the lens of google. Inf. Process. Manag. 58(5), 102654 (2021). https:\/\/doi.org\/10.1016\/j.ipm.2021.102654, https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0306457321001424","DOI":"10.1016\/j.ipm.2021.102654"},{"key":"39_CR28","doi-asserted-by":"crossref","unstructured":"Pariser, E.: The Filter Bubble: What the Internet Is Hiding from You. The Penguin Group, London (2011)","DOI":"10.3139\/9783446431164"},{"key":"39_CR29","doi-asserted-by":"publisher","unstructured":"Pitoura, E., et al.: On measuring bias in online information. SIGMOD Rec. 46(4), 16\u201321 (2018). https:\/\/doi.org\/10.1145\/3186549.3186553","DOI":"10.1145\/3186549.3186553"},{"key":"39_CR30","unstructured":"ProPublica.: Google Has Quietly Dropped Ban on Personally Identifiable Web Tracking (2016). http:\/\/bit.ly\/2eAjC9w"},{"key":"39_CR31","doi-asserted-by":"publisher","unstructured":"Puschmann, C.: Beyond the bubble: assessing the diversity of political search results. Digit. Journal. 7(6), 824\u2013843 (2019). https:\/\/doi.org\/10.1080\/21670811.2018.1539626","DOI":"10.1080\/21670811.2018.1539626"},{"key":"39_CR32","doi-asserted-by":"publisher","unstructured":"Robertson, R.E., Lazer, D., Wilson, C.: Auditing the personalization and composition of politically-related search engine results pages. In: The Web Conference 2018\u2013Proceedings of the World Wide Web Conference, WWW 2018, pp. 955\u2013965. Association for Computing Machinery Inc, New York, New York, USA, April 2018. https:\/\/doi.org\/10.1145\/3178876.3186143, http:\/\/dl.acm.org\/citation.cfm?doid=3178876.3186143","DOI":"10.1145\/3178876.3186143"},{"key":"39_CR33","doi-asserted-by":"publisher","unstructured":"Sakai, T., Kando, N., Macdonald, C., Soboroff, I.: Introduction to the special issue on search intents and diversification. Inf. Retr. 16(4), 427\u2013428 (2013). https:\/\/doi.org\/10.1007\/s10791-013-9223-6, http:\/\/link.springer.com\/10.1007\/s10791-013-9223-6","DOI":"10.1007\/s10791-013-9223-6"},{"key":"39_CR34","doi-asserted-by":"publisher","unstructured":"Sales, A., Balby, L., Veloso, A.: Media bias characterization in Brazilian presidential elections. In: HT 2019 - Proceedings of the 30th ACM Conference on Hypertext and Social Media, pp. 231\u2013240. Association for Computing Machinery, Inc., September 2019. https:\/\/doi.org\/10.1145\/3342220.3343656","DOI":"10.1145\/3342220.3343656"},{"key":"39_CR35","doi-asserted-by":"publisher","unstructured":"Santos, R.L.T., Macdonald, C., Ounis, I.: Search result diversification. Found. Trends\u00ae Inf. Retr. 9(1), 1\u201390 (2015). https:\/\/doi.org\/10.1561\/1500000040","DOI":"10.1561\/1500000040"},{"key":"39_CR36","doi-asserted-by":"crossref","unstructured":"Selberg, E., Etzioni, O.: Multi-service search and comparison using the MetaCrawler. In: 4th International Conference on World Wide Web (1995)","DOI":"10.1145\/3592626.3592641"},{"key":"39_CR37","doi-asserted-by":"crossref","unstructured":"Spink, A., Jansen, B.J., Wang, C.: Comparison of major web search engine overlap: 2005 and 2007. In: 14th Australasian World Wide Web Conference","DOI":"10.1109\/ITNG.2006.105"},{"key":"39_CR38","doi-asserted-by":"publisher","unstructured":"Spink, A., Jansen, B.J., Blakely, C., Koshman, S.: A study of results overlap and uniqueness among major web search engines. Inf. Process. Manag. 42(5), 1379\u20131391 (2006). https:\/\/doi.org\/10.1016\/j.ipm.2005.11.001, https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0306457305001500","DOI":"10.1016\/j.ipm.2005.11.001"},{"key":"39_CR39","doi-asserted-by":"publisher","unstructured":"Urman, A., Makhortykh, M., Ulloa, R.: The matter of chance: auditing web search results related to the 2020 U.S. presidential primary elections across six search engines. Soc. Sci. Comput. Rev. 08944393211006863. https:\/\/doi.org\/10.1177\/08944393211006863, https:\/\/doi.org\/10.1177\/08944393211006863","DOI":"10.1177\/08944393211006863"},{"key":"39_CR40","doi-asserted-by":"publisher","unstructured":"Vaughan, L., Thelwall, M.: Search engine coverage bias: evidence and possible causes. Inf. Process. Manag. 40(4), 693\u2013707 (2004). https:\/\/doi.org\/10.1016\/S0306-4573(03)00063-3, https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0306457303000633","DOI":"10.1016\/S0306-4573(03)00063-3"},{"key":"39_CR41","doi-asserted-by":"publisher","unstructured":"Weber, I., Garimella, V.R.K., Borra, E.: Mining web query logs to analyze political issues. In: Proceedings of the 4th Annual ACM Web Science Conference, pp. 330\u2013334. WebSci 2012, Association for Computing Machinery, New York, NY, USA (2012). https:\/\/doi.org\/10.1145\/2380718.2380761","DOI":"10.1145\/2380718.2380761"},{"key":"39_CR42","doi-asserted-by":"publisher","unstructured":"White, R.W.: Beliefs and biases in web search. In: SIGIR 2013\u2013Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 3\u201312. ACM Press, New York, New York, USA (2013). https:\/\/doi.org\/10.1145\/2484028.2484053, http:\/\/dl.acm.org\/citation.cfm?doid=2484028.2484053","DOI":"10.1145\/2484028.2484053"}],"container-title":["Communications in Computer and Information Science","Artificial Intelligence and Cognitive Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-26438-2_39","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,7]],"date-time":"2023-12-07T10:57:34Z","timestamp":1701946654000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-26438-2_39"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"ISBN":["9783031264375","9783031264382"],"references-count":42,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-26438-2_39","relation":{},"ISSN":["1865-0929","1865-0937"],"issn-type":[{"value":"1865-0929","type":"print"},{"value":"1865-0937","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023]]},"assertion":[{"value":"23 February 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"AICS","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Irish Conference on Artificial Intelligence and Cognitive Science","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Munster","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Ireland","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2022","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"8 December 2022","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"9 December 2022","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"30","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"aics2022","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/aics2022.mtu.ie\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Single-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"102","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"41","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"0","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"40% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"No","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}