{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T12:19:24Z","timestamp":1775909964176,"version":"3.50.1"},"publisher-location":"Cham","reference-count":25,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783032083326","type":"print"},{"value":"9783032083333","type":"electronic"}],"license":[{"start":{"date-parts":[[2025,10,19]],"date-time":"2025-10-19T00:00:00Z","timestamp":1760832000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,10,19]],"date-time":"2025-10-19T00:00:00Z","timestamp":1760832000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>This study examines the reliability of AI-based Voting Advice Applications (VAAs) and large language models (LLMs) in providing objective political information. Our analysis is based upon comparing party responses to 38 statements of the Wahl-O-Mat, a well-established German online tool that helps inform voters by comparing their views with political party positions. For the LLMs, we identify significant biases. They exhibit a strong alignment (over 75% on average) with left-wing parties and a substantially lower alignment with center-right (smaller 50%) and right-wing parties (around 30%). Furthermore, for the VAAs, intended to objectively inform voters, we found substantial deviations from the parties\u2019 stated positions in Wahl-O-Mat: While one VAA deviated in 25% of cases, another VAA showed deviations in more than 50% of cases. For the latter, we even observed that simple prompt injections led to severe hallucinations, including false claims such as non-existent connections between political parties and right-wing extremist ties.<\/jats:p>","DOI":"10.1007\/978-3-032-08333-3_4","type":"book-chapter","created":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T05:22:38Z","timestamp":1760764958000},"page":"64-85","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Cautionary Tale About \u201cNeutrally\u201d Informative AI Tools Ahead of\u00a0the\u00a02025 Federal Elections in\u00a0Germany"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1921-4917","authenticated-orcid":false,"given":"Ina","family":"Dormuth","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5822-5745","authenticated-orcid":false,"given":"Sven","family":"Franke","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-0222-0025","authenticated-orcid":false,"given":"Marlies","family":"Hafer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0154-7735","authenticated-orcid":false,"given":"Tim","family":"Katzke","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1575-824X","authenticated-orcid":false,"given":"Alexander","family":"Marx","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5409-6875","authenticated-orcid":false,"given":"Emmanuel","family":"M\u00fcller","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9276-6342","authenticated-orcid":false,"given":"Daniel","family":"Neider","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0976-7190","authenticated-orcid":false,"given":"Markus","family":"Pauly","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6907-9296","authenticated-orcid":false,"given":"J\u00e9r\u00f4me","family":"Rutinowski","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,10,19]]},"reference":[{"key":"4_CR1","unstructured":"Achiam, J., et al.: GPT-4 technical report. arXiv preprint arXiv:2303.08774 (2023)"},{"key":"4_CR2","doi-asserted-by":"crossref","unstructured":"Bang, Y., Chen, D., Lee, N., Fung, P.: Measuring political bias in large language models: What is said and how it is said. arXiv preprint arXiv:2403.18932 (2024)","DOI":"10.18653\/v1\/2024.acl-long.600"},{"key":"4_CR3","unstructured":"van\u00a0den Broek, M.: ChatGPT\u2019s Left-leaning Liberal Bias. University of Leiden (2023)"},{"key":"4_CR4","unstructured":"Bundeszentrale f\u00fcr politische Bildung (BpB): Wahl-o-mat (2025). https:\/\/www.bpb.de\/themen\/wahl-o-mat\/, retrieved February 13, 2025"},{"key":"4_CR5","unstructured":"Bundeszentrale f\u00fcr politische Bildung (BpB): Wahl-O-Mat - Deine Wahlhilfe (2025). https:\/\/www.wahl-o-mat.de\/, retrieved between February 6 and 21, 2025"},{"key":"4_CR6","unstructured":"Dormuth, I., et al.: A cautionary tale about \u201cneutrally\u201d informative AI tools ahead of the 2025 federal elections in Germany. arXiv preprint arXiv:2502.15568 (2025)"},{"key":"4_CR7","unstructured":"Guo, D., et\u00a0al.: DeepSeek-R1: Incentivizing reasoning capability in LLMs via reinforcement learning. arXiv preprint arXiv:2501.12948 (2025)"},{"key":"4_CR8","doi-asserted-by":"crossref","unstructured":"Gupta, R.: Comparative analysis of DeepSeek R1, ChatGPT, Gemini, Alibaba, and llama: Performance, reasoning capabilities, and political bias. Authorea Preprints (2025)","DOI":"10.22541\/au.173921625.50315230\/v1"},{"key":"4_CR9","doi-asserted-by":"crossref","unstructured":"Hartmann, J., Schwenzow, J., Witte, M.: The Political Ideology of Conversational AI: Converging Evidence on ChatGPT\u2019s Pro-environmental, Left-libertarian Orientation. arXiv:2301.01768 (2023)","DOI":"10.2139\/ssrn.4316084"},{"key":"4_CR10","unstructured":"Hurst, A., et\u00a0al.: GPT-4o system card. arXiv preprint arXiv:2410.21276 (2024)"},{"key":"4_CR11","unstructured":"Lewis, P., et al.: Retrieval-augmented generation for knowledge-intensive NLP tasks. Adv. Neural. Inf. Process. Syst. 33, 9459\u20139474 (2020)"},{"key":"4_CR12","doi-asserted-by":"crossref","unstructured":"Liu, R., Jia, C., Wei, J., Xu, G., Vosoughi, S.: Quantifying and alleviating political bias in language models. Artif. Intell. 304 (2022)","DOI":"10.1016\/j.artint.2021.103654"},{"key":"4_CR13","doi-asserted-by":"crossref","unstructured":"Liu, Y., Panwang, Y., Gu, C.: \u201cturning right\u201d? An experimental study on the political value shift in large language models. Humanit. Soc. Sci. Commun. 12(1), 1\u201310 (2025)","DOI":"10.1057\/s41599-025-04465-z"},{"key":"4_CR14","doi-asserted-by":"crossref","unstructured":"Lunardi, R., La\u00a0Barbera, D., Roitero, K.: The elusiveness of detecting political bias in language models. In: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, pp. 3922\u20133926 (2024)","DOI":"10.1145\/3627673.3680002"},{"key":"4_CR15","doi-asserted-by":"crossref","unstructured":"McGee, R.W.: Is Chat GPT Biased against Conservatives? An Empirical Study. SSRN preprint SSRN 4359405 (2023)","DOI":"10.2139\/ssrn.4359405"},{"key":"4_CR16","doi-asserted-by":"crossref","unstructured":"McGee, R.W.: Who Were the 10 Best and 10 Worst US Presidents? The Opinion of Chat GPT (Artificial Intelligence) (2023)","DOI":"10.2139\/ssrn.4367762"},{"key":"4_CR17","doi-asserted-by":"crossref","unstructured":"Motoki, F., Pinho\u00a0Neto, V., Rodrigues, V.: More Human than Human: Measuring ChatGPT Political Bias. Social Sciences Research Network 4372349 (2023)","DOI":"10.1007\/s11127-023-01097-2"},{"issue":"2","key":"4_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s13347-022-00512-8","volume":"35","author":"U Peters","year":"2022","unstructured":"Peters, U.: Algorithmic political bias\u00a0in artificial intelligence systems. Philos. Technol. 35(2), 1\u201323 (2022). https:\/\/doi.org\/10.1007\/s13347-022-00512-8","journal-title":"Philos. Technol."},{"key":"4_CR19","doi-asserted-by":"crossref","unstructured":"Rettenberger, L., Reischl, M., Schutera, M.: Assessing political bias in large language models. arXiv preprint arXiv:2405.13041 (2024)","DOI":"10.1007\/s42001-025-00376-w"},{"key":"4_CR20","unstructured":"Rozado, D.: Danger in the machine: the perils of political and demographic biases embedded in AI systems. Manhattan Inst. 14(03) (2023)"},{"issue":"3","key":"4_CR21","doi-asserted-by":"publisher","first-page":"148","DOI":"10.3390\/socsci12030148","volume":"12","author":"D Rozado","year":"2023","unstructured":"Rozado, D.: The political biases of ChatGPT. Soc. Sci. 12(3), 148 (2023)","journal-title":"Soc. Sci."},{"issue":"1","key":"4_CR22","first-page":"7115633","volume":"2024","author":"J Rutinowski","year":"2024","unstructured":"Rutinowski, J., Franke, S., Endendyk, J., Dormuth, I., Roidl, M., Pauly, M.: The self-perception and political biases of ChatGPT. Human Behav. Emerg. Technol. 2024(1), 7115633 (2024)","journal-title":"Human Behav. Emerg. Technol."},{"key":"4_CR23","doi-asserted-by":"publisher","unstructured":"Schiele, M., Gittmann, Y., Ilchmann, S., Gojsalic, A., Jurincic, D., Klempt, P.: Voting advice applications: Implementation of rag-supported LLMs. TechRxiv (2024). https:\/\/doi.org\/10.36227\/techrxiv.172115156.64500701\/v1","DOI":"10.36227\/techrxiv.172115156.64500701\/v1"},{"key":"4_CR24","unstructured":"Wahl.Chat: Wahl.Chat - Dein KI-Tool zur Bundestagswahl 2025 (2025). https:\/\/wahl.chat\/, retrieved February 14, 2025"},{"key":"4_CR25","unstructured":"WAHLWEISE: WAHLWEISE - Dein intelligenter Assistent f\u00fcr Wahlen und Politik (2025). https:\/\/wahlweise.info\/, retrieved February 14, 2025"}],"container-title":["Communications in Computer and Information Science","Explainable Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-032-08333-3_4","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T05:22:49Z","timestamp":1760764969000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-032-08333-3_4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,19]]},"ISBN":["9783032083326","9783032083333"],"references-count":25,"URL":"https:\/\/doi.org\/10.1007\/978-3-032-08333-3_4","relation":{},"ISSN":["1865-0929","1865-0937"],"issn-type":[{"value":"1865-0929","type":"print"},{"value":"1865-0937","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,19]]},"assertion":[{"value":"19 October 2025","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"The authors have no competing interests to declare that\u00a0are relevant to the content of this article.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Disclosure of Interests"}},{"value":"During the preparation of this proposal, we used the ChatGPT 4o model from OpenAI for minor language edits, aiming to enhance readability. After using this tool\/service, the authors reviewed\u00a0and edited the content as needed and take full responsibility for the content of the proposal.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration of generative AI and AI-assisted technologies in the writing process"}},{"value":"xAI","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"World Conference on Explainable Artificial Intelligence","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Istanbul","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"T\u00fcrkiye","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2025","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"9 July 2025","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"11 July 2025","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"3","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"xai2025","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/xaiworldconference.com\/2025\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}