{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T17:38:12Z","timestamp":1779385092848,"version":"3.53.1"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643685489","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,10,16]],"date-time":"2024-10-16T00:00:00Z","timestamp":1729036800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,10,16]]},"abstract":"<jats:p>Detecting cognitive biases in large language models (LLMs) is a fascinating task that aims to probe the existing cognitive biases within these models. Current methods for detecting cognitive biases in language models generally suffer from incomplete detection capabilities and a restricted range of detectable bias types. To address this issue, we introduced the \u2018MindScope\u2019 dataset, which distinctively integrates static and dynamic elements. The static component comprises 5,170 open-ended questions spanning 72 cognitive bias categories. The dynamic component leverages a rule-based, multi-agent communication framework to facilitate the generation of multi-round dialogues. This framework is flexible and readily adaptable for various psychological experiments involving LLMs. In addition, we introduce a multi-agent detection method applicable to a wide range of detection tasks, which integrates Retrieval-Augmented Generation (RAG), competitive debate, and a reinforcement learning-based decision module. Demonstrating substantial effectiveness, this method has shown to improve detection accuracy by as much as 35.10% compared to GPT-4. Codes and appendix are available at https:\/\/github.com\/2279072142\/MindScope.<\/jats:p>","DOI":"10.3233\/faia240879","type":"book-chapter","created":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T13:37:32Z","timestamp":1729172252000},"source":"Crossref","is-referenced-by-count":5,"title":["MindScope: Exploring Cognitive Biases in Large Language Models Through Multi-Agent Systems"],"prefix":"10.3233","author":[{"given":"Zhentao","family":"Xie","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, East China Normal University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiabao","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, East China Normal University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yilei","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, East China Normal University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinxin","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, East China Normal University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanhong","family":"Bai","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, East China Normal University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xingjiao","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Computer Science, Fudan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liang","family":"He","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, East China Normal University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","ECAI 2024"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA240879","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T13:37:32Z","timestamp":1729172252000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA240879"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,16]]},"ISBN":["9781643685489"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia240879","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,16]]}}}