{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T22:14:46Z","timestamp":1791497686240,"version":"4.3.4"},"publisher-location":"New York, NY, USA","reference-count":35,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,7,10]],"date-time":"2024-07-10T00:00:00Z","timestamp":1720569600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Queen Mary?s Apocrita HPC facility"},{"name":"Next Generation EU PRIN 2022","award":["20227F2ZN3 MoT--The Measure of Truth: An Evaluation-Centered Machine-Human Hybrid Framework for Assessing Information Truthfulness"],"award-info":[{"award-number":["20227F2ZN3 MoT--The Measure of Truth: An Evaluation-Centered Machine-Human Hybrid Framework for Assessing Information Truthfulness"]}]},{"name":"Strategic Plan of the University of Udine-Interdepartment Project on Artificial Intelligence (2020-25)"},{"name":"China Scholarship Council (CSC)"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,7,10]]},"DOI":"10.1145\/3626772.3657965","type":"proceedings-article","created":{"date-parts":[[2024,7,11]],"date-time":"2024-07-11T12:40:05Z","timestamp":1720701605000},"page":"2332-2336","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Combining Large Language Models and Crowdsourcing for Hybrid Human-AI Misinformation Detection"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7535-6904","authenticated-orcid":false,"given":"Xia","family":"Zeng","sequence":"first","affiliation":[{"name":"Queen Mary University of London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8215-5502","authenticated-orcid":false,"given":"David","family":"La Barbera","sequence":"additional","affiliation":[{"name":"University of Udine, Udine, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9191-3280","authenticated-orcid":false,"given":"Kevin","family":"Roitero","sequence":"additional","affiliation":[{"name":"University of Udine, Udine, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4583-3623","authenticated-orcid":false,"given":"Arkaitz","family":"Zubiaga","sequence":"additional","affiliation":[{"name":"Queen Mary University of London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2852-168X","authenticated-orcid":false,"given":"Stefano","family":"Mizzaro","sequence":"additional","affiliation":[{"name":"University of Udine, Udine, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,7,11]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.abf4393"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2022.103219"},{"key":"e_1_3_2_1_3_1","first-page":"65","article-title":"Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities","volume":"43","author":"Demartini Gianluca","year":"2020","unstructured":"Gianluca Demartini, Stefano Mizzaro, and Damiano Spina. 2020. Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities. IEEE Data Engineering Bulletin, Vol. 43, 3 (2020), 65--74. http:\/\/sites.computer.org\/debull\/A20sept\/p65.pdf","journal-title":"IEEE Data Engineering Bulletin"},{"key":"e_1_3_2_1_4_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. CoRR","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. CoRR, Vol. abs\/1810.04805 (2018). arxiv: 1810.04805"},{"key":"e_1_3_2_1_5_1","unstructured":"Harnoor Dhingra Preetiha Jayashanker Sayali Moghe and Emma Strubell. 2023. Queer People are People First: Deconstructing Sexual Identity Stereotypes in Large Language Models. arxiv: 2307.00101 [cs.CL]"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/IDSTA55301.2022.9923043"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3534629"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00454"},{"key":"e_1_3_2_1_9_1","unstructured":"Bing He Yibo Hu Yeon-Chang Lee Soyoung Oh Gaurav Verma and Srijan Kumar. 2023. A Survey on the Role of Crowds in Combating Online Misinformation: Annotators Evaluators and Creators. arxiv: 2310.02095 [cs.SI]"},{"key":"e_1_3_2_1_10_1","volume-title":"DeBERTa: Decoding-enhanced BERT with Disentangled Attention. arxiv","author":"He Pengcheng","year":"2006","unstructured":"Pengcheng He, Xiaodong Liu, Jianfeng Gao, and Weizhu Chen. 2021. DeBERTa: Decoding-enhanced BERT with Disentangled Attention. arxiv: 2006.03654"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.667881"},{"key":"e_1_3_2_1_12_1","first-page":"43","article-title":"Computing Krippendorff's Alpha-Reliability","volume":"1","author":"Krippendorff Klaus","year":"2008","unstructured":"Klaus Krippendorff. 2008. Computing Krippendorff's Alpha-Reliability. UPENN Libraries, Vol. 1 (2008), 43. https:\/\/repository.upenn.edu\/asc_papers\/43","journal-title":"UPENN Libraries"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-45442-5_26"},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of the 6th Workshop on Natural Language for Artificial Intelligence (NL4AI '22)","author":"Barbera David La","year":"2022","unstructured":"David La Barbera, Kevin Roitero, and Stefano Mizzaro. 2022. A Hybrid Human-In-The-Loop Framework for Fact Checking. In Proceedings of the 6th Workshop on Natural Language for Artificial Intelligence (NL4AI '22). CEUR-WS.org, Udine, Italy, 1--10. https:\/\/ceur-ws.org\/Vol-3287\/paper4.pdf"},{"key":"e_1_3_2_1_15_1","volume-title":"A Paragraph-level Multi-task Learning Model for Scientific Fact-Verification. arXiv","author":"Li Xiangci","year":"2021","unstructured":"Xiangci Li, Gully Burns, and Nanyun Peng. 2021. A Paragraph-level Multi-task Learning Model for Scientific Fact-Verification. arXiv, Vol. abs\/2012.14500 (Jan. 2021). http:\/\/arxiv.org\/abs\/2012.14500"},{"key":"e_1_3_2_1_16_1","volume-title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR, Vol. abs\/1907.11692 (2019). arxiv: 1907.11692"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/619"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3546916"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Dorian Quelle and Alexandre Bovet. 2023. The Perils & Promises of Fact-checking with Large Language Models. arxiv: 2310.13549 [cs.CL]","DOI":"10.3389\/frai.2024.1341697"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401112"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3511808.3557279"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2021.102710"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.findings-naacl.6"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-2067"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/WIFS53200.2021.9648388"},{"key":"e_1_3_2_1_26_1","volume-title":"Proceedings of the 35th Conference on Computational Linguistics and Speech Processing (ROCLING 2023","author":"Yeh Kai-Ching","year":"2023","unstructured":"Kai-Ching Yeh, Jou-An Chi, Da-Chen Lian, and Shu-Kai Hsieh. 2023. Evaluating Interfaced LLM Bias. In Proceedings of the 35th Conference on Computational Linguistics and Speech Processing (ROCLING 2023), Jheng-Long Wu and Ming-Hsiang Su (Eds.). The Association for Computational Linguistics and Chinese Language Processing (ACLCLP), Taipei City, Taiwan, 292--299. https:\/\/aclanthology.org\/2023.rocling-1.37"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1111\/lnc3.12438"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","unstructured":"Xia Zeng and Arkaitz Zubiaga. 2021. QMUL-SDS at SCIVER: Step-by-Step Binary Classification for Scientific Claim Verification. In Proceedings of the Second Workshop on Scholarly Document Processing Iz Beltagy Arman Cohan Guy Feigenblat Dayne Freitag Tirthankar Ghosal Keith Hall Drahomira Herrmannova Petr Knoth Kyle Lo Philipp Mayr Robert M. Patton Michal Shmueli-Scheuer Anita de Waard Kuansan Wang and Lucy Lu Wang (Eds.). Association for Computational Linguistics Online 116--123. https:\/\/doi.org\/10.18653\/v1\/2021.sdp-1.15","DOI":"10.18653\/v1\/2021.sdp-1.15"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.1137"},{"key":"e_1_3_2_1_30_1","volume-title":"Active PETs: Active Data Annotation Prioritisation for Few-Shot Claim Verification with Pattern Exploiting Training. In Findings of the Association for Computational Linguistics: EACL 2023","author":"Zeng Xia","year":"2023","unstructured":"Xia Zeng and Arkaitz Zubiaga. 2023. Active PETs: Active Data Annotation Prioritisation for Few-Shot Claim Verification with Pattern Exploiting Training. In Findings of the Association for Computational Linguistics: EACL 2023. Association for Computational Linguistics, Dubrovnik, Croatia, 190--204. https:\/\/aclanthology.org\/2023.findings-eacl.14"},{"key":"e_1_3_2_1_31_1","volume-title":"MAPLE: Micro Analysis of Pairwise Language Evolution for Few-Shot Claim Verification. In Findings of the Association for Computational Linguistics: EACL 2024","author":"Zeng Xia","year":"2024","unstructured":"Xia Zeng and Arkaitz Zubiaga. 2024. MAPLE: Micro Analysis of Pairwise Language Evolution for Few-Shot Claim Verification. In Findings of the Association for Computational Linguistics: EACL 2024, Yvette Graham and Matthew Purver (Eds.). Association for Computational Linguistics, St. Julian's, Malta, 1177--1196. https:\/\/aclanthology.org\/2024.findings-eacl.79"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.290"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.54501\/jots.v2i1.118"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1201\/b12207"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2023.1350306"}],"event":{"name":"SIGIR 2024: The 47th International ACM SIGIR Conference on Research and Development in Information Retrieval","location":"Washington DC USA","acronym":"SIGIR 2024","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3626772.3657965","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3626772.3657965","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T05:42:46Z","timestamp":1755841366000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3626772.3657965"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,10]]},"references-count":35,"alternative-id":["10.1145\/3626772.3657965","10.1145\/3626772"],"URL":"https:\/\/doi.org\/10.1145\/3626772.3657965","relation":{},"subject":[],"published":{"date-parts":[[2024,7,10]]},"assertion":[{"value":"2024-07-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}