{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T13:19:10Z","timestamp":1774012750142,"version":"3.50.1"},"reference-count":159,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2024,11,7]],"date-time":"2024-11-07T00:00:00Z","timestamp":1730937600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1939606, DGE-2125858"],"award-info":[{"award-number":["IIS-1939606, DGE-2125858"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,11,7]]},"abstract":"<jats:p>\n            While many Natural Language Processing (NLP) techniques have been proposed for fact-checking, both academic research and fact-checking organizations report limited adoption of such NLP work due to poor alignment with fact-checker practices, values, and needs. To address this, we investigate a co-design method,\n            <jats:italic toggle=\"yes\">Matchmaking for AI,<\/jats:italic>\n            to enable fact-checkers, designers, and NLP researchers to collaboratively identify what fact-checker needs should be addressed by technology, and to brainstorm ideas for potential solutions. Co-design sessions we conducted with 22 professional fact-checkers yielded a set of 11 design ideas that offer a \"north star'', integrating fact-checker criteria into novel NLP design concepts. These concepts range from pre-bunking misinformation, efficient and personalized monitoring misinformation, proactively reducing fact-checker potential biases, and collaborative writing fact-check reports. Our work provides new insights into both human-centered fact-checking research and practice and AI co-design research.\n          <\/jats:p>","DOI":"10.1145\/3686962","type":"journal-article","created":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T15:52:40Z","timestamp":1731081160000},"page":"1-44","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0983-6202","authenticated-orcid":false,"given":"Houjiang","family":"Liu","sequence":"first","affiliation":[{"name":"School of Information, University of Texas at Austin, Austin, Texas, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5412-6149","authenticated-orcid":false,"given":"Anubrata","family":"Das","sequence":"additional","affiliation":[{"name":"School of Information, University of Texas at Austin, Austin, Texas, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2666-1838","authenticated-orcid":false,"given":"Alexander","family":"Boltz","sequence":"additional","affiliation":[{"name":"Human Centered Design &amp; Engineering, University of Washington, Seattle, Washington, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9637-6154","authenticated-orcid":false,"given":"Didi","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Information, University of Texas at Austin, Austin, Texas, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0448-8851","authenticated-orcid":false,"given":"Daisy","family":"Pinaroc","sequence":"additional","affiliation":[{"name":"School of Information, University of Texas at Austin, Austin, Texas, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0056-2834","authenticated-orcid":false,"given":"Matthew","family":"Lease","sequence":"additional","affiliation":[{"name":"School of Information, University of Texas at Austin, Austin, Texas, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2696-6546","authenticated-orcid":false,"given":"Min Kyung","family":"Lee","sequence":"additional","affiliation":[{"name":"School of Information, University of Texas at Austin, Austin, Texas, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,11,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Bill Adair. 2020. Squash report card: Improvements during State of the Union. .. and how humans will make our AI smarter - Duke Reporters' Lab. https:\/\/reporterslab.org\/squash-report-card-improvements-during-state-of-the-union-and-how-humans-will-make-our-ai-smarter\/"},{"key":"e_1_2_1_2_1","volume-title":"Shaden Shaar, Hamed Firooz, and Preslav Nakov.","author":"Alam Firoj","year":"2022","unstructured":"Firoj Alam, Stefano Cresci, Tanmoy Chakraborty, Fabrizio Silvestri, Dimiter Dimitrov, Giovanni Da San Martino, Shaden Shaar, Hamed Firooz, and Preslav Nakov. 2022. A Survey on Multimodal Disinformation Detection. In Proceedings of the 29th International Conference on Computational Linguistics, Nicoletta Calzolari, Chu-Ren Huang, Hansaem Kim, James Pustejovsky, Leo Wanner, Key-Sun Choi, Pum-Mo Ryu, Hsin-Hsi Chen, Lucia Donatelli, Heng Ji, Sadao Kurohashi, Patrizia Paggio, Nianwen Xue, Seokhwan Kim, Younggyun Hahm, Zhong He, Tony Kyungil Lee, Enrico Santus, Francis Bond, and Seung-Hoon Na (Eds.). International Committee on Computational Linguistics, Gyeongju, Republic of Korea, 6625--6643."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v15i1.18114"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.findings-emnlp.56"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359301"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.acl-long.752"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1017\/pan.2023.2"},{"key":"e_1_2_1_8_1","unstructured":"Phoebe Arnold. 2020. The challenges of online fact checking: how technology can (and can't) help - Full Fact. https:\/\/fullfact.org\/blog\/2020\/dec\/the-challenges-of-online-fact-checking-how-technology-can-and-cant-help\/. (Accessed on 09\/11\/2021)."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472225"},{"key":"e_1_2_1_10_1","volume-title":"Fact-checking Multidimensional Statistic Claims in French. In TTO 2022-Truth and Trust Online.","author":"Balalau Oana","year":"2022","unstructured":"Oana Balalau, Simon Ebel, Th\u00e9o Galizzi, Ioana Manolescu, Quentin Massonnat, Antoine Deiana, Emilie Gautreau, Antoine Krempf, Thomas Pontillon, G\u00e9rald Roux, and Others. 2022. Fact-checking Multidimensional Statistic Claims in French. In TTO 2022-Truth and Trust Online."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000024"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-031--28241--6_59"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1183463.1183464"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376718"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 2020 Computation Journalism Symposium (Boston, MA, USA)(C J 2020).","author":"Beers Andrew","year":"2020","unstructured":"Andrew Beers, Melinda McClure Haughey, Ahmer Arif, and Kate Starbird. 2020. Examining the digital toolsets of journalists reporting on disinformation. In Proceedings of the 2020 Computation Journalism Symposium (Boston, MA, USA)(C J 2020)."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-tutorials.6"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.636"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/296165.296174"},{"key":"e_1_2_1_19_1","unstructured":"Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language models are few-shot learners. Advances in neural information processing systems Vol. 33 (2020) 1877--1901."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359206"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-030--42699--6_8"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 29th International Conference on Computational Linguistics. 5613--5635","author":"Castro Santiago","year":"2022","unstructured":"Santiago Castro, Naihao Deng, Pingxuan Huang, Mihai Burzo, and Rada Mihalcea. 2022. In-the-Wild Video Question Answering. In Proceedings of the 29th International Conference on Computational Linguistics. 5613--5635."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1177\/0894439318791168"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.naacl-long.196"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.emnlp-main.229"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.nlpcss-1.16"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00377"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3417108"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3064663.3064667"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300231"},{"key":"e_1_2_1_31_1","unstructured":"David Corney. 2021. Towards a common definition of claim matching. https:\/\/fullfact.org\/blog\/2021\/oct\/towards-common-definition-claim-matching\/. Accessed: 2022--9--12."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2022.103219"},{"key":"e_1_2_1_33_1","volume-title":"\u201cAdd Diverse Stakeholders and Stir\u201d. (1","author":"Delgado Fernando","year":"2021","unstructured":"Fernando Delgado, Stephen Yang, Michael Madaio, and Qian Yang. 2021. Stakeholder Participation in AI: Beyond \u201cAdd Diverse Stakeholders and Stir\u201d. (1 Nov. 2021). arxiv: 2111.01122 [cs.AI]"},{"key":"e_1_2_1_34_1","first-page":"65","article-title":"Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation","volume":"43","author":"Demartini Gianluca","year":"2020","unstructured":"Gianluca Demartini, Stefano Mizzaro, and Damiano Spina. 2020. Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities. IEEE Data Eng. Bull., Vol. 43, 3 (2020), 65--74.","journal-title":"Challenges and Opportunities. IEEE Data Eng. Bull."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"e_1_2_1_36_1","unstructured":"Michael Dobbs. 2012. The rise of political fact-checking: How Reagan inspired a journalistic movement: A reporter's eye view. Technical Report."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1473--3099(20)30120--1"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/1368430220982068"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1111\/pops.12568"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025739"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.580"},{"key":"e_1_2_1_42_1","unstructured":"Daniel Funke. 2017. In a step toward automation Full Fact has built a live fact-checking prototype. https:\/\/www.poynter.org\/fact-checking\/2017\/in-a-step-toward-automation-full-fact-has-built-a-live-fact-checking-prototype\/. Accessed: 2023--6--15."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331285"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","unstructured":"D Graves. 2018. Understanding the promise and limits of automated fact-checking. (2018). https:\/\/doi.org\/10.60625\/risj-nqnx-bg89","DOI":"10.60625\/risj-nqnx-bg89"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1111\/cccr.12163"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1080\/1461670X.2016.1196602"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00454"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3543507.3583290"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.findings-naacl.94"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445723"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137765.3137815"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3543507.3583214"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v6i1.14245"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1006\/obhd.1995.1039"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303030"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479864"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.acl-long.815"},{"key":"e_1_2_1_58_1","first-page":"1094","article-title":"Lexicon of lies: Terms for problematic information","volume":"3","author":"Jack Caroline","year":"2017","unstructured":"Caroline Jack. 2017. Lexicon of lies: Terms for problematic information. Data & Society, Vol. 3, 22 (2017), 1094--1096.","journal-title":"Data & Society"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.51"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3451727"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.1"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555143"},{"key":"e_1_2_1_63_1","volume-title":"HAGRID: A Human-LLM Collaborative Dataset for Generative Information-Seeking with Attribution. (July","author":"Kamalloo Ehsan","year":"2023","unstructured":"Ehsan Kamalloo, Aref Jafari, Xinyu Zhang, Nandan Thakur, and Jimmy Lin. 2023. HAGRID: A Human-LLM Collaborative Dataset for Generative Information-Seeking with Attribution. (July 2023). arxiv: 2307.16883 [cs.CL]"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415520"},{"key":"e_1_2_1_65_1","volume-title":"Too Many Claims to Fact-Check: Prioritizing Political Claims Based on Check-Worthiness. (April","author":"Kartal Yavuz Selim","year":"2020","unstructured":"Yavuz Selim Kartal, Busra Guvenen, and Mucahid Kutlu. 2020. Too Many Claims to Fact-Check: Prioritizing Political Claims Based on Check-Worthiness. (April 2020). arxiv: 2004.08166 [cs.CL]"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.347"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.nlp4if-1.7"},{"key":"e_1_2_1_68_1","volume-title":"Heritage: Having a say","author":"Kensing Finn","year":"2012","unstructured":"Finn Kensing and Joan Greenbaum. 2012. Heritage: Having a say. In Routledge international handbook of participatory design. Routledge, 41--56."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1080\/21670811.2021.2006073"},{"key":"e_1_2_1_70_1","volume-title":"AI-Augmented Surveys: Leveraging Large Language Models and Surveys for Opinion Prediction. (16","author":"Kim Junsol","year":"2023","unstructured":"Junsol Kim and Byungkyu Lee. 2023. AI-Augmented Surveys: Leveraging Large Language Models and Surveys for Opinion Prediction. (16 May 2023). arxiv: 2305.09620 [cs.CL]"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2023.103160"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17--3204"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacr.2017.12.029"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419249.3420105"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3412869"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580882"},{"key":"e_1_2_1_77_1","volume-title":"Towards a Science of Human-AI Decision Making: A Survey of Empirical Studies. (Dec","author":"Lai Vivian","year":"2021","unstructured":"Vivian Lai, Chacha Chen, Q Vera Liao, Alison Smith-Renner, and Chenhao Tan. 2021. Towards a Science of Human-AI Decision Making: A Survey of Empirical Studies. (Dec. 2021). arxiv: 2112.11471 [cs.AI]"},{"key":"e_1_2_1_78_1","unstructured":"Matt Lease. 2020. Designing human-AI partnerships to combat misinfomation."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.1.50_30392"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502030"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951718756684"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359283"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00440"},{"key":"e_1_2_1_84_1","first-page":"9459","article-title":"Retrieval-augmented generation for knowledge-intensive nlp tasks","volume":"33","author":"Lewis Patrick","year":"2020","unstructured":"Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich K\u00fcttler, Mike Lewis, Wen-tau Yih, Tim Rockt\u00e4schel, et al. 2020. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems, Vol. 33 (2020), 9459--9474.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441694"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/3563657.3596123"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581058"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-030--87031--7_6"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512974"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","unstructured":"Preslav Nakov Alberto Barr\u00f3n-Cede no Giovanni Da San Martino Firoj Alam Julia Maria Stru\u00df Thomas Mandl Rub\u00e9n M\u00edguez Tommaso Caselli Mucahid Kutlu Wajdi Zaghouani Chengkai Li Shaden Shaar Gautam Kishore Shahi Hamdy Mubarak Alex Nikolov Nikolay Babulkov Yavuz Selim Kartal and Javier Beltr\u00e1n. 2022. The CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection. In Advances in Information Retrieval. Springer International Publishing 416--428. https:\/\/doi.org\/10.1007\/978--3-030--99739--7_52","DOI":"10.1007\/978--3-030--99739--7_52"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/619"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242666"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401408"},{"key":"e_1_2_1_95_1","volume-title":"Cross-Language Information Retrieval","author":"Nie Jian-Yun","unstructured":"Jian-Yun Nie. 2022. Cross-Language Information Retrieval. Springer Nature."},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/1806491.1806494"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.97"},{"key":"e_1_2_1_98_1","volume-title":"Qualitative Research & Evaluation Methods: Integrating Theory and Practice","author":"Patton Michael Quinn","unstructured":"Michael Quinn Patton. 2014. Qualitative Research & Evaluation Methods: Integrating Theory and Practice. SAGE Publications."},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.200"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-linguistics-031120--111653"},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2104235118"},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.36190\/2023.28"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17--1317"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0241045"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.eacl-main.99"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1177\/1940161219898055"},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00601"},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1145\/2309996.2310044"},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.165"},{"key":"e_1_2_1_110_1","unstructured":"Mohammed Saeed and Paolo Papotti. 2021. Fact-checking statistical claims with tables. https:\/\/www.eurecom.fr\/publication\/6630\/download\/data-publi-6630.pdf. Accessed: 2023--6--14."},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1080\/15710880701875068"},{"key":"e_1_2_1_112_1","volume-title":"Proceedings of the 40th International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"30004","author":"Santurkar Shibani","year":"2023","unstructured":"Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, and Tatsunori Hashimoto. 2023. Whose Opinions Do Language Models Reflect?. In Proceedings of the 40th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 202), Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 29971--30004."},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.findings-emnlp.297"},{"key":"e_1_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.1145\/3641010"},{"key":"e_1_2_1_115_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.332"},{"key":"e_1_2_1_116_1","volume-title":"Fatima Haouari, Alex Nikolov, Mucahid Kutlu, Yavuz Selim Kartal, Firoj Alam, and Giovanni Da San Martino.","author":"Shaar Shaden","year":"2021","unstructured":"Shaden Shaar, Maram Hasanain, Baya Hamdan, Zien Sheikh Ali, Fatima Haouari, Alex Nikolov, Mucahid Kutlu, Yavuz Selim Kartal, Firoj Alam, and Giovanni Da San Martino. 2021. Overview of the CLEF-2021 CheckThat! lab task 1 on check-worthiness estimation in tweets and political debates. In CLEF (Working Notes). gcris.etu.edu.tr."},{"key":"e_1_2_1_117_1","volume-title":"Conference and Labs of the Evaluation Forum","author":"Shaar S","year":"2021","unstructured":"S Shaar, Maram Hasanain, Bayan Hamdan, Zien Sheikh Ali, Fatima Haouari, Alex Nikolov, Mucahid Kutlu, Yavuz Selim Kartal, Firoj Alam, Giovanni Da San Martino, Alberto Barr\u00f3n-Cede no, Rub\u00e9n M\u00edguez, Javier Beltr\u00e1n, Tamer Elsayed, and Preslav Nakov. 2021. Overview of the CLEF-2021 CheckThat! Lab task 1 on check-worthiness estimation in tweets and political debates. Conference and Labs of the Evaluation Forum (2021), 369--392."},{"key":"e_1_2_1_118_1","volume-title":"Julia Maria Stru\u00df, and Thomas Mandl","author":"Shahi Gautam Kishore","year":"2021","unstructured":"Gautam Kishore Shahi, Julia Maria Stru\u00df, and Thomas Mandl. 2021. Overview of the CLEF-2021 CheckThat! Lab: Task 3 on Fake News Detection.. In CLEF (Working Notes). 406--423."},{"key":"e_1_2_1_119_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872518.2890098"},{"key":"e_1_2_1_120_1","volume-title":"Should you trust media bias charts. URL: https:\/\/www. poynter. org\/factchecking\/media-literacy\/2021\/should-you-trust-media-bias-charts","author":"Sheridan J","year":"2021","unstructured":"J Sheridan. 2021. Should you trust media bias charts. URL: https:\/\/www. poynter. org\/factchecking\/media-literacy\/2021\/should-you-trust-media-bias-charts (2021)."},{"key":"e_1_2_1_121_1","doi-asserted-by":"publisher","DOI":"10.1109\/TTS.2020.2992669"},{"key":"e_1_2_1_122_1","volume-title":"Junyi Jessy Li, and Matthew Lease","author":"Singh Prakhar","year":"2021","unstructured":"Prakhar Singh, Anubrata Das, Junyi Jessy Li, and Matthew Lease. 2021. The Case for Claim Difficulty Assessment in Automatic Fact Checking. (Sept. 2021). arxiv: 2109.09689 [cs.CL]"},{"key":"e_1_2_1_123_1","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3382901"},{"key":"e_1_2_1_124_1","volume-title":"TTO","author":"Srinivasan Santhosh","year":"2019","unstructured":"Santhosh Srinivasan and Craig Fagan. 2019. Rating the disinformation risks of news domains: the Global Disinformation Index. In TTO 2019. truthandtrustonline.com."},{"key":"e_1_2_1_125_1","doi-asserted-by":"publisher","DOI":"10.1177\/20539517221115189"},{"key":"e_1_2_1_126_1","doi-asserted-by":"publisher","DOI":"10.1162\/desi_a_00207"},{"key":"e_1_2_1_127_1","unstructured":"Mark Stencel Erica Ryan and Joel Luther. 2022. Fact-checkers extend their global reach with 391 outlets but growth has slowed. Technical Report. Duke Reporters' Lab."},{"key":"e_1_2_1_128_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555130"},{"key":"e_1_2_1_129_1","doi-asserted-by":"publisher","DOI":"10.2196\/17187"},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517537"},{"key":"e_1_2_1_131_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461778.3462012"},{"key":"e_1_2_1_132_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2018.09.008"},{"key":"e_1_2_1_133_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0001131"},{"key":"e_1_2_1_134_1","unstructured":"The Poynter Institute. 2021. Global Fact 8 Pre-recorded Segment 4. https:\/\/www.youtube.com\/watch?v=gOhPKDaeQxI&t=770s"},{"key":"e_1_2_1_135_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3312843"},{"key":"e_1_2_1_136_1","doi-asserted-by":"publisher","DOI":"10.26615\/978--954--452-056--4_141"},{"key":"e_1_2_1_137_1","doi-asserted-by":"publisher","DOI":"10.1080\/15710880500135987"},{"key":"e_1_2_1_138_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331248"},{"key":"e_1_2_1_139_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.609"},{"key":"e_1_2_1_140_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.findings-emnlp.240"},{"key":"e_1_2_1_141_1","volume-title":"Proceedings of the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing, Su Lin Blodgett, Michael Madaio, Brendan O'Connor","author":"Wang Zijie J","unstructured":"Zijie J Wang, Dongjin Choi, Shenyu Xu, and Diyi Yang. 2021. Putting Humans in the Natural Language Processing Loop: A Survey. In Proceedings of the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing, Su Lin Blodgett, Michael Madaio, Brendan O'Connor, Hanna Wallach, and Qian Yang (Eds.). Association for Computational Linguistics, Online, 47--52."},{"key":"e_1_2_1_142_1","doi-asserted-by":"publisher","unstructured":"Claire Wardle. [n. d.]. Misinformation Has Created a New World Disorder. Scientific American ( [n. d.]). https:\/\/doi.org\/10.1038\/scientificamerican0919--88","DOI":"10.1038\/scientificamerican0919--88"},{"key":"e_1_2_1_143_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcom.12164"},{"key":"e_1_2_1_144_1","volume-title":"Brian Lester, Nan Du, Andrew M Dai, and Quoc V Le.","author":"Wei Jason","year":"2021","unstructured":"Jason Wei, Maarten Bosma, Vincent Y Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M Dai, and Quoc V Le. 2021. Finetuned Language Models Are Zero-Shot Learners. (3 Sept. 2021). arxiv: 2109.01652 [cs.CL]"},{"key":"e_1_2_1_145_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00192"},{"key":"e_1_2_1_146_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517582"},{"key":"e_1_2_1_147_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.emnlp-main.679"},{"key":"e_1_2_1_148_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403275"},{"key":"e_1_2_1_149_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300415"},{"key":"e_1_2_1_150_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300468"},{"key":"e_1_2_1_151_1","doi-asserted-by":"publisher","DOI":"10.1145\/3563657.3596058"},{"key":"e_1_2_1_152_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501866"},{"key":"e_1_2_1_153_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-030--72240--1_48"},{"key":"e_1_2_1_154_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3133182"},{"key":"e_1_2_1_155_1","doi-asserted-by":"publisher","DOI":"10.1145\/3395046"},{"key":"e_1_2_1_156_1","doi-asserted-by":"publisher","DOI":"10.1080\/07370024.2020.1736075"},{"key":"e_1_2_1_157_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274463"},{"key":"e_1_2_1_158_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517789"},{"key":"e_1_2_1_159_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3516506"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686962","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3686962","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T09:28:32Z","timestamp":1755768512000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686962"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,7]]},"references-count":159,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2024,11,7]]}},"alternative-id":["10.1145\/3686962"],"URL":"https:\/\/doi.org\/10.1145\/3686962","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,7]]},"assertion":[{"value":"2024-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}