{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T23:48:40Z","timestamp":1769557720374,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":41,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,23]]},"DOI":"10.1145\/3715275.3732104","type":"proceedings-article","created":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T17:01:18Z","timestamp":1750698078000},"page":"1565-1587","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["LExT: Towards Evaluating Trustworthiness of Natural Language Explanations"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-9999-9785","authenticated-orcid":false,"given":"Krithi","family":"Shailya","sequence":"first","affiliation":[{"name":"Indian Institute of Technology, Madras, Chennai, Tamil Nadu, India"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-4578-0465","authenticated-orcid":false,"given":"Shreya","family":"Rajpal","sequence":"additional","affiliation":[{"name":"Vellore Institute of Technology, Vellore, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1344-4722","authenticated-orcid":false,"given":"Gokul S","family":"Krishnan","sequence":"additional","affiliation":[{"name":"Indian Institute of Technology, Madras, Chennai, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5364-7639","authenticated-orcid":false,"given":"Balaraman","family":"Ravindran","sequence":"additional","affiliation":[{"name":"Indian Institute of Technology, Madras, Chennai, India"}]}],"member":"320","published-online":{"date-parts":[[2025,6,23]]},"reference":[{"key":"e_1_3_3_2_2_2","unstructured":"Marah Abdin Jyoti Aneja Hany Awadalla Ahmed Awadallah Ammar\u00a0Ahmad Awan Nguyen Bach Amit Bahree Arash Bakhtiari Jianmin Bao Harkirat Behl Alon Benhaim Misha Bilenko Johan Bjorck S\u00e9bastien Bubeck Martin Cai Qin Cai Vishrav Chaudhary Dong Chen Dongdong Chen Weizhu Chen Yen-Chun Chen Yi-Ling Chen Hao Cheng Parul Chopra Xiyang Dai Matthew Dixon Ronen Eldan Victor Fragoso Jianfeng Gao Mei Gao Min Gao Amit Garg Allie\u00a0Del Giorno Abhishek Goswami Suriya Gunasekar Emman Haider Junheng Hao Russell\u00a0J. Hewett Wenxiang Hu Jamie Huynh Dan Iter Sam\u00a0Ade Jacobs Mojan Javaheripi Xin Jin Nikos Karampatziakis Piero Kauffmann Mahoud Khademi Dongwoo Kim Young\u00a0Jin Kim Lev Kurilenko James\u00a0R. Lee Yin\u00a0Tat Lee Yuanzhi Li Yunsheng Li Chen Liang Lars Liden Xihui Lin Zeqi Lin Ce Liu Liyuan Liu Mengchen Liu Weishung Liu Xiaodong Liu Chong Luo Piyush Madan Ali Mahmoudzadeh David Majercak Matt Mazzola Caio C\u00e9sar\u00a0Teodoro Mendes Arindam Mitra Hardik Modi Anh Nguyen Brandon Norick Barun Patra Daniel Perez-Becker Thomas Portet Reid Pryzant Heyang Qin Marko Radmilac Liliang Ren Gustavo de Rosa Corby Rosset Sambudha Roy Olatunji Ruwase Olli Saarikivi Amin Saied Adil Salim Michael Santacroce Shital Shah Ning Shang Hiteshi Sharma Yelong Shen Swadheen Shukla Xia Song Masahiro Tanaka Andrea Tupini Praneetha Vaddamanu Chunyu Wang Guanhua Wang Lijuan Wang Shuohang Wang Xin Wang Yu Wang Rachel Ward Wen Wen Philipp Witte Haiping Wu Xiaoxia Wu Michael Wyatt Bin Xiao Can Xu Jiahang Xu Weijian Xu Jilong Xue Sonali Yadav Fan Yang Jianwei Yang Yifan Yang Ziyi Yang Donghan Yu Lu Yuan Chenruidong Zhang Cyril Zhang Jianwen Zhang Li\u00a0Lyna Zhang Yi Zhang Yue Zhang Yunan Zhang and Xiren Zhou. 2024. Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone. arxiv:https:\/\/arXiv.org\/abs\/2404.14219\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2404.14219"},{"key":"e_1_3_3_2_3_2","doi-asserted-by":"publisher","unstructured":"Amina Adadi and Mohammed Berrada. 2018. Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI). IEEE Access 6 (2018) 52138\u201352160. 10.1109\/ACCESS.2018.2870052","DOI":"10.1109\/ACCESS.2018.2870052"},{"key":"e_1_3_3_2_4_2","unstructured":"Chirag Agarwal Dan Ley Satyapriya Krishna Eshika Saxena Martin Pawelczyk Nari Johnson Isha Puri Marinka Zitnik and Himabindu Lakkaraju. 2024. OpenXAI: Towards a Transparent Evaluation of Model Explanations. arxiv:https:\/\/arXiv.org\/abs\/2206.11104\u00a0[cs.LG] https:\/\/arxiv.org\/abs\/2206.11104"},{"key":"e_1_3_3_2_5_2","unstructured":"Chirag Agarwal Sree\u00a0Harsha Tanneru and Himabindu Lakkaraju. 2024. Faithfulness vs. Plausibility: On the (Un)Reliability of Explanations from Large Language Models. arxiv:https:\/\/arXiv.org\/abs\/2402.04614\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2402.04614"},{"key":"e_1_3_3_2_6_2","unstructured":"Rohan Ajwani Shashidhar\u00a0Reddy Javaji Frank Rudzicz and Zining Zhu. 2024. LLM-Generated Black-box Explanations Can Be Adversarially Helpful. arxiv:https:\/\/arXiv.org\/abs\/2405.06800\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2405.06800"},{"key":"e_1_3_3_2_7_2","doi-asserted-by":"publisher","unstructured":"Sajid Ali Tamer Abuhmed Shaker El-Sappagh Khan Muhammad Jose\u00a0M. Alonso-Moral Roberto Confalonieri Riccardo Guidotti Javier Del Ser Natalia D\u00edaz-Rodr\u00edguez and Francisco Herrera. 2023. Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence. Information Fusion 99 (2023) 101805. 10.1016\/j.inffus.2023.101805","DOI":"10.1016\/j.inffus.2023.101805"},{"key":"e_1_3_3_2_8_2","unstructured":"Tom\u00a0B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel\u00a0M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. arxiv:https:\/\/arXiv.org\/abs\/2005.14165\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2005.14165"},{"key":"e_1_3_3_2_9_2","unstructured":"Yanda Chen Ruiqi Zhong Narutatsu Ri Chen Zhao He He Jacob Steinhardt Zhou Yu and Kathleen McKeown. 2023. Do Models Explain Themselves? Counterfactual Simulatability of Natural Language Explanations. arxiv:https:\/\/arXiv.org\/abs\/2307.08678\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2307.08678"},{"key":"e_1_3_3_2_10_2","unstructured":"Zeming Chen Alejandro\u00a0Hern\u00e1ndez Cano Angelika Romanou Antoine Bonnet Kyle Matoba Francesco Salvi Matteo Pagliardini Simin Fan Andreas K\u00f6pf Amirkeivan Mohtashami Alexandre Sallinen Alireza Sakhaeirad Vinitra Swamy Igor Krawczuk Deniz Bayazit Axel Marmet Syrielle Montariol Mary-Anne Hartley Martin Jaggi and Antoine Bosselut. 2023. MEDITRON-70B: Scaling Medical Pretraining for Large Language Models. arxiv:https:\/\/arXiv.org\/abs\/2311.16079\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2311.16079"},{"key":"e_1_3_3_2_11_2","unstructured":"Zichen Chen Jianda Chen Ambuj Singh and Misha Sra. 2024. XplainLLM: A Knowledge-Augmented Dataset for Reliable Grounded Explanations in LLMs. arxiv:https:\/\/arXiv.org\/abs\/2311.08614\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2311.08614"},{"key":"e_1_3_3_2_12_2","unstructured":"Zhiyu\u00a0Zoey Chen Jing Ma Xinlu Zhang Nan Hao An Yan Armineh Nourbakhsh Xianjun Yang Julian McAuley Linda Petzold and William\u00a0Yang Wang. 2024. A Survey on Large Language Models for Critical Societal Domains: Finance Healthcare and Law. arxiv:https:\/\/arXiv.org\/abs\/2405.01769\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2405.01769"},{"key":"e_1_3_3_2_13_2","unstructured":"Jacob Devlin Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arxiv:https:\/\/arXiv.org\/abs\/1810.04805\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/1810.04805"},{"key":"e_1_3_3_2_14_2","unstructured":"Shahul Es Jithin James Luis Espinosa-Anke and Steven Schockaert. 2023. RAGAS: Automated Evaluation of Retrieval Augmented Generation. arxiv:https:\/\/arXiv.org\/abs\/2309.15217\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2309.15217"},{"key":"e_1_3_3_2_15_2","unstructured":"Md\u00a0Meftahul Ferdaus Mahdi Abdelguerfi Elias Ioup Kendall\u00a0N. Niles Ken Pathak and Steven Sloan. 2024. Towards Trustworthy AI: A Review of Ethical and Robust Large Language Models. arxiv:https:\/\/arXiv.org\/abs\/2407.13934\u00a0[cs.CY] https:\/\/arxiv.org\/abs\/2407.13934"},{"key":"e_1_3_3_2_16_2","unstructured":"National\u00a0Center for Biotechnology\u00a0Information. 2023. PubMed Dataset. https:\/\/www.nlm.nih.gov\/databases\/download\/pubmed_medline.html Contains over 36 million citations for biomedical literature including MEDLINE life science journals and online books. Citations may include links to full-text content from PubMed Central and publisher websites.."},{"key":"e_1_3_3_2_17_2","unstructured":"Aaron Grattafiori Abhimanyu Dubey Abhinav Jauhri Abhinav Pandey Abhishek Kadian Ahmad Al-Dahle Aiesha Letman Akhil Mathur Alan Schelten Alex Vaughan Amy Yang Angela Fan Anirudh Goyal Anthony Hartshorn Aobo Yang Archi Mitra Archie Sravankumar Artem Korenev Arthur Hinsvark Arun Rao Aston Zhang Aurelien Rodriguez Austen Gregerson Ava Spataru Baptiste Roziere Bethany Biron Binh Tang Bobbie Chern Charlotte Caucheteux Chaya Nayak Chloe Bi Chris Marra Chris McConnell Christian Keller Christophe Touret Chunyang Wu Corinne Wong Cristian\u00a0Canton Ferrer Cyrus Nikolaidis Damien Allonsius Daniel Song Danielle Pintz Danny Livshits Danny Wyatt David Esiobu Dhruv Choudhary Dhruv Mahajan Diego Garcia-Olano Diego Perino Dieuwke Hupkes Egor Lakomkin Ehab AlBadawy Elina Lobanova Emily Dinan Eric\u00a0Michael Smith Filip Radenovic Francisco Guzm\u00e1n Frank Zhang Gabriel Synnaeve Gabrielle Lee Georgia\u00a0Lewis Anderson Govind Thattai Graeme Nail Gregoire Mialon Guan Pang Guillem Cucurell Hailey Nguyen Hannah Korevaar Hu Xu Hugo Touvron Iliyan Zarov Imanol\u00a0Arrieta Ibarra Isabel Kloumann Ishan Misra Ivan Evtimov Jack Zhang Jade Copet Jaewon Lee Jan Geffert Jana Vranes Jason Park Jay Mahadeokar Jeet Shah Jelmer van\u00a0der Linde Jennifer Billock Jenny Hong Jenya Lee Jeremy Fu Jianfeng Chi Jianyu Huang Jiawen Liu Jie Wang Jiecao Yu Joanna Bitton Joe Spisak Jongsoo Park Joseph Rocca Joshua Johnstun Joshua Saxe Junteng Jia Kalyan\u00a0Vasuden Alwala Karthik Prasad Kartikeya Upasani Kate Plawiak Ke Li Kenneth Heafield Kevin Stone Khalid El-Arini Krithika Iyer Kshitiz Malik Kuenley Chiu Kunal Bhalla Kushal Lakhotia Lauren Rantala-Yeary Laurens van\u00a0der Maaten Lawrence Chen Liang Tan Liz Jenkins Louis Martin Lovish Madaan Lubo Malo Lukas Blecher Lukas Landzaat Luke de Oliveira Madeline Muzzi Mahesh Pasupuleti Mannat Singh Manohar Paluri Marcin Kardas Maria Tsimpoukelli Mathew Oldham Mathieu Rita Maya Pavlova Melanie Kambadur Mike Lewis Min Si Mitesh\u00a0Kumar Singh Mona Hassan Naman Goyal Narjes Torabi Nikolay Bashlykov Nikolay Bogoychev Niladri Chatterji Ning Zhang Olivier Duchenne Onur \u00c7elebi Patrick Alrassy Pengchuan Zhang Pengwei Li Petar Vasic Peter Weng Prajjwal Bhargava Pratik Dubal Praveen Krishnan Punit\u00a0Singh Koura Puxin Xu Qing He Qingxiao Dong Ragavan Srinivasan Raj Ganapathy Ramon Calderer Ricardo\u00a0Silveira Cabral Robert Stojnic Roberta Raileanu Rohan Maheswari Rohit Girdhar Rohit Patel Romain Sauvestre Ronnie Polidoro Roshan Sumbaly Ross Taylor Ruan Silva Rui Hou Rui Wang Saghar Hosseini Sahana Chennabasappa Sanjay Singh Sean Bell Seohyun\u00a0Sonia Kim Sergey Edunov Shaoliang Nie Sharan Narang Sharath Raparthy Sheng Shen Shengye Wan Shruti Bhosale Shun Zhang Simon Vandenhende Soumya Batra Spencer Whitman Sten Sootla Stephane Collot Suchin Gururangan Sydney Borodinsky Tamar Herman Tara Fowler Tarek Sheasha Thomas Georgiou Thomas Scialom Tobias Speckbacher Todor Mihaylov Tong Xiao Ujjwal Karn Vedanuj Goswami Vibhor Gupta Vignesh Ramanathan Viktor Kerkez Vincent Gonguet Virginie Do Vish Vogeti V\u00edtor Albiero Vladan Petrovic Weiwei Chu Wenhan Xiong Wenyin Fu Whitney Meers Xavier Martinet Xiaodong Wang Xiaofang Wang Xiaoqing\u00a0Ellen Tan Xide Xia Xinfeng Xie Xuchao Jia Xuewei Wang Yaelle Goldschlag Yashesh Gaur Yasmine Babaei Yi Wen Yiwen Song Yuchen Zhang Yue Li Yuning Mao Zacharie\u00a0Delpierre Coudert Zheng Yan Zhengxing Chen Zoe Papakipos Aaditya Singh Aayushi Srivastava Abha Jain Adam Kelsey Adam Shajnfeld Adithya Gangidi Adolfo Victoria Ahuva Goldstand Ajay Menon Ajay Sharma Alex Boesenberg Alexei Baevski Allie Feinstein Amanda Kallet Amit Sangani Amos Teo Anam Yunus Andrei Lupu Andres Alvarado Andrew Caples Andrew Gu Andrew Ho Andrew Poulton Andrew Ryan Ankit Ramchandani Annie Dong Annie Franco Anuj Goyal Aparajita Saraf Arkabandhu Chowdhury Ashley Gabriel Ashwin Bharambe Assaf Eisenman Azadeh Yazdan Beau James Ben Maurer Benjamin Leonhardi Bernie Huang Beth Loyd Beto\u00a0De Paola Bhargavi Paranjape Bing Liu Bo Wu Boyu Ni Braden Hancock Bram Wasti Brandon Spence Brani Stojkovic Brian Gamido Britt Montalvo Carl Parker Carly Burton Catalina Mejia Ce Liu Changhan Wang Changkyu Kim Chao Zhou Chester Hu Ching-Hsiang Chu Chris Cai Chris Tindal Christoph Feichtenhofer Cynthia Gao Damon Civin Dana Beaty Daniel Kreymer Daniel Li David Adkins David Xu Davide Testuggine Delia David Devi Parikh Diana Liskovich Didem Foss Dingkang Wang Duc Le Dustin Holland Edward Dowling Eissa Jamil Elaine Montgomery Eleonora Presani Emily Hahn Emily Wood Eric-Tuan Le Erik Brinkman Esteban Arcaute Evan Dunbar Evan Smothers Fei Sun Felix Kreuk Feng Tian Filippos Kokkinos Firat Ozgenel Francesco Caggioni Frank Kanayet Frank Seide Gabriela\u00a0Medina Florez Gabriella Schwarz Gada Badeer Georgia Swee Gil Halpern Grant Herman Grigory Sizov Guangyi Zhang Guna Lakshminarayanan Hakan Inan Hamid Shojanazeri Han Zou Hannah Wang Hanwen Zha Haroun Habeeb Harrison Rudolph Helen Suk Henry Aspegren Hunter Goldman Hongyuan Zhan Ibrahim Damlaj Igor Molybog Igor Tufanov Ilias Leontiadis Irina-Elena Veliche Itai Gat Jake Weissman James Geboski James Kohli Janice Lam Japhet Asher Jean-Baptiste Gaya Jeff Marcus Jeff Tang Jennifer Chan Jenny Zhen Jeremy Reizenstein Jeremy Teboul Jessica Zhong Jian Jin Jingyi Yang Joe Cummings Jon Carvill Jon Shepard Jonathan McPhie Jonathan Torres Josh Ginsburg Junjie Wang Kai Wu Kam\u00a0Hou U Karan Saxena Kartikay Khandelwal Katayoun Zand Kathy Matosich Kaushik Veeraraghavan Kelly Michelena Keqian Li Kiran Jagadeesh Kun Huang Kunal Chawla Kyle Huang Lailin Chen Lakshya Garg Lavender A Leandro Silva Lee Bell Lei Zhang Liangpeng Guo Licheng Yu Liron Moshkovich Luca Wehrstedt Madian Khabsa Manav Avalani Manish Bhatt Martynas Mankus Matan Hasson Matthew Lennie Matthias Reso Maxim Groshev Maxim Naumov Maya Lathi Meghan Keneally Miao Liu Michael\u00a0L. Seltzer Michal Valko Michelle Restrepo Mihir Patel Mik Vyatskov Mikayel Samvelyan Mike Clark Mike Macey Mike Wang Miquel\u00a0Jubert Hermoso Mo Metanat Mohammad Rastegari Munish Bansal Nandhini Santhanam Natascha Parks Natasha White Navyata Bawa Nayan Singhal Nick Egebo Nicolas Usunier Nikhil Mehta Nikolay\u00a0Pavlovich Laptev Ning Dong Norman Cheng Oleg Chernoguz Olivia Hart Omkar Salpekar Ozlem Kalinli Parkin Kent Parth Parekh Paul Saab Pavan Balaji Pedro Rittner Philip Bontrager Pierre Roux Piotr Dollar Polina Zvyagina Prashant Ratanchandani Pritish Yuvraj Qian Liang Rachad Alao Rachel Rodriguez Rafi Ayub Raghotham Murthy Raghu Nayani Rahul Mitra Rangaprabhu Parthasarathy Raymond Li Rebekkah Hogan Robin Battey Rocky Wang Russ Howes Ruty Rinott Sachin Mehta Sachin Siby Sai\u00a0Jayesh Bondu Samyak Datta Sara Chugh Sara Hunt Sargun Dhillon Sasha Sidorov Satadru Pan Saurabh Mahajan Saurabh Verma Seiji Yamamoto Sharadh Ramaswamy Shaun Lindsay Shaun Lindsay Sheng Feng Shenghao Lin Shengxin\u00a0Cindy Zha Shishir Patil Shiva Shankar Shuqiang Zhang Shuqiang Zhang Sinong Wang Sneha Agarwal Soji Sajuyigbe Soumith Chintala Stephanie Max Stephen Chen Steve Kehoe Steve Satterfield Sudarshan Govindaprasad Sumit Gupta Summer Deng Sungmin Cho Sunny Virk Suraj Subramanian Sy Choudhury Sydney Goldman Tal Remez Tamar Glaser Tamara Best Thilo Koehler Thomas Robinson Tianhe Li Tianjun Zhang Tim Matthews Timothy Chou Tzook Shaked Varun Vontimitta Victoria Ajayi Victoria Montanez Vijai Mohan Vinay\u00a0Satish Kumar Vishal Mangla Vlad Ionescu Vlad Poenaru Vlad\u00a0Tiberiu Mihailescu Vladimir Ivanov Wei Li Wenchen Wang Wenwen Jiang Wes Bouaziz Will Constable Xiaocheng Tang Xiaojian Wu Xiaolan Wang Xilun Wu Xinbo Gao Yaniv Kleinman Yanjun Chen Ye Hu Ye Jia Ye Qi Yenda Li Yilin Zhang Ying Zhang Yossi Adi Youngjin Nam Yu Wang Yu Zhao Yuchen Hao Yundi Qian Yunlu Li Yuzi He Zach Rait Zachary DeVito Zef Rosnbrick Zhaoduo Wen Zhenyu Yang Zhiwei Zhao and Zhiyu Ma. 2024. The Llama 3 Herd of Models. arxiv:https:\/\/arXiv.org\/abs\/2407.21783\u00a0[cs.AI] https:\/\/arxiv.org\/abs\/2407.21783"},{"key":"e_1_3_3_2_18_2","doi-asserted-by":"publisher","unstructured":"Aidan Hogan Eva Blomqvist Michael Cochez Claudia D\u2019amato Gerard\u00a0De Melo Claudio Gutierrez Sabrina Kirrane Jos\u00e9 Emilio\u00a0Labra Gayo Roberto Navigli Sebastian Neumaier Axel-Cyrille\u00a0Ngonga Ngomo Axel Polleres Sabbir\u00a0M. Rashid Anisa Rula Lukas Schmelzeisen Juan Sequeda Steffen Staab and Antoine Zimmermann. 2021. Knowledge Graphs. Comput. Surveys 54 4 (July 2021) 1\u201337. 10.1145\/3447772","DOI":"10.1145\/3447772"},{"key":"e_1_3_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.386"},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"publisher","unstructured":"JaeYong Kim and Bathri\u00a0Narayan Vajravelu. 2025. Assessing the Current Limitations of Large Language Models in Advancing Health Care Education. JMIR Form Res 9 (16 Jan 2025) e51319. 10.2196\/51319","DOI":"10.2196\/51319"},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"crossref","unstructured":"Yanis Labrak Adrien Bazoge Emmanuel Morin Pierre-Antoine Gourraud Mickael Rouvier and Richard Dufour. 2024. BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains. arxiv:https:\/\/arXiv.org\/abs\/2402.10373\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2402.10373","DOI":"10.18653\/v1\/2024.findings-acl.348"},{"key":"e_1_3_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.3115\/1626355.1626389"},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.733"},{"key":"e_1_3_3_2_24_2","first-page":"74","volume-title":"Text Summarization Branches Out","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out. Association for Computational Linguistics, Barcelona, Spain, 74\u201381. https:\/\/aclanthology.org\/W04-1013\/"},{"key":"e_1_3_3_2_25_2","volume-title":"Q-Pain: A Question Answering Dataset to Measure Social Bias in Pain Management","author":"Log\u00e9 C\u00e9cile","year":"2021","unstructured":"C\u00e9cile Log\u00e9, Emily Ross, David Yaw\u00a0Amoah Dadey, Saahil Jain, Adriel Saporta, Andrew\u00a0Y. Ng, and Pranav Rajpurkar. 2021. Q-Pain: A Question Answering Dataset to Measure Social Bias in Pain Management. arxiv:https:\/\/arXiv.org\/abs\/2108.01764\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2108.01764"},{"key":"e_1_3_3_2_26_2","doi-asserted-by":"publisher","unstructured":"Qing Lyu Marianna Apidianaki and Chris Callison-Burch. 2024. Towards Faithful Model Explanation in NLP: A Survey. Computational Linguistics 50 2 (06 2024) 657\u2013723. 10.1162\/coli_a_00511 arXiv:https:\/\/direct.mit.edu\/coli\/article-pdf\/50\/2\/657\/2457495\/coli_a_00511.pdf","DOI":"10.1162\/coli_a_00511"},{"key":"e_1_3_3_2_27_2","unstructured":"Andreas Madsen Sarath Chandar and Siva Reddy. 2024. Are self-explanations from Large Language Models faithful? arxiv:https:\/\/arXiv.org\/abs\/2401.07927\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2401.07927"},{"key":"e_1_3_3_2_28_2","unstructured":"Saketh Mattupalli. [n. d.]. BLAZE999\/medical-ner hugging face. https:\/\/huggingface.co\/blaze999\/Medical-NER"},{"key":"e_1_3_3_2_29_2","unstructured":"David Nadeau Mike Kroutikov Karen McNeil and Simon Baribeau. 2024. Benchmarking Llama2 Mistral Gemma and GPT for Factuality Toxicity Bias and Propensity for Hallucinations. arxiv:https:\/\/arXiv.org\/abs\/2404.09785\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2404.09785"},{"key":"e_1_3_3_2_30_2","unstructured":"Zabir\u00a0Al Nazi and Wei Peng. 2024. Large language models in healthcare and medical domain: A review. arxiv:https:\/\/arXiv.org\/abs\/2401.06775\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2401.06775"},{"key":"e_1_3_3_2_31_2","unstructured":"National\u00a0Institute of Standards and Technology (NIST). 2025. AI Risk Management Framework. https:\/\/nist.gov\/itl\/ai-risk-management-framework"},{"key":"e_1_3_3_2_32_2","unstructured":"OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad Ilge Akkaya Florencia\u00a0Leoni Aleman Diogo Almeida Janko Altenschmidt Sam Altman Shyamal Anadkat Red Avila Igor Babuschkin Suchir Balaji Valerie Balcom Paul Baltescu Haiming Bao Mohammad Bavarian Jeff Belgum Irwan Bello Jake Berdine Gabriel Bernadett-Shapiro Christopher Berner Lenny Bogdonoff Oleg Boiko Madelaine Boyd Anna-Luisa Brakman Greg Brockman Tim Brooks Miles Brundage Kevin Button Trevor Cai Rosie Campbell Andrew Cann Brittany Carey Chelsea Carlson Rory Carmichael Brooke Chan Che Chang Fotis Chantzis Derek Chen Sully Chen Ruby Chen Jason Chen Mark Chen Ben Chess Chester Cho Casey Chu Hyung\u00a0Won Chung Dave Cummings Jeremiah Currier Yunxing Dai Cory Decareaux Thomas Degry Noah Deutsch Damien Deville Arka Dhar David Dohan Steve Dowling Sheila Dunning Adrien Ecoffet Atty Eleti Tyna Eloundou David Farhi Liam Fedus Niko Felix Sim\u00f3n\u00a0Posada Fishman Juston Forte Isabella Fulford Leo Gao Elie Georges Christian Gibson Vik Goel Tarun Gogineni Gabriel Goh Rapha Gontijo-Lopes Jonathan Gordon Morgan Grafstein Scott Gray Ryan Greene Joshua Gross Shixiang\u00a0Shane Gu Yufei Guo Chris Hallacy Jesse Han Jeff Harris Yuchen He Mike Heaton Johannes Heidecke Chris Hesse Alan Hickey Wade Hickey Peter Hoeschele Brandon Houghton Kenny Hsu Shengli Hu Xin Hu Joost Huizinga Shantanu Jain Shawn Jain Joanne Jang Angela Jiang Roger Jiang Haozhun Jin Denny Jin Shino Jomoto Billie Jonn Heewoo Jun Tomer Kaftan \u0141ukasz Kaiser Ali Kamali Ingmar Kanitscheider Nitish\u00a0Shirish Keskar Tabarak Khan Logan Kilpatrick Jong\u00a0Wook Kim Christina Kim Yongjik Kim Jan\u00a0Hendrik Kirchner Jamie Kiros Matt Knight Daniel Kokotajlo \u0141ukasz Kondraciuk Andrew Kondrich Aris Konstantinidis Kyle Kosic Gretchen Krueger Vishal Kuo Michael Lampe Ikai Lan Teddy Lee Jan Leike Jade Leung Daniel Levy Chak\u00a0Ming Li Rachel Lim Molly Lin Stephanie Lin Mateusz Litwin Theresa Lopez Ryan Lowe Patricia Lue Anna Makanju Kim Malfacini Sam Manning Todor Markov Yaniv Markovski Bianca Martin Katie Mayer Andrew Mayne Bob McGrew Scott\u00a0Mayer McKinney Christine McLeavey Paul McMillan Jake McNeil David Medina Aalok Mehta Jacob Menick Luke Metz Andrey Mishchenko Pamela Mishkin Vinnie Monaco Evan Morikawa Daniel Mossing Tong Mu Mira Murati Oleg Murk David M\u00e9ly Ashvin Nair Reiichiro Nakano Rajeev Nayak Arvind Neelakantan Richard Ngo Hyeonwoo Noh Long Ouyang Cullen O\u2019Keefe Jakub Pachocki Alex Paino Joe Palermo Ashley Pantuliano Giambattista Parascandolo Joel Parish Emy Parparita Alex Passos Mikhail Pavlov Andrew Peng Adam Perelman Filipe de Avila Belbute\u00a0Peres Michael Petrov Henrique\u00a0Ponde de Oliveira\u00a0Pinto Michael Pokorny Michelle Pokrass Vitchyr\u00a0H. Pong Tolly Powell Alethea Power Boris Power Elizabeth Proehl Raul Puri Alec Radford Jack Rae Aditya Ramesh Cameron Raymond Francis Real Kendra Rimbach Carl Ross Bob Rotsted Henri Roussez Nick Ryder Mario Saltarelli Ted Sanders Shibani Santurkar Girish Sastry Heather Schmidt David Schnurr John Schulman Daniel Selsam Kyla Sheppard Toki Sherbakov Jessica Shieh Sarah Shoker Pranav Shyam Szymon Sidor Eric Sigler Maddie Simens Jordan Sitkin Katarina Slama Ian Sohl Benjamin Sokolowsky Yang Song Natalie Staudacher Felipe\u00a0Petroski Such Natalie Summers Ilya Sutskever Jie Tang Nikolas Tezak Madeleine\u00a0B. Thompson Phil Tillet Amin Tootoonchian Elizabeth Tseng Preston Tuggle Nick Turley Jerry Tworek Juan Felipe\u00a0Cer\u00f3n Uribe Andrea Vallone Arun Vijayvergiya Chelsea Voss Carroll Wainwright Justin\u00a0Jay Wang Alvin Wang Ben Wang Jonathan Ward Jason Wei CJ Weinmann Akila Welihinda Peter Welinder Jiayi Weng Lilian Weng Matt Wiethoff Dave Willner Clemens Winter Samuel Wolrich Hannah Wong Lauren Workman Sherwin Wu Jeff Wu Michael Wu Kai Xiao Tao Xu Sarah Yoo Kevin Yu Qiming Yuan Wojciech Zaremba Rowan Zellers Chong Zhang Marvin Zhang Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk and Barret Zoph. 2024. GPT-4 Technical Report. arxiv:https:\/\/arXiv.org\/abs\/2303.08774\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2303.08774"},{"key":"e_1_3_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_3_3_2_34_2","unstructured":"Karan Singhal Shekoofeh Azizi Tao Tu S.\u00a0Sara Mahdavi Jason Wei Hyung\u00a0Won Chung Nathan Scales Ajay Tanwani Heather Cole-Lewis Stephen Pfohl Perry Payne Martin Seneviratne Paul Gamble Chris Kelly Nathaneal Scharli Aakanksha Chowdhery Philip Mansfield Blaise\u00a0Aguera y Arcas Dale Webster Greg\u00a0S. Corrado Yossi Matias Katherine Chou Juraj Gottweis Nenad Tomasev Yun Liu Alvin Rajkomar Joelle Barral Christopher Semturs Alan Karthikesalingam and Vivek Natarajan. 2022. Large Language Models Encode Clinical Knowledge. arxiv:https:\/\/arXiv.org\/abs\/2212.13138\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2212.13138"},{"key":"e_1_3_3_2_35_2","unstructured":"Gemini Team Rohan Anil Sebastian Borgeaud Jean-Baptiste Alayrac Jiahui Yu Radu Soricut Johan Schalkwyk Andrew\u00a0M. Dai Anja Hauth Katie Millican David Silver Melvin Johnson Ioannis Antonoglou Julian Schrittwieser Amelia Glaese Jilin Chen Emily Pitler Timothy Lillicrap Angeliki Lazaridou Orhan Firat James Molloy Michael Isard Paul\u00a0R. Barham Tom Hennigan Benjamin Lee Fabio Viola Malcolm Reynolds Yuanzhong Xu Ryan Doherty Eli Collins Clemens Meyer Eliza Rutherford Erica Moreira Kareem Ayoub Megha Goel Jack Krawczyk Cosmo Du Ed Chi Heng-Tze Cheng Eric Ni Purvi Shah Patrick Kane Betty Chan Manaal Faruqui Aliaksei Severyn Hanzhao Lin YaGuang Li Yong Cheng Abe Ittycheriah Mahdis Mahdieh Mia Chen Pei Sun Dustin Tran Sumit Bagri Balaji Lakshminarayanan Jeremiah Liu Andras Orban Fabian G\u00fcra Hao Zhou Xinying Song Aurelien Boffy Harish Ganapathy Steven Zheng HyunJeong Choe \u00c1goston Weisz Tao Zhu Yifeng Lu Siddharth Gopal Jarrod Kahn Maciej Kula Jeff Pitman Rushin Shah Emanuel Taropa Majd\u00a0Al Merey Martin Baeuml Zhifeng Chen Laurent\u00a0El Shafey Yujing Zhang Olcan Sercinoglu George Tucker Enrique Piqueras Maxim Krikun Iain Barr Nikolay Savinov Ivo Danihelka Becca Roelofs Ana\u00efs White Anders Andreassen Tamara von Glehn Lakshman Yagati Mehran Kazemi Lucas Gonzalez Misha Khalman Jakub Sygnowski Alexandre Frechette Charlotte Smith Laura Culp Lev Proleev Yi Luan Xi Chen James Lottes Nathan Schucher Federico Lebron Alban Rrustemi Natalie Clay Phil Crone Tomas Kocisky Jeffrey Zhao Bartek Perz Dian Yu Heidi Howard Adam Bloniarz Jack\u00a0W. Rae Han Lu Laurent Sifre Marcello Maggioni Fred Alcober Dan Garrette Megan Barnes Shantanu Thakoor Jacob Austin Gabriel Barth-Maron William Wong Rishabh Joshi Rahma Chaabouni Deeni Fatiha Arun Ahuja Gaurav\u00a0Singh Tomar Evan Senter Martin Chadwick Ilya Kornakov Nithya Attaluri I\u00f1aki Iturrate Ruibo Liu Yunxuan Li Sarah Cogan Jeremy Chen Chao Jia Chenjie Gu Qiao Zhang Jordan Grimstad Ale\u00a0Jakse Hartman Xavier Garcia Thanumalayan\u00a0Sankaranarayana Pillai Jacob Devlin Michael Laskin Diego de Las\u00a0Casas Dasha Valter Connie Tao Lorenzo Blanco Adri\u00e0\u00a0Puigdom\u00e8nech Badia David Reitter Mianna Chen Jenny Brennan Clara Rivera Sergey Brin Shariq Iqbal Gabriela Surita Jane Labanowski Abhi Rao Stephanie Winkler Emilio Parisotto Yiming Gu Kate Olszewska Ravi Addanki Antoine Miech Annie Louis Denis Teplyashin Geoff Brown Elliot Catt Jan Balaguer Jackie Xiang Pidong Wang Zoe Ashwood Anton Briukhov Albert Webson Sanjay Ganapathy Smit Sanghavi Ajay Kannan Ming-Wei Chang Axel Stjerngren Josip Djolonga Yuting Sun Ankur Bapna Matthew Aitchison Pedram Pejman Henryk Michalewski Tianhe Yu Cindy Wang Juliette Love Junwhan Ahn Dawn Bloxwich Kehang Han Peter Humphreys Thibault Sellam James Bradbury Varun Godbole Sina Samangooei Bogdan Damoc Alex Kaskasoli S\u00e9bastien M.\u00a0R. Arnold Vijay Vasudevan Shubham Agrawal Jason Riesa Dmitry Lepikhin Richard Tanburn Srivatsan Srinivasan Hyeontaek Lim Sarah Hodkinson Pranav Shyam Johan Ferret Steven Hand Ankush Garg Tom\u00a0Le Paine Jian Li Yujia Li Minh Giang Alexander Neitz Zaheer Abbas Sarah York Machel Reid Elizabeth Cole Aakanksha Chowdhery Dipanjan Das Dominika Rogozi\u0144ska Vitaliy Nikolaev Pablo Sprechmann Zachary Nado Lukas Zilka Flavien Prost Luheng He Marianne Monteiro Gaurav Mishra Chris Welty Josh Newlan Dawei Jia Miltiadis Allamanis Clara\u00a0Huiyi Hu Raoul de Liedekerke Justin Gilmer Carl Saroufim Shruti Rijhwani Shaobo Hou Disha Shrivastava Anirudh Baddepudi Alex Goldin Adnan Ozturel Albin Cassirer Yunhan Xu Daniel Sohn Devendra Sachan Reinald\u00a0Kim Amplayo Craig Swanson Dessie Petrova Shashi Narayan Arthur Guez Siddhartha Brahma Jessica Landon Miteyan Patel Ruizhe Zhao Kevin Villela Luyu Wang Wenhao Jia Matthew Rahtz Mai Gim\u00e9nez Legg Yeung James Keeling Petko Georgiev Diana Mincu Boxi Wu Salem Haykal Rachel Saputro Kiran Vodrahalli James Qin Zeynep Cankara Abhanshu Sharma Nick Fernando Will Hawkins Behnam Neyshabur Solomon Kim Adrian Hutter Priyanka Agrawal Alex Castro-Ros George van\u00a0den Driessche Tao Wang Fan Yang Shuo yiin Chang Paul Komarek Ross McIlroy Mario Lu\u010di\u0107 Guodong Zhang Wael Farhan Michael Sharman Paul Natsev Paul Michel Yamini Bansal Siyuan Qiao Kris Cao Siamak Shakeri Christina Butterfield Justin Chung Paul\u00a0Kishan Rubenstein Shivani Agrawal Arthur Mensch Kedar Soparkar Karel Lenc Timothy Chung Aedan Pope Loren Maggiore Jackie Kay Priya Jhakra Shibo Wang Joshua Maynez Mary Phuong Taylor Tobin Andrea Tacchetti Maja Trebacz Kevin Robinson Yash Katariya Sebastian Riedel Paige Bailey Kefan Xiao Nimesh Ghelani Lora Aroyo Ambrose Slone Neil Houlsby Xuehan Xiong Zhen Yang Elena Gribovskaya Jonas Adler Mateo Wirth Lisa Lee Music Li Thais Kagohara Jay Pavagadhi Sophie Bridgers Anna Bortsova Sanjay Ghemawat Zafarali Ahmed Tianqi Liu Richard Powell Vijay Bolina Mariko Iinuma Polina Zablotskaia James Besley Da-Woon Chung Timothy Dozat Ramona Comanescu Xiance Si Jeremy Greer Guolong Su Martin Polacek Rapha\u00ebl\u00a0Lopez Kaufman Simon Tokumine Hexiang Hu Elena Buchatskaya Yingjie Miao Mohamed Elhawaty Aditya Siddhant Nenad Tomasev Jinwei Xing Christina Greer Helen Miller Shereen Ashraf Aurko Roy Zizhao Zhang Ada Ma Angelos Filos Milos Besta Rory Blevins Ted Klimenko Chih-Kuan Yeh Soravit Changpinyo Jiaqi Mu Oscar Chang Mantas Pajarskas Carrie Muir Vered Cohen Charline\u00a0Le Lan Krishna Haridasan Amit Marathe Steven Hansen Sholto Douglas Rajkumar Samuel Mingqiu Wang Sophia Austin Chang Lan Jiepu Jiang Justin Chiu Jaime\u00a0Alonso Lorenzo Lars\u00a0Lowe Sj\u00f6sund S\u00e9bastien Cevey Zach Gleicher Thi Avrahami Anudhyan Boral Hansa Srinivasan Vittorio Selo Rhys May Konstantinos Aisopos L\u00e9onard Hussenot Livio\u00a0Baldini Soares Kate Baumli Michael\u00a0B. Chang Adri\u00e0 Recasens Ben Caine Alexander Pritzel Filip Pavetic Fabio Pardo Anita Gergely Justin Frye Vinay Ramasesh Dan Horgan Kartikeya Badola Nora Kassner Subhrajit Roy Ethan Dyer V\u00edctor\u00a0Campos Campos Alex Tomala Yunhao Tang Dalia\u00a0El Badawy Elspeth White Basil Mustafa Oran Lang Abhishek Jindal Sharad Vikram Zhitao Gong Sergi Caelles Ross Hemsley Gregory Thornton Fangxiaoyu Feng Wojciech Stokowiec Ce Zheng Phoebe Thacker \u00c7a\u011flar \u00dcnl\u00fc Zhishuai Zhang Mohammad Saleh James Svensson Max Bileschi Piyush Patil Ankesh Anand Roman Ring Katerina Tsihlas Arpi Vezer Marco Selvi Toby Shevlane Mikel Rodriguez Tom Kwiatkowski Samira Daruki Keran Rong Allan Dafoe Nicholas FitzGerald Keren Gu-Lemberg Mina Khan Lisa\u00a0Anne Hendricks Marie Pellat Vladimir Feinberg James Cobon-Kerr Tara Sainath Maribeth Rauh Sayed\u00a0Hadi Hashemi Richard Ives Yana Hasson Eric Noland Yuan Cao Nathan Byrd Le Hou Qingze Wang Thibault Sottiaux Michela Paganini Jean-Baptiste Lespiau Alexandre Moufarek Samer Hassan Kaushik Shivakumar Joost van Amersfoort Amol Mandhane Pratik Joshi Anirudh Goyal Matthew Tung Andrew Brock Hannah Sheahan Vedant Misra Cheng Li Nemanja Raki\u0107evi\u0107 Mostafa Dehghani Fangyu Liu Sid Mittal Junhyuk Oh Seb Noury Eren Sezener Fantine Huot Matthew Lamm Nicola\u00a0De Cao Charlie Chen Sidharth Mudgal Romina Stella Kevin Brooks Gautam Vasudevan Chenxi Liu Mainak Chain Nivedita Melinkeri Aaron Cohen Venus Wang Kristie Seymore Sergey Zubkov Rahul Goel Summer Yue Sai Krishnakumaran Brian Albert Nate Hurley Motoki Sano Anhad Mohananey Jonah Joughin Egor Filonov Tomasz K\u0119pa Yomna Eldawy Jiawern Lim Rahul Rishi Shirin Badiezadegan Taylor Bos Jerry Chang Sanil Jain Sri Gayatri\u00a0Sundara Padmanabhan Subha Puttagunta Kalpesh Krishna Leslie Baker Norbert Kalb Vamsi Bedapudi Adam Kurzrok Shuntong Lei Anthony Yu Oren Litvin Xiang Zhou Zhichun Wu Sam Sobell Andrea Siciliano Alan Papir Robby Neale Jonas Bragagnolo Tej Toor Tina Chen Valentin Anklin Feiran Wang Richie Feng Milad Gholami Kevin Ling Lijuan Liu Jules Walter Hamid Moghaddam Arun Kishore Jakub Adamek Tyler Mercado Jonathan Mallinson Siddhinita Wandekar Stephen Cagle Eran Ofek Guillermo Garrido Clemens Lombriser Maksim Mukha Botu Sun Hafeezul\u00a0Rahman Mohammad Josip Matak Yadi Qian Vikas Peswani Pawel Janus Quan Yuan Leif Schelin Oana David Ankur Garg Yifan He Oleksii Duzhyi Anton \u00c4lgmyr Timoth\u00e9e Lottaz Qi Li Vikas Yadav Luyao Xu Alex Chinien Rakesh Shivanna Aleksandr Chuklin Josie Li Carrie Spadine Travis Wolfe Kareem Mohamed Subhabrata Das Zihang Dai Kyle He Daniel von Dincklage Shyam Upadhyay Akanksha Maurya Luyan Chi Sebastian Krause Khalid Salama Pam\u00a0G Rabinovitch Pavan Kumar\u00a0Reddy M Aarush Selvan Mikhail Dektiarev Golnaz Ghiasi Erdem Guven Himanshu Gupta Boyi Liu Deepak Sharma Idan\u00a0Heimlich Shtacher Shachi Paul Oscar Akerlund Fran\u00e7ois-Xavier Aubet Terry Huang Chen Zhu Eric Zhu Elico Teixeira Matthew Fritze Francesco Bertolini Liana-Eleonora Marinescu Martin B\u00f6lle Dominik Paulus Khyatti Gupta Tejasi Latkar Max Chang Jason Sanders Roopa Wilson Xuewei Wu Yi-Xuan Tan Lam\u00a0Nguyen Thiet Tulsee Doshi Sid Lall Swaroop Mishra Wanming Chen Thang Luong Seth Benjamin Jasmine Lee Ewa Andrejczuk Dominik Rabiej Vipul Ranjan Krzysztof Styrc Pengcheng Yin Jon Simon Malcolm\u00a0Rose Harriott Mudit Bansal Alexei Robsky Geoff Bacon David Greene Daniil Mirylenka Chen Zhou Obaid Sarvana Abhimanyu Goyal Samuel Andermatt Patrick Siegler Ben Horn Assaf Israel Francesco Pongetti Chih-Wei\u00a0\"Louis\" Chen Marco Selvatici Pedro Silva Kathie Wang Jackson Tolins Kelvin Guu Roey Yogev Xiaochen Cai Alessandro Agostini Maulik Shah Hung Nguyen Noah\u00a0\u00d3 Donnaile S\u00e9bastien Pereira Linda Friso Adam Stambler Adam Kurzrok Chenkai Kuang Yan Romanikhin Mark Geller ZJ Yan Kane Jang Cheng-Chun Lee Wojciech Fica Eric Malmi Qijun Tan Dan Banica Daniel Balle Ryan Pham Yanping Huang Diana Avram Hongzhi Shi Jasjot Singh Chris Hidey Niharika Ahuja Pranab Saxena Dan Dooley Srividya\u00a0Pranavi Potharaju Eileen O\u2019Neill Anand Gokulchandran Ryan Foley Kai Zhao Mike Dusenberry Yuan Liu Pulkit Mehta Ragha Kotikalapudi Chalence Safranek-Shrader Andrew Goodman Joshua Kessinger Eran Globen Prateek Kolhar Chris Gorgolewski Ali Ibrahim Yang Song Ali Eichenbaum Thomas Brovelli Sahitya Potluri Preethi Lahoti Cip Baetu Ali Ghorbani Charles Chen Andy Crawford Shalini Pal Mukund Sridhar Petru Gurita Asier Mujika Igor Petrovski Pierre-Louis Cedoz Chenmei Li Shiyuan Chen Niccol\u00f2\u00a0Dal Santo Siddharth Goyal Jitesh Punjabi Karthik Kappaganthu Chester Kwak Pallavi LV Sarmishta Velury Himadri Choudhury Jamie Hall Premal Shah Ricardo Figueira Matt Thomas Minjie Lu Ting Zhou Chintu Kumar Thomas Jurdi Sharat Chikkerur Yenai Ma Adams Yu Soo Kwak Victor \u00c4hdel Sujeevan Rajayogam Travis Choma Fei Liu Aditya Barua Colin Ji Ji\u00a0Ho Park Vincent Hellendoorn Alex Bailey Taylan Bilal Huanjie Zhou Mehrdad Khatir Charles Sutton Wojciech Rzadkowski Fiona Macintosh Konstantin Shagin Paul Medina Chen Liang Jinjing Zhou Pararth Shah Yingying Bi Attila Dankovics Shipra Banga Sabine Lehmann Marissa Bredesen Zifan Lin John\u00a0Eric Hoffmann Jonathan Lai Raynald Chung Kai Yang Nihal Balani Arthur Bra\u017einskas Andrei Sozanschi Matthew Hayes H\u00e9ctor\u00a0Fern\u00e1ndez Alcalde Peter Makarov Will Chen Antonio Stella Liselotte Snijders Michael Mandl Ante K\u00e4rrman Pawe\u0142 Nowak Xinyi Wu Alex Dyck Krishnan Vaidyanathan Raghavender R Jessica Mallet Mitch Rudominer Eric Johnston Sushil Mittal Akhil Udathu Janara Christensen Vishal Verma Zach Irving Andreas Santucci Gamaleldin Elsayed Elnaz Davoodi Marin Georgiev Ian Tenney Nan Hua Geoffrey Cideron Edouard Leurent Mahmoud Alnahlawi Ionut Georgescu Nan Wei Ivy Zheng Dylan Scandinaro Heinrich Jiang Jasper Snoek Mukund Sundararajan Xuezhi Wang Zack Ontiveros Itay Karo Jeremy Cole Vinu Rajashekhar Lara Tumeh Eyal Ben-David Rishub Jain Jonathan Uesato Romina Datta Oskar Bunyan Shimu Wu John Zhang Piotr Stanczyk Ye Zhang David Steiner Subhajit Naskar Michael Azzam Matthew Johnson Adam Paszke Chung-Cheng Chiu Jaume\u00a0Sanchez Elias Afroz Mohiuddin Faizan Muhammad Jin Miao Andrew Lee Nino Vieillard Jane Park Jiageng Zhang Jeff Stanway Drew Garmon Abhijit Karmarkar Zhe Dong Jong Lee Aviral Kumar Luowei Zhou Jonathan Evens William Isaac Geoffrey Irving Edward Loper Michael Fink Isha Arkatkar Nanxin Chen Izhak Shafran Ivan Petrychenko Zhe Chen Johnson Jia Anselm Levskaya Zhenkai Zhu Peter Grabowski Yu Mao Alberto Magni Kaisheng Yao Javier Snaider Norman Casagrande Evan Palmer Paul Suganthan Alfonso Casta\u00f1o Irene Giannoumis Wooyeol Kim Miko\u0142aj Rybi\u0144ski Ashwin Sreevatsa Jennifer Prendki David Soergel Adrian Goedeckemeyer Willi Gierke Mohsen Jafari Meenu Gaba Jeremy Wiesner Diana\u00a0Gage Wright Yawen Wei Harsha Vashisht Yana Kulizhskaya Jay Hoover Maigo Le Lu Li Chimezie Iwuanyanwu Lu Liu Kevin Ramirez Andrey Khorlin Albert Cui Tian LIN Marcus Wu Ricardo Aguilar Keith Pallo Abhishek Chakladar Ginger Perng Elena\u00a0Allica Abellan Mingyang Zhang Ishita Dasgupta Nate Kushman Ivo Penchev Alena Repina Xihui Wu Tom van\u00a0der Weide Priya Ponnapalli Caroline Kaplan Jiri Simsa Shuangfeng Li Olivier Dousse Fan Yang Jeff Piper Nathan Ie Rama Pasumarthi Nathan Lintz Anitha Vijayakumar Daniel Andor Pedro Valenzuela Minnie Lui Cosmin Paduraru Daiyi Peng Katherine Lee Shuyuan Zhang Somer Greene Duc\u00a0Dung Nguyen Paula Kurylowicz Cassidy Hardin Lucas Dixon Lili Janzer Kiam Choo Ziqiang Feng Biao Zhang Achintya Singhal Dayou Du Dan McKinnon Natasha Antropova Tolga Bolukbasi Orgad Keller David Reid Daniel Finchelstein Maria\u00a0Abi Raad Remi Crocker Peter Hawkins Robert Dadashi Colin Gaffney Ken Franko Anna Bulanova R\u00e9mi Leblond Shirley Chung Harry Askham Luis\u00a0C. Cobo Kelvin Xu Felix Fischer Jun Xu Christina Sorokin Chris Alberti Chu-Cheng Lin Colin Evans Alek Dimitriev Hannah Forbes Dylan Banarse Zora Tung Mark Omernick Colton Bishop Rachel Sterneck Rohan Jain Jiawei Xia Ehsan Amid Francesco Piccinno Xingyu Wang Praseem Banzal Daniel\u00a0J. Mankowitz Alex Polozov Victoria Krakovna Sasha Brown MohammadHossein Bateni Dennis Duan Vlad Firoiu Meghana Thotakuri Tom Natan Matthieu Geist Ser tan Girgin Hui Li Jiayu Ye Ofir Roval Reiko Tojo Michael Kwong James Lee-Thorp Christopher Yew Danila Sinopalnikov Sabela Ramos John Mellor Abhishek Sharma Kathy Wu David Miller Nicolas Sonnerat Denis Vnukov Rory Greig Jennifer Beattie Emily Caveness Libin Bai Julian Eisenschlos Alex Korchemniy Tomy Tsai Mimi Jasarevic Weize Kong Phuong Dao Zeyu Zheng Frederick Liu Fan Yang Rui Zhu Tian\u00a0Huey Teh Jason Sanmiya Evgeny Gladchenko Nejc Trdin Daniel Toyama Evan Rosen Sasan Tavakkol Linting Xue Chen Elkind Oliver Woodman John Carpenter George Papamakarios Rupert Kemp Sushant Kafle Tanya Grunina Rishika Sinha Alice Talbert Diane Wu Denese Owusu-Afriyie Cosmo Du Chloe Thornton Jordi Pont-Tuset Pradyumna Narayana Jing Li Saaber Fatehi John Wieting Omar Ajmeri Benigno Uria Yeongil Ko Laura Knight Am\u00e9lie H\u00e9liou Ning Niu Shane Gu Chenxi Pang Yeqing Li Nir Levine Ariel Stolovich Rebeca Santamaria-Fernandez Sonam Goenka Wenny Yustalim Robin Strudel Ali Elqursh Charlie Deck Hyo Lee Zonglin Li Kyle Levin Raphael Hoffmann Dan Holtmann-Rice Olivier Bachem Sho Arora Christy Koh Soheil\u00a0Hassas Yeganeh Siim P\u00f5der Mukarram Tariq Yanhua Sun Lucian Ionita Mojtaba Seyedhosseini Pouya Tafti Zhiyu Liu Anmol Gulati Jasmine Liu Xinyu Ye Bart Chrzaszcz Lily Wang Nikhil Sethi Tianrun Li Ben Brown Shreya Singh Wei Fan Aaron Parisi Joe Stanton Vinod Koverkathu Christopher\u00a0A. Choquette-Choo Yunjie Li TJ Lu Abe Ittycheriah Prakash Shroff Mani Varadarajan Sanaz Bahargam Rob Willoughby David Gaddy Guillaume Desjardins Marco Cornero Brona Robenek Bhavishya Mittal Ben Albrecht Ashish Shenoy Fedor Moiseev Henrik Jacobsson Alireza Ghaffarkhah Morgane Rivi\u00e8re Alanna Walton Cl\u00e9ment Crepy Alicia Parrish Zongwei Zhou Clement Farabet Carey Radebaugh Praveen Srinivasan Claudia van\u00a0der Salm Andreas Fidjeland Salvatore Scellato Eri Latorre-Chimoto Hanna Klimczak-Pluci\u0144ska David Bridson Dario de Cesare Tom Hudson Piermaria Mendolicchio Lexi Walker Alex Morris Matthew Mauger Alexey Guseynov Alison Reid Seth Odoom Lucia Loher Victor Cotruta Madhavi Yenugula Dominik Grewe Anastasia Petrushkina Tom Duerig Antonio Sanchez Steve Yadlowsky Amy Shen Amir Globerson Lynette Webb Sahil Dua Dong Li Surya Bhupatiraju Dan Hurt Haroon Qureshi Ananth Agarwal Tomer Shani Matan Eyal Anuj Khare Shreyas\u00a0Rammohan Belle Lei Wang Chetan Tekur Mihir\u00a0Sanjay Kale Jinliang Wei Ruoxin Sang Brennan Saeta Tyler Liechty Yi Sun Yao Zhao Stephan Lee Pandu Nayak Doug Fritz Manish\u00a0Reddy Vuyyuru John Aslanides Nidhi Vyas Martin Wicke Xiao Ma Evgenii Eltyshev Nina Martin Hardie Cate James Manyika Keyvan Amiri Yelin Kim Xi Xiong Kai Kang Florian Luisier Nilesh Tripuraneni David Madras Mandy Guo Austin Waters Oliver Wang Joshua Ainslie Jason Baldridge Han Zhang Garima Pruthi Jakob Bauer Feng Yang Riham Mansour Jason Gelman Yang Xu George Polovets Ji Liu Honglong Cai Warren Chen XiangHai Sheng Emily Xue Sherjil Ozair Christof Angermueller Xiaowei Li Anoop Sinha Weiren Wang Julia Wiesinger Emmanouil Koukoumidis Yuan Tian Anand Iyer Madhu Gurumurthy Mark Goldenson Parashar Shah MK Blake Hongkun Yu Anthony Urbanowicz Jennimaria Palomaki Chrisantha Fernando Ken Durden Harsh Mehta Nikola Momchev Elahe Rahimtoroghi Maria Georgaki Amit Raul Sebastian Ruder Morgan Redshaw Jinhyuk Lee Denny Zhou Komal Jalan Dinghua Li Blake Hechtman Parker Schuh Milad Nasr Kieran Milan Vladimir Mikulik Juliana Franco Tim Green Nam Nguyen Joe Kelley Aroma Mahendru Andrea Hu Joshua Howland Ben Vargas Jeffrey Hui Kshitij Bansal Vikram Rao Rakesh Ghiya Emma Wang Ke Ye Jean\u00a0Michel Sarr Melanie\u00a0Moranski Preston Madeleine Elish Steve Li Aakash Kaku Jigar Gupta Ice Pasupat Da-Cheng Juan Milan Someswar Tejvi M. Xinyun Chen Aida Amini Alex Fabrikant Eric Chu Xuanyi Dong Amruta Muthal Senaka Buthpitiya Sarthak Jauhari Nan Hua Urvashi Khandelwal Ayal Hitron Jie Ren Larissa Rinaldi Shahar Drath Avigail Dabush Nan-Jiang Jiang Harshal Godhia Uli Sachs Anthony Chen Yicheng Fan Hagai Taitelbaum Hila Noga Zhuyun Dai James Wang Chen Liang Jenny Hamer Chun-Sung Ferng Chenel Elkind Aviel Atias Paulina Lee V\u00edt List\u00edk Mathias Carlen Jan van\u00a0de Kerkhof Marcin Pikus Krunoslav Zaher Paul M\u00fcller Sasha Zykova Richard Stefanec Vitaly Gatsko Christoph Hirnschall Ashwin Sethi Xingyu\u00a0Federico Xu Chetan Ahuja Beth Tsai Anca Stefanoiu Bo Feng Keshav Dhandhania Manish Katyal Akshay Gupta Atharva Parulekar Divya Pitta Jing Zhao Vivaan Bhatia Yashodha Bhavnani Omar Alhadlaq Xiaolin Li Peter Danenberg Dennis Tu Alex Pine Vera Filippova Abhipso Ghosh Ben Limonchik Bhargava Urala Chaitanya\u00a0Krishna Lanka Derik Clive Yi Sun Edward Li Hao Wu Kevin Hongtongsak Ianna Li Kalind Thakkar Kuanysh Omarov Kushal Majmundar Michael Alverson Michael Kucharski Mohak Patel Mudit Jain Maksim Zabelin Paolo Pelagatti Rohan Kohli Saurabh Kumar Joseph Kim Swetha Sankar Vineet Shah Lakshmi Ramachandruni Xiangkai Zeng Ben Bariach Laura Weidinger Tu Vu Alek Andreev Antoine He Kevin Hui Sheleem Kashem Amar Subramanya Sissie Hsiao Demis Hassabis Koray Kavukcuoglu Adam Sadovsky Quoc Le Trevor Strohman Yonghui Wu Slav Petrov Jeffrey Dean and Oriol Vinyals. 2024. Gemini: A Family of Highly Capable Multimodal Models. arxiv:https:\/\/arXiv.org\/abs\/2312.11805\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2312.11805"},{"key":"e_1_3_3_2_36_2","unstructured":"Gemma Team Thomas Mesnard Cassidy Hardin Robert Dadashi Surya Bhupatiraju Shreya Pathak Laurent Sifre Morgane Rivi\u00e8re Mihir\u00a0Sanjay Kale Juliette Love Pouya Tafti L\u00e9onard Hussenot Pier\u00a0Giuseppe Sessa Aakanksha Chowdhery Adam Roberts Aditya Barua Alex Botev Alex Castro-Ros Ambrose Slone Am\u00e9lie H\u00e9liou Andrea Tacchetti Anna Bulanova Antonia Paterson Beth Tsai Bobak Shahriari Charline\u00a0Le Lan Christopher\u00a0A. Choquette-Choo Cl\u00e9ment Crepy Daniel Cer Daphne Ippolito David Reid Elena Buchatskaya Eric Ni Eric Noland Geng Yan George Tucker George-Christian Muraru Grigory Rozhdestvenskiy Henryk Michalewski Ian Tenney Ivan Grishchenko Jacob Austin James Keeling Jane Labanowski Jean-Baptiste Lespiau Jeff Stanway Jenny Brennan Jeremy Chen Johan Ferret Justin Chiu Justin Mao-Jones Katherine Lee Kathy Yu Katie Millican Lars\u00a0Lowe Sjoesund Lisa Lee Lucas Dixon Machel Reid Maciej Miku\u0142a Mateo Wirth Michael Sharman Nikolai Chinaev Nithum Thain Olivier Bachem Oscar Chang Oscar Wahltinez Paige Bailey Paul Michel Petko Yotov Rahma Chaabouni Ramona Comanescu Reena Jana Rohan Anil Ross McIlroy Ruibo Liu Ryan Mullins Samuel\u00a0L Smith Sebastian Borgeaud Sertan Girgin Sholto Douglas Shree Pandya Siamak Shakeri Soham De Ted Klimenko Tom Hennigan Vlad Feinberg Wojciech Stokowiec Yu hui Chen Zafarali Ahmed Zhitao Gong Tris Warkentin Ludovic Peran Minh Giang Cl\u00e9ment Farabet Oriol Vinyals Jeff Dean Koray Kavukcuoglu Demis Hassabis Zoubin Ghahramani Douglas Eck Joelle Barral Fernando Pereira Eli Collins Armand Joulin Noah Fiedel Evan Senter Alek Andreev and Kathleen Kenealy. 2024. Gemma: Open Models Based on Gemini Research and Technology. arxiv:https:\/\/arXiv.org\/abs\/2403.08295\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2403.08295"},{"key":"e_1_3_3_2_37_2","unstructured":"Miles Turpin Julian Michael Ethan Perez and Samuel\u00a0R. Bowman. 2023. Language Models Don\u2019t Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting. arxiv:https:\/\/arXiv.org\/abs\/2305.04388\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2305.04388"},{"key":"e_1_3_3_2_38_2","unstructured":"European Union. 2025. EU Artificial Intelligence Act. https:\/\/www.euaiact.com\/"},{"key":"e_1_3_3_2_39_2","unstructured":"Jason Wei Yi Tay Rishi Bommasani Colin Raffel Barret Zoph Sebastian Borgeaud Dani Yogatama Maarten Bosma Denny Zhou Donald Metzler Ed\u00a0H. Chi Tatsunori Hashimoto Oriol Vinyals Percy Liang Jeff Dean and William Fedus. 2022. Emergent Abilities of Large Language Models. arxiv:https:\/\/arXiv.org\/abs\/2206.07682\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2206.07682"},{"key":"e_1_3_3_2_40_2","unstructured":"Sarah Wiegreffe and Ana Marasovi\u0107. 2021. Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processing. arxiv:https:\/\/arXiv.org\/abs\/2102.12060\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2102.12060"},{"key":"e_1_3_3_2_41_2","unstructured":"Chaoyi Wu Weixiong Lin Xiaoman Zhang Ya Zhang Yanfeng Wang and Weidi Xie. 2023. PMC-LLaMA: Towards Building Open-source Language Models for Medicine. arxiv:https:\/\/arXiv.org\/abs\/2304.14454\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2304.14454"},{"key":"e_1_3_3_2_42_2","unstructured":"Haiyan Zhao Hanjie Chen Fan Yang Ninghao Liu Huiqi Deng Hengyi Cai Shuaiqiang Wang Dawei Yin and Mengnan Du. 2023. Explainability for Large Language Models: A Survey. arxiv:https:\/\/arXiv.org\/abs\/2309.01029\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2309.01029"}],"event":{"name":"FAccT '25: The 2025 ACM Conference on Fairness, Accountability, and Transparency","location":"Athens Greece","acronym":"FAccT '25"},"container-title":["Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715275.3732104","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T11:05:39Z","timestamp":1750763139000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715275.3732104"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,23]]},"references-count":41,"alternative-id":["10.1145\/3715275.3732104","10.1145\/3715275"],"URL":"https:\/\/doi.org\/10.1145\/3715275.3732104","relation":{},"subject":[],"published":{"date-parts":[[2025,6,23]]},"assertion":[{"value":"2025-06-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}