{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T00:48:15Z","timestamp":1772930895792,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":53,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,23]],"date-time":"2023-10-23T00:00:00Z","timestamp":1698019200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","award":[""],"award-info":[{"award-number":[""]}]},{"name":"Haslab\/INESC TEC","award":[""],"award-info":[{"award-number":[""]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,10,23]]},"DOI":"10.1145\/3623476.3623522","type":"proceedings-article","created":{"date-parts":[[2023,10,19]],"date-time":"2023-10-19T13:45:16Z","timestamp":1697723116000},"page":"111-124","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["GPT-3-Powered Type Error Debugging: Investigating the Use of Large Language Models for Code Repair"],"prefix":"10.1145","author":[{"given":"Francisco","family":"Ribeiro","sequence":"first","affiliation":[{"name":"HASLab\/INESC TEC, Braga, Portugal \/ University of Minho, Braga, Portugal"}]},{"given":"Jos\u00e9 Nuno Castro","family":"de Macedo","sequence":"additional","affiliation":[{"name":"HASLab\/INESC TEC, Braga, Portugal \/ University of Minho, Braga, Portugal"}]},{"given":"Kanae","family":"Tsushima","sequence":"additional","affiliation":[{"name":"National Institute of Informatics, Tokyo, Japan \/ Sokendai University, Braga, Japan"}]},{"given":"Rui","family":"Abreu","sequence":"additional","affiliation":[{"name":"INESC-ID, Porto, Portugal \/ University of Porto, Porto, Portugal"}]},{"given":"Jo\u00e3o","family":"Saraiva","sequence":"additional","affiliation":[{"name":"HASLab\/INESC TEC, Braga, Portugal \/ University of Minho, Braga, Portugal"}]}],"member":"320","published-online":{"date-parts":[[2023,10,23]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290353"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSREW.2017.68"},{"key":"e_1_3_2_1_3_1","volume-title":"Evolutionary repair of faulty software. Applied soft computing, 11, 4","author":"Arcuri Andrea","year":"2011","unstructured":"Andrea Arcuri . 2011. Evolutionary repair of faulty software. Applied soft computing, 11, 4 ( 2011 ), 3494\u20133514. Andrea Arcuri. 2011. Evolutionary repair of faulty software. Applied soft computing, 11, 4 (2011), 3494\u20133514."},{"key":"e_1_3_2_1_4_1","volume-title":"Language Models are Few-Shot Learners. CoRR, abs\/2005.14165","author":"Brown Tom B.","year":"2020","unstructured":"Tom B. Brown , Benjamin Mann , Nick Ryder , Melanie Subbiah , Jared Kaplan , Prafulla Dhariwal , Arvind Neelakantan , Pranav Shyam , Girish Sastry , Amanda Askell , Sandhini Agarwal , Ariel Herbert-Voss , Gretchen Krueger , Tom Henighan , Rewon Child , Aditya Ramesh , Daniel M. Ziegler , Jeffrey Wu , Clemens Winter , Christopher Hesse , Mark Chen , Eric Sigler , Mateusz Litwin , Scott Gray , Benjamin Chess , Jack Clark , Christopher Berner , Sam McCandlish , Alec Radford , Ilya Sutskever , and Dario Amodei . 2020. Language Models are Few-Shot Learners. CoRR, abs\/2005.14165 ( 2020 ), arXiv:2005.14165. arxiv:2005.14165 Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. CoRR, abs\/2005.14165 (2020), arXiv:2005.14165. arxiv:2005.14165"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2351676.2351752"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2535838.2535863"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07151-0_3"},{"key":"e_1_3_2_1_8_1","first-page":"1943","article-title":"Sequencer: Sequence-to-sequence learning for end-to-end program repair","volume":"47","author":"Chen Zimin","year":"2019","unstructured":"Zimin Chen , Steve Kommrusch , Michele Tufano , Louis-No\u00ebl Pouchet , Denys Poshyvanyk , and Martin Monperrus . 2019 . Sequencer: Sequence-to-sequence learning for end-to-end program repair . IEEE Transactions on Software Engineering , 47 , 9 (2019), 1943 \u2013 1959 . Zimin Chen, Steve Kommrusch, Michele Tufano, Louis-No\u00ebl Pouchet, Denys Poshyvanyk, and Martin Monperrus. 2019. Sequencer: Sequence-to-sequence learning for end-to-end program repair. IEEE Transactions on Software Engineering, 47, 9 (2019), 1943\u20131959.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/507635.507659"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/357766.351266"},{"key":"e_1_3_2_1_11_1","unstructured":"David Coimbra Sofia Reis Rui Abreu Corina P\u0103s\u0103reanu and Hakan Erdogmus. 2021. On using distributed representations of source code for the detection of C security vulnerabilities. arXiv preprint arXiv:2106.01367. \t\t\t\t  David Coimbra Sofia Reis Rui Abreu Corina P\u0103s\u0103reanu and Hakan Erdogmus. 2021. On using distributed representations of source code for the detection of C security vulnerabilities. arXiv preprint arXiv:2106.01367."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/582153.582176"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/C-M.1978.218136"},{"key":"e_1_3_2_1_14_1","volume-title":"Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2018 . Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416587"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2896921.2896931"},{"key":"e_1_3_2_1_17_1","volume-title":"Codebert: A pre-trained model for programming and natural languages. arXiv preprint arXiv:2002.08155.","author":"Feng Zhangyin","year":"2020","unstructured":"Zhangyin Feng , Daya Guo , Duyu Tang , Nan Duan , Xiaocheng Feng , Ming Gong , Linjun Shou , Bing Qin , Ting Liu , and Daxin Jiang . 2020 . Codebert: A pre-trained model for programming and natural languages. arXiv preprint arXiv:2002.08155. Zhangyin Feng, Daya Guo, Duyu Tang, Nan Duan, Xiaocheng Feng, Ming Gong, Linjun Shou, Bing Qin, Ting Liu, and Daxin Jiang. 2020. Codebert: A pre-trained model for programming and natural languages. arXiv preprint arXiv:2002.08155."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318162"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2004.01.004"},{"key":"e_1_3_2_1_20_1","unstructured":"BJ Heeren JT Jeuring Doaitse Swierstra and Pablo Azero Alcocer. 2002. Improving type-error messages in functional languages. \t\t\t\t  BJ Heeren JT Jeuring Doaitse Swierstra and Pablo Azero Alcocer. 2002. Improving type-error messages in functional languages."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/871895.871902"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236051"},{"key":"e_1_3_2_1_23_1","volume-title":"Genprog: A generic method for automatic software repair. Ieee transactions on software engineering, 38, 1","author":"Goues Claire Le","year":"2011","unstructured":"Claire Le Goues , ThanhVu Nguyen , Stephanie Forrest , and Westley Weimer . 2011 . Genprog: A generic method for automatic software repair. Ieee transactions on software engineering, 38, 1 (2011), 54\u201372. Claire Le Goues, ThanhVu Nguyen, Stephanie Forrest, and Westley Weimer. 2011. Genprog: A generic method for automatic software repair. Ieee transactions on software engineering, 38, 1 (2011), 54\u201372."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/291891.291892"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273442.1250783"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380345"},{"key":"e_1_3_2_1_27_1","volume-title":"Codexglue: A machine learning benchmark dataset for code understanding and generation. arXiv preprint arXiv:2102.04664.","author":"Lu Shuai","year":"2021","unstructured":"Shuai Lu , Daya Guo , Shuo Ren , Junjie Huang , Alexey Svyatkovskiy , Ambrosio Blanco , Colin Clement , Dawn Drain , Daxin Jiang , and Duyu Tang . 2021 . Codexglue: A machine learning benchmark dataset for code understanding and generation. arXiv preprint arXiv:2102.04664. Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin Clement, Dawn Drain, Daxin Jiang, and Duyu Tang. 2021. Codexglue: A machine learning benchmark dataset for code understanding and generation. arXiv preprint arXiv:2102.04664."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397369"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2014.28"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2013.6606623"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2001420.2001445"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2017.62"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Alexandre Perez Rui Abreu and IT HASLab. 2018. Leveraging Qualitative Reasoning to Improve SFL.. In IJCAI. 1935\u20131941. \t\t\t\t  Alexandre Perez Rui Abreu and IT HASLab. 2018. Leveraging Qualitative Reasoning to Improve SFL.. In IJCAI. 1935\u20131941.","DOI":"10.24963\/ijcai.2018\/267"},{"key":"e_1_3_2_1_34_1","volume-title":"Types and Programming Languages","author":"Pierce Benjamin C.","year":"2091","unstructured":"Benjamin C. Pierce . 2002. Types and Programming Languages ( 1 st ed.). The MIT Press . isbn:026216 2091 Benjamin C. Pierce. 2002. Types and Programming Languages (1st ed.). The MIT Press. isbn:0262162091","edition":"1"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3524459.3527351"},{"key":"e_1_3_2_1_36_1","volume-title":"Language models are unsupervised multitask learners. OpenAI blog, 1, 8","author":"Radford Alec","year":"2019","unstructured":"Alec Radford , Jeffrey Wu , Rewon Child , David Luan , Dario Amodei , and Ilya Sutskever . 2019. Language models are unsupervised multitask learners. OpenAI blog, 1, 8 ( 2019 ), 9. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI blog, 1, 8 (2019), 9."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsc.2016.07.013"},{"key":"e_1_3_2_1_38_1","volume-title":"On Understanding Contextual Changes of Failures. In 2021 IEEE 21st International Conference on Software Quality, Reliability and Security (QRS). 1036\u20131047","author":"Ribeiro Francisco","year":"2021","unstructured":"Francisco Ribeiro , Rui Abreu , and Jo\u00e3o Saraiva . 2021 . On Understanding Contextual Changes of Failures. In 2021 IEEE 21st International Conference on Software Quality, Reliability and Security (QRS). 1036\u20131047 . Francisco Ribeiro, Rui Abreu, and Jo\u00e3o Saraiva. 2021. On Understanding Contextual Changes of Failures. In 2021 IEEE 21st International Conference on Software Quality, Reliability and Security (QRS). 1036\u20131047."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3524459.3527347"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.6084\/m9.figshare.23646903.v2"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3385412.3386005"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32037-8_1"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/871895.871903"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1017472.1017486"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3417058"},{"key":"e_1_3_2_1_46_1","unstructured":"Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux Timoth\u00e9e Lacroix Baptiste Rozi\u00e8re Naman Goyal Eric Hambro Faisal Azhar Aurelien Rodriguez Armand Joulin Edouard Grave and Guillaume Lample. 2023. LLaMA: Open and Efficient Foundation Language Models. arxiv:2302.13971. \t\t\t\t  Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux Timoth\u00e9e Lacroix Baptiste Rozi\u00e8re Naman Goyal Eric Hambro Faisal Azhar Aurelien Rodriguez Armand Joulin Edouard Grave and Guillaume Lample. 2023. LLaMA: Open and Efficient Foundation Language Models. arxiv:2302.13971."},{"key":"e_1_3_2_1_47_1","volume-title":"Symposium on Implementation and Application of Functional Languages. 190\u2013206","author":"Tsushima Kanae","year":"2012","unstructured":"Kanae Tsushima and Kenichi Asai . 2012 . An embedded type debugger . In Symposium on Implementation and Application of Functional Languages. 190\u2013206 . Kanae Tsushima and Kenichi Asai. 2012. An embedded type debugger. In Symposium on Implementation and Application of Functional Languages. 190\u2013206."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-41582-1_12"},{"key":"e_1_3_2_1_49_1","first-page":"131","article-title":"A weighted type-error slicer","volume":"31","author":"Tsushima Kanae","year":"2014","unstructured":"Kanae Tsushima and Kenichi Asai . 2014 . A weighted type-error slicer . Journal of Computer Software , 31 , 4 (2014), 131 \u2013 148 . Kanae Tsushima and Kenichi Asai. 2014. A weighted type-error slicer. Journal of Computer Software, 31, 4 (2014), 131\u2013148.","journal-title":"Journal of Computer Software"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3412932.3412939"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/512644.512648"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2560811"},{"key":"e_1_3_2_1_53_1","volume-title":"Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, and Luke Zettlemoyer.","author":"Zhang Susan","year":"2022","unstructured":"Susan Zhang , Stephen Roller , Naman Goyal , Mikel Artetxe , Moya Chen , Shuohui Chen , Christopher Dewan , Mona Diab , Xian Li , Xi Victoria Lin , Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, and Luke Zettlemoyer. 2022 . OPT : Open Pre-trained Transformer Language Models . arxiv:2205.01068. Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, and Luke Zettlemoyer. 2022. OPT: Open Pre-trained Transformer Language Models. arxiv:2205.01068."}],"event":{"name":"SLE '23: 16th ACM SIGPLAN International Conference on Software Language Engineering","location":"Cascais Portugal","acronym":"SLE '23","sponsor":["SIGPLAN ACM Special Interest Group on Programming Languages"]},"container-title":["Proceedings of the 16th ACM SIGPLAN International Conference on Software Language Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3623476.3623522","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:51:00Z","timestamp":1750287060000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3623476.3623522"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,23]]},"references-count":53,"alternative-id":["10.1145\/3623476.3623522","10.1145\/3623476"],"URL":"https:\/\/doi.org\/10.1145\/3623476.3623522","relation":{},"subject":[],"published":{"date-parts":[[2023,10,23]]},"assertion":[{"value":"2023-10-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}