{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T05:54:49Z","timestamp":1770530089090,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":14,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,5,20]],"date-time":"2024-05-20T00:00:00Z","timestamp":1716163200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,5,20]]},"DOI":"10.1145\/3658271.3658320","type":"proceedings-article","created":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T10:26:23Z","timestamp":1716459983000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["ChatGPT and Bard Performance on the POSCOMP Exam"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-1447-6472","authenticated-orcid":false,"given":"Mateus Santos","family":"Saldanha","sequence":"first","affiliation":[{"name":"Universidade de S\u00e3o Paulo, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4890-1548","authenticated-orcid":false,"given":"Luciano Antonio","family":"Digiampietri","sequence":"additional","affiliation":[{"name":"Universidade de S\u00e3o Paulo, Brazil"}]}],"member":"320","published-online":{"date-parts":[[2024,5,23]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Sebastian Bordt and Ulrike von Luxburg. 2023. ChatGPT Participates in a Computer Science Exam. arxiv:2303.09461\u00a0[cs.CL]"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","unstructured":"Felipe de Fonseca Ivandr\u00e9 Paraboni and Luciano Digiampietri. 2023. Contextual stance classification using prompt engineering. In Anais do XIV Simp\u00f3sio Brasileiro de Tecnologia da Informa\u00e7\u00e3o e da Linguagem Humana (Belo Horizonte\/MG). SBC Porto Alegre RS Brasil 33\u201342. https:\/\/doi.org\/10.5753\/stil.2023.233708","DOI":"10.5753\/stil.2023.233708"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1423"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1021\/ci960088t"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3587102.3588827"},{"key":"e_1_3_2_1_6_1","volume-title":"Proceedings of the International Conference on Information Processing. I K International Publishing House","author":"Newell A.","unstructured":"A. Newell, J.C. Shaw, and H.A. Simon. 1959. Report on a general problem-solving program. In Proceedings of the International Conference on Information Processing. I K International Publishing House, Paris, France, 256\u2013264."},{"key":"e_1_3_2_1_7_1","volume-title":"Advances in Neural Information Processing Systems, S.\u00a0Koyejo, S.\u00a0Mohamed, A.\u00a0Agarwal, D.\u00a0Belgrave, K.\u00a0Cho, and A.\u00a0Oh (Eds.). Vol.\u00a035. Curran Associates","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul\u00a0F Christiano, Jan Leike, and Ryan Lowe. 2022. Training language models to follow instructions with human feedback. In Advances in Neural Information Processing Systems, S.\u00a0Koyejo, S.\u00a0Mohamed, A.\u00a0Agarwal, D.\u00a0Belgrave, K.\u00a0Cho, and A.\u00a0Oh (Eds.). Vol.\u00a035. Curran Associates, Inc., New Orleans, LA, USA, 27730\u201327744. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/file\/b1efde53be364a73914f58805a001731-Paper-Conference.pdf"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Vinay Pursnani Yusuf Sermet and Ibrahim Demir. 2023. Performance of ChatGPT on the US Fundamentals of Engineering Exam: Comprehensive Assessment of Proficiency and Potential Implications for Professional Environmental Engineering Practice. arxiv:2304.12198\u00a0[cs.CY]","DOI":"10.1016\/j.caeai.2023.100183"},{"key":"e_1_3_2_1_9_1","unstructured":"Basit Qureshi. 2023. Exploring the Use of ChatGPT as a Tool for Learning and Assessment in Undergraduate Computer Science Curriculum: Opportunities and Challenges. arxiv:2304.11214\u00a0[cs.CY]"},{"key":"e_1_3_2_1_10_1","unstructured":"Alec Radford and Karthik Narasimhan. 2018. Improving Language Understanding by Generative Pre-Training. https:\/\/api.semanticscholar.org\/CorpusID:49313245"},{"key":"e_1_3_2_1_11_1","volume-title":"Russell and Peter Norvig","author":"J.","year":"2009","unstructured":"Stuart\u00a0J. Russell and Peter Norvig. 2009. Artificial Intelligence: a modern approach (3 ed.). Pearson, London, England."},{"key":"e_1_3_2_1_12_1","volume-title":"Chi, and Quoc Le","author":"Thoppilan Romal","year":"2022","unstructured":"Romal Thoppilan, Daniel\u00a0De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu\u00a0Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Vincent Zhao, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Pranesh Srinivasan, Laichee Man, Kathleen Meier-Hellstern, Meredith\u00a0Ringel Morris, Tulsee Doshi, Renelito\u00a0Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Aguera-Arcas, Claire Cui, Marian Croak, Ed Chi, and Quoc Le. 2022. LaMDA: Language Models for Dialog Applications. arxiv:2201.08239\u00a0[cs.CL]"},{"key":"e_1_3_2_1_13_1","unstructured":"Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux Timoth\u00e9e Lacroix Baptiste Rozi\u00e8re Naman Goyal Eric Hambro Faisal Azhar Aurelien Rodriguez Armand Joulin Edouard Grave and Guillaume Lample. 2023. LLaMA: Open and Efficient Foundation Language Models. arxiv:2302.13971\u00a0[cs.CL]"},{"key":"e_1_3_2_1_14_1","volume-title":"Advances in Neural Information Processing Systems, I.\u00a0Guyon, U.\u00a0Von Luxburg, S.\u00a0Bengio, H.\u00a0Wallach, R.\u00a0Fergus, S.\u00a0Vishwanathan, and R.\u00a0Garnett (Eds.). Vol.\u00a030. Curran Associates","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan\u00a0N Gomez, \u0141\u00a0ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, I.\u00a0Guyon, U.\u00a0Von Luxburg, S.\u00a0Bengio, H.\u00a0Wallach, R.\u00a0Fergus, S.\u00a0Vishwanathan, and R.\u00a0Garnett (Eds.). Vol.\u00a030. Curran Associates, Inc., Long Beach, CA, USA. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2017\/file\/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf"}],"event":{"name":"SBSI '24: XX Brazilian Symposium on Information Systems","location":"Juiz de Fora Brazil","acronym":"SBSI '24"},"container-title":["Proceedings of the 20th Brazilian Symposium on Information Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658271.3658320","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3658271.3658320","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T13:07:32Z","timestamp":1755868052000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658271.3658320"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,20]]},"references-count":14,"alternative-id":["10.1145\/3658271.3658320","10.1145\/3658271"],"URL":"https:\/\/doi.org\/10.1145\/3658271.3658320","relation":{},"subject":[],"published":{"date-parts":[[2024,5,20]]},"assertion":[{"value":"2024-05-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}