{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T19:31:32Z","timestamp":1772652692722,"version":"3.50.1"},"reference-count":42,"publisher":"Elsevier BV","issue":"2","license":[{"start":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T00:00:00Z","timestamp":1725840000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T00:00:00Z","timestamp":1725840000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Artif Intell Educ"],"published-print":{"date-parts":[[2025,6]]},"DOI":"10.1007\/s40593-024-00427-9","type":"journal-article","created":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T13:02:27Z","timestamp":1725886947000},"page":"627-650","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["ChatGPT in Undergraduate Education: Performance of GPT-3.5 and Identification of AI-Generated Text in Introductory Neuroscience"],"prefix":"10.1016","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0016-2654","authenticated-orcid":false,"given":"Natalie V.","family":"Covington","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9112-1147","authenticated-orcid":false,"given":"Olivia","family":"Vruwink","sequence":"additional","affiliation":[]}],"member":"78","published-online":{"date-parts":[[2024,9,9]]},"reference":[{"issue":"2","key":"427_CR1","first-page":"25","volume":"23","author":"K Alexander","year":"2023","unstructured":"Alexander, K., Savvidou, C., & Alexander, C. (2023). Who wrote this essay? Detecting AI-Generated writing in second language education in higher education. Teaching English with Technology, 23(2), 25\u201343.","journal-title":"Teaching English with Technology"},{"key":"427_CR2","volume-title":"Taxonomy of educational objectives: The classification of educational goals. Handbook 1: Cognitive domain","year":"1956","unstructured":"Bloom, B. S., Engelhart, M. D., Furst, E. J., Hill, W. H., & Krathwohl, D. R. (Eds.). (1956). Taxonomy of educational objectives: The classification of educational goals. Handbook 1: Cognitive domain. David McKay."},{"key":"427_CR3","unstructured":"Bordt, S., & von Luxburg, U. (2023). ChatGPT participates in a computer science exam. arXiv preprint arXiv:2303.09461."},{"key":"427_CR4","unstructured":"Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., ... & Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877\u20131901."},{"issue":"1","key":"427_CR5","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1177\/05694345231218454","volume":"69","author":"J Buchanan","year":"2024","unstructured":"Buchanan, J., Hill, S., & Shapoval, O. (2024). ChatGPT hallucinates non-existent citations: evidence from economics. The American Economist, 69(1), 80\u201387.","journal-title":"The American Economist"},{"issue":"6","key":"427_CR6","doi-asserted-by":"publisher","first-page":"874","DOI":"10.1080\/02602938.2022.2140780","volume":"48","author":"CKY Chan","year":"2022","unstructured":"Chan, C. K. Y. (2022). A review of the changes in higher education assessment and grading policy during covid-19. Assessment & Evaluation in Higher Education, 48(6), 874\u2013887.","journal-title":"Assessment & Evaluation in Higher Education"},{"key":"427_CR7","doi-asserted-by":"crossref","unstructured":"Chen, L., Zaharia, M., & Zou, J. (2023). How is ChatGPT's behavior changing over time?.\u00a0arXiv preprint arXiv:2307.09009.","DOI":"10.1162\/99608f92.5317da47"},{"key":"427_CR8","first-page":"387","volume":"71","author":"JH Choi","year":"2022","unstructured":"Choi, J. H., Hickman, K. E., Monahan, A. B., & Schwarcz, D. (2022). ChatGPT goes to law school. Journal of Legal Education, 71, 387.","journal-title":"Journal of Legal Education"},{"issue":"10","key":"427_CR9","doi-asserted-by":"publisher","first-page":"3934","DOI":"10.1021\/acs.jchemed.3c00500","volume":"100","author":"TM Clark","year":"2023","unstructured":"Clark, T. M., Anderson, E., Dickson-Karn, N. M., Soltanirad, C., & Tafini, N. (2023). Comparing the Performance of College Chemistry Students with ChatGPT for Calculations Involving Acids and Bases. Journal of Chemical Education, 100(10), 3934\u20133944.","journal-title":"Journal of Chemical Education"},{"key":"427_CR10","doi-asserted-by":"publisher","unstructured":"Clark, E., August, T., Serrano, S., Haduong, N., Gururangan, S., & Smith, N. A. (2021). All That\u2019s \u201cHuman\u201d Is Not Gold: Evaluating Human Evaluation of Generated Text (arXiv:2107.00061). arXiv. http:\/\/arxiv.org\/abs\/2107.00061https:\/\/doi.org\/10.1371\/journal.pone.0025085","DOI":"10.1371\/journal.pone.0025085"},{"issue":"4","key":"427_CR11","doi-asserted-by":"publisher","first-page":"1672","DOI":"10.1021\/acs.jchemed.3c00087","volume":"100","author":"S Fergus","year":"2023","unstructured":"Fergus, S., Botha, M., & Ostovar, M. (2023). Evaluating academic answers generated using ChatGPT. Journal of Chemical Education, 100(4), 1672\u20131675.","journal-title":"Journal of Chemical Education"},{"issue":"5","key":"427_CR12","doi-asserted-by":"publisher","first-page":"1548","DOI":"10.1021\/acs.jchemed.0c01482","volume":"98","author":"SA Finkenstaedt-Quinn","year":"2021","unstructured":"Finkenstaedt-Quinn, S. A., Petterson, M., Gere, A., & Shultz, G. (2021). Praxis of Writing-to-Learn: A Model for the Design and Propagation of Writing-to-Learn in STEM. Journal of Chemical Education, 98(5), 1548\u20131555.","journal-title":"Journal of Chemical Education"},{"key":"427_CR13","unstructured":"Hensley, R. (2024). An AI Workshop for the Overwhelmed and Uninterested.\u00a0Teaching and Generative AI."},{"key":"427_CR14","doi-asserted-by":"crossref","unstructured":"Holland, A., & Ciachir, C. (2024). A qualitative study of students\u2019 lived experience and perceptions of using ChatGPT: Immediacy, equity and integrity. Interactive Learning Environments, 1\u201312.","DOI":"10.1080\/10494820.2024.2350655"},{"key":"427_CR15","doi-asserted-by":"crossref","unstructured":"Ippolito, D., Duckworth, D., Callison-Burch, C., & Eck, D. (2020). Automatic Detection of Generated Text is Easiest when Humans are Fooled (arXiv:1911.00650). arXiv. http:\/\/arxiv.org\/abs\/1911.00650","DOI":"10.18653\/v1\/2020.acl-main.164"},{"issue":"11","key":"427_CR16","doi-asserted-by":"publisher","first-page":"e2208839120","DOI":"10.1073\/pnas.2208839120","volume":"120","author":"M Jakesch","year":"2023","unstructured":"Jakesch, M., Hancock, J. T., & Naaman, M. (2023). Human heuristics for AI-generated language are flawed. Proceedings of the National Academy of Sciences, 120(11), e2208839120.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"427_CR17","doi-asserted-by":"crossref","unstructured":"Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., ... & Fung, P. (2023). Survey of hallucination in natural language generation. ACM Computing Surveys, 55(12), 1\u201338.","DOI":"10.1145\/3571730"},{"key":"427_CR18","doi-asserted-by":"crossref","unstructured":"Karpinska, M., Akoury, N., & Iyyer, M. (2021). The perils of using mechanical turk to evaluate open-ended text generation.\u00a0arXiv preprint arXiv:2109.06835.","DOI":"10.18653\/v1\/2021.emnlp-main.97"},{"issue":"2","key":"427_CR19","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1177\/00472395221118392","volume":"51","author":"J Kerrigan","year":"2022","unstructured":"Kerrigan, J., Cochran, G., Tabanli, S., Charnley, M., & Mulvey, S. (2022). Post-covid changes to assessment practices: A case study of undergraduate STEM recitations. Journal of Educational Technology Systems, 51(2), 192\u2013201.","journal-title":"Journal of Educational Technology Systems"},{"issue":"2","key":"427_CR20","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1002\/(SICI)1098-237X(199903)83:2<115::AID-SCE2>3.0.CO;2-Q","volume":"83","author":"CW Keys","year":"1999","unstructured":"Keys, C. W. (1999). Revitalizing instruction in scientific genres: Connecting knowledge production with writing to learn in science. Science Education, 83(2), 115\u2013130.","journal-title":"Science Education"},{"key":"427_CR21","doi-asserted-by":"crossref","unstructured":"Khalil, M., & Er, E. (2023). Will ChatGPT Get You Caught? Rethinking of Plagiarism Detection. In P. Zaphiris & A. Ioannou (Eds.), Learning and Collaboration Technologies. HCII 2023. Lecture Notes in Computer Science.  (Vol. 14040). Springer, Cham.","DOI":"10.35542\/osf.io\/fnh48"},{"issue":"3","key":"427_CR22","doi-asserted-by":"publisher","first-page":"311","DOI":"10.17239\/jowr-2016.07.03.01","volume":"7","author":"PD Klein","year":"2016","unstructured":"Klein, P. D., & Boscolo, P. (2016). Trends in research on writing as a learning activity. Journal of Writing Research, 7(3), 311\u2013350.","journal-title":"Journal of Writing Research"},{"issue":"1","key":"427_CR23","doi-asserted-by":"publisher","first-page":"010132","DOI":"10.1103\/PhysRevPhysEducRes.19.010132","volume":"19","author":"G Kortemeyer","year":"2023","unstructured":"Kortemeyer, G. (2023). Could an artificial-intelligence agent pass an introductory physics course? Physical Review Physics Education Research, 19(1), 010132.","journal-title":"Physical Review Physics Education Research"},{"key":"427_CR24","doi-asserted-by":"publisher","unstructured":"Malik, A., Khan, M. L., & Hussain, K. (2023). How is ChatGPT transforming academia? Examining its impact on teaching, research, assessment, and learning. https:\/\/doi.org\/10.2139\/ssrn.4413516","DOI":"10.2139\/ssrn.4413516"},{"issue":"3","key":"427_CR25","doi-asserted-by":"publisher","first-page":"520","DOI":"10.1007\/s11528-024-00954-1","volume":"68","author":"Y Mamo","year":"2024","unstructured":"Mamo, Y., Crompton, H., Burke, D., & Nickel, C. (2024). Higher education faculty perceptions of ChatGPT and the influencing factors: a sentiment analysis of X. TechTrends, 68(3), 520\u2013534.","journal-title":"TechTrends"},{"key":"427_CR26","doi-asserted-by":"crossref","unstructured":"Newton, P. M., & Xiromeriti, M. (2023). ChatGPT Performance on MCQ Exams in Higher Education. A Pragmatic Scoping Review. Assessment & Evaluation in Higher Education, 1\u201318.","DOI":"10.35542\/osf.io\/sytu3"},{"issue":"6654","key":"427_CR27","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1126\/science.adh2586","volume":"381","author":"S Noy","year":"2023","unstructured":"Noy, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. Science, 381(6654), 187\u2013192.","journal-title":"Science"},{"key":"427_CR28","unstructured":"OpenAI. (2023). GPT-4 Technical Report."},{"key":"427_CR29","doi-asserted-by":"publisher","first-page":"100166","DOI":"10.1016\/j.caeo.2024.100166","volume":"6","author":"L Parker","year":"2024","unstructured":"Parker, L., Carter, C., Karakas, A., Loper, A. J., & Sokkar, A. (2024). Graduate instructors navigating the AI frontier: The role of ChatGPT in higher education. Computers and Education Open, 6, 100166.","journal-title":"Computers and Education Open"},{"issue":"2","key":"427_CR30","doi-asserted-by":"publisher","first-page":"07","DOI":"10.53761\/1.20.02.07","volume":"20","author":"M Perkins","year":"2023","unstructured":"Perkins, M. (2023). Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond. Journal of University Teaching & Learning Practice, 20(2), 07.","journal-title":"Journal of University Teaching & Learning Practice"},{"key":"427_CR31","doi-asserted-by":"crossref","unstructured":"Pursnani, V., Sermet, Y., Kurt, M., & Demir, I. (2023). Performance of ChatGPT on the US fundamentals of engineering exam: Comprehensive assessment of proficiency and potential implications for professional environmental engineering practice. Computers and Education: Artificial Intelligence, 5, 100183.","DOI":"10.1016\/j.caeai.2023.100183"},{"issue":"9","key":"427_CR32","doi-asserted-by":"publisher","first-page":"676","DOI":"10.1016\/j.tics.2016.07.002","volume":"20","author":"EF Risko","year":"2016","unstructured":"Risko, E. F., & Gilbert, S. J. (2016). Cognitive offloading. Trends in Cognitive Sciences, 20(9), 676\u2013688.","journal-title":"Trends in Cognitive Sciences"},{"issue":"1","key":"427_CR33","first-page":"342","volume":"6","author":"J Rudolph","year":"2023","unstructured":"Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning and Teaching, 6(1), 342\u2013363.","journal-title":"Journal of Applied Learning and Teaching"},{"key":"427_CR34","doi-asserted-by":"crossref","unstructured":"Salamin, A. D., Russo, D., & Rueger, D. (2023). ChatGPT, an excellent liar: how conversational agent hallucinations impact learning and teaching. In\u00a0Proceedings of the 7th International Conference on Teaching, Learning and Education.","DOI":"10.33422\/6th.iacetl.2023.11.100"},{"key":"427_CR35","unstructured":"Villasenor, J. (2023). How ChatGPT Can Improve Education, Not Threaten It. Scientific American. https:\/\/www.scientificamerican.com\/article\/how-chatgpt-can-improve-education-not-threaten-it\/"},{"issue":"1","key":"427_CR36","doi-asserted-by":"publisher","first-page":"20220158","DOI":"10.1515\/opis-2022-0158","volume":"7","author":"WH Walters","year":"2023","unstructured":"Walters, W. H. (2023). The effectiveness of software designed to detect AI-Generated writing: a comparison of 16 AI text detectors. Open Information Science, 7(1), 20220158.","journal-title":"Open Information Science"},{"issue":"1","key":"427_CR37","doi-asserted-by":"publisher","first-page":"14045","DOI":"10.1038\/s41598-023-41032-5","volume":"13","author":"WH Walters","year":"2023","unstructured":"Walters, W. H., & Wilder, E. I. (2023). Fabrication and errors in the bibliographic citations generated by ChatGPT. Scientific Reports, 13(1), 14045.","journal-title":"Scientific Reports"},{"issue":"10","key":"427_CR38","doi-asserted-by":"publisher","first-page":"3806","DOI":"10.1021\/acs.jchemed.3c00664","volume":"100","author":"FM Watts","year":"2023","unstructured":"Watts, F. M., Dood, A. J., Shultz, G. V., & Rodriguez, J. M. G. (2023). Comparing Student and Generative Artificial Intelligence Chatbot Responses to Organic Chemistry Writing-to-Learn Assignments. Journal of Chemical Education, 100(10), 3806\u20133817.","journal-title":"Journal of Chemical Education"},{"issue":"1","key":"427_CR39","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1007\/s40979-023-00146-z","volume":"19","author":"D Weber-Wulff","year":"2023","unstructured":"Weber-Wulff, D., Anohina-Naumeca, A., Bjelobaba, S., Folt\u00fdnek, T., Guerrero-Dib, J., Popoola, O., \u0160igut, P., & Waddington, L. (2023). Testing of detection tools for AI-generated text. International Journal for Educational Integrity, 19(1), 26.","journal-title":"International Journal for Educational Integrity"},{"key":"427_CR40","unstructured":"West, C. G. (2023). AI and the FCI: Can ChatGPT project an understanding of introductory physics?. arXiv preprint arXiv:2303.01067."},{"key":"427_CR41","unstructured":"Woo, D. J., Guo, K., & Susanto, H. (2023). Cases of EFL Secondary Students' Prompt Engineering Pathways to Complete a Writing Task with ChatGPT. arXiv preprint arXiv:2307.05493."},{"key":"427_CR42","doi-asserted-by":"crossref","unstructured":"Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. (2023). Why Johnny can\u2019t prompt: how non-AI experts try (and fail) to design LLM prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1\u201321).","DOI":"10.1145\/3544548.3581388"}],"container-title":["International Journal of Artificial Intelligence in Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40593-024-00427-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40593-024-00427-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40593-024-00427-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T18:12:52Z","timestamp":1772647972000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40593-024-00427-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,9]]},"references-count":42,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["427"],"URL":"https:\/\/doi.org\/10.1007\/s40593-024-00427-9","relation":{},"ISSN":["1560-4292","1560-4306"],"issn-type":[{"value":"1560-4292","type":"print"},{"value":"1560-4306","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,9]]},"assertion":[{"value":"13 August 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 September 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study was reviewed and deemed exempt by the University of Minnesota Institutional Review Board.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"The authors have no relevant financial interests to disclose. Both authors serve in teaching-related roles in the course from which study materials were drawn. The study was conducted using de-identified secondary data after the course had fully concluded.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}]}}