{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T23:28:07Z","timestamp":1784417287935,"version":"3.55.0"},"reference-count":38,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,6,12]],"date-time":"2024-06-12T00:00:00Z","timestamp":1718150400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>The use of large language models (LLMs) is now spreading in several areas of research and development. This work is concerned with systematically reviewing LLMs\u2019 involvement in engineering education. Starting from a general research question, two queries were used to select 370 papers from the literature. Filtering them through several inclusion\/exclusion criteria led to the selection of 20 papers. These were investigated based on eight dimensions to identify areas of engineering disciplines that involve LLMs, where they are most present, how this involvement takes place, and which LLM-based tools are used, if any. Addressing these key issues allowed three more specific research questions to be answered, offering a clear overview of the current involvement of LLMs in engineering education. The research outcomes provide insights into the potential and challenges of LLMs in transforming engineering education, contributing to its responsible and effective future implementation. This review\u2019s outcomes could help address the best ways to involve LLMs in engineering education activities and measure their effectiveness as time progresses. For this reason, this study addresses suggestions on how to improve activities in engineering education. The systematic review on which this research is based conforms to the rules of the current literature regarding inclusion\/exclusion criteria and quality assessments in order to make the results as objective as possible and easily replicable.<\/jats:p>","DOI":"10.3390\/info15060345","type":"journal-article","created":{"date-parts":[[2024,6,12]],"date-time":"2024-06-12T04:15:27Z","timestamp":1718165727000},"page":"345","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":53,"title":["Large Language Models (LLMs) in Engineering Education: A Systematic Review and Suggestions for Practical Adoption"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6281-8690","authenticated-orcid":false,"given":"Stefano","family":"Filippi","sequence":"first","affiliation":[{"name":"Polytechnic Department of Engineering and Architecture (DPIA), University of Udine, 33100 Udine, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9632-9799","authenticated-orcid":false,"given":"Barbara","family":"Motyl","sequence":"additional","affiliation":[{"name":"Polytechnic Department of Engineering and Architecture (DPIA), University of Udine, 33100 Udine, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,12]]},"reference":[{"key":"ref_1","unstructured":"(2024, April 18). OpenAI. 2024. (Apr 2024 Version). Available online: https:\/\/openai.com\/research\/overview."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1007\/s11023-020-09548-1","article-title":"GPT-3: Its Nature, Scope, Limits, and Consequences","volume":"30","author":"Floridi","year":"2020","journal-title":"Minds Mach."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1111\/bjet.13370","article-title":"Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Review","volume":"55","author":"Yan","year":"2024","journal-title":"Br. J. Educ. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Prather, J., Denny, P., Leinonen, J., Becker, B.A., Albluwi, I., Craig, M., Keuning, H., Kiesler, N., Kohn, T., and Luxton-Reilly, A. (2023, January 10\u201312). The Robots Are Here: Navigating the Generative AI Revolution in Computing Education. Proceedings of the 2023 Working Group Reports on Innovation and Technology in Computer Science Education, Turku, Finland.","DOI":"10.1145\/3623762.3633499"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1186\/s40634-023-00700-1","article-title":"ChatGPT and Large Language Models in Orthopedics: From Education and Surgery to Research","volume":"10","author":"Chatterjee","year":"2023","journal-title":"J. Exp. orthop."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1007\/s11920-023-01477-x","article-title":"An Introduction to Generative Artificial Intelligence in Mental Health Care: Considerations and Guidance","volume":"25","author":"King","year":"2023","journal-title":"Curr. Psychiatry Rep."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1007\/s40171-023-00356-x","article-title":"Unravelling the Impact of Generative Artificial Intelligence (GAI) in Industrial Applications: A Review of Scientific and Grey Literature","volume":"24","author":"Kar","year":"2023","journal-title":"Glob. J. Flex. Syst. Manag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1080\/03043797.2023.2213169","article-title":"ChatGPT versus Engineering Education Assessment: A Multidisciplinary and Multi-Institutional Benchmarking and Analysis of This Generative Artificial Intelligence Tool to Investigate Assessment Integrity","volume":"48","author":"Nikolic","year":"2023","journal-title":"Eur. J. Eng. Educ."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Filippi, S. (2023). Measuring the Impact of ChatGPT on Fostering Concept Generation in Innovative Product Design. Electronics, 12.","DOI":"10.3390\/electronics12163535"},{"key":"ref_10","first-page":"113","article-title":"Relationships among Personality Traits, ChatGPT Usage and Concept Generation in Innovation Design","volume":"Volume 113","author":"Karwowski","year":"2023","journal-title":"Artificial Intelligence, Social Computing and Wearable Technologies. Proceedings of the AHFE (2023) International Conference, San Francisco, CA, USA, 20\u201324 July 2023"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"100394","DOI":"10.1016\/j.xops.2023.100394","article-title":"Generative Artificial Intelligence through ChatGPT and Other Large Language Models in Ophthalmology","volume":"3","author":"Tan","year":"2023","journal-title":"Ophthalmol. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhang, C., Chen, J., Li, J., Peng, Y., and Mao, Z. (2023). Large Language Models for Human\u2013Robot Interaction: A Review. Biomim. Intell. Robot., 3.","DOI":"10.1016\/j.birob.2023.100131"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bahroun, Z., Anane, C., Ahmed, V., and Zacca, A. (2023). Transforming Education: A Comprehensive Review of Generative Artificial Intelligence in Educational Settings through Bibliometric and Content Analysis. Sustainability, 15.","DOI":"10.3390\/su151712983"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"ref_15","unstructured":"(2024, April 18). PRISMA 2020 Checklist. Available online: https:\/\/www.prisma-statement.org\/s\/PRISMA_2020_checklist-fxke.docx."},{"key":"ref_16","unstructured":"(2024, April 18). GEMINI. Available online: https:\/\/gemini.google.com\/app."},{"key":"ref_17","unstructured":"(2024, April 18). ALPACA. Available online: https:\/\/crfm.stanford.edu\/2023\/03\/13\/alpaca."},{"key":"ref_18","unstructured":"(2024, April 18). ELICIT. Available online: https:\/\/ought.org\/elicit."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Abdelfattah, A.M., Ali, N.A., Elaziz, M.A., and Ammar, H.H. (2023, January 3\u20135). Roadmap for Software Engineering Education Using ChatGPT. Proceedings of the 2023 International Conference on Artificial Intelligence Science and Applications in Industry and Society (CAISAIS), Galala, Egypt.","DOI":"10.1109\/CAISAIS59399.2023.10270477"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/978-3-031-48550-3_20","article-title":"ChatGPT as a Fullstack Web Developer\u2014Early Results","volume":"Volume 489","author":"Kruchten","year":"2024","journal-title":"Agile Processes in Software Engineering and Extreme Programming\u2014Workshops"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"100172","DOI":"10.1016\/j.caeai.2023.100172","article-title":"Students\u2019 Use of Large Language Models in Engineering Education: A Case Study on Technology Acceptance, Perceptions, Efficacy, and Detection Chances","volume":"5","author":"Bernabei","year":"2023","journal-title":"Comput. Educ. Artif. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chen, L., and Shimada, A. (December, January 27). Designing Worksheet for Using ChatGPT: Towards Enhancing Information Retrieval and Judgment Skills. Proceedings of the 2023 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE), Auckland, New Zealand.","DOI":"10.1109\/TALE56641.2023.10398310"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Daun, M., and Brings, J. (2023, January 10\u201312). How ChatGPT Will Change Software Engineering Education. Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1, Turku, Finland.","DOI":"10.1145\/3587102.3588815"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"100126","DOI":"10.1016\/j.dche.2023.100126","article-title":"Complementary Role of Large Language Models in Educating Undergraduate Design of Distillation Column: Methodology Development","volume":"9","author":"Kong","year":"2023","journal-title":"Digit. Chem. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"690","DOI":"10.14569\/IJACSA.2024.0150168","article-title":"Practical Application of AI and Large Language Models in Software Engineering Education","volume":"15","author":"Kozov","year":"2024","journal-title":"IJACSA"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lauren, P., and Watta, P. (2023, January 18\u201321). Work-in-Progress: Integrating Generative AI with Evidence-Based Learning Strategies in Computer Science and Engineering Education. Proceedings of the 2023 IEEE Frontiers in Education Conference (FIE), College Station, TX, USA.","DOI":"10.1109\/FIE58773.2023.10342970"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.ece.2023.05.005","article-title":"A Perspective on the Synergistic Potential of Artificial Intelligence and Product-Based Learning Strategies in Biobased Materials Education","volume":"44","author":"Marquez","year":"2023","journal-title":"Educ. Chem. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.14742\/ajet.8825","article-title":"Digital Transformation in Engineering Education: Exploring the Potential of AI-Assisted Learning","volume":"39","author":"Pham","year":"2023","journal-title":"AJET"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Popovici, M.-D. (2023). ChatGPT in the Classroom. Exploring Its Potential and Limitations in a Functional Programming Course. Int. J. Hum.\u2013Comput. Interact., ahead of print.","DOI":"10.1080\/10447318.2023.2269006"},{"key":"ref_30","unstructured":"Puig-Ortiz, J., P\u00e0mies-Vil\u00e0, R., and Jordi Nebot, L. (2023, January 11\u201314). Exploring the Application Of Chatgpt in Mechanical Engineering Education. Proceedings of the 51st Annual Conference of the European Society for Engineering Education (SEFI), Dublin, Ireland."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Qureshi, B. (2023, January 9\u201311). ChatGPT in Computer Science Curriculum Assessment: An Analysis of Its Successes and Shortcomings. Proceedings of the 2023 9th International Conference on e-Society, e-Learning and e-Technologies, Portsmouth, UK.","DOI":"10.1145\/3613944.3613946"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez-Ruiz, L.M., Moll-L\u00f3pez, S., Nu\u00f1ez-P\u00e9rez, A., Mora\u00f1o-Fern\u00e1ndez, J.A., and Vega-Fleitas, E. (2023). ChatGPT Challenges Blended Learning Methodologies in Engineering Education: A Case Study in Mathematics. Appl. Sci., 13.","DOI":"10.3390\/app13106039"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"38805","DOI":"10.1109\/ACCESS.2023.3268224","article-title":"Exploring Students\u2019 Perceptions of ChatGPT: Thematic Analysis and Follow-Up Survey","volume":"11","author":"Shoufan","year":"2023","journal-title":"IEEE Access"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1069","DOI":"10.1109\/TLT.2024.3355015","article-title":"Student Perceptions of ChatGPT Use in a College Essay Assignment: Implications for Learning, Grading, and Trust in Artificial Intelligence","volume":"17","author":"Tossell","year":"2024","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.ece.2023.05.001","article-title":"Exploring the Use of Large Language Models (LLMs) in Chemical Engineering Education: Building Core Course Problem Models with Chat-GPT","volume":"44","author":"Tsai","year":"2023","journal-title":"Educ. Chem. Eng."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wang, T., D\u00edaz, D.V., Brown, C., and Chen, Y. (2023, January 3\u20136). Exploring the Role of AI Assistants in Computer Science Education: Methods, Implications, and Instructor Perspectives. Proceedings of the 2023 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC), Washington, DC, USA.","DOI":"10.1109\/VL-HCC57772.2023.00018"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Speth, S., Mei\u00dfner, N., and Becker, S. (2023, January 7\u20139). Investigating the Use of AI-Generated Exercises for Beginner and Intermediate Programming Courses: A ChatGPT Case Study. Proceedings of the 2023 IEEE 35th International Conference on Software Engineering Education and Training (CSEE&T), Tokyo, Japan.","DOI":"10.1109\/CSEET58097.2023.00030"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Hu, M., Assadi, T., and Mahroeian, H. (December, January 27). Explicitly Introducing ChatGPT into First-Year Programming Practice: Challenges and Impact. Proceedings of the 2023 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE), Auckland, New Zealand.","DOI":"10.1109\/TALE56641.2023.10398297"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/6\/345\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:57:07Z","timestamp":1760108227000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/6\/345"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,12]]},"references-count":38,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["info15060345"],"URL":"https:\/\/doi.org\/10.3390\/info15060345","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,12]]}}}