{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T05:57:00Z","timestamp":1778219820147,"version":"3.51.4"},"reference-count":36,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,7,16]],"date-time":"2023-07-16T00:00:00Z","timestamp":1689465600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>In recent years, artificial intelligence (AI) has emerged as a valuable resource for teaching and learning, and it has also shown promise as a tool to help solve problems. A tool that has gained attention in education is ChatGPT, which supports teaching and learning through AI. This research investigates the difficulties faced by ChatGPT in comprehending and responding to chemistry problems pertaining to the topic of Introduction to Material Science. By employing the theoretical framework proposed by Holme et al., encompassing categories such as transfer, depth, predict\/explain, problem solving, and translate, we evaluate ChatGPT\u2019s conceptual understanding difficulties. We presented ChatGPT with a set of thirty chemistry problems within the Introduction to Material Science domain and tasked it with generating solutions. Our findings indicated that ChatGPT encountered significant conceptual knowledge difficulties across various categories, with a notable emphasis on representations and depth, where difficulties in representations hindered effective knowledge transfer.<\/jats:p>","DOI":"10.3390\/info14070409","type":"journal-article","created":{"date-parts":[[2023,7,17]],"date-time":"2023-07-17T00:56:47Z","timestamp":1689555407000},"page":"409","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":49,"title":["Artificial Intelligence Generative Tools and Conceptual Knowledge in Problem Solving in Chemistry"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8207-0250","authenticated-orcid":false,"given":"Wajeeh","family":"Daher","sequence":"first","affiliation":[{"name":"Mathematics Department, Al-Qasemi Academic College of Education, Baqa 3010000, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hussam","family":"Diab","sequence":"additional","affiliation":[{"name":"Science Department, Al-Qasemi Academic College of Education, Baqa 3010000, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8255-5947","authenticated-orcid":false,"given":"Anwar","family":"Rayan","sequence":"additional","affiliation":[{"name":"Science Department, Al-Qasemi Academic College of Education, Baqa 3010000, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"13","DOI":"10.2478\/rem-2020-0003","article-title":"Artificial Intelligence in Education and Schools","volume":"12","author":"Gocen","year":"2020","journal-title":"Res. Educ. Media"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Dai, Y., Liu, A., and Lim, C.P. (2023, January 17\u201319). Reconceptualizing ChatGPT and generative AI as a student-driven innovation in higher education. Proceedings of the 33rd CIRP Design Conference, Sydney, Australia.","DOI":"10.35542\/osf.io\/nwqju"},{"key":"ref_3","unstructured":"The Centre for Learning, Teaching, and Development (2023). ChatGPT for Learning and Teaching, University of the Witwatersrand."},{"key":"ref_4","unstructured":"West, C.G. (2023). AI and the FCI: Can ChatGPT project an understanding of introductory physics?. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"102642","DOI":"10.1016\/j.ijinfomgt.2023.102642","article-title":"\u201cSo what if ChatGPT wrote it?\u201d Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy","volume":"71","author":"Dwivedi","year":"2023","journal-title":"Int. J. Inf. Manag."},{"key":"ref_6","first-page":"62","article-title":"ChatGpt: Open Possibilities","volume":"4","author":"Aljanabi","year":"2023","journal-title":"Iraqi J. Comput. Sci. Math."},{"key":"ref_7","first-page":"1","article-title":"What ChatGPT means for universities: Perceptions of scholars and students","volume":"6","author":"Firat","year":"2023","journal-title":"J. Appl. Learn. Teach."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"ep429","DOI":"10.30935\/cedtech\/13152","article-title":"Revolutionizing education with AI: Exploring the transformative potential of ChatGPT","volume":"15","author":"Adiguzel","year":"2023","journal-title":"Contemp. Educ. Technol."},{"key":"ref_9","first-page":"1","article-title":"Examining the Impacts of ChatGPT on Student Motivation and Engagement","volume":"23","author":"Gayoso","year":"2023","journal-title":"Soc. Space"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1199350","DOI":"10.3389\/frai.2023.1199350","article-title":"Human-like problem-solving abilities in large language models using ChatGPT","volume":"6","author":"Piarulli","year":"2023","journal-title":"Front. Artif. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1021\/ed085p873","article-title":"Concept Learning versus Problem Solving: A Cognitive Difference","volume":"85","author":"Cracolice","year":"2008","journal-title":"J. Chem. Educ."},{"key":"ref_12","unstructured":"Jones, B.F., and Idol, L. (1990). Dimensions of Thinking and Cognitive Instruction, Lawrence Erlbaum Associates."},{"key":"ref_13","first-page":"191","article-title":"Growth in Ecological Concept Development and Conceptual Understanding in Teacher Education: The Discerning Teacher","volume":"6","author":"Puk","year":"2011","journal-title":"Int. J. Environ. Sci. Educ."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"7930","DOI":"10.1166\/asl.2018.12459","article-title":"Assessing conceptual understanding in chemistry using representation","volume":"24","author":"Lansangan","year":"2018","journal-title":"Adv. Sci. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1477","DOI":"10.1021\/acs.jchemed.5b00218","article-title":"Defining Conceptual Understanding in General Chemistry","volume":"92","author":"Holme","year":"2015","journal-title":"J. Chem. Educ."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"012063","DOI":"10.1088\/1742-6596\/1797\/1\/012063","article-title":"Evaluating student performance based on bloom\u2019s taxonomy levels","volume":"1797","author":"Prasad","year":"2021","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"100","DOI":"10.5539\/elt.v8n5p100","article-title":"Using Bloom\u2019s Taxonomy to Evaluate the Cognitive Levels of Master Class Textbook\u2019s Questions","volume":"8","author":"Assaly","year":"2015","journal-title":"Engl. Lang. Teach."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"78774","DOI":"10.1109\/ACCESS.2021.3083924","article-title":"Middle School Students\u2019 Learning of Social Studies in the Video and 360-Degree Videos Contexts","volume":"9","author":"Daher","year":"2021","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1007\/s10956-023-10039-y","article-title":"Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence","volume":"32","author":"Cooper","year":"2023","journal-title":"J. Sci. Educ. Technol."},{"key":"ref_20","unstructured":"Leon, A., and Vidhani, D. (2023, July 01). ChatGPT Needs a Chemistry Tutor Too. Available online: https:\/\/chemrxiv.org\/engage\/api-gateway\/chemrxiv\/assets\/orp\/resource\/item\/642f2351a41dec1a5699bf9f\/original\/chat-gpt-needs-a-chemistry-tutor-too.pdf."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Daher, W. (2023). Saturation in Qualitative Educational Technology Research. Educ. Sci., 13.","DOI":"10.3390\/educsci13020098"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Daher, W., Ashour, W., and Hamdan, R. (2022). The Role of ICT Centers in the Management of Distance Education in Palestinian Universities during Emergency Education. Educ. Sci., 12.","DOI":"10.3390\/educsci12080542"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Daher, W., Baya\u2019a, N., Jaber, O., and Shahbari, J.A. (2020). A Trajectory for Advancing the Meta-Cognitive Solving of Mathematics-Based Programming Problems with Scratch. Symmetry, 12.","DOI":"10.3390\/sym12101627"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Daher, W., Mokh, A.A., Shayeb, S., Jaber, R., Saqer, K., Dawood, I., Bsharat, M., and Rabbaa, M. (2022). The Design of Tasks to Suit Distance Learning in Emergency Education. Sustainability, 14.","DOI":"10.3390\/su14031070"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"72","DOI":"10.3991\/ijet.v16i06.18847","article-title":"Quality of Using Google Classroom to Support the Learning Processes in the Automation and Programming Course","volume":"16","author":"Abuzant","year":"2021","journal-title":"Int. J. Emerg. Technol. Learn. (iJET)"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Toukiloglou, P., and Xinogalos, S. (2023). A Systematic Literature Review on Adaptive Supports in Serious Games for Programming. Information, 14.","DOI":"10.3390\/info14050277"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Munir, H., Vogel, B., and Jacobsson, A. (2022). Artificial Intelligence and Machine Learning Approaches in Digital Education: A Systematic Revision. Information, 13.","DOI":"10.3390\/info13040203"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lameras, P., and Arnab, S. (2022). Power to the Teachers: An Exploratory Review on Artificial Intelligence in Education. Information, 13.","DOI":"10.3390\/info13010014"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Raschka, S., Patterson, J., and Nolet, C. (2020). Machine Learning in Python: Main Developments and Technology Trends in Data Science, Machine Learning, and Artificial Intelligence. Information, 11.","DOI":"10.3390\/info11040193"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"How, M.-L., Cheah, S.-M., Chan, Y.-J., Khor, A.C., and Say, E.M.P. (2020). Artificial Intelligence-Enhanced Decision Support for Informing Global Sustainable Development: A Human-Centric AI-Thinking Approach. Information, 11.","DOI":"10.3390\/info11010039"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"367","DOI":"10.29333\/iejme\/618","article-title":"Process of Mathematical Representation Translation from Verbal into Graphic","volume":"12","author":"Rahmawati","year":"2017","journal-title":"Int. Electron. J. Math. Educ."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Goris, T.V., and Dyrenfurth, M.J. (2013, January 23\u201326). How Electrical Engineering Technology Students Understand Concepts of Electricity. Comparison of misconceptions of freshmen, sophomores, and seniors. Proceedings of the 2013 ASEE Annual Conference & Exposition, Atlanta, GA, USA.","DOI":"10.18260\/1-2--19682"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Jiang, P., Rayan, J., Dow, S.P., and Xia, H. (2023). Graphologue: Exploring Large Language Model Responses with Interactive Diagrams. arXiv.","DOI":"10.1145\/3586183.3606737"},{"key":"ref_34","first-page":"1","article-title":"Are ChatGPT\u2019s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: A descriptive study","volume":"20","author":"Huh","year":"2023","journal-title":"J. Educ. Evaluation Health Prof."},{"key":"ref_35","first-page":"e36272","article-title":"The capability of ChatGPT in predicting and explaining common drug-drug interactions","volume":"15","author":"Juhi","year":"2023","journal-title":"Cureus"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"100130","DOI":"10.1016\/j.caeai.2023.100130","article-title":"Empowering learners for the age of artificial intelligence","volume":"4","author":"Siemens","year":"2023","journal-title":"Comput. Educ. Artif. Intell."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/7\/409\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:12:54Z","timestamp":1760127174000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/7\/409"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,16]]},"references-count":36,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["info14070409"],"URL":"https:\/\/doi.org\/10.3390\/info14070409","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,16]]}}}