{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T18:30:30Z","timestamp":1779906630085,"version":"3.53.1"},"reference-count":23,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T00:00:00Z","timestamp":1755648000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Mastering client-side Web programming is essential for the development of responsive and interactive Web applications. To support novice students\u2019 self-study, in this paper, we propose a novel exercise format called the phrase fill-in-blank problem (PFP) in the Web Programming Learning Assistant System (WPLAS). A PFP instance presents a source code with blanked phrases (a set of elements) and corresponding Web page screenshots. Then, it requests the user to fill in the blanks, and the answers are automatically evaluated through string matching with predefined correct answers. By increasing blanks, PFP can come close to writing a code from scratch. To facilitate scalable and context-aware question creation, we implemented the PFP instance generation algorithm in Python using regular expressions. This approach targets meaningful code segments in HTML, CSS, and JavaScript that reflect the interactive behavior of front-end development. For evaluations, we generated 10 PFP instances for basic Web programming topics and 5 instances for video games and assigned them to students at Okayama University, Japan, and the State Polytechnic of Malang, Indonesia. Their solution results show that most students could solve them correctly, indicating the effectiveness and accessibility of the generated instances. In addition, we investigated the ability of generative AI, specifically ChatGPT, to solve the PFP instances. The results show 86.7% accuracy for basic-topic PFP instances. Although it still cannot fully find answers, we must monitor progress carefully. In future work, we will enhance PFP in WPLAS to handle non-unique answers by improving answer validation for flexible recognition of equivalent responses.<\/jats:p>","DOI":"10.3390\/info16080709","type":"journal-article","created":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T08:02:44Z","timestamp":1755763364000},"page":"709","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Phrase Fill-in-Blank Problem in a Client-Side Web Programming Assistant System"],"prefix":"10.3390","volume":"16","author":[{"given":"Huiyu","family":"Qi","sequence":"first","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 7008530, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhikang","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 7008530, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nobuo","family":"Funabiki","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 7008530, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Htoo Htoo","family":"Sandi Kyaw","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 7008530, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wen Chung","family":"Kao","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taiwan Normal University, Taipei 10610, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,8,20]]},"reference":[{"key":"ref_1","unstructured":"(2025, June 01). What Is JavaScript. Available online: https:\/\/developer.mozilla.org\/en-US\/docs\/Learn_web_development\/Core\/Scripting\/What_is_JavaScript."},{"key":"ref_2","unstructured":"(2025, April 01). Regular Expression in Python. Available online: https:\/\/docs.python.org\/3\/library\/re.html."},{"key":"ref_3","unstructured":"(2025, April 01). ChatGPT. Available online: https:\/\/openai.com\/chatgpt\/overview\/."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Qi, H., Li, Z., Funabiki, N., Kyaw, H.H.S., and Kao, W.C. (2025, January 29\u201331). A proposal of blank phrase selection algorithm for phrase fill-in-blank problems in web-client programming learning assistant system. Proceedings of the2025 1st International Conference on Consumer Technology (ICCT-Pacific), Matsue, Japan.","DOI":"10.1109\/ICCT-Pacific63901.2025.11012866"},{"key":"ref_5","first-page":"134","article-title":"Automated fill-in-the-blank exercises in online learning: Effectiveness and limitations","volume":"25","author":"Smith","year":"2017","journal-title":"Int. J. Comput. Educ."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Jordan, M., Ly, K., and Soosai Raj, A.G. (2024, January 20\u201323). Need a programming exercise generated in your native language? ChatGPT\u2019s got your back: Automatic generation of non-English programming exercises using OpenAI GPT-3.5. Proceedings of the 55th ACM Technical Symposium on Computer Science Education (SIGCSE \u201924), Portland, OR, USA.","DOI":"10.1145\/3626252.3630897"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Denny, P., Luxton-Reilly, A., Prather, J., and Becker, B.A. (2024, January 20\u201323). Prompt Problems: A new programming exercise for the generative AI era. Proceedings of the 55th ACM Technical Symposium on Computer Science Education, Portland, OR, USA.","DOI":"10.1145\/3626252.3630909"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3636515","article-title":"Automated grading and feedback tools for programming education: A systematic review","volume":"24","author":"Messer","year":"2024","journal-title":"ACM Trans. Comput. Educ."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.compedu.2018.09.021","article-title":"Analyzing students\u2019 perceptions to improve the design of an automated assessment tool in online distributed programming","volume":"128","author":"Daradoumis","year":"2019","journal-title":"Comput. Educ."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Duran, R., Rybicki, J.M., Sorva, J., and Hellas, A. (2019, January 12\u201314). Exploring the value of student self-evaluation in introductory programming. Proceedings of the 2019 ACM Conference on International Computing Education Research, Toronto, ON, Canada.","DOI":"10.1145\/3291279.3339407"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1504\/IJTEL.2020.106282","article-title":"Evaluating a game-development approach to teach introductory programming concepts in secondary education","volume":"12","author":"Papadakis","year":"2020","journal-title":"Int. J. Technol. Enhanc. Learn."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gulec, U., Yilmaz, M., Yalcin, A.D., O\u2019Connor, R.V., and Clarke, P.M. (2019, January 18\u201320). Cengo: A web-based serious game to increase the programming knowledge levels of computer engineering students. Proceedings of the EuroSPI 2019, Edinburgh, UK.","DOI":"10.1007\/978-3-030-28005-5_18"},{"key":"ref_13","first-page":"774","article-title":"Evaluation of LLM tools for feedback generation in a course on concurrent programming","volume":"35","author":"Callejo","year":"2024","journal-title":"Int. J. Artif. Intell. Educ."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ma, B., Chen, L., and Konomi, S. (2024). Enhancing programming education with ChatGPT: A case study on student perceptions and interactions in a Python course. International Conference on Artificial Intelligence in Education, Springer.","DOI":"10.1007\/978-3-031-64315-6_9"},{"key":"ref_15","unstructured":"Doughty, J., Prather, J., Teague, D., Zingaro, D., Petersen, A., and Becker, B.A. (February, January 29). A comparative study of AI-generated (GPT-4) and human-crafted MCQs in programming education. Proceedings of the 26th Australasian Computing Education Conference, Sydney, Australia."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ghimire, A., and Edwards, J. (2024, January 8\u201312). Coding with AI: How are tools like ChatGPT being used by students in foundational programming courses. Proceedings of the International Conference on Artificial Intelligence in Education, Recife, Brazil.","DOI":"10.1007\/978-3-031-64299-9_20"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Silva, C.A.G.D., Ramos, F.N., De Moraes, R.V., and Santos, E.L.D. (2024). ChatGPT: Challenges and benefits in software programming for higher education. Sustainability, 16.","DOI":"10.3390\/su16031245"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"7743","DOI":"10.1080\/10447318.2023.2269006","article-title":"ChatGPT in the classroom: Exploring its potential and limitations in a functional programming course","volume":"40","author":"Popovici","year":"2024","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Rahman, M.M., and Watanobe, Y. (2023). ChatGPT for education and research: Opportunities, threats, and strategies. Appl. Sci., 13.","DOI":"10.20944\/preprints202303.0473.v1"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lo, C.K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Educ. Sci., 13.","DOI":"10.3390\/educsci13040410"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1921","DOI":"10.1002\/sd.3221","article-title":"AI-driven adaptive learning for sustainable educational transformation","volume":"33","author":"Strielkowski","year":"2025","journal-title":"Sustain. Dev."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chang, C.I., Choi, W.C., and Choi, I.C. (2024, January 24\u201326). A systematic literature review of the opportunities and advantages for AIGC (OpenAI ChatGPT, Copilot, Codex) in programming course. Proceedings of the 7th International Conference on Big Data and Education (ICBDE \u201924), Fukuoka, Japan.","DOI":"10.1145\/3704289.3704301"},{"key":"ref_23","first-page":"684","article-title":"A blank element selection algorithm for element fill-in-blank problems in client-side web programming","volume":"32","author":"Qi","year":"2024","journal-title":"Eng. Lett."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/8\/709\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:31:35Z","timestamp":1760034695000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/8\/709"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,20]]},"references-count":23,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2025,8]]}},"alternative-id":["info16080709"],"URL":"https:\/\/doi.org\/10.3390\/info16080709","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,20]]}}}