{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T04:15:02Z","timestamp":1768882502223,"version":"3.49.0"},"reference-count":21,"publisher":"Fuji Technology Press Ltd.","issue":"1","funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["22K00801"],"award-info":[{"award-number":["22K00801"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JACIII","J. Adv. Comput. Intell. Intell. Inform."],"published-print":{"date-parts":[[2026,1,20]]},"abstract":"<jats:p>Japan\u2019s declining birthrate has been leading to an increasing distribution of academic abilities among university students. To ensure the successful completion of studies, it is crucial to identify students at-risk of academic failure at an early stage and provide them with the necessary support. In conventional teaching systems, this task is highly dependent on teaching experience. Recently developed early-warning systems (EWSs), which are based on the data mining of learning management systems, are built in post-hoc models and lack sufficient generalizability to new academic years. In this study, we present an EWS that combines data augmentation with a transfer learning-enhanced classification model. Through the use of multiple sub-modules, we construct a deep-learning classification model that enhances the generalizability of the EWS. A comparison between a conventional predictive classification model and the presented model shows that our model achieved the optimal overall performance. The stability of this fine-tuned model is verified by the hold-out method. Our EWS is purposefully addressed for difficulties in real-world teaching environments (that is, year-to-year sample domain shifts and small sample sizes); thus, it is robustly adaptable to diverse teaching environments. Teachers can use the recommendations made by the EWS to implement next steps in academic interventions, improve learning strategies, and help students succeed in their studies. All data collection uses non-identifiable information and protects privacy.<\/jats:p>","DOI":"10.20965\/jaciii.2026.p0232","type":"journal-article","created":{"date-parts":[[2026,1,19]],"date-time":"2026-01-19T15:02:06Z","timestamp":1768834926000},"page":"232-245","source":"Crossref","is-referenced-by-count":0,"title":["An Early-Warning Educational System with Small Samples and Across Academic Year Based on Combination of Transformer and XGBoost"],"prefix":"10.20965","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-4172-7873","authenticated-orcid":true,"given":"Xiangfeng","family":"Tan","sequence":"first","affiliation":[{"name":"Graduate School of Engineering, Tokyo University of Technology, 1404-1 Katakuramachi, Hachioji, Tokyo 192-0982, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3165-5045","authenticated-orcid":true,"given":"Jinhua","family":"She","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Tokyo University of Technology, 1404-1 Katakuramachi, Hachioji, Tokyo 192-0982, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0121-616X","authenticated-orcid":true,"given":"Shumei","family":"Chen","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Tokyo University of Technology, 1404-1 Katakuramachi, Hachioji, Tokyo 192-0982, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6625-0429","authenticated-orcid":true,"given":"Sumio","family":"Ohno","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Tokyo University of Technology, 1404-1 Katakuramachi, Hachioji, Tokyo 192-0982, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3667-4085","authenticated-orcid":true,"given":"Hiroyuki","family":"Kameda","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Tokyo University of Technology, 1404-1 Katakuramachi, Hachioji, Tokyo 192-0982, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"8550","published-online":{"date-parts":[[2026,1,20]]},"reference":[{"key":"key-10.20965\/jaciii.2026.p0232-1","unstructured":"Statistics Bureau of Japan, \u201cPopulation estimates.\u201d https:\/\/www.stat.go.jp\/english\/data\/jinsui\/index.html [Accessed September 24, 2025]"},{"key":"key-10.20965\/jaciii.2026.p0232-2","unstructured":"Ministry of Education, Culture, Sports, Science and Technology (MEXT), \u201cNew entrants.\u201d https:\/\/www.mext.go.jp\/b_menu\/houdou\/2020\/1414952_00007.htm [Accessed September 24, 2025]"},{"key":"key-10.20965\/jaciii.2026.p0232-3","unstructured":"Ministry of Education, Culture, Sports, Science and Technology (MEXT), \u201cSchool basic survey,\u201d (in Japanese). https:\/\/www.e-stat.go.jp\/stat-search\/files?page=1&toukei=00400001&tstat=000001011528&cycle=0&cycle_facet=cycle&metadata=1&data=1 [Accessed September 24, 2025]"},{"key":"key-10.20965\/jaciii.2026.p0232-4","unstructured":"Ministry of Education, Culture, Sports, Science and Technology (MEXT), \u201cAdmissions rate,\u201d (in Japanese). https:\/\/www.e-stat.go.jp\/stat-search\/files?page=1&layout=datalist&toukei=00400001&tstat=000001011528&cycle=0&tclass1=000001021812&stat_infid=000031852304&tclass2val=0 [Accessed September 24, 2025]"},{"key":"key-10.20965\/jaciii.2026.p0232-5","unstructured":"T. Ui, \u201cThe problem of declining academic ability among university students and possible solutions,\u201d Communications of the Operations Research Society of Japan, Vol.54, No.5, pp. 243-248, 2009 (in Japanese)."},{"key":"key-10.20965\/jaciii.2026.p0232-6","unstructured":"S. Yamamoto, \u201cThe reality that 10% of each cohort drops out of university before graduation; Efforts are needed to prevent this, an expert points out,\u201d (in Japanese). https:\/\/www.asahi.com\/edua\/article\/14928001 [Accessed September 24, 2025]"},{"key":"key-10.20965\/jaciii.2026.p0232-7","unstructured":"Ministry of Education, Culture, Sports, Science and Technology (MEXT), \u201cStudent support,\u201d (in Japanese). https:\/\/www.mext.go.jp\/a_menu\/koutou\/gakuseishien\/1269672.htm [Accessed September 24, 2025]"},{"key":"key-10.20965\/jaciii.2026.p0232-8","doi-asserted-by":"crossref","unstructured":"P. Black and D. Wiliam, \u201cAssessment and classroom learning,\u201d Assessment in Education: Principles, Policy & Practice, Vol.5, No.1, pp. 7-74, 1998. https:\/\/doi.org\/10.1080\/0969595980050102","DOI":"10.1080\/0969595980050102"},{"key":"key-10.20965\/jaciii.2026.p0232-9","unstructured":"N. Safer and S. Fleischman, \u201cResearch matters: How student progress monitoring improves instruction,\u201d Educational Leadership, Vol.62, No.5, pp. 81-83, 2005."},{"key":"key-10.20965\/jaciii.2026.p0232-10","doi-asserted-by":"crossref","unstructured":"V.-A. Romero-Zaldivar, A. Pardo, D. Burgos, and C. Delgado-Kloos, \u201cMonitoring student progress using virtual appliances: A case study,\u201d Computers & Education, Vol.58, No.4, pp. 1058-1067, 2012. https:\/\/doi.org\/10.1016\/j.compedu.2011.12.003","DOI":"10.1016\/j.compedu.2011.12.003"},{"key":"key-10.20965\/jaciii.2026.p0232-11","unstructured":"K. J. Cotton, \u201cMonitoring student learning in the classroom: School improvement research series close-up #4,\u201d Assessment and Evaluation Program of Northwest Regional Educational Laboratory, 1988."},{"key":"key-10.20965\/jaciii.2026.p0232-12","doi-asserted-by":"crossref","unstructured":"K. E. Arnold and M. D. Pistilli, \u201cCourse signals at Purdue: Using learning analytics to increase student success,\u201d Proc. of the 2nd Int. Conf. on Learning Analytics and Knowledge, pp. 267-270, 2012. https:\/\/doi.org\/10.1145\/2330601.2330666","DOI":"10.1145\/2330601.2330666"},{"key":"key-10.20965\/jaciii.2026.p0232-13","doi-asserted-by":"crossref","unstructured":"R. Villano, S. Harrison, G. Lynch, and G. Chen, \u201cLinking early alert systems and student retention: A survival analysis approach,\u201d Higher Education, Vol.76, No.5, pp. 903-920, 2018. https:\/\/doi.org\/10.1007\/s10734-018-0249-y","DOI":"10.1007\/s10734-018-0249-y"},{"key":"key-10.20965\/jaciii.2026.p0232-14","unstructured":"R. Rumberger, H. Addis, E. Allensworth, R. Balfanz, J. Bruch, E. Dillon, D. Duardo, M. Dynarski, J. Furgeson, M. Jayanthi, R. Newman-Gonchar, K. Place, and C. Tuttle, \u201cPreventing dropout in secondary schools (NCEE 2017-4028),\u201d Washington, DC: National Center for Education Evaluation and Regional Assistance (NCEE), Institute of Education Sciences, U.S. Department of Education. https:\/\/whatworks.ed.gov, 2017. https:\/\/ies.ed.gov\/ncee\/wwc\/Docs\/PracticeGuide\/wwc_dropout_092617.pdf [Accessed September 24, 2025]"},{"key":"key-10.20965\/jaciii.2026.p0232-15","unstructured":"T. Netsu, \u201cReconsideration of subjectivity in evaluation of education: Based on the discussions of researchers,\u201d Bulletin of Faculty of Education and Integrated Arts and Sciences, Waseda University, Vol.71, pp. 13-23, 2023 (in Japanese)."},{"key":"key-10.20965\/jaciii.2026.p0232-16","doi-asserted-by":"crossref","unstructured":"L. Mai, A. K\u00f6chling, and M. C. Wehner, \u201c\u2018This student needs to stay back\u2019: To what degree would instructors rely on the recommendation of learning analytics?,\u201d SN Computer Science, Vol.3, No.4, Article No.259, 2022. https:\/\/doi.org\/10.1007\/s42979-022-01137-6","DOI":"10.1007\/s42979-022-01137-6"},{"key":"key-10.20965\/jaciii.2026.p0232-17","doi-asserted-by":"crossref","unstructured":"L. P. Macfadyen and S. Dawson, \u201cMining LMS data to develop an \u2018early warning system\u2019 for educators: A proof of concept,\u201d Computers & Education, Vol.54, No.2, pp. 588-599, 2010. https:\/\/doi.org\/10.1016\/j.compedu.2009.09.008","DOI":"10.1016\/j.compedu.2009.09.008"},{"key":"key-10.20965\/jaciii.2026.p0232-18","doi-asserted-by":"crossref","unstructured":"G. Ak\u00e7ap\u0131nar, A. Altun, and P. A\u015fkar, \u201cUsing learning analytics to develop early-warning system for at-risk students,\u201d Int. J. of Educational Technology in Higher Education, Vol.16, No.1, Article No.40, 2019. https:\/\/doi.org\/10.1186\/s41239-019-0172-z","DOI":"10.1186\/s41239-019-0172-z"},{"key":"key-10.20965\/jaciii.2026.p0232-19","doi-asserted-by":"crossref","unstructured":"T.-T. Goh, \u201cLearning management system log analytics: The role of persistence and consistency of engagement behaviour on academic success,\u201d J. of Computers in Education, 2025. https:\/\/doi.org\/10.1007\/s40692-025-00358-x","DOI":"10.1007\/s40692-025-00358-x"},{"key":"key-10.20965\/jaciii.2026.p0232-20","unstructured":"V. Paajanen, \u201cLMS log activity as a predictor of learning success on an undergraduate flipped classroom course of cellular biology,\u201d CEUR Workshop Proc., Vol.3383, 2022. https:\/\/ceur-ws.org\/Vol-3383\/FLAIEC22_paper_3090.pdf [Accessed September 24, 2025]"},{"key":"key-10.20965\/jaciii.2026.p0232-21","unstructured":"X. Tan, S. Chen, S. Ohno, H. Kameda, and J. She, \u201cEstablishing an early warning system using machine learning algorithms to identify students at high risk of academic failure in online education,\u201d ISCIIA&ITCA 2024, 2024."}],"container-title":["Journal of Advanced Computational Intelligence and Intelligent Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.fujipress.jp\/main\/wp-content\/themes\/Fujipress\/hyosetsu.php?ppno=jacii003000010021","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,19]],"date-time":"2026-01-19T15:03:46Z","timestamp":1768835026000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.fujipress.jp\/jaciii\/jc\/jacii003000010232"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,20]]},"references-count":21,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1,20]]},"published-print":{"date-parts":[[2026,1,20]]}},"URL":"https:\/\/doi.org\/10.20965\/jaciii.2026.p0232","relation":{},"ISSN":["1883-8014","1343-0130"],"issn-type":[{"value":"1883-8014","type":"electronic"},{"value":"1343-0130","type":"print"}],"subject":[],"published":{"date-parts":[[2026,1,20]]}}}