{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T22:05:57Z","timestamp":1766268357942,"version":"3.37.3"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,11,9]],"date-time":"2022-11-09T00:00:00Z","timestamp":1667952000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,9]],"date-time":"2022-11-09T00:00:00Z","timestamp":1667952000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100019065","name":"Tianjin Science and Technology Program","doi-asserted-by":"publisher","award":["22YDTPJC00940"],"award-info":[{"award-number":["22YDTPJC00940"]}],"id":[{"id":"10.13039\/501100019065","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006606","name":"Natural Science Foundation of Tianjin City","doi-asserted-by":"publisher","award":["19JCYBJC15300","21ZYQCSY00050"],"award-info":[{"award-number":["19JCYBJC15300","21ZYQCSY00050"]}],"id":[{"id":"10.13039\/501100006606","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Tianjin Higher Education Institute Undergraduate Teaching Quality and Teaching Reform Research Project","award":["B201005706"],"award-info":[{"award-number":["B201005706"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61807024"],"award-info":[{"award-number":["61807024"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2023,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Top-N recommendation has received great attention in assisting students in providing personalized learning guidance on the required subject\/domain. Generally, existing approaches mainly aim to maximize the overall accuracy of the recommendation list while ignoring the accuracy of highly ranked recommended exercises, which seriously affects the students\u2019 learning enthusiasm. Motivated by the Knowledge Distillation (KD) technique, we skillfully design a fully adaptive recommendation paradigm named Top-enhanced Recommender Distillation framework (TERD) to improve the recommendation effect of the top positions. Specifically, the proposed TERD transfers the knowledge of an arbitrary recommender (teacher network), and injects it into a well-designed student network. The prior knowledge provided by the teacher network, including student-exercise embeddings, and candidate exercise subsets, are further utilized to define the state and action space of the student network (i.e., DDQN). In addition, the student network introduces a well-designed state representation scheme and an effective individual ability tracing model to enhance the recommendation accuracy of top positions. The developed TERD follows a flexible model-agnostic paradigm that not only simplifies the action space of the student network, but also promotes the recommendation accuracy of the top position, thus enhancing the students\u2019 motivation and engagement in e-learning environment. We implement our proposed approach on three well-established datasets and evaluate its Top-enhanced performance. The experimental evaluation on three publicly available datasets shows that our proposed TERD scheme effectively resolves the Top-enhanced recommendation issue.<\/jats:p>","DOI":"10.1007\/s40747-022-00905-4","type":"journal-article","created":{"date-parts":[[2022,11,9]],"date-time":"2022-11-09T07:02:58Z","timestamp":1667977378000},"page":"2159-2176","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Fully adaptive recommendation paradigm: top-enhanced recommender distillation for intelligent education systems"],"prefix":"10.1007","volume":"9","author":[{"given":"Yimeng","family":"Ren","sequence":"first","affiliation":[]},{"given":"Kun","family":"Liang","sequence":"additional","affiliation":[]},{"given":"Yuhu","family":"Shang","sequence":"additional","affiliation":[]},{"given":"Xiankun","family":"Zhang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,11,9]]},"reference":[{"key":"905_CR1","doi-asserted-by":"crossref","unstructured":"Anderson A, Huttenlocher D, Kleinberg J, Leskovec J (2014) Engaging with massive online courses. In: Proceedings of the 23rd International Conference on World Wide Web, pp. 687\u2013698","DOI":"10.1145\/2566486.2568042"},{"issue":"1","key":"905_CR2","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1177\/0146621617697959","volume":"42","author":"Y Chen","year":"2018","unstructured":"Chen Y, Li X, Liu J, Ying Z (2018) Recommendation system for adaptive learning. Appl Psychol Meas 42(1):24\u201341","journal-title":"Appl Psychol Meas"},{"key":"905_CR3","doi-asserted-by":"publisher","first-page":"100010","DOI":"10.1016\/j.caeai.2021.100010","volume":"2","author":"J Wang","year":"2021","unstructured":"Wang J, Xie H, Wang FL, Lee L-K, Au OTS (2021) Top-n personalized recommendation with graph neural networks in moocs. Comput Educ Artif Intell 2:100010","journal-title":"Comput Educ Artif Intell"},{"key":"905_CR4","doi-asserted-by":"crossref","unstructured":"Henderson P, Islam R, Bachman P, Pineau J, Precup D, Meger D (2018) Deep reinforcement learning that matters. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32","DOI":"10.1609\/aaai.v32i1.11694"},{"key":"905_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106706","volume":"213","author":"L Huang","year":"2021","unstructured":"Huang L, Fu M, Li F, Qu H, Liu Y, Chen W (2021) A deep reinforcement learning based long-term recommender system. Knowl-Based Syst 213:106706","journal-title":"Knowl-Based Syst"},{"key":"905_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.108546","volume":"244","author":"Y Lin","year":"2022","unstructured":"Lin Y, Lin F, Zeng W, Xiahou J, Li L, Wu P, Liu Y, Miao C (2022) Hierarchical reinforcement learning with dynamic recurrent mechanism for course recommendation. Knowl-Based Syst 244:108546","journal-title":"Knowl-Based Syst"},{"key":"905_CR7","doi-asserted-by":"crossref","unstructured":"Liu Q, Tong S, Liu C, Zhao H, Chen E, Ma H, Wang S (2019) Exploiting cognitive structure for adaptive learning. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 627\u2013635","DOI":"10.1145\/3292500.3330922"},{"key":"905_CR8","unstructured":"Chen J, Yin J (2006) Recommendation based on influence sets. In: Proceedings of the Workshop on Web Mining and Web Usage Analysis Citeseer"},{"key":"905_CR9","doi-asserted-by":"publisher","first-page":"386","DOI":"10.1016\/j.eswa.2017.09.026","volume":"91","author":"K Leung","year":"2018","unstructured":"Leung K, Choy KL, Siu PK, Ho GT, Lam H, Lee CK (2018) A b2c e-commerce intelligent system for re-engineering the e-order fulfilment process. Expert Syst Appl 91:386\u2013401","journal-title":"Expert Syst Appl"},{"key":"905_CR10","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.neucom.2022.02.080","volume":"488","author":"W Gan","year":"2022","unstructured":"Gan W, Sun Y, Sun Y (2022) Knowledge interaction enhanced sequential modeling for interpretable learner knowledge diagnosis in intelligent tutoring systems. Neurocomputing 488:36\u201353","journal-title":"Neurocomputing"},{"issue":"1","key":"905_CR11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2556270","volume":"47","author":"Y Shi","year":"2014","unstructured":"Shi Y, Larson M, Hanjalic A (2014) Collaborative filtering beyond the user-item matrix: a survey of the state of the art and future challenges. ACM Comput Surv (CSUR) 47(1):1\u201345","journal-title":"ACM Comput Surv (CSUR)"},{"issue":"1","key":"905_CR12","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1007\/s40747-019-00123-5","volume":"6","author":"J Chen","year":"2020","unstructured":"Chen J, Zhao C, Chen L (2020) Collaborative filtering recommendation algorithm based on user correlation and evolutionary clustering. Complex Intell Syst 6(1):147\u2013156","journal-title":"Complex Intell Syst"},{"key":"905_CR13","doi-asserted-by":"publisher","first-page":"106481","DOI":"10.1016\/j.knosys.2020.106481","volume":"210","author":"Z Wu","year":"2020","unstructured":"Wu Z, Li M, Tang Y, Liang Q (2020) Exercise recommendation based on knowledge concept prediction. Knowl-Based Syst 210:106481","journal-title":"Knowl-Based Syst"},{"issue":"3","key":"905_CR14","doi-asserted-by":"publisher","first-page":"1241","DOI":"10.1007\/s40747-021-00315-y","volume":"7","author":"L Xie","year":"2021","unstructured":"Xie L, Hu Z, Cai X, Zhang W, Chen J (2021) Explainable recommendation based on knowledge graph and multi-objective optimization. Complex Intell Syst 7(3):1241\u20131252","journal-title":"Complex Intell Syst"},{"key":"905_CR15","doi-asserted-by":"publisher","first-page":"106478","DOI":"10.1016\/j.knosys.2020.106478","volume":"209","author":"M Chen","year":"2020","unstructured":"Chen M, Zhou X (2020) Deeprank: learning to rank with neural networks for recommendation. Knowl-Based Syst 209:106478","journal-title":"Knowl-Based Syst"},{"key":"905_CR16","unstructured":"Hinton G, Vinyals O, Dean J et al (2015) Distilling the knowledge in a neural network. 2(7) arXiv preprint arXiv:1503.02531"},{"key":"905_CR17","doi-asserted-by":"crossref","unstructured":"Bhardwaj S, Srinivasan M, Khapra MM (2019) Efficient video classification using fewer frames. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 354\u2013363","DOI":"10.1109\/CVPR.2019.00044"},{"key":"905_CR18","doi-asserted-by":"crossref","unstructured":"Wang C, Kong C, Lucey S (2019) Distill knowledge from nrsfm for weakly supervised 3d pose learning. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 743\u2013752","DOI":"10.1109\/ICCV.2019.00083"},{"key":"905_CR19","doi-asserted-by":"crossref","unstructured":"Zhou Y, Wang M, Liu D, Hu Z, Zhang H (2020) More grounded image captioning by distilling image-text matching model. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 4777\u20134786","DOI":"10.1109\/CVPR42600.2020.00483"},{"key":"905_CR20","doi-asserted-by":"publisher","first-page":"103167","DOI":"10.1016\/j.cviu.2021.103167","volume":"205","author":"U Michieli","year":"2021","unstructured":"Michieli U, Zanuttigh P (2021) Knowledge distillation for incremental learning in semantic segmentation. Comput Vis Image Underst 205:103167","journal-title":"Comput Vis Image Underst"},{"key":"905_CR21","unstructured":"Zhou C, Neubig G, Gu J (2019) Understanding knowledge distillation in non-autoregressive machine translation. arXiv preprint arXiv:1911.02727"},{"key":"905_CR22","doi-asserted-by":"crossref","unstructured":"Yang Y, Qiu J, Song M, Tao D, Wang X (2020) Distilling knowledge from graph convolutional networks. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 7074\u20137083","DOI":"10.1109\/CVPR42600.2020.00710"},{"key":"905_CR23","doi-asserted-by":"crossref","unstructured":"Lee J-w, Choi M, Lee J, Shim H (2019) Collaborative distillation for top-n recommendation. In: 2019 IEEE International Conference on Data Mining (ICDM), pp. 369\u2013378 IEEE","DOI":"10.1109\/ICDM.2019.00047"},{"key":"905_CR24","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2021.104494","volume":"106","author":"Y Pan","year":"2021","unstructured":"Pan Y, He F, Yan X, Li H (2021) A synchronized heterogeneous autoencoder with feature-level and label-level knowledge distillation for the recommendation. Eng Appl Artif Intell 106:104494","journal-title":"Eng Appl Artif Intell"},{"key":"905_CR25","unstructured":"Lee H, Hwang SJ, Shin J (2020) Self-supervised label augmentation via input transformations. In: International Conference on Machine Learning, pp. 5714\u20135724 . PMLR"},{"key":"905_CR26","first-page":"2","volume":"2","author":"H Xing","year":"2022","unstructured":"Xing H, Xiao Z, Zhan D, Luo S, Dai P, Li K (2022) Selfmatch: robust semisupervised time-series classification with self-distillation. Int J Intell Syst 2:2","journal-title":"Int J Intell Syst"},{"key":"905_CR27","doi-asserted-by":"crossref","unstructured":"Xia Y, Yang Y (2021) Generalization self-distillation with epoch-wise regularization. In: 2021 International Joint Conference on Neural Networks (IJCNN), pp. 1\u20138 IEEE","DOI":"10.1109\/IJCNN52387.2021.9533993"},{"key":"905_CR28","first-page":"2","volume":"2","author":"Z Huang","year":"2022","unstructured":"Huang Z, Lin Z, Gong Z, Chen Y, Tang Y (2022) A two-phase knowledge distillation model for graph convolutional network-based recommendation. Int J Intell Syst 2:2","journal-title":"Int J Intell Syst"},{"key":"905_CR29","doi-asserted-by":"crossref","unstructured":"Tang J, Wang K (2018) Ranking distillation: Learning compact ranking models with high performance for recommender system. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 2289\u20132298","DOI":"10.1145\/3219819.3220021"},{"key":"905_CR30","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.ins.2021.08.060","volume":"580","author":"S Kang","year":"2021","unstructured":"Kang S, Hwang J, Kweon W, Yu H (2021) Item-side ranking regularized distillation for recommender system. Inf Sci 580:15\u201334","journal-title":"Inf Sci"},{"key":"905_CR31","doi-asserted-by":"crossref","unstructured":"Chiang C-L, Cheng M-Y, Ye T-Y, Chen Y-L, Huang P-H (2019) Convergence improvement of q-learning based on a personalized recommendation system. In: 2019 International Automatic Control Conference (CACS), pp. 1\u20136 IEEE","DOI":"10.1109\/CACS47674.2019.9024742"},{"key":"905_CR32","doi-asserted-by":"crossref","unstructured":"Huang Z, Liu Q, Zhai C, Yin Y, Chen E, Gao W, Hu G (2019) Exploring multi-objective exercise recommendations in online education systems. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 1261\u20131270","DOI":"10.1145\/3357384.3357995"},{"key":"905_CR33","doi-asserted-by":"crossref","unstructured":"Xia J, Li G, Cao Z (2018) Personalized exercise recommendation algorithm combining learning objective and assignment feedback. J Intell Fuzzy Syst 35(3):2965\u20132973","DOI":"10.3233\/JIFS-169652"},{"issue":"1","key":"905_CR34","doi-asserted-by":"publisher","first-page":"18","DOI":"10.7763\/IJMO.2019.V9.677","volume":"9","author":"T Gong","year":"2019","unstructured":"Gong T, Yao X (2019) Deep exercise recommendation model. Int J Model Optim 9(1):18\u201323","journal-title":"Int J Model Optim"},{"key":"905_CR35","first-page":"2","volume":"2","author":"F Ai","year":"2019","unstructured":"Ai F, Chen Y, Guo Y, Zhao Y, Wang Z, Fu G, Wang G (2019) Concept-aware deep knowledge tracing and exercise recommendation in an online learning system. Int Educ Data Mining Soc 2:2","journal-title":"Int Educ Data Mining Soc"},{"key":"905_CR36","doi-asserted-by":"publisher","first-page":"266","DOI":"10.1016\/j.ins.2020.03.014","volume":"523","author":"Y Huo","year":"2020","unstructured":"Huo Y, Wong DF, Ni LM, Chao LS, Zhang J (2020) Knowledge modeling via contextualized representations for lstm-based personalized exercise recommendation. Inf Sci 523:266\u2013278","journal-title":"Inf Sci"},{"key":"905_CR37","doi-asserted-by":"publisher","DOI":"10.1016\/j.caeai.2021.100010","volume":"2","author":"J Wang","year":"2021","unstructured":"Wang J, Xie H, Wang FL, Lee L-K, Au OTS (2021) Top-n personalized recommendation with graph neural networks in moocs. Comput Educ Artif Intell 2:100010","journal-title":"Comput Educ Artif Intell"},{"key":"905_CR38","doi-asserted-by":"crossref","unstructured":"Van\u00a0Hasselt H, Guez A, Silver D (2016) Deep reinforcement learning with double q-learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 30","DOI":"10.1609\/aaai.v30i1.10295"},{"issue":"3","key":"905_CR39","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1145\/203330.203343","volume":"38","author":"G Tesauro","year":"1995","unstructured":"Tesauro G (1995) Temporal difference learning and td-gammon. Commun ACM 38(3):58\u201368","journal-title":"Commun ACM"},{"key":"905_CR40","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1016\/j.ins.2020.08.017","volume":"545","author":"X Wang","year":"2021","unstructured":"Wang X, Mei X, Huang Q, Han Z, Huang C (2021) Fine-grained learning performance prediction via adaptive sparse self-attention networks. Inf Sci 545:223\u2013240","journal-title":"Inf Sci"},{"key":"905_CR41","first-page":"2","volume":"28","author":"C Piech","year":"2015","unstructured":"Piech C, Bassen J, Huang J, Ganguli S, Sahami M, Guibas LJ, Sohl-Dickstein J (2015) Deep knowledge tracing. Adv Neural Inf Process Syst 28:2","journal-title":"Adv Neural Inf Process Syst"},{"issue":"24","key":"905_CR42","doi-asserted-by":"publisher","first-page":"17508","DOI":"10.1109\/JIOT.2021.3081694","volume":"8","author":"J Chen","year":"2021","unstructured":"Chen J, Xing H, Xiao Z, Xu L, Tao T (2021) A drl agent for jointly optimizing computation offloading and resource allocation in mec. IEEE Internet Things J 8(24):17508\u201317524","journal-title":"IEEE Internet Things J"},{"issue":"6","key":"905_CR43","doi-asserted-by":"publisher","first-page":"2227","DOI":"10.1109\/TNNLS.2018.2806087","volume":"29","author":"J Pan","year":"2018","unstructured":"Pan J, Wang X, Cheng Y, Yu Q (2018) Multisource transfer double dqn based on actor learning. IEEE Trans Neural Netw Learn Syst 29(6):2227\u20132238","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"905_CR44","volume-title":"Reinforcement learning: an introduction","author":"RS Sutton","year":"2018","unstructured":"Sutton RS, Barto AG (2018) Reinforcement learning: an introduction. MIT press, Cambridge"},{"key":"905_CR45","unstructured":"Wu L, Hsieh C-J, Sharpnack J (2018) Sql-rank: A listwise approach to collaborative ranking. In: International Conference on Machine Learning, pp. 5315\u20135324 PMLR"},{"key":"905_CR46","unstructured":"Mnih V, Kavukcuoglu K, Silver D, Graves A, Antonoglou I, Wierstra D, Riedmiller M (2013) Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602"},{"key":"905_CR47","doi-asserted-by":"crossref","unstructured":"Chuang A-C, Huang N-F, Tzeng J-W, Lee C-A, Huang Y-X, Huang H-H (2021) Moocers: exercise recommender system in moocs based on reinforcement learning algorithm. In: 2021 8th International Conference on Soft Computing & Machine Intelligence (ISCMI), pp. 186\u2013190. IEEE","DOI":"10.1109\/ISCMI53840.2021.9654805"},{"key":"905_CR48","unstructured":"Lillicrap TP, Hunt JJ, Pritzel A, Heess N, Erez T, Tassa Y, Silver D, Wierstra D (2015) Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971"},{"key":"905_CR49","unstructured":"Heffernan P (2009) assistment-2009-2010. https:\/\/sites.google.com\/site\/assistmentsdata\/home\/assistment-2009\/OT1\/textendash2010-data"},{"key":"905_CR50","unstructured":"Stamper J, Niculescu-Mizil A, Ritter S, Gordon G, Koedinger K (2005) Algebra https:\/\/pslcdatashop.web.cmu.edu\/KDDCup\/downloads.jsp,2005"},{"key":"905_CR51","unstructured":"Bier N (2011) Statics https:\/\/pslcdatashop.web.cmu.edu\/"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-022-00905-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-022-00905-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-022-00905-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,18]],"date-time":"2023-04-18T09:43:52Z","timestamp":1681811032000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-022-00905-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,9]]},"references-count":51,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["905"],"URL":"https:\/\/doi.org\/10.1007\/s40747-022-00905-4","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"type":"print","value":"2199-4536"},{"type":"electronic","value":"2198-6053"}],"subject":[],"published":{"date-parts":[[2022,11,9]]},"assertion":[{"value":"6 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}