{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T22:52:27Z","timestamp":1769727147797,"version":"3.49.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2024,2,12]],"date-time":"2024-02-12T00:00:00Z","timestamp":1707696000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Industrial Support Project of Gansu Colleges, China","award":["2022CYZC11"],"award-info":[{"award-number":["2022CYZC11"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61762078, 62276073"],"award-info":[{"award-number":["61762078, 62276073"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Guangxi Key Laboratory of Trusted Software","award":["kx202302"],"award-info":[{"award-number":["kx202302"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2024,5,31]]},"abstract":"<jats:p>\n            Learning high-quality vector representations (aka. embeddings) of educational questions lies at the core of knowledge tracing (KT), which defines a task of estimating students\u2019 knowledge states by predicting the probability that they correctly answer questions. Although existing KT efforts have leveraged question information to achieve remarkable improvements, most of them learn question embeddings by following the supervised learning paradigm. In this article, we propose a novel question embedding pre-training method for improving knowledge tracing with self-supervised\n            <jats:italic>Bi<\/jats:italic>\n            -graph\n            <jats:italic>Co<\/jats:italic>\n            -contrastive learning (\n            <jats:italic>BiCo<\/jats:italic>\n            ). Technically, on the basis of self-supervised learning paradigm, we first select two similar but distinct views (i.e., representing objective and subjective semantic perspectives) as the semantic source of question embeddings. Then, we design a primary task (structure recovery) together with two auxiliary tasks (question difficulty recovery and contrastive learning) to further enhance the representativeness of questions. Finally, extensive experiments conducted on two real-world datasets show BiCo has a higher expressive power that enables KT methods to effectively predict students\u2019 performances.\n          <\/jats:p>","DOI":"10.1145\/3638055","type":"journal-article","created":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T11:53:11Z","timestamp":1702986791000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Pre-training Question Embeddings for Improving Knowledge Tracing with Self-supervised Bi-graph Co-contrastive Learning"],"prefix":"10.1145","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9919-7488","authenticated-orcid":false,"given":"Wentao","family":"Wang","sequence":"first","affiliation":[{"name":"College of Computer Science and Engineering, Northwest Normal University, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5104-8982","authenticated-orcid":false,"given":"Huifang","family":"Ma","sequence":"additional","affiliation":[{"name":"College of Computer Science and Engineering, Northwest Normal University, Guangxi Key Lab of Multi-source Information Mining and Security, Guangxi Normal University, and Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2626-1308","authenticated-orcid":false,"given":"Yan","family":"Zhao","sequence":"additional","affiliation":[{"name":"College of Computer Science and Engineering, Northwest Normal University, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5313-6134","authenticated-orcid":false,"given":"Zhixin","family":"Li","sequence":"additional","affiliation":[{"name":"Guangxi Key Lab of Multi-source Information Mining and Security, Guangxi Normal University, China"}]}],"member":"320","published-online":{"date-parts":[[2024,2,12]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11280-022-01041-2"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.119786"},{"key":"e_1_3_2_4_2","volume-title":"Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2330\u20132339","author":"Ghosh A.","unstructured":"A. Ghosh, N. Heffernan, and A. S. Lan. 2020. Context-aware attentive knowledge tracing. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2330\u20132339."},{"key":"e_1_3_2_5_2","volume-title":"Proceedings of 2019 WI International Conference on Web Intelligence. 156\u2013163","author":"Nakagawa H.","unstructured":"H. Nakagawa, Y. Iwasawa, and Y. Matsuo. 2019. Graph-based knowledge tracing: Modeling student proficiency using graph neural network. In Proceedings of 2019 WI International Conference on Web Intelligence. 156\u2013163."},{"key":"e_1_3_2_6_2","volume-title":"Proceedings of the 12th International Conference on Educational Data Mining. 384\u2013389","author":"Pandey S.","unstructured":"S. Pandey and G. Karypis. 2019. A self attentive model for knowledge tracing. In Proceedings of the 12th International Conference on Educational Data Mining. 384\u2013389."},{"key":"e_1_3_2_7_2","volume-title":"Proceeding of the 29th ACM International Conference on Information and Knowledge Management. 1205\u20131214","author":"Pandey S.","unstructured":"S. Pandey and J. Srivastava. 2020. RKT: Relation-aware self-attention for knowledge tracing. In Proceeding of the 29th ACM International Conference on Information and Knowledge Management. 1205\u20131214."},{"key":"e_1_3_2_8_2","volume-title":"Proceedings of the 28th International Conference on Neural Information Processing Systems. 505\u2013513","author":"Piech C.","unstructured":"C. Piech, J. Spencer, J. Huang, S. Ganguli, M. Sahami, L. Guibas, and J. Sohl-Dickstein. 2015. Deep knowledge tracing. In Proceedings of the 28th International Conference on Neural Information Processing Systems. 505\u2013513."},{"key":"e_1_3_2_9_2","volume-title":"Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases","author":"Yang Y.","year":"2020","unstructured":"Y. Yang, J. Shen, Y. Qu, Y. Liu, K. Wang, Y. Zhu, W. Zhang, and Y. Yu. 2020. GIKT: A graph-based interaction model for knowledge tracing. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases 2020. 299\u2013315."},{"key":"e_1_3_2_10_2","volume-title":"Proceedings of the 26th International Conference on World Wide Web.765\u2013774","author":"Zhang J.","unstructured":"J. Zhang, X. Shi, I.King, and D. Y. Yeung. 2017. Dynamic key-value memory networks for knowledge tracing. Dynamic key-value memory networks for knowledge tracing. In Proceedings of the 26th International Conference on World Wide Web.765\u2013774."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2020.03.014"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.116454"},{"key":"e_1_3_2_13_2","volume-title":"Proceedings of the 27th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 696\u2013704","author":"Huang Z.","unstructured":"Z. Huang, X. Liu, H. Wang, Q. Liu, E. Chen, J. Ma, Y. Su, and W. Tong. 2021. DisenQNet: Disentangled representation learning for educational questions. In Proceedings of the 27th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 696\u2013704."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2924374"},{"key":"e_1_3_2_15_2","volume-title":"Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1328\u20131336","author":"Yin Y.","unstructured":"Y. Yin, Q. Liu, Z. Huang, E. Chen, W. Tong, S. Wang, and Y. Su. 2019. QuesNet: A unified representation for heterogeneous test questions. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1328\u20131336."},{"key":"e_1_3_2_16_2","first-page":"857","article-title":"Self-supervised learning: Generative or contrastive","volume":"35","author":"Liu X.","year":"2021","unstructured":"X. Liu, F. Zhang, Z. Hou, L. Mian, Z. Wang, J. Zhang, and J. Tang. 2021. Self-supervised learning: Generative or contrastive. IEEE Transactions on Knowledge and Data Engineering, 35, 1 (2021), 857\u2013876.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_2_17_2","volume-title":"Proceedings of the 37th International Conference on Machine Learning. 1597\u20131607","author":"Chen T.","unstructured":"T. Chen, S. Kornblith, M. Norouzi, and G. Hinton. 2020. A simple framework for contrastive learning of visual representations. In Proceedings of the 37th International Conference on Machine Learning. 1597\u20131607."},{"key":"e_1_3_2_18_2","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 9729\u20139738","author":"He K.","unstructured":"K. He, H. Fan, Y. Wu, S. Xie, and R. Girshick. 2020. Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 9729\u20139738."},{"key":"e_1_3_2_19_2","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4171\u20134186","author":"Hassani K.","unstructured":"K. Hassani and A. H. Khasahmadi. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4171\u20134186."},{"key":"e_1_3_2_20_2","volume-title":"Proceedings of the 8th International Conference on Learning Representations. 4116\u20134126","author":"Lan Z.","unstructured":"Z. Lan, M. Chen, S. Goodman, K. Gimpel, P. Sharma, and R. Soricut. 2020. ALBERT: A lite BERT for self-supervised learning of language representations. In Proceedings of the 8th International Conference on Learning Representations. 4116\u20134126."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531937"},{"key":"e_1_3_2_22_2","volume-title":"Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 726\u2013735","author":"Wu J.","unstructured":"J. Wu, X. Wang, F. Feng, X. He, L. Chen, J. Lian, and X. Xie. 2021. Self-supervised graph learning for recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 726\u2013735."},{"key":"e_1_3_2_23_2","volume-title":"Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1726-1736","author":"Wang X.","unstructured":"X. Wang, N. Liu, H. Han, and C. Shi. 2021. Self-supervised heterogeneous graph neural network with co-contrastive learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1726-1736."},{"key":"e_1_3_2_24_2","volume-title":"Proceedings of the 24th International Conference on World Wide Web. 1067\u20131077","author":"Tang J.","unstructured":"J. Tang, M. Qu, M. Wang, M. Zhang, J. Yan, and Q. Mei. 2015. LINE: Large-scale information network embedding. In Proceedings of the 24th International Conference on World Wide Web. 1067\u20131077."},{"key":"e_1_3_2_25_2","volume-title":"Proceedings of the 29th International Joint Conference on Artificial Intelligence. 1577\u20131583","author":"Liu Y.","unstructured":"Y. Liu, Y. Yang, X. Chen, J. Shen, H. Zhang, and Y. Yu. 2020. Improving knowledge tracing via pre-training question embeddings. In Proceedings of the 29th International Joint Conference on Artificial Intelligence. 1577\u20131583."},{"key":"e_1_3_2_26_2","volume-title":"Proceedings of the 27th Conference of the Database Systems for Advanced Applications. 281\u2013288","author":"Wang W.","unstructured":"W. Wang, H. Ma, Y. Zhao, F. Yang, and L. Chang. 2022. PERM: Pre-training question embeddings via relation map for improving knowledge tracing. In Proceedings of the 27th Conference of the Database Systems for Advanced Applications. 281\u2013288."},{"key":"e_1_3_2_27_2","volume-title":"Proceedings of the 7th International Conference on Learning Representations.","author":"Velickovic P.","unstructured":"P. Velickovic, W. Fedus, W. L. Hamilton, P. Li\u00f3a, Y. Bengio, and R. D. Hjelm. 2019. Deep graph infomax. In Proceedings of the 7th International Conference on Learning Representations."},{"key":"e_1_3_2_28_2","volume-title":"Proceedings of the 29th International Conference on World Wide Web. 259\u2013270","author":"Peng Z.","unstructured":"Z. Peng, W. Huang, M. Luo, Q. Zheng, Y. Rong, T. Xu, and J. Huang. 2020. Graph representation learning via graphical mutual information maximization. In Proceedings of the 29th International Conference on World Wide Web. 259\u2013270."},{"key":"e_1_3_2_29_2","volume-title":"Proceedings of the 34th AAAI Conference on Artificial Intelligence. 5371\u20135378","author":"Park C.","unstructured":"C. Park, D. Kim, J. Han, and H. Yu. 2020. Unsupervised attributed multiplex network embedding. In Proceedings of the 34th AAAI Conference on Artificial Intelligence. 5371\u20135378."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2022.10.015"},{"key":"e_1_3_2_31_2","volume-title":"Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 517\u2013525","author":"Wang C.","unstructured":"C. Wang, W. Ma, M. Zhang, C. Lv, F. Wan, H. Lin, T. Tang, Y. Liu, and S. Ma. 2021. Temporal cross-effects in knowledge tracing. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 517\u2013525."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/754"},{"key":"e_1_3_2_33_2","volume-title":"Proceedings of the 25th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1709\u20131719","author":"Hao J.","unstructured":"J. Hao, M. Chen, W. Yu, Y. Sun, and W. Wang. 2019. Universal representation learning of knowledge bases by jointly embedding instances and ontological concepts. In Proceedings of the 25th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1709\u20131719."},{"key":"e_1_3_2_34_2","volume-title":"Proceedings of the 37th International Conference on Machine Learning. 4116\u20134126","author":"Hassani K.","unstructured":"K. Hassani and A. H. Khasahmadi. 2020. Contrastive multi-view representation learning on graphs. In Proceedings of the 37th International Conference on Machine Learning. 4116\u20134126."},{"key":"e_1_3_2_35_2","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 639\u2013648","author":"He X.","unstructured":"X. He, K. Deng, X. Wang, Y. Li, Y. Zhang, and M. Wang. 2020. LightGCN: Simplifying and powering graph convolution network for recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 639\u2013648."},{"key":"e_1_3_2_36_2","unstructured":"Aaron van den Oord Yazhe Li and Oriol Vinyals. 2018. Representation learning with contrastive predictive coding. arXiv:1807.03748. Retrieved from https:\/\/arxiv.org\/abs\/1807.03748"},{"key":"e_1_3_2_37_2","volume-title":"Proceedings of the 20th IEEE International Conference on Data Mining. 42\u201351","author":"Bi H.","unstructured":"H. Bi, H. Ma, Z. Huang, Y. Yin, Q. Liu, E. Chen, Y. Su, and S. Wang. 2020. Quality meets diversity: A model-agnostic framework for computerized adaptive testing. In Proceedings of the 20th IEEE International Conference on Data Mining. 42\u201351."},{"key":"e_1_3_2_38_2","volume-title":"Proceeding of the 30th ACM International Conference on Information and Knowledge Management. 2180\u20132190","author":"Xia X.","unstructured":"X. Xia, H. Yin, J. Yu, Y. Shao, and L. Cui. 2021. Self-supervised graph co-Training for session-based recommendation. In Proceeding of the 30th ACM International Conference on Information and Knowledge Management. 2180\u20132190."}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3638055","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3638055","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:35:53Z","timestamp":1750178153000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3638055"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,12]]},"references-count":37,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,5,31]]}},"alternative-id":["10.1145\/3638055"],"URL":"https:\/\/doi.org\/10.1145\/3638055","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,12]]},"assertion":[{"value":"2022-09-14","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-12-15","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}