{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T09:59:20Z","timestamp":1777370360523,"version":"3.51.4"},"reference-count":20,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,12,1]],"date-time":"2019-12-01T00:00:00Z","timestamp":1575158400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,12,23]],"date-time":"2019-12-23T00:00:00Z","timestamp":1577059200000},"content-version":"vor","delay-in-days":22,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Smart Learn. Environ."],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Evaluating student learning effect plays an essential role in education, which is typically done by assessing student\u2019s final deliverables. However, the student\u2019s learning process has not been properly explored in the past.In this paper, we propose an interactive student learning effect evaluation framework which focuses on in-process learning effect evaluation. In particular, our proposal analyzes students modeling assignment based on their operation records by using techniques of frequent sequential pattern mining, user behavior analysis, feature engineering, and process mining. A comprehensive online modeling platform has been developed to enable data collection. We have carried out a case study, in which we applied our approach to a real teaching scenario, consisting of student online modeling behavior data collected from 24 students majoring in computer science. We also associate our process mining results with the numeric evaluation values. The preliminary result of case analysis has shown good potential to mine student modeling patterns and interpret their behaviors, contributing to student learning effect evaluation.<\/jats:p>","DOI":"10.1186\/s40561-019-0097-y","type":"journal-article","created":{"date-parts":[[2019,12,23]],"date-time":"2019-12-23T14:03:26Z","timestamp":1577109806000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Recognizing patterns of student\u2019s modeling behaviour patterns via process mining"],"prefix":"10.1186","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5289-6521","authenticated-orcid":false,"given":"Yu","family":"Wang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8881-0037","authenticated-orcid":false,"given":"Tong","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Congkai","family":"Geng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yihan","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,12,23]]},"reference":[{"key":"97_CR1","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1145\/1148170.1148177","volume-title":"Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"E. Agichtein","year":"2006","unstructured":"Agichtein, E., Brill, E., Dumais, S. (2006). Improving web search ranking by incorporating user behavior information. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, New York, (pp. 19\u201326)."},{"key":"97_CR2","first-page":"3","volume-title":"International Conference on Data Engineering","author":"R. Agrawal","year":"1995","unstructured":"Agrawal, R., & Srikant, R. (1995). Mining sequential patterns. In International Conference on Data Engineering. IEEE, New York, (pp. 3\u201314)."},{"key":"97_CR3","first-page":"186","volume-title":"Proceedings of the 5th International Workshop on Semantic Evaluation","author":"G. Berend","year":"2010","unstructured":"Berend, G., & Farkas, R. (2010). Sztergak: Feature engineering for keyphrase extraction. In Proceedings of the 5th International Workshop on Semantic Evaluation. Association for Computational Linguistics, Stroudsburg, (pp. 186\u2013189)."},{"issue":"1","key":"97_CR4","first-page":"7","volume":"5","author":"P. Black","year":"1998","unstructured":"Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7\u201374.","journal-title":"Assessment in Education: Principles, Policy & Practice"},{"issue":"1","key":"97_CR5","first-page":"1230","volume":"8","author":"A. Bogar\u00edn","year":"2018","unstructured":"Bogar\u00edn, A., Cerezo, R., Romero, C. (2018). A survey on educational process mining. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 8(1), 1230.","journal-title":"Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery"},{"key":"97_CR6","volume-title":"International Journal on Advances in Intelligent Systems","author":"A.H. Cairns","year":"2015","unstructured":"Cairns, A.H., Gueni, B., Fhima, M., Cairns, A., David, S., Khelifa, N. (2015). Process mining in the education domain. In International Journal on Advances in Intelligent Systems, Vol. 8. IARIA, USA."},{"key":"97_CR7","first-page":"8","volume-title":"Fifth IEEE International Conference on Data Mining (ICDM\u201905)","author":"H. Cao","year":"2005","unstructured":"Cao, H., Mamoulis, N., Cheung, D.W. (2005). Mining frequent spatio-temporal sequential patterns. In Fifth IEEE International Conference on Data Mining (ICDM\u201905). IEEE, New York, (pp. 8\u201311)."},{"key":"97_CR8","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1145\/347090.347167","volume-title":"Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"J. Han","year":"2000","unstructured":"Han, J., Pei, J., Mortazavi-Asl, B., Chen, Q., Dayal, U. (2000). Freespan: frequent pattern-projected sequential pattern mining. In Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, New York, (pp. 355\u2013359)."},{"issue":"2","key":"97_CR9","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1016\/S0306-4573(99)00056-4","volume":"36","author":"B.J. Jansen","year":"2000","unstructured":"Jansen, B.J., Spink, A., Saracevic, T. (2000). Real life, real users, and real needs: a study and analysis of user queries on the web. Information processing & management, 36(2), 207\u2013227.","journal-title":"Information processing & management"},{"key":"97_CR10","doi-asserted-by":"publisher","first-page":"718","DOI":"10.1016\/j.sbspro.2011.11.133","volume":"28","author":"S. Jimaa","year":"2011","unstructured":"Jimaa, S. (2011). The impact of assessment on students learning. Procedia-Social and Behavioral Sciences, 28, 718\u2013721.","journal-title":"Procedia-Social and Behavioral Sciences"},{"key":"97_CR11","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1016\/j.cattod.2016.04.013","volume":"280","author":"Z. Li","year":"2017","unstructured":"Li, Z., Ma, X., Xin, H. (2017). Feature engineering of machine-learning chemisorption models for catalyst design. Catalysis Today, 280, 232\u2013238.","journal-title":"Catalysis Today"},{"issue":"1","key":"97_CR12","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1145\/1824795.1824798","volume":"43","author":"N.R. Mabroukeh","year":"2010","unstructured":"Mabroukeh, N.R., & Ezeife, C.I. (2010). A taxonomy of sequential pattern mining algorithms. ACM Computing Surveys (CSUR), 43(1), 3.","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"97_CR13","first-page":"272","volume-title":"SIGIR\u201994","author":"M. Morita","year":"1994","unstructured":"Morita, M., & Shinoda, Y. (1994). Information filtering based on user behavior analysis and best match text retrieval. In SIGIR\u201994. Springer, Heidelberg, (pp. 272\u2013281)."},{"key":"97_CR14","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1109\/ICDE.2001.914830","volume-title":"Proceedings 17th International Conference on Data Engineering","author":"J. Pei","year":"2001","unstructured":"Pei, J., Han, J., Mortazavi-Asl, B., Pinto, H. (2001). Prefixspan: Mining sequential patterns efficiently by prefix-projected pattern growth. In Proceedings 17th International Conference on Data Engineering. IEEE, New Yrok, (pp. 215\u2013224)."},{"key":"97_CR15","unstructured":"R\u00e9, C., Sadeghian, A.A., Shan, Z., Shin, J., Wang, F., Wu, S., Zhang, C. (2014). Feature engineering for knowledge base construction. CoRR abs\/1407.6439. arXiv preprint arXiv:1407.6439."},{"issue":"1","key":"97_CR16","first-page":"12","volume":"3","author":"C. Romero","year":"2013","unstructured":"Romero, C., & Ventura, S. (2013). Data mining in education. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 3(1), 12\u201327.","journal-title":"Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery"},{"key":"97_CR17","first-page":"1","volume-title":"International Conference on Extending Database Technology","author":"R. Srikant","year":"1996","unstructured":"Srikant, R., & Agrawal, R. (1996). Mining sequential patterns: Generalizations and performance improvements. In International Conference on Extending Database Technology. Springer, Heidelberg, (pp. 1\u201317)."},{"issue":"4","key":"97_CR18","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1080\/02602930500099102","volume":"30","author":"K. Struyven","year":"2005","unstructured":"Struyven, K., Dochy, F., Janssens, S. (2005). Students\u2019 perceptions about evaluation and assessment in higher education: a review. Assessment & Evaluation in Higher Education, 30(4), 325\u2013341.","journal-title":"Assessment & Evaluation in Higher Education"},{"issue":"1","key":"97_CR19","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/S0164-1212(99)00062-X","volume":"49","author":"C.R. Turner","year":"1999","unstructured":"Turner, C.R., Fuggetta, A., Lavazza, L., Wolf, A.L. (1999). A conceptual basis for feature engineering. Journal of Systems and Software, 49(1), 3\u201315.","journal-title":"Journal of Systems and Software"},{"key":"97_CR20","volume-title":"ICAI2019","author":"W. Yu","year":"2019","unstructured":"Yu, W., Tong, L., Congkai, G., Yihan, W. (2019). Evaluating student learning effect based on process mining. In ICAI2019. Springer, Heidelberg."}],"container-title":["Smart Learning Environments"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40561-019-0097-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s40561-019-0097-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40561-019-0097-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,12,22]],"date-time":"2020-12-22T00:08:27Z","timestamp":1608595707000},"score":1,"resource":{"primary":{"URL":"https:\/\/slejournal.springeropen.com\/articles\/10.1186\/s40561-019-0097-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12]]},"references-count":20,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["97"],"URL":"https:\/\/doi.org\/10.1186\/s40561-019-0097-y","relation":{},"ISSN":["2196-7091"],"issn-type":[{"value":"2196-7091","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12]]},"assertion":[{"value":"19 September 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 November 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 December 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"26"}}