{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T16:23:18Z","timestamp":1779121398353,"version":"3.51.4"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,10,31]],"date-time":"2018-10-31T00:00:00Z","timestamp":1540944000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100002341","name":"Academy of Finland","doi-asserted-by":"crossref","award":["251170 and 266969"],"award-info":[{"award-number":["251170 and 266969"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2018,12,31]]},"abstract":"<jats:p>The computing education research literature contains a wide variety of methods that can be used to identify students who are either at risk of failing their studies or who could benefit from additional challenges. Many of these are based on machine-learning models that learn to make predictions based on previously observed data. However, in educational contexts, differences between courses set huge challenges for the generalizability of these methods. For example, traditional machine-learning methods assume identical distribution in all data\u2014in our terms, traditional machine-learning methods assume that all teaching contexts are alike. In practice, data collected from different courses can be very different as a variety of factors may change, including grading, materials, teaching approach, and the students.<\/jats:p>\n          <jats:p>Transfer-learning methodologies have been created to address this challenge. They relax the strict assumption of identical distribution for training and test data. Some similarity between the contexts is still needed for efficient learning. In this work, we review the concept of transfer learning especially for the purpose of predicting the outcome of an introductory programming course and contrast the results with those from traditional machine-learning methods. The methods are evaluated using data collected in situ from two separate introductory programming courses.<\/jats:p>\n          <jats:p>We empirically show that transfer-learning methods are able to improve the predictions, especially in cases with limited amount of training data, for example, when making early predictions for a new context. The difference in predictive power is, however, rather subtle, and traditional machine-learning models can be sufficiently accurate assuming the contexts are closely related and the features describing the student activity are carefully chosen to be insensitive to the fine differences.<\/jats:p>","DOI":"10.1145\/3152714","type":"journal-article","created":{"date-parts":[[2018,11,13]],"date-time":"2018-11-13T13:20:16Z","timestamp":1542115216000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["Transfer-Learning Methods in Programming Course Outcome Prediction"],"prefix":"10.1145","volume":"18","author":[{"given":"Jarkko","family":"Lagus","sequence":"first","affiliation":[{"name":"University of Helsinki, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Krista","family":"Longi","sequence":"additional","affiliation":[{"name":"University of Helsinki, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Arto","family":"Klami","sequence":"additional","affiliation":[{"name":"University of Helsinki, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Arto","family":"Hellas","sequence":"additional","affiliation":[{"name":"University of Helsinki, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,10,31]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2787622.2787717"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2899415.2899463"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1047344.1047480"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2787622.2787710"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017792"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2009.44"},{"key":"e_1_2_1_8_1","unstructured":"Wenyuan Dai Yuqiang Chen Gui-Rong Xue Qiang Yang and Yong Yu. 2008. Translated learning: Transfer learning across different feature spaces. In Advances in Neural Information Processing Systems. 353--360.   Wenyuan Dai Yuqiang Chen Gui-Rong Xue Qiang Yang and Yong Yu. 2008. Translated learning: Transfer learning across different feature spaces. In Advances in Neural Information Processing Systems. 353--360."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273521"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/2900423.2900476"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511973000"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.1997.1504"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 32nd International Conference on International Conference on Machine Learning (ICML'15)","volume":"37","author":"Ganin Yaroslav","year":"2015","unstructured":"Yaroslav Ganin and Victor Lempitsky . 2015 . Unsupervised domain adaptation by backpropagation . In Proceedings of the 32nd International Conference on International Conference on Machine Learning (ICML'15) , Francis Bach and David Blei (Eds.). Vol. 37 . JMLR.org, 1180--1189. Yaroslav Ganin and Victor Lempitsky. 2015. Unsupervised domain adaptation by backpropagation. In Proceedings of the 32nd International Conference on International Conference on Machine Learning (ICML'15), Francis Bach and David Blei (Eds.). Vol. 37. JMLR.org, 1180--1189."},{"key":"e_1_2_1_14_1","volume-title":"Transfer learning decision forests for gesture recognition. J. Mach. Learn. Res. 15 (November","author":"Goussies Norberto A.","year":"2014","unstructured":"Norberto A. Goussies , Sebasti\u00e1n Ubalde , and Marta Mejail . 2014. Transfer learning decision forests for gesture recognition. J. Mach. Learn. Res. 15 (November 2014 ), 3667--3690. Norberto A. Goussies, Sebasti\u00e1n Ubalde, and Marta Mejail. 2014. Transfer learning decision forests for gesture recognition. J. Mach. Learn. Res. 15 (November 2014), 3667--3690."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944968"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/11774303_52"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858796.2858798"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1151588.1151600"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2787622.2787718"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2960310.2960315"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.21125\/edulearn.2016.1296"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2009.05.010"},{"key":"e_1_2_1_24_1","volume-title":"Retrieved","year":"2016","unstructured":"Merriam-Webster. 2016. Learning . Retrieved January 2016 from http:\/\/www.merriam-webster.com\/dictionary\/learning. Merriam-Webster. 2016. Learning. Retrieved January 2016 from http:\/\/www.merriam-webster.com\/dictionary\/learning."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2008.02.065"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_2_1_27_1","article-title":"Normalization: A preprocessing stage","volume":"2","author":"Patro S. Gopal Krishna","year":"2015","unstructured":"S. Gopal Krishna Patro and Kishore Kumar Sahu . 2015 . Normalization: A preprocessing stage . In International Advanced Research Journal in Science, Engineering and Technology 2 , 3 (2015). S. Gopal Krishna Patro and Kishore Kumar Sahu. 2015. Normalization: A preprocessing stage. In International Advanced Research Journal in Science, Engineering and Technology 2, 3 (2015).","journal-title":"International Advanced Research Journal in Science, Engineering and Technology"},{"key":"e_1_2_1_28_1","volume-title":"Scikit-learn: Machine learning in python. J. Mach. Lear. Res. 12 (November","author":"Pedregosa Fabian","year":"2011","unstructured":"Fabian Pedregosa , Ga\u00ebl Varoquaux , Alexandre Gramfort , Vincent Michel , Bertrand Thirion , Olivier Grisel , Mathieu Blondel , Peter Prettenhofer , Ron Weiss , Vincent Dubourg , Jake Vanderplas , Alexandre Passos , David Cournapeau , Matthieu Brucher , Matthieu Perrot , and \u00c9douard Duchesnay . 2011 . Scikit-learn: Machine learning in python. J. Mach. Lear. Res. 12 (November 2011), 2825--2830. Fabian Pedregosa, Ga\u00ebl Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, and \u00c9douard Duchesnay. 2011. Scikit-learn: Machine learning in python. J. Mach. Lear. Res. 12 (November 2011), 2825--2830."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2828959.2828966"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157182"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632320.2632354"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1044550.1041669"},{"key":"e_1_2_1_33_1","volume-title":"Empirical Inference","author":"Schapire Robert E.","unstructured":"Robert E. Schapire . 2013. Explaining adaboost . In Empirical Inference . Springer , 37--52. Robert E. Schapire. 2013. Explaining adaboost. In Empirical Inference. Springer, 37--52."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 8th Australasian Conference on Computing Education (ACE\u201906)","volume":"52","author":"Fincher Sally","year":"2006","unstructured":"Simon, Sally Fincher , Anthony Robins , Bob Baker , Ilona Box , Quintin Cutts , Michael de Raadt , Patricia Haden , John Hamer , Margaret Hamilton , Raymond Lister , Marian Petre , Ken Sutton , Denise Tolhurst , and Jodi Tutty . 2006 . Predictors of success in a first programming course . In Proceedings of the 8th Australasian Conference on Computing Education (ACE\u201906) , Vol. 52 . Australian Computer Society, Inc., Darlinghurst, Australia, 189--196. Simon, Sally Fincher, Anthony Robins, Bob Baker, Ilona Box, Quintin Cutts, Michael de Raadt, Patricia Haden, John Hamer, Margaret Hamilton, Raymond Lister, Marian Petre, Ken Sutton, Denise Tolhurst, and Jodi Tutty. 2006. Predictors of success in a first programming course. In Proceedings of the 8th Australasian Conference on Computing Education (ACE\u201906), Vol. 52. Australian Computer Society, Inc., Darlinghurst, Australia, 189--196."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the IAPR Asian Conference on Patten Recognition (ACPR\u201915)","volume":"2","author":"Tsuchiya Masamitsu","unstructured":"Masamitsu Tsuchiya , R. Yumiba , Y. Yamauchi , T. Yamashita , and H. Fujiyoshi . 2015. Transfer forest based on covariate shift . In Proceedings of the IAPR Asian Conference on Patten Recognition (ACPR\u201915) , Vol. 2 . 4. Masamitsu Tsuchiya, R. Yumiba, Y. Yamauchi, T. Yamashita, and H. Fujiyoshi. 2015. Transfer forest based on covariate shift. In Proceedings of the IAPR Asian Conference on Patten Recognition (ACPR\u201915), Vol. 2. 4."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380552.2380603"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2462476.2462501"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538930"},{"key":"e_1_2_1_39_1","volume-title":"Hall","author":"Witten Ian H.","year":"2011","unstructured":"Ian H. Witten , Eibe Frank , and Mark A . Hall . 2011 . Data Mining : Practical Machine Learning Tools and Techniques (3rd ed.). Morgan Kaufmann , San Francisco, CA. Ian H. Witten, Eibe Frank, and Mark A. Hall. 2011. Data Mining: Practical Machine Learning Tools and Techniques (3rd ed.). Morgan Kaufmann, San Francisco, CA."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2007.02.026"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5539857"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 7th International Conference on Educational Data Mining (EDM'14)","author":"Yudelson Michael","year":"2014","unstructured":"Michael Yudelson , Steve Fancsali , Steve Ritter , Susan Berman , Tristan Nixon , and Ambarish Joshi . 2014 . Better data beats big data . In Proceedings of the 7th International Conference on Educational Data Mining (EDM'14) . Michael Yudelson, Steve Fancsali, Steve Ritter, Susan Berman, Tristan Nixon, and Ambarish Joshi. 2014. Better data beats big data. In Proceedings of the 7th International Conference on Educational Data Mining (EDM'14)."}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3152714","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3152714","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:11:09Z","timestamp":1750212669000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3152714"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,31]]},"references-count":41,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,12,31]]}},"alternative-id":["10.1145\/3152714"],"URL":"https:\/\/doi.org\/10.1145\/3152714","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,31]]},"assertion":[{"value":"2016-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-10-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}