{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T19:55:01Z","timestamp":1766087701764,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":42,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T00:00:00Z","timestamp":1614729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,3]]},"DOI":"10.1145\/3408877.3432422","type":"proceedings-article","created":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T18:45:38Z","timestamp":1614969938000},"page":"94-100","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Towards a Human-AI Hybrid System for Categorising Programming Problems"],"prefix":"10.1145","author":[{"given":"Filipe Dwan","family":"Pereira","sequence":"first","affiliation":[{"name":"Federal University of Roraima, Boa Vista, Brazil"}]},{"given":"Francisco","family":"Pires","sequence":"additional","affiliation":[{"name":"Federal University of Roraima, Boa Vista, Brazil"}]},{"given":"Samuel C.","family":"Fonseca","sequence":"additional","affiliation":[{"name":"Federal University of Amazonas, Manaus, Brazil"}]},{"given":"Elaine H. T.","family":"Oliveira","sequence":"additional","affiliation":[{"name":"Federal University of Amazonas, Manaus, Brazil"}]},{"given":"Leandro S. G.","family":"Carvalho","sequence":"additional","affiliation":[{"name":"Federal University of Amazonas, Manaus, Brazil"}]},{"given":"David B. F.","family":"Oliveira","sequence":"additional","affiliation":[{"name":"Federal University of Amazonas, Manaus, Brazil"}]},{"given":"Alexandra I.","family":"Cristea","sequence":"additional","affiliation":[{"name":"Durham University, Durham, United Kingdom"}]}],"member":"320","published-online":{"date-parts":[[2021,3,5]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3013499.3013503"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-49663-0_20"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2015.7344081"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-5511"},{"key":"e_1_3_2_1_5_1","volume-title":"Recommending Tasks in Online Judges. In International Conference in Methodologies and intelligent Systems for Techhnology Enhanced Learning. Springer, 129--136","author":"Audrito Giorgio","year":"2019","unstructured":"Giorgio Audrito , Tania Di Mascio , Paolo Fantozzi , Luigi Laura , Gemma Martini , Umberto Nanni , and Marco Temperini . 2019 . Recommending Tasks in Online Judges. In International Conference in Methodologies and intelligent Systems for Techhnology Enhanced Learning. Springer, 129--136 . Giorgio Audrito, Tania Di Mascio, Paolo Fantozzi, Luigi Laura, Gemma Martini, Umberto Nanni, and Marco Temperini. 2019. Recommending Tasks in Online Judges. In International Conference in Methodologies and intelligent Systems for Techhnology Enhanced Learning. Springer, 129--136."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCSE.2014.6926445"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2018.07.011"},{"key":"e_1_3_2_1_8_1","volume-title":"Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2018 . Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018). Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3330430.3333641"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1332"},{"key":"e_1_3_2_1_11_1","volume-title":"Cross-Lingual Argumentation Mining for Russian Texts. In International Conference on Analysis of Images, Social Networks and Texts. Springer, 134--144","author":"Fishcheva Irina","year":"2019","unstructured":"Irina Fishcheva and Evgeny Kotelnikov . 2019 . Cross-Lingual Argumentation Mining for Russian Texts. In International Conference on Analysis of Images, Social Networks and Texts. Springer, 134--144 . Irina Fishcheva and Evgeny Kotelnikov. 2019. Cross-Lingual Argumentation Mining for Russian Texts. In International Conference on Analysis of Images, Social Networks and Texts. Springer, 134--144."},{"key":"e_1_3_2_1_12_1","volume-title":"Elaine HT Oliveira, David BF Oliveira, Leandro SG Carvalho, and Alexandra I Cristea.","author":"Fonseca Samuel C","year":"2020","unstructured":"Samuel C Fonseca , Filipe Dwan Pereira , Elaine HT Oliveira, David BF Oliveira, Leandro SG Carvalho, and Alexandra I Cristea. 2020 . Automatic Subject-based Contextualisation of Programming Assignment Lists. Educational Data Mining . Samuel C Fonseca, Filipe Dwan Pereira, Elaine HT Oliveira, David BF Oliveira, Leandro SG Carvalho, and Alexandra I Cristea. 2020. Automatic Subject-based Contextualisation of Programming Assignment Lists. Educational Data Mining."},{"volume-title":"Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems","author":"G\u00e9ron Aur\u00e9lien","key":"e_1_3_2_1_13_1","unstructured":"Aur\u00e9lien G\u00e9ron . 2019. Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems . O'Reilly Media . Aur\u00e9lien G\u00e9ron. 2019. Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems .O'Reilly Media."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-39967-4_8"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2016.12.035"},{"key":"e_1_3_2_1_16_1","unstructured":"Steven Halim Felix Halim Steven S Skiena and Miguel A Revilla. 2013. Competitive Programming 3 .Lulu Independent Publish.  Steven Halim Felix Halim Steven S Skiena and Miguel A Revilla. 2013. Competitive Programming 3 .Lulu Independent Publish."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274856.3274862"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3323771.3323795"},{"volume-title":"Brazilian Symposium on Computers in Education (Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educacc ao-SBIE) .","author":"Freitas Junior Hermino Barbosa","key":"e_1_3_2_1_19_1","unstructured":"Hermino Barbosa Freitas Junior , Filipe Dwan Pereira , Elaine Harada Teixeira Oliveira , David Fernandes , and Leandro Silva Galv ao de Carvalho. 2020. Recomendacc ao Autom\u00e1tica de Problemas em Ju\u00edzes Online Usando Processamento de Linguagem Natural e An\u00e1lise Dirigida aos Dados . In Brazilian Symposium on Computers in Education (Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educacc ao-SBIE) . Hermino Barbosa Freitas Junior, Filipe Dwan Pereira, Elaine Harada Teixeira Oliveira, David Fernandes, and Leandro Silva Galv ao de Carvalho. 2020. Recomendacc ao Autom\u00e1tica de Problemas em Ju\u00edzes Online Usando Processamento de Linguagem Natural e An\u00e1lise Dirigida aos Dados. In Brazilian Symposium on Computers in Education (Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educacc ao-SBIE) ."},{"key":"e_1_3_2_1_20_1","volume-title":"Proceedings of the [email protected] In Metha P., Rosso P., Majumder P., Mitra M.(Eds.) Working Notes of the Forum for Information Retrieval Evaluation (FIRE 2019). CEUR Workshop Proceedings .","author":"Khalifa Muhammad","year":"2019","unstructured":"Muhammad Khalifa and Noura Hussein . 2019 . Ensemble Learning for Irony Detection in Arabic Tweets . In Proceedings of the [email protected] In Metha P., Rosso P., Majumder P., Mitra M.(Eds.) Working Notes of the Forum for Information Retrieval Evaluation (FIRE 2019). CEUR Workshop Proceedings . Muhammad Khalifa and Noura Hussein. 2019. Ensemble Learning for Irony Detection in Arabic Tweets. In Proceedings of the [email protected] In Metha P., Rosso P., Majumder P., Mitra M.(Eds.) Working Notes of the Forum for Information Retrieval Evaluation (FIRE 2019). CEUR Workshop Proceedings ."},{"key":"e_1_3_2_1_21_1","unstructured":"Taisiya Kostareva Svetlana Chuprina and Alexandr Nam. 2016. Using Ontology-Driven Methods to Develop Frameworks for Tackling NLP Problems.. In AIST (Supplement). 102--113.  Taisiya Kostareva Svetlana Chuprina and Alexandr Nam. 2016. Using Ontology-Driven Methods to Develop Frameworks for Tackling NLP Problems.. In AIST (Supplement). 102--113."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2018.1485053"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3152714"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-019-09773-y"},{"key":"e_1_3_2_1_25_1","volume-title":"Brazilian Symposium on Computers in Education (Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educacc ao-SBIE)","volume":"31","author":"Pimenta de Lima Marcos Avner","unstructured":"Marcos Avner Pimenta de Lima , Leandro Silva Galv ao de Carvalho, Elaine H. T. Oliveira, David Fernandes, and Filipe Dwan Pereira. 2020. Classificacc ao de dificuldade de quest oes de programacc ao com base em m'etricas de c'\u00f8digo . In Brazilian Symposium on Computers in Education (Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educacc ao-SBIE) , Vol. 31 . Marcos Avner Pimenta de Lima, Leandro Silva Galv ao de Carvalho, Elaine H. T. Oliveira, David Fernandes, and Filipe Dwan Pereira. 2020. Classificacc ao de dificuldade de quest oes de programacc ao com base em m'etricas de c'\u00f8digo. In Brazilian Symposium on Computers in Education (Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educacc ao-SBIE), Vol. 31."},{"key":"e_1_3_2_1_26_1","unstructured":"Edward Ma. 2019. NLP Augmentation. https:\/\/github.com\/makcedward\/nlpaug .  Edward Ma. 2019. NLP Augmentation. https:\/\/github.com\/makcedward\/nlpaug ."},{"key":"e_1_3_2_1_27_1","volume-title":"Cost-Sensitive BERT for Generalisable Sentence Classification with Imbalanced Data. arXiv preprint arXiv:2003.11563","author":"Madabushi Harish Tayyar","year":"2020","unstructured":"Harish Tayyar Madabushi , Elena Kochkina , and Michael Castelle . 2020. Cost-Sensitive BERT for Generalisable Sentence Classification with Imbalanced Data. arXiv preprint arXiv:2003.11563 ( 2020 ). Harish Tayyar Madabushi, Elena Kochkina, and Michael Castelle. 2020. Cost-Sensitive BERT for Generalisable Sentence Classification with Imbalanced Data. arXiv preprint arXiv:2003.11563 (2020)."},{"volume-title":"First International Conference on Sustainable Technologies for Computational Intelligence","author":"Mehta Raj P","key":"e_1_3_2_1_28_1","unstructured":"Raj P Mehta , Meet A Sanghvi , Darshin K Shah , and Artika Singh . 2020. Sentiment Analysis of Tweets Using Supervised Learning Algorithms . In First International Conference on Sustainable Technologies for Computational Intelligence . Springer , 323--338. Raj P Mehta, Meet A Sanghvi, Darshin K Shah, and Artika Singh. 2020. Sentiment Analysis of Tweets Using Supervised Learning Algorithms. In First International Conference on Sustainable Technologies for Computational Intelligence. Springer, 323--338."},{"key":"e_1_3_2_1_29_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Greg S Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems. 3111--3119.  Tomas Mikolov Ilya Sutskever Kai Chen Greg S Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems. 3111--3119."},{"key":"e_1_3_2_1_30_1","first-page":"107","article-title":"Using ontological engineering to overcome common AI-ED problems","volume":"11","author":"Mizoguchi Riichiro","year":"2000","unstructured":"Riichiro Mizoguchi and Jacqueline Bourdeau . 2000 . Using ontological engineering to overcome common AI-ED problems . Journal of Artificial Intelligence and Education , Vol. 11 (2000), 107 -- 121 . Riichiro Mizoguchi and Jacqueline Bourdeau. 2000. Using ontological engineering to overcome common AI-ED problems. Journal of Artificial Intelligence and Education, Vol. 11 (2000), 107--121.","journal-title":"Journal of Artificial Intelligence and Education"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_2_1_32_1","volume-title":"Brazilian Symposium on Computers in Education (Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educacc ao-SBIE)","volume":"30","author":"Pereira Filipe","year":"2019","unstructured":"Filipe Pereira , Elaine Oliveira , David Fernandes , Hermino Junior , and Leandro Silva Galv ao Carvalho . 2019 c. Otimizacc ao e automacc ao da predicc ao precoce do desempenho de alunos que utilizam ju'izes online: uma abordagem com algoritmo gen\u00e9tico . In Brazilian Symposium on Computers in Education (Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educacc ao-SBIE) , Vol. 30 . 1451. Filipe Pereira, Elaine Oliveira, David Fernandes, Hermino Junior, and Leandro Silva Galv ao Carvalho. 2019 c. Otimizacc ao e automacc ao da predicc ao precoce do desempenho de alunos que utilizam ju'izes online: uma abordagem com algoritmo gen\u00e9tico. In Brazilian Symposium on Computers in Education (Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educacc ao-SBIE), Vol. 30. 1451."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Filipe Dwan Pereira Samuel C Fonseca Elaine HT Oliveira David BF Oliveira Alexandra I Cristea and Leandro SG Carvalho. 2020 a. Deep learning for early performance prediction of introductory programming students: a comparative and explanatory study. Brazilian journal of computers in education. Vol. 28 (2020) 723--749.  Filipe Dwan Pereira Samuel C Fonseca Elaine HT Oliveira David BF Oliveira Alexandra I Cristea and Leandro SG Carvalho. 2020 a. Deep learning for early performance prediction of introductory programming students: a comparative and explanatory study. Brazilian journal of computers in education. Vol. 28 (2020) 723--749.","DOI":"10.5753\/rbie.2020.28.0.723"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-23207-8_13"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICALT.2019.00066"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Filipe D Pereira Elaine HT Oliveira David BF Oliveira Alexandra I Cristea Leandro SG Carvalho Samuel C Fonseca Armando Toda and Seiji Isotani. 2020 b. Using learning analytics in the Amazonas: understanding students' behaviour in introductory programming. British Journal of Educational Technology (2020).  Filipe D Pereira Elaine HT Oliveira David BF Oliveira Alexandra I Cristea Leandro SG Carvalho Samuel C Fonseca Armando Toda and Seiji Isotani. 2020 b. Using learning analytics in the Amazonas: understanding students' behaviour in introductory programming. British Journal of Educational Technology (2020).","DOI":"10.1111\/bjet.12953"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2019.1612679"},{"key":"e_1_3_2_1_38_1","first-page":"327","article-title":"Novice programmers and introductory programming. In The Cambridge Handbook of Computing Education Research. Cambridge University Press, Cambridge","volume":"12","author":"Robins A. V.","year":"2019","unstructured":"A. V. Robins . 2019 . Novice programmers and introductory programming. In The Cambridge Handbook of Computing Education Research. Cambridge University Press, Cambridge , Chapter 12 , 327 -- 376 . A. V. Robins. 2019. Novice programmers and introductory programming. In The Cambridge Handbook of Computing Education Research. Cambridge University Press, Cambridge, Chapter 12, 327--376.","journal-title":"Chapter"},{"volume-title":"Designing instructional systems: Decision making in course planning and curriculum design","author":"Romiszowski Alexander Joseph","key":"e_1_3_2_1_39_1","unstructured":"Alexander Joseph Romiszowski . 2016. Designing instructional systems: Decision making in course planning and curriculum design . Routledge . Alexander Joseph Romiszowski. 2016. Designing instructional systems: Decision making in course planning and curriculum design. Routledge."},{"key":"e_1_3_2_1_40_1","volume-title":"Case-Based Recommendation for Online Judges Using Learning Itineraries. In International Conference on Case-Based Reasoning. Springer, 315--329","author":"S\u00e1nchez-Ruiz Antonio A","year":"2017","unstructured":"Antonio A S\u00e1nchez-Ruiz , Guillermo Jimenez-Diaz , Pedro P G\u00f3mez-Mart'in , and Marco A G\u00f3mez-Mart'in . 2017 . Case-Based Recommendation for Online Judges Using Learning Itineraries. In International Conference on Case-Based Reasoning. Springer, 315--329 . Antonio A S\u00e1nchez-Ruiz, Guillermo Jimenez-Diaz, Pedro P G\u00f3mez-Mart'in, and Marco A G\u00f3mez-Mart'in. 2017. Case-Based Recommendation for Online Judges Using Learning Itineraries. In International Conference on Case-Based Reasoning. Springer, 315--329."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3143560"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3158670","article-title":"Automatically learning topics and difficulty levels of problems in online judge systems","volume":"36","author":"Zhao Wayne Xin","year":"2018","unstructured":"Wayne Xin Zhao , Wenhui Zhang , Yulan He , Xing Xie , and Ji-Rong Wen . 2018 . Automatically learning topics and difficulty levels of problems in online judge systems . ACM Transactions on Information Systems (TOIS) , Vol. 36 , 3 (2018), 1 -- 33 . Wayne Xin Zhao, Wenhui Zhang, Yulan He, Xing Xie, and Ji-Rong Wen. 2018. Automatically learning topics and difficulty levels of problems in online judge systems. ACM Transactions on Information Systems (TOIS), Vol. 36, 3 (2018), 1--33.","journal-title":"ACM Transactions on Information Systems (TOIS)"}],"event":{"name":"SIGCSE '21: The 52nd ACM Technical Symposium on Computer Science Education","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"],"location":"Virtual Event USA","acronym":"SIGCSE '21"},"container-title":["Proceedings of the 52nd ACM Technical Symposium on Computer Science Education"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408877.3432422","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3408877.3432422","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:37Z","timestamp":1750195897000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408877.3432422"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,3]]},"references-count":42,"alternative-id":["10.1145\/3408877.3432422","10.1145\/3408877"],"URL":"https:\/\/doi.org\/10.1145\/3408877.3432422","relation":{},"subject":[],"published":{"date-parts":[[2021,3,3]]},"assertion":[{"value":"2021-03-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}