{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T17:47:42Z","timestamp":1754156862553,"version":"3.41.2"},"reference-count":37,"publisher":"Emerald","issue":"5","license":[{"start":{"date-parts":[[2024,5,29]],"date-time":"2024-05-29T00:00:00Z","timestamp":1716940800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["DTA"],"published-print":{"date-parts":[[2024,9,4]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>The existing traditional recommendations based on content-based filtering (CBF), collaborative filtering (CF) and hybrid approaches are inadequate for recommending practice challenges in programming online judge (POJ). These systems only consider the preferences of the target users or similar users to recommend items. In the learning environment, recommender systems should consider the learning path, knowledge level and ability of the learner. Another major problem in POJ is the learners don't give ratings to practice challenges like e-commerce and video streaming portals. This purpose of the proposed approach is to overcome the abovementioned shortcomings.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>To achieve the context-aware practice challenge recommendation, the data preparation techniques including implicit rating extraction, data preprocessing to remove outliers, sequence-based learner clustering and utility sequence pattern mining approaches are used in the proposed approach. The approach ensures that the recommender system considers the knowledge level, learning path and learning goals of the learner to recommend practice challenges.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>Experiments on practice challenge recommendations conducted using real-world POJ dataset show that the proposed system outperforms other traditional approaches. The experiment also demonstrates that the proposed system is recommending challenges based on the learner's current context. The implicit rating extracted using the proposed approach works accurately in the recommender system.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>The proposed system contains the following novel approaches to address the lack of rating and context-aware recommendations. The mathematical model was used to extract ratings from learner submissions. The statistical approach was used in data preprocessing. The sequence similarity-based learner clustering was used in transition matrix. Utilizing the rating as a utility in the USPAN algorithm provides useful insights into learner\u2013challenge relationships.<\/jats:p><\/jats:sec>","DOI":"10.1108\/dta-10-2023-0688","type":"journal-article","created":{"date-parts":[[2024,5,29]],"date-time":"2024-05-29T08:14:56Z","timestamp":1716970496000},"page":"718-741","source":"Crossref","is-referenced-by-count":1,"title":["Practice challenge recommendations in online judge using implicit rating extraction and utility sequence patterns"],"prefix":"10.1108","volume":"58","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3216-458X","authenticated-orcid":false,"given":"Ramesh","family":"P Natarajan","sequence":"first","affiliation":[]},{"given":"Kannimuthu","family":"S","sequence":"additional","affiliation":[]},{"given":"Bhanu","family":"D","sequence":"additional","affiliation":[]}],"member":"140","published-online":{"date-parts":[[2024,5,29]]},"reference":[{"issue":"4","key":"key2025010616364628800_ref001","doi-asserted-by":"publisher","first-page":"23","DOI":"10.4316\/AECE.2018.04003","article-title":"Cascaded feature selection for enhancing the performance of collaborative recommender system","volume":"18","year":"2018","journal-title":"Advances in Electrical and Computer Engineering"},{"issue":"3","key":"key2025010616364628800_ref002","doi-asserted-by":"publisher","first-page":"200","DOI":"10.5121\/ijcsit.2011.3314","article-title":"E-learning personalization based on dynamic learners' preference","volume":"3","year":"2011","journal-title":"International Journal of Computer Science and Information Technology"},{"first-page":"91","article-title":"Personalizing E-learning curriculum using: reversed roulette wheel selection algorithm","year":"2014","key":"key2025010616364628800_ref003"},{"issue":"1","key":"key2025010616364628800_ref004","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1007\/s10586-017-1160-5","article-title":"An efficient personalized trust-based hybrid recommendation (TBHR) strategy for e-learning system in cloud computing","volume":"22","year":"2019","journal-title":"Cluster Computing"},{"first-page":"477","article-title":"Association rules mining method of big data for E-learning recommendation engine","year":"2018","key":"key2025010616364628800_ref005"},{"issue":"4","key":"key2025010616364628800_ref006","doi-asserted-by":"publisher","first-page":"1427","DOI":"10.1007\/s10639-017-9667-1","article-title":"An empirical study of using sequential behaviour pattern mining approach to predict learning styles","volume":"23","year":"2018","journal-title":"Education and Information Technology"},{"key":"key2025010616364628800_ref007","first-page":"85","article-title":"Impact of an E-learning strategy on pedagogical aspects","volume":"3","year":"2006","journal-title":"Journal of Instructional Technology & Distance Learning"},{"key":"key2025010616364628800_ref008","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1007\/s11257-008-9047-z","article-title":"An architecture for making recommendations to courseware authors using association rule mining and collaborative filtering","volume":"19","year":"2009","journal-title":"User Model User Adapt Interact"},{"issue":"6","key":"key2025010616364628800_ref009","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1007\/s11423-010-9155-4","article-title":"Learning materials recommendation using good learners' ratings and content-based filtering","volume":"58","year":"2010","journal-title":"Educational Technology Research and Development"},{"issue":"6","key":"key2025010616364628800_ref010","first-page":"130","article-title":"Intelligent recommendations for e-learning personalization based on learner's learning activities and performances","volume":"7","year":"2018","journal-title":"International Journal of Computer Science and Software Engineering"},{"first-page":"660","article-title":"USpan: an efficient algorithm for mining high utility sequential patterns","year":"2012","key":"key2025010616364628800_ref011"},{"issue":"4","key":"key2025010616364628800_ref012","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1080\/08839514.2014.891839","article-title":"Discovery of high utility itemsets using genetic algorithm with ranked mutation","volume":"28","year":"2014","journal-title":"Applied Artificial Intelligence"},{"issue":"1","key":"key2025010616364628800_ref013","doi-asserted-by":"publisher","first-page":"1169","DOI":"10.3233\/JIFS-220871","article-title":"Mining high utility itemsets using Genetic Algorithm Based-Particle Swarm Optimization (GA-PSO)","volume":"44","year":"2023","journal-title":"Journal of Intelligent and Fuzzy Systems"},{"key":"key2025010616364628800_ref014","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1109\/ICALT.2008.198","article-title":"Automatic recommendations for e-learning personalization based on web usage mining techniques and information retrieval","year":"2008"},{"key":"key2025010616364628800_ref015","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1109\/ICALT.2013.123","article-title":"Toward a fully automatic learner modeling based on web usage mining with respect to educational preferences and learning styles","year":"2013"},{"issue":"6","key":"key2025010616364628800_ref016","doi-asserted-by":"publisher","first-page":"1519","DOI":"10.1007\/s10489-017-1051-8","article-title":"Enhancing e-learning systems with personalized recommendation based on collaborative tagging techniques","volume":"48","year":"2018","journal-title":"Applied Intelligence"},{"key":"key2025010616364628800_ref017","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1007\/978-3-642-25813-8_33","article-title":"Combining collaborative filtering and sequential pattern mining for recommendation in E-learning environment","year":"2011"},{"key":"key2025010616364628800_ref018","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1007\/11925293_2","article-title":"Courseware recommendation in E-learning system","year":"2006"},{"key":"key2025010616364628800_ref019","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1111\/j.1365-2729.2010.00362.x","article-title":"Collaborative recommendation of e-learning resources: an experimental investigation","volume":"26","year":"2010","journal-title":"Journal of Computer Assisted Learning"},{"key":"key2025010616364628800_ref020","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1145\/502932.502935","article-title":"Effective personalization based on association rule discovery from web usage data","year":"2001"},{"issue":"1","key":"key2025010616364628800_ref021","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/j.engappai.2016.10.011","article-title":"Scalable and adaptive collaborative filtering by mining frequent item co-occurrences in a user feedback stream","volume":"58","year":"2017","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"key2025010616364628800_ref022","unstructured":"Nielsen, J.(2006), \u201cParticipation inequality: lurkers vs. contributors in internet communities\u201d, available at: www.nngroup.com\/articles\/participation-inequality\/ (accessed 10 December 2022)."},{"issue":"1","key":"key2025010616364628800_ref023","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1504\/IJKWI.2012.048161","article-title":"The development of a course recommendation system for e-learning students","volume":"3","year":"2012","journal-title":"International Journal of Knowledge and Web Intelligence"},{"issue":"8","key":"key2025010616364628800_ref024","doi-asserted-by":"publisher","first-page":"5145","DOI":"10.1007\/s11227-019-02791-z","article-title":"An intelligent fuzzy rule-based e-learning recommendation system for dynamic user interests","volume":"75","year":"2019","journal-title":"Journal of Supercomputing"},{"key":"key2025010616364628800_ref025","unstructured":"Philippe, F.-V. (2008), \u201cSequential Pattern Mining Framework: an open-source data mining library\u201d, available at: www.philippe-fournier-viger.com\/spmf\/ (accessed 12 March 2023)."},{"key":"key2025010616364628800_ref026","first-page":"3569","article-title":"SPMF: a java open-source pattern mining library","volume":"15","year":"2014","journal-title":"Journal of Machine Learning Research"},{"issue":"1","key":"key2025010616364628800_ref027","doi-asserted-by":"publisher","first-page":"36","DOI":"10.4018\/IJDET.2020010103","article-title":"Learning path recommendation system for programming education based on neural networks","volume":"18","year":"2020","journal-title":"International Journal of Distance Education Technologies"},{"key":"key2025010616364628800_ref028","doi-asserted-by":"crossref","first-page":"105618","DOI":"10.1016\/j.knosys.2020.105618","article-title":"A learning path recommendation model based on a multidimensional knowledge graph framework for e-learning","volume":"195","year":"2020","journal-title":"Knowledge-Based Systems"},{"issue":"2","key":"key2025010616364628800_ref029","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1007\/s00530-017-0539-8","article-title":"A content-based recommendation algorithm for learning resources","volume":"24","year":"2018","journal-title":"Multimedia Systems"},{"issue":"8","key":"key2025010616364628800_ref030","doi-asserted-by":"publisher","first-page":"2449","DOI":"10.1007\/s00500-017-2720-6","article-title":"A hybrid recommender system for e-learning based on context awareness and sequential pattern mining","volume":"22","year":"2018","journal-title":"Soft Computing"},{"key":"key2025010616364628800_ref031","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/j.future.2017.02.049","article-title":"A hybrid knowledge-based recommender system for e-learning based on ontology and sequential pattern mining","volume":"72","year":"2017","journal-title":"Future Generation Computer Systems"},{"issue":"2","key":"key2025010616364628800_ref032","doi-asserted-by":"publisher","first-page":"17","DOI":"10.3390\/informatics5020017","article-title":"A recommender system for programming online judges using fuzzy information modeling","volume":"5","year":"2018","journal-title":"Informatics"},{"key":"key2025010616364628800_ref033","first-page":"191","article-title":"Recommendation in higher education using data mining techniques","volume-title":"Proceedings of the 2nd International Conference on Educational Data Mining","year":"2009"},{"key":"key2025010616364628800_ref034","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.knosys.2018.06.014","article-title":"An e-learning recommendation approach based on the self-organization of learning resource","volume":"160","year":"2018","journal-title":"Knowledge-Based Systems"},{"issue":"1","key":"key2025010616364628800_ref035","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3143560","article-title":"A survey on online judge systems and their applications","volume":"51","year":"2018","journal-title":"ACM Computing Surveys"},{"issue":"3","key":"key2025010616364628800_ref036","first-page":"243","article-title":"A web content suggestion system for distance learning","volume":"9","year":"2006","journal-title":"Tamkang Journal of Science and Engineering"},{"key":"key2025010616364628800_ref037","doi-asserted-by":"publisher","first-page":"1264","DOI":"10.1007\/s10489-017-1051-8","article-title":"Research on E-learning in college education: a model on personalized resource recommendation based on learning situation","year":"2016"}],"container-title":["Data Technologies and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/DTA-10-2023-0688\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/DTA-10-2023-0688\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T23:15:27Z","timestamp":1753398927000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/dta\/article\/58\/5\/718-741\/1234928"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,29]]},"references-count":37,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5,29]]},"published-print":{"date-parts":[[2024,9,4]]}},"alternative-id":["10.1108\/DTA-10-2023-0688"],"URL":"https:\/\/doi.org\/10.1108\/dta-10-2023-0688","relation":{},"ISSN":["2514-9288","2514-9288"],"issn-type":[{"type":"print","value":"2514-9288"},{"type":"electronic","value":"2514-9288"}],"subject":[],"published":{"date-parts":[[2024,5,29]]}}}