{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T10:55:12Z","timestamp":1769597712820,"version":"3.49.0"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,9,23]],"date-time":"2019-09-23T00:00:00Z","timestamp":1569196800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,9,23]],"date-time":"2019-09-23T00:00:00Z","timestamp":1569196800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Smart Learn. Environ."],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Educational data mining (EDM) processes have shifted towards open-ended processes with visualizations and parameter and predictive model adjusting. Data and models in hyperdimensions can be visualized for end-users with popular data mining platforms such as Weka and RapidMiner. Multiple studies have shown how the adjusting and even creating the decision tree classifiers help EDM end-users to better comprehend the dataset and the context where the data has been collected. To harness the power of such open-ended approach in EDM, we introduce a novel<jats:italic>Augmented Intelligence<\/jats:italic>method and a cluster analysis algorithm<jats:italic>Neural N-Tree<\/jats:italic>. These contributions allow EDM end-users to analyze educational data in an iterative process where the knowledge discovery and the accuracy of the predictive model generated by the algorithm increases over time through the interactions between the models and the end-users. In contrast to other similar approaches, the key in our method is in the model adjusting and not in parameter tuning. We report a study where the potential EDM end-users clustered data from an education setting and interacted with Neural N-Tree models by following Augmented Intelligence method. The findings of the study suggest that the accuracy of the models evolve over time and especially the end-users who have a adequate level of knowledge from data mining benefit from the method. Moreover, the study indicates that the knowledge discovery is possible through AUI.<\/jats:p>","DOI":"10.1186\/s40561-019-0086-1","type":"journal-article","created":{"date-parts":[[2019,9,23]],"date-time":"2019-09-23T11:03:03Z","timestamp":1569236583000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Augmented intelligence in educational data mining"],"prefix":"10.1186","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8250-0495","authenticated-orcid":false,"given":"Tapani","family":"Toivonen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ilkka","family":"Jormanainen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Markku","family":"Tukiainen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,9,23]]},"reference":[{"issue":"3","key":"86_CR1","first-page":"324","volume":"5","author":"O. A. Abbas","year":"2008","unstructured":"O. A. Abbas, Comparisons between data clustering algorithms. Int. Arab J. Inf. Technol. (IAJIT). 5(3), 324 (2008).","journal-title":"Int. Arab J. Inf. Technol. (IAJIT)"},{"issue":"2","key":"86_CR2","doi-asserted-by":"crossref","first-page":"43","DOI":"10.13189\/wjcat.2014.020203","volume":"2","author":"A. B. E. D. Ahmed","year":"2014","unstructured":"A. B. E. D. Ahmed, I. S. Elaraby, Data mining: A prediction for student\u2019s performance using classification method. World J. Comput. Appl. Technol.2(2), 43\u201347 (2014).","journal-title":"World J. Comput. Appl. Technol."},{"key":"86_CR3","unstructured":"Q. A. Al-Radaideh, E. M. Al-Shawakfa, M. I. Al-Najjar, in International Arab Conference on Information Technology (ACIT\u20192006), Yarmouk University, Jordan. Mining student data using decision trees (Al Ain University of Science and Technology, 2006)."},{"key":"86_CR4","volume-title":"Proceedings of the 10th International Conference on Educational Data Mining","author":"T. -S. An","year":"2017","unstructured":"T. -S. An, C. Krauss, A. Merceron, in Proceedings of the 10th International Conference on Educational Data Mining. Can typical behaviors identified in moocs be discovered in other courses? International educational data mining society (Department of Social Science and Policy Studies Worcester Polytechnic Institute 100 Institute Road WorcesterMA 01609 USA, 2017)."},{"key":"86_CR5","doi-asserted-by":"crossref","unstructured":"M. Ankerst, C. Elsen, M. Ester, H. -P. Kriegel, in Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Visual classification: an interactive approach to decision tree construction (ACM, 1999), pp. 392\u2013396.","DOI":"10.1145\/312129.312298"},{"issue":"3","key":"86_CR6","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1007\/s11423-012-9235-8","volume":"60","author":"P. D. Antonenko","year":"2012","unstructured":"P. D. Antonenko, S. Toy, D. S. Niederhauser, Using cluster analysis for data mining in educational technology research. Educ. Technol. Res. Dev.60(3), 383\u2013398 (2012).","journal-title":"Educ. Technol. Res. Dev."},{"key":"86_CR7","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1016\/j.compedu.2017.05.007","volume":"113","author":"R. Asif","year":"2017","unstructured":"R. Asif, A. Merceron, S. A. Ali, N. G. Haider, Analyzing undergraduate students\u2019 performance using educational data mining. Comput. Educ.113:, 177\u2013194 (2017).","journal-title":"Comput. Educ."},{"issue":"1","key":"86_CR8","first-page":"3","volume":"1","author":"R. S. Baker","year":"2009","unstructured":"R. S. Baker, K. Yacef, The state of educational data mining in 2009: A review and future visions. JEDM J. Educ. Data Min.1(1), 3\u201317 (2009).","journal-title":"JEDM J. Educ. Data Min."},{"key":"86_CR9","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1109\/CT.1997.617682","volume-title":"Cognitive Technology, 1997. Humanizing the Information Age. Proceedings., Second International Conference On","author":"W. Beynon","year":"1997","unstructured":"W. Beynon, in Cognitive Technology, 1997. Humanizing the Information Age. Proceedings., Second International Conference On. Empirical modelling for educational technology (IEEEUSA, 1997), pp. 54\u201368."},{"issue":"6","key":"86_CR10","first-page":"1115","volume":"3","author":"N. Bhargava","year":"2013","unstructured":"N. Bhargava, G. Sharma, R. Bhargava, M. Mathuria, Decision tree analysis on j48 algorithm for data mining. Proc. Int. J. Adv. Res. Comput. Sci. Softw. Eng.3(6), 1115 (2013).","journal-title":"Proc. Int. J. Adv. Res. Comput. Sci. Softw. Eng."},{"issue":"3","key":"86_CR11","first-page":"674","volume":"29","author":"B. Delibasic","year":"2013","unstructured":"B. Delibasic, M. Vukicevic, M. Jovanovic, White-box decision tree algorithms: A pilot study on perceived usefulness, perceived ease of use, and perceived understanding. Int. J. Eng. Educ.29(3), 674\u2013687 (2013).","journal-title":"Int. J. Eng. Educ."},{"key":"86_CR12","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1109\/EDUNINE.2017.7918187","volume-title":"2017 IEEE World Engineering Education Conference (EDUNINE)","author":"D. B. Fern\u00e1ndez","year":"2017","unstructured":"D. B. Fern\u00e1ndez, S. Luj\u00e1n-Mora, in 2017 IEEE World Engineering Education Conference (EDUNINE). Comparison of applications for educational data mining in engineering education (IEEEUSA, 2017), pp. 81\u201385."},{"issue":"2","key":"86_CR13","first-page":"113","volume":"9","author":"M. Goyal","year":"2012","unstructured":"M. Goyal, R. Vohra, Applications of data mining in higher education. Int. J. Comput. Sci.9(2), 113 (2012).","journal-title":"Int. J. Comput. Sci."},{"key":"86_CR14","unstructured":"D. Gunning, Explainable artificial intelligence (xai), (2017). https:\/\/www.darpa.mil\/attachments\/XAIProgramUpdate.pdf . Accessed 7 Nov 2019."},{"issue":"1","key":"86_CR15","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1145\/1656274.1656278","volume":"11","author":"M. Hall","year":"2009","unstructured":"M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, I. H. Witten, The weka data mining software: an update. ACM SIGKDD Explor. Newsl.11(1), 10\u201318 (2009).","journal-title":"ACM SIGKDD Explor. Newsl."},{"key":"86_CR16","unstructured":"A. J. Harfield, Empirical modelling as a new paradigm for educational technology. PhD thesis, University of Warwick (2007)."},{"key":"86_CR17","volume-title":"RapidMiner: Data Mining Use Cases and Business Analytics Applications","author":"M. Hofmann","year":"2013","unstructured":"M. Hofmann, R. Klinkenberg, RapidMiner: Data Mining Use Cases and Business Analytics Applications (CRC Press, New York, 2013)."},{"key":"86_CR18","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1109\/DIGITEL.2012.14","volume-title":"Proceedings of the Fourth IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning","author":"I. Jormanainen","year":"2012","unstructured":"I. Jormanainen, E. Sutinen, in Proceedings of the Fourth IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning. Using Data Mining to Support Teacher\u2019s Intervention in a Robotics Class (IEEE Computer SocietyLos Alamitos, California, 2012), pp. 39\u201346."},{"key":"86_CR19","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1145\/2526968.2526997","volume-title":"Proceedings of the 13th Koli Calling International Conference on Computing Education Research","author":"I. Jormanainen","year":"2013","unstructured":"I. Jormanainen, E. Sutinen, in Proceedings of the 13th Koli Calling International Conference on Computing Education Research. An open approach for learning educational data mining (ACMNew York, 2013), pp. 203\u2013204."},{"key":"86_CR20","first-page":"1","volume-title":"2019 4th MEC International Conference on Big Data and Smart City (ICBDSC)","author":"I. Khan","year":"2019","unstructured":"I. Khan, A. Al Sadiri, A. R. Ahmad, N. Jabeur, in 2019 4th MEC International Conference on Big Data and Smart City (ICBDSC). Tracking student performance in introductory programming by means of machine learning (IEEEUSA, 2019), pp. 1\u20136."},{"key":"86_CR21","first-page":"1","volume-title":"Proceedings of the Seventh International Learning Analytics & Knowledge Conference","author":"V. Kovanovi\u0107","year":"2017","unstructured":"V. Kovanovi\u0107, S. Joksimovi\u0107, P. Katerinopoulos, C. Michail, G. Siemens, D. Ga\u0161evi\u0107, in Proceedings of the Seventh International Learning Analytics & Knowledge Conference. Developing a mooc experimentation platform: Insights from a user study (ACMNew York, 2017), pp. 1\u20135."},{"key":"86_CR22","unstructured":"A. Merceron, K. Yacef, in Proceedings of the 12th International Conference on Artificial Intelligence in Education (AIED 2005). Educational data mining: a case study (InderScience PublishersGen\u00e8ve, 2005a), pp. 467\u2013474."},{"key":"86_CR23","unstructured":"A. Merceron, K. Yacef, Interact. Multimed. Electron. J. Comput.-Enhanc. Learn.7(1), 267\u2013287 (2005b)."},{"key":"86_CR24","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1109\/AFGR.2000.840651","volume-title":"Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580)","author":"B. Moghaddam","year":"2000","unstructured":"B. Moghaddam, M. -H. Yang, in Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580). Gender classification with support vector machines (IEEEUSA, 2000), pp. 306\u2013311."},{"key":"86_CR25","unstructured":"U. K. Pandey, S. Pal, Data mining: A prediction of performer or underperformer using classification. arXiv preprint arXiv:1104.4163 (2011)."},{"issue":"1","key":"86_CR26","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1016\/j.compedu.2007.05.016","volume":"51","author":"C. Romero","year":"2008","unstructured":"C. Romero, S. Ventura, E. Garc\u00eda, Data mining in course management systems: Moodle case study and tutorial. Comput. Educ.51(1), 368\u2013384 (2008).","journal-title":"Comput. Educ."},{"key":"86_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/19488289.2018.1424059","volume":"8","author":"W. B. Rouse","year":"2018","unstructured":"W. B. Rouse, J. C. Spohrer, Automating versus augmenting intelligence. Journal of Enterprise Transformation. 8:, 1\u201321 (2018).","journal-title":"Journal of Enterprise Transformation"},{"key":"86_CR28","first-page":"96","volume-title":"Advanced Computing & Communication Technologies (ACCT), 2012 Second International Conference On","author":"R. B. Sachin","year":"2012","unstructured":"R. B. Sachin, M. S. Vijay, in Advanced Computing & Communication Technologies (ACCT), 2012 Second International Conference On. A survey and future vision of data mining in educational field (IEEEUSA, 2012), pp. 96\u2013100."},{"issue":"1","key":"86_CR29","doi-asserted-by":"publisher","first-page":"85","DOI":"10.3102\/1076998616666808","volume":"42","author":"S. Slater","year":"2017","unstructured":"S. Slater, S. Joksimovi\u0107, V. Kovanovic, R. S. Baker, D. Gasevic, Tools for educational data mining: A review. J. Educ. Behav. Stat.42(1), 85\u2013106 (2017).","journal-title":"J. Educ. Behav. Stat."},{"key":"86_CR30","doi-asserted-by":"crossref","unstructured":"T. Toivonen, I. Jormanainen, C. S. Montero, A. Alessandrini, in Challenges and Solutions in Smart Learning, ed. by M. Chang, E. Popescu, Kinshuk, N. -S. Chen, M. Jemni, R. Huang, and J. M. Spector. Innovative maker movement platform for k-12 education as a smart learning environment (SpringerSingapore, 2018), pp. 61\u201366.","DOI":"10.1007\/978-981-10-8743-1_9"},{"key":"86_CR31","doi-asserted-by":"publisher","first-page":"352","DOI":"10.1007\/978-3-319-24258-3_26","volume-title":"Design for Teaching and Learning in a Networked World","author":"M. Vahdat","year":"2015","unstructured":"M. Vahdat, L. Oneto, D. Anguita, M. Funk, M. Rauterberg, in Design for Teaching and Learning in a Networked World, ed. by G. Conole, T. Klobu\u010dar, C. Rensing, J. Konert, and E. Lavou\u00e9. A learning analytics approach to correlate the academic achievements of students with interaction data from an educational simulator (SpringerCham, 2015), pp. 352\u2013366."},{"key":"86_CR32","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1109\/ICBDA.2018.8367655","volume-title":"2018 IEEE 3rd International Conference on Big Data Analysis (ICBDA)","author":"W. Zhang","year":"2018","unstructured":"W. Zhang, S. Qin, in 2018 IEEE 3rd International Conference on Big Data Analysis (ICBDA). A brief analysis of the key technologies and applications of educational data mining on online learning platform (IEEEUSA, 2018), pp. 83\u201386."}],"container-title":["Smart Learning Environments"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40561-019-0086-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s40561-019-0086-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40561-019-0086-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T09:49:37Z","timestamp":1664444977000},"score":1,"resource":{"primary":{"URL":"https:\/\/slejournal.springeropen.com\/articles\/10.1186\/s40561-019-0086-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,23]]},"references-count":32,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["86"],"URL":"https:\/\/doi.org\/10.1186\/s40561-019-0086-1","relation":{},"ISSN":["2196-7091"],"issn-type":[{"value":"2196-7091","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,9,23]]},"assertion":[{"value":"12 February 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 July 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 September 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"10"}}