{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T00:50:30Z","timestamp":1771548630805,"version":"3.50.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,10,6]],"date-time":"2022-10-06T00:00:00Z","timestamp":1665014400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,10,6]],"date-time":"2022-10-06T00:00:00Z","timestamp":1665014400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000774","name":"The University of Newcastle","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000774","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Educ Inf Technol"],"published-print":{"date-parts":[[2023,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Digital capabilities have become increasingly important in this digital age. Within a university setting, digital capability assessment is key to curriculum design and curriculum mapping, given that digital capabilities not only can help students engage and communicate with others but also succeed at work. To the best of our knowledge, however, no previous studies in the relevant literature have reported the assessment of digital capabilities in courses across a university. It is extremely challenging to do so manually, as thousands of courses offered by the university would have to be checked. In this study, we therefore use machine learning classifiers to automatically identify digital capabilities in courses based on real-world university course rubric data. Through text analysis of course rubrics produced by course academics, decision makers can identify the digital capabilities that are formally assessed in university courses. This, in turn, would enable them to design and map curriculums to develop the digital capabilities of staff and students. Comprehensive experimental results reveal that the machine learning models tested in this study can effectively identify digital capabilities. Among the prediction models included in our experiments, the performance of support vector machines was the best, achieving accuracy and F-measure scores of 0.8535 and 0.8338, respectively.<\/jats:p>","DOI":"10.1007\/s10639-022-11075-8","type":"journal-article","created":{"date-parts":[[2022,10,6]],"date-time":"2022-10-06T09:03:07Z","timestamp":1665046987000},"page":"3937-3952","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Identifying digital capabilities in university courses: An automated machine learning approach"],"prefix":"10.1007","volume":"28","author":[{"given":"Zongwen","family":"Fan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raymond","family":"Chiong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,10,6]]},"reference":[{"issue":"3","key":"11075_CR1","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1007\/s40593-020-00201-7","volume":"30","author":"R Balyan","year":"2020","unstructured":"Balyan, R., McCarthy, K.S., & McNamara, D.S. (2020). Applying natural language processing and hierarchical machine learning approaches to text difficulty classification. International Journal of Artificial Intelligence in Education, 30(3), 337\u2013370.","journal-title":"International Journal of Artificial Intelligence in Education"},{"key":"11075_CR2","volume-title":"Pattern recognition and machine learning","author":"CM Bishop","year":"2006","unstructured":"Bishop, C.M. (2006). Pattern recognition and machine learning. New York: springer."},{"key":"11075_CR3","doi-asserted-by":"crossref","unstructured":"Borges, A.F., Laurindo, F.J., Sp\u00ednola, M. M., Gon\u00e7alves, R. F., & Mattos, C.A. (2020). The strategic use of artificial intelligence in the digital era: Systematic literature review and future research directions. International Journal of Information Management, p. 102225.","DOI":"10.1016\/j.ijinfomgt.2020.102225"},{"issue":"1","key":"11075_CR4","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5\u201332.","journal-title":"Machine Learning"},{"key":"11075_CR5","unstructured":"Brownlee, J. (2017). Deep learning for natural language processing: develop deep learning models for your natural language problems. Machine Learning Mastery."},{"issue":"2","key":"11075_CR6","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1023\/A:1009715923555","volume":"2","author":"CJ Burges","year":"1998","unstructured":"Burges, C.J. (1998). A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2(2), 121\u2013167.","journal-title":"Data Mining and Knowledge Discovery"},{"key":"11075_CR7","doi-asserted-by":"publisher","first-page":"304","DOI":"10.1016\/j.iref.2018.03.008","volume":"61","author":"P Carmona","year":"2019","unstructured":"Carmona, P., Climent, F., & Momparler, A. (2019). Predicting failure in the us banking sector: An extreme gradient boosting approach. International Review of Economics & Finance, 61, 304\u2013323.","journal-title":"International Review of Economics & Finance"},{"key":"11075_CR8","unstructured":"Chen, T., He, T., Benesty, M., Khotilovich, V., & Tang, Y. (2015). Xgboost: extreme gradient boosting. R package version 0.4-2, pp. 1\u20134."},{"key":"11075_CR9","doi-asserted-by":"publisher","first-page":"105,749","DOI":"10.1016\/j.cmpb.2020.105749","volume":"198","author":"R Chiong","year":"2021","unstructured":"Chiong, R., Fan, Z., Hu, Z., & Chiong, F. (2021). Using an improved relative error support vector machine for body fat prediction. Computer Methods and Programs in Biomedicine, 198, 105,749.","journal-title":"Computer Methods and Programs in Biomedicine"},{"key":"11075_CR10","doi-asserted-by":"publisher","unstructured":"Chiong, R., Wang, Z., Fan, Z., & Dhakal, S. (2022). A fuzzy-based ensemble model for improving malicious web domain identification. Expert Systems with Applications, p. 117243. https:\/\/doi.org\/10.1016\/j.eswa.2022.117243.","DOI":"10.1016\/j.eswa.2022.117243"},{"issue":"1","key":"11075_CR11","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1111\/jade.12231","volume":"39","author":"A Crosby","year":"2020","unstructured":"Crosby, A., Pham, K., Peterson, J.F., & Lee, T. (2020). Digital work practices: Affordances in design education. International Journal of Art & Design Education, 39(1), 22\u201337.","journal-title":"International Journal of Art & Design Education"},{"issue":"2","key":"11075_CR12","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1080\/0158037X.2015.1074894","volume":"38","author":"R Edwards","year":"2016","unstructured":"Edwards, R., & Fenwick, T. (2016). Digital analytics in professional work and learning. Studies in Continuing Education, 38(2), 213\u2013227.","journal-title":"Studies in Continuing Education"},{"issue":"3","key":"11075_CR13","doi-asserted-by":"publisher","first-page":"102","DOI":"10.3390\/educsci8030102","volume":"8","author":"M Elphick","year":"2018","unstructured":"Elphick, M. (2018). The impact of embedded ipad use on student perceptions of their digital capabilities. Education Sciences, 8(3), 102.","journal-title":"Education Sciences"},{"key":"11075_CR14","doi-asserted-by":"publisher","first-page":"2359","DOI":"10.1007\/s10489-021-02421-3","volume":"52","author":"Z Fan","year":"2022","unstructured":"Fan, Z., Chiong, R., & Chiong, F. (2022). A fuzzy-weighted gaussian kernel-based machine learning approach for body fat prediction. Applied Intelligence, 52, 2359\u20132368.","journal-title":"Applied Intelligence"},{"key":"11075_CR15","doi-asserted-by":"publisher","first-page":"106,171","DOI":"10.1016\/j.compstruc.2019.106171","volume":"230","author":"Z Fan","year":"2020","unstructured":"Fan, Z., Chiong, R., Hu, Z., & Lin, Y. (2020). A fuzzy weighted relative error support vector machine for reverse prediction of concrete components. Computers & Structures, 230, 106,171.","journal-title":"Computers & Structures"},{"key":"11075_CR16","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1016\/j.asoc.2019.03.037","volume":"80","author":"HA Fayed","year":"2019","unstructured":"Fayed, H.A., & Atiya, A.F. (2019). Speed up grid-search for parameter selection of support vector machines. Applied Soft Computing, 80, 202\u2013210.","journal-title":"Applied Soft Computing"},{"issue":"4","key":"11075_CR17","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1016\/S0167-9473(01)00065-2","volume":"38","author":"JH Friedman","year":"2002","unstructured":"Friedman, J.H. (2002). Stochastic gradient boosting. Computational Statistics & Data Analysis, 38(4), 367\u2013378.","journal-title":"Computational Statistics & Data Analysis"},{"issue":"4","key":"11075_CR18","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1016\/j.patrec.2005.08.011","volume":"27","author":"PO Gislason","year":"2006","unstructured":"Gislason, P.O., Benediktsson, J.A., & Sveinsson, J.R. (2006). Random forests for land cover classification. Pattern Recognition Letters, 27(4), 294\u2013300.","journal-title":"Pattern Recognition Letters"},{"key":"11075_CR19","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1016\/j.compind.2016.04.004","volume":"80","author":"O Gonz\u00e1lez-Rojas","year":"2016","unstructured":"Gonz\u00e1lez-Rojas, O., Correal, D., & Camargo, M. (2016). Ict capabilities for supporting collaborative work on business processes within the digital content industry. Computers in Industry, 80, 16\u201329.","journal-title":"Computers in Industry"},{"issue":"8","key":"11075_CR20","doi-asserted-by":"publisher","first-page":"e17,022","DOI":"10.2196\/17022","volume":"22","author":"M Krasuska","year":"2020","unstructured":"Krasuska, M., Williams, R., Sheikh, A., Franklin, B.D., Heeney, C., Lane, W., Mozaffar, H., Mason, K., Eason, S., Hinder, S., & et al. (2020). Technological capabilities to assess digital excellence in hospitals in high performing health care systems: International edelphi exercise. Journal of Medical Internet Research, 22(8), e17,022.","journal-title":"Journal of Medical Internet Research"},{"key":"11075_CR21","doi-asserted-by":"crossref","unstructured":"Land, W.H., & Schaffer, J.D. (2020). The support vector machine. In The art and science of machine intelligence (pp. 45\u201376). Springer.","DOI":"10.1007\/978-3-030-18496-4_2"},{"issue":"4","key":"11075_CR22","doi-asserted-by":"publisher","first-page":"781","DOI":"10.1080\/02331888.2014.913049","volume":"49","author":"H Murakami","year":"2015","unstructured":"Murakami, H. (2015). The power of the modified wilcoxon rank-sum test for the one-sided alternative. Statistics, 49(4), 781\u2013794.","journal-title":"Statistics"},{"issue":"2","key":"11075_CR23","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1080\/03055698.2016.1148588","volume":"42","author":"L Pagani","year":"2016","unstructured":"Pagani, L., Argentin, G., Gui, M., & Stanca, L. (2016). The impact of digital skills on educational outcomes: Evidence from performance tests. Educational Studies, 42(2), 137\u2013162.","journal-title":"Educational Studies"},{"key":"#cr-split#-11075_CR24.1","unstructured":"Qader, W.A., Ameen, M.M., & Ahmed, B.I. (2019). An overview of bag of words"},{"key":"#cr-split#-11075_CR24.2","unstructured":"importance, implementation, applications, and challenges. In 2019 International Engineering Conference (IEC) (pp. 200-204). IEEE."},{"issue":"1","key":"11075_CR25","doi-asserted-by":"publisher","first-page":"25","DOI":"10.5120\/ijca2018917395","volume":"181","author":"S Qaiser","year":"2018","unstructured":"Qaiser, S., & Ali, R. (2018). Text mining: use of TF-IDF to examine the relevance of words to documents. International Journal of Computer Applications, 181(1), 25\u201329.","journal-title":"International Journal of Computer Applications"},{"key":"11075_CR26","doi-asserted-by":"publisher","first-page":"120,719","DOI":"10.1016\/j.techfore.2021.120719","volume":"167","author":"M Tang","year":"2021","unstructured":"Tang, M., & Liao, H. (2021). Multi-attribute large-scale group decision making with data mining and subgroup leaders: An application to the development of the circular economy. Technological Forecasting and Social Change, 167, 120,719.","journal-title":"Technological Forecasting and Social Change"},{"issue":"1","key":"11075_CR27","doi-asserted-by":"publisher","first-page":"e277","DOI":"10.1002\/pra2.277","volume":"57","author":"D Whetstone","year":"2020","unstructured":"Whetstone, D., & Moulaison-Sandy, H. (2020). Quantifying authorship: A comparison of authorship rubrics from five disciplines. Proceedings of the Association for Information Science and Technology, 57(1), e277.","journal-title":"Proceedings of the Association for Information Science and Technology"},{"issue":"2","key":"11075_CR28","first-page":"292","volume":"2","author":"CB Wilson","year":"2020","unstructured":"Wilson, C.B., & Slade, C. (2020). Developing digital capabilities of future students through consensus curriculum development. ETH Learning and Teaching Journal, 2(2), 292\u2013295.","journal-title":"ETH Learning and Teaching Journal"},{"issue":"3","key":"11075_CR29","doi-asserted-by":"publisher","first-page":"736","DOI":"10.1016\/j.compedu.2010.10.016","volume":"56","author":"ZJ Zhong","year":"2011","unstructured":"Zhong, Z.J. (2011). From access to usage: The divide of self-reported digital skills among adolescents. Computers & Education, 56(3), 736\u2013746.","journal-title":"Computers & Education"},{"key":"11075_CR30","doi-asserted-by":"publisher","first-page":"73,271","DOI":"10.1109\/ACCESS.2019.2920655","volume":"7","author":"E Zhu","year":"2019","unstructured":"Zhu, E., Chen, Y., Ye, C., Li, X., & Liu, F. (2019). Ofs-nn: An effective phishing websites detection model based on optimal feature selection and neural network. IEEE Access, 7, 73,271\u201373,284.","journal-title":"IEEE Access"}],"container-title":["Education and Information Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-022-11075-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10639-022-11075-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-022-11075-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,14]],"date-time":"2023-04-14T09:13:49Z","timestamp":1681463629000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10639-022-11075-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,6]]},"references-count":31,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["11075"],"URL":"https:\/\/doi.org\/10.1007\/s10639-022-11075-8","relation":{},"ISSN":["1360-2357","1573-7608"],"issn-type":[{"value":"1360-2357","type":"print"},{"value":"1573-7608","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,6]]},"assertion":[{"value":"28 August 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 April 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 October 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This article does not contain any studies with human participants or animals performed by any of the authors.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Ethics approval"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Consent to participate"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Consent for Publication"}},{"value":"The authors declare that they have no competing interests.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Competing interests"}},{"value":"The authors have no conflicts of interest to declare that are relevant to the content of this article.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interests"}}]}}