{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T21:34:19Z","timestamp":1777152859209,"version":"3.51.4"},"reference-count":25,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T00:00:00Z","timestamp":1612742400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T00:00:00Z","timestamp":1612742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Singapore Management University\u2019s Technology-enhanced Learning Grant"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["RPTEL"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Do my students understand? The question that lingers in every instructor\u2019s mind after each lesson. With the focus on learner-centered pedagogy, is it feasible to provide timely and relevant guidance to individual learners according to their levels of understanding? One of the options available is to collect reflections from learners after each lesson to extract relevant feedback so that doubts or questions can be addressed in a timely manner. In this paper, we derived a hybrid approach that leverages a novel Doubt Sentic Pattern Detection (SPD) algorithm and a machine learning model to automate the identification of doubts from students\u2019 informal reflections. The encouraging results clearly show that the hybrid approach has the potential to be adopted in the real-world doubt detection. Using reflections as a feedback mechanism and automated doubt detection can pave the way to a promising approach for learner-centered teaching and personalized learning.<\/jats:p>","DOI":"10.1186\/s41039-021-00149-9","type":"journal-article","created":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T22:50:31Z","timestamp":1612824631000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Automated doubt identification from informal reflections through hybrid sentic patterns and machine learning approach"],"prefix":"10.1186","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8749-0473","authenticated-orcid":false,"given":"Siaw Ling","family":"Lo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kar Way","family":"Tan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eng Lieh","family":"Ouh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,2,8]]},"reference":[{"key":"149_CR1","doi-asserted-by":"crossref","unstructured":"Cambria, E., & Hussain, A. (2015). Sentic computing: A common-sense-based framework for concept-level sentiment analysis, (vol. 1). Springer International Publishing.\u00a0https:\/\/www.springer.com\/gp\/book\/9783319236537.","DOI":"10.1007\/978-3-319-23654-4"},{"key":"149_CR2","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1145\/1390334.1390415","volume-title":"Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval \u2013 SIGIR 08","author":"G Cong","year":"2008","unstructured":"Cong, G., Wang, L., Lin, C. Y., Song, Y. I., & Sun, Y. (2008). Finding question-answer pairs from online forums. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval \u2013 SIGIR 08, (pp. 467\u2013474)."},{"key":"149_CR3","first-page":"21","volume-title":"Proceedings of the 43rd ACM Technical Symposium on Computer Science Education \u2013 SIGCSE 12","author":"H Danielsiek","year":"2012","unstructured":"Danielsiek, H., Paul, W., & Vahrenhold, J. (2012). Detecting and understanding students\u2019 misconceptions related to algorithms and data structures. In Proceedings of the 43rd ACM Technical Symposium on Computer Science Education \u2013 SIGCSE 12, (pp. 21\u201326)."},{"key":"149_CR4","first-page":"4171","volume":"1","author":"J Devlin","year":"2019","unstructured":"Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1, 4171\u20134186.","journal-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies"},{"key":"149_CR5","first-page":"1","volume-title":"3rd MEC International Conference on Big Data and Smart City (ICBDSC)","author":"V Dhanalakshmi","year":"2016","unstructured":"Dhanalakshmi, V., Bino, D., & Saravanan, A. M. (2016). Opinion mining from student feedback data using supervised learning algorithms. In 3rd MEC International Conference on Big Data and Smart City (ICBDSC), (pp. 1\u20135)."},{"issue":"1","key":"149_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/meet.14504701208","volume":"47","author":"M Efron","year":"2010","unstructured":"Efron, M., & Winget, M. (2010). Questions are content: a taxonomy of questions in a microblogging environment. Proceedings of the American Society for Information Science and Technology, 47(1), 1\u201310.","journal-title":"Proceedings of the American Society for Information Science and Technology"},{"key":"149_CR7","first-page":"1606","volume-title":"Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"M Faruqui","year":"2015","unstructured":"Faruqui, M., Dodge, J., Jauhar, S. K., Dyer, C., Hovy, E. H., & Smith, N. A. (2015). Retrofitting word vectors to semantic lexicons. In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, (pp. 1606\u20131615)."},{"key":"149_CR8","first-page":"1","volume-title":"2017 IEEE Frontiers in Education Conference (FIE)","author":"S Gottipati","year":"2017","unstructured":"Gottipati, S., Shankararaman, V., & Gan, S. (2017). A conceptual framework for analyzing students\u2019 feedback. In 2017 IEEE Frontiers in Education Conference (FIE), (pp. 1\u20138)."},{"key":"149_CR9","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1145\/3230977.3231002","volume-title":"Proceedings of 2018 International Computing Education Research Conference","author":"L Gusukuma","year":"2018","unstructured":"Gusukuma, L., Bart, A. C., Kafura, D., & Ernst, J. (2018). Misconception-driven feedback: results from an experimental study. In Proceedings of 2018 International Computing Education Research Conference, (pp. 160\u2013168)."},{"key":"149_CR10","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.edurev.2013.11.003","volume":"11","author":"K Kori","year":"2014","unstructured":"Kori, K., Pedaste, M., Leijen, \u00c4., & M\u00e4eots, M. (2014). Supporting reflection in technology-enhanced learning. Educational Research Review, 11, 45\u201355.","journal-title":"Educational Research Review"},{"key":"149_CR11","first-page":"1188","volume-title":"Proceedings of the 31st International Conference on Machine Learning","author":"Q Le","year":"2014","unstructured":"Le, Q., & Mikolov, T. (2014). Distributed representations of sentences and documents. In Proceedings of the 31st International Conference on Machine Learning, (pp. 1188\u20131196)."},{"key":"149_CR12","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1016\/j.knosys.2016.04.024","volume":"105","author":"SL Lo","year":"2016","unstructured":"Lo, S. L., Cambria, E., Chiong, R., & Cornforth, D. (2016). A multilingual semi-supervised approach in deriving Singlish sentic patterns for polarity detection. Knowledge-Based Systems, 105, 236\u2013247.","journal-title":"Knowledge-Based Systems"},{"key":"149_CR13","first-page":"252","volume-title":"Proceedings of the 27th International Conference on Computers in Education, I","author":"SL Lo","year":"2019","unstructured":"Lo, S. L., Tan, K. W., & Ouh, E. L. (2019). Do my students understand? Automated identification of doubts from informal reflections. In Proceedings of the 27th International Conference on Computers in Education, I, (pp. 252\u2013262)."},{"issue":"3","key":"149_CR14","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh, M. L. (2012). Interrater reliability: the kappa statistic. Biochemia Medica, 22(3), 276\u2013282.","journal-title":"Biochemia Medica"},{"key":"149_CR15","first-page":"3111","volume-title":"Proceedings of the 26th International Conference on Neural Information Processing System","author":"T Mikolov","year":"2013","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In Proceedings of the 26th International Conference on Neural Information Processing System, (pp. 3111\u20133119)."},{"key":"149_CR16","volume-title":"Macro F1 and Macro F1","author":"J Opitz","year":"2019","unstructured":"Opitz, J., & Burst, S. (2019). Macro F1 and Macro F1.arXiv preprint arXiv:1911.03347."},{"issue":"1","key":"149_CR17","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1108\/JARHE-11-2018-0253","volume":"12","author":"D Ozdemir","year":"2019","unstructured":"Ozdemir, D., Opseth, H. M., & Taylor, H. (2019). Leveraging learning analytics for student reflection and course evaluation. Journal of Applied Research in Higher Education, 12(1), 27\u201337.","journal-title":"Journal of Applied Research in Higher Education"},{"key":"149_CR18","first-page":"1532","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing","author":"J Pennington","year":"2014","unstructured":"Pennington, J., Socher, R., & Manning, C. D. (2014). Glove: global vectors for word representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, (pp. 1532\u20131543)."},{"key":"149_CR19","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.knosys.2014.05.005","volume":"69","author":"S Poria","year":"2014","unstructured":"Poria, S., Cambria, E., Winterstein, G., & Huang, G.-B. (2014). Sentic patterns: dependency-based rules for concept-level sentiment analysis. Knowledge-Based Systems, 69, 45\u201363.","journal-title":"Knowledge-Based Systems"},{"key":"149_CR20","first-page":"261","volume-title":"Proceedings of 25th International Conference on Computers in Education","author":"V Shankararaman","year":"2017","unstructured":"Shankararaman, V., Gottipati, S., Lin, J. R., & Gan, S. (2017). Extracting implicit suggestions from students\u2019 comments \u2013 a text analytics approach. In Proceedings of 25th International Conference on Computers in Education, (pp. 261\u2013269)."},{"key":"149_CR21","unstructured":"Sharp, J. H., & Lang, G. (2018). Agile in teaching and learning: Conceptual framework and research agenda. Journal of Information Systems Education, 29(2):45\u201352."},{"key":"149_CR22","doi-asserted-by":"publisher","first-page":"1015","DOI":"10.1007\/11941439_114","volume-title":"AI 2006: Advances in Artificial Intelligence","author":"M Sokolova","year":"2006","unstructured":"Sokolova, M., Japkowicz, N., & Szpakowicz, S. (2006). Beyond accuracy, F-score and ROC: a family of discriminant measures for performance evaluation. In AI 2006: Advances in Artificial Intelligence, (pp. 1015\u20131021)."},{"issue":"2","key":"149_CR23","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1080\/1360144X.2019.1659797","volume":"25","author":"S Veine","year":"2020","unstructured":"Veine, S., Anderson, M. K., Andersen, N. H., Espenes, T. C., S\u00f8yland, T. B., Wallin, P., & Reams, J. (2020). Reflection as a core student learning activity in higher education\u2014insights from nearly two decades of academic development. International Journal for Academic Development, 25(2), 147\u2013161.","journal-title":"International Journal for Academic Development"},{"key":"149_CR24","first-page":"1155","volume-title":"Proceedings of the 23rd International Conference on Computational Linguistics","author":"K Wang","year":"2010","unstructured":"Wang, K., & Chua, T. S. (2010). Exploiting salient patterns for question detection and question retrieval in community-based question answering. In Proceedings of the 23rd International Conference on Computational Linguistics, (pp. 1155\u20131163)."},{"key":"149_CR25","first-page":"403","volume-title":"Proceedings of IEEE International Conference on Data Mining Workshops","author":"Y Xia","year":"2014","unstructured":"Xia, Y., Li, X., Cambria, E., & Hussain, A. (2014). A localization toolkit for SenticNet. In Proceedings of IEEE International Conference on Data Mining Workshops, (pp. 403\u2013408)."}],"container-title":["Research and Practice in Technology Enhanced Learning"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s41039-021-00149-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s41039-021-00149-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s41039-021-00149-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T22:51:34Z","timestamp":1612824694000},"score":1,"resource":{"primary":{"URL":"https:\/\/telrp.springeropen.com\/articles\/10.1186\/s41039-021-00149-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,8]]},"references-count":25,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["149"],"URL":"https:\/\/doi.org\/10.1186\/s41039-021-00149-9","relation":{},"ISSN":["1793-7078"],"issn-type":[{"value":"1793-7078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,8]]},"assertion":[{"value":"3 July 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 January 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 February 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"1"}}