{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,6]],"date-time":"2026-02-06T22:41:29Z","timestamp":1770417689366,"version":"3.49.0"},"reference-count":47,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T00:00:00Z","timestamp":1640563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Augmented reality (AR) has been widely used in education, particularly for child education. This paper presents the design and implementation of a novel mobile app, Learn2Write, using machine learning techniques and augmented reality to teach alphabet writing. The app has two main features: (i) guided learning to teach users how to write the alphabet and (ii) on-screen and AR-based handwriting testing using machine learning. A learner needs to write on the mobile screen in on-screen testing, whereas AR-based testing allows one to evaluate writing on paper or a board in a real world environment. We implement a novel approach to use machine learning for AR-based testing to detect an alphabet written on a board or paper. It detects the handwritten alphabet using our developed machine learning model. After that, a 3D model of that alphabet appears on the screen with its pronunciation\/sound. The key benefit of our approach is that it allows the learner to use a handwritten alphabet. As we have used marker-less augmented reality, it does not require a static image as a marker. The app was built with ARCore SDK for Unity. We further evaluated and quantified the performance of our app on multiple devices.<\/jats:p>","DOI":"10.3390\/computers11010004","type":"journal-article","created":{"date-parts":[[2021,12,28]],"date-time":"2021-12-28T01:18:15Z","timestamp":1640654295000},"page":"4","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Learn2Write: Augmented Reality and Machine Learning-Based Mobile App to Learn Writing"],"prefix":"10.3390","volume":"11","author":[{"given":"Md. Nahidul Islam","family":"Opu","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Chittagong University of Engineering and Technology, Chottogram 4349, Bangladesh"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Md. Rakibul","family":"Islam","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Chittagong University of Engineering and Technology, Chottogram 4349, Bangladesh"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6798-6535","authenticated-orcid":false,"given":"Muhammad Ashad","family":"Kabir","sequence":"additional","affiliation":[{"name":"Data Science Research Unit, School of Computing, Mathematics and Engineering, Charles Sturt University, Bathurst, NSW 2795, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4545-6872","authenticated-orcid":false,"given":"Md. Sabir","family":"Hossain","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Chittagong University of Engineering and Technology, Chottogram 4349, Bangladesh"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohammad Mainul","family":"Islam","sequence":"additional","affiliation":[{"name":"Verizon Media Australia, Sydney, NSW 2015, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"42","DOI":"10.58680\/ccc198015965","article-title":"The process of writing and the process of learning","volume":"31","author":"Odell","year":"1980","journal-title":"Coll. Compos. Commun."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"588","DOI":"10.3126\/nje.v6i3.15870","article-title":"Evolution of technology in teaching: Blackboard and beyond in Medical Education","volume":"6","author":"Muttappallymyalil","year":"2016","journal-title":"Nepal J. Epidemiol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1145\/159544.159630","article-title":"Interacting with Paper on the DigitalDesk","volume":"36","author":"Wellner","year":"1993","journal-title":"Commun. ACM"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Alvaro, A.K.S., Cruz, R.L.D.D., Fonseca, D.M.T., and Samonte, M.J.C. (2010, January 11\u201312). Basic handwriting instructor for kids using OCR as an Evaluator. Proceedings of the 2010 International Conference on Networking and Information Technology, Manila, Philippines.","DOI":"10.1109\/ICNIT.2010.5508516"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1369","DOI":"10.1007\/s11423-017-9532-3","article-title":"Use of handwriting recognition technologies in tablet-based learning modules for first grade education","volume":"65","author":"Yanikoglu","year":"2017","journal-title":"Educ. Technol. Res. Dev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.compedu.2012.10.024","article-title":"Current status, opportunities and challenges of augmented reality in education","volume":"62","author":"Wu","year":"2013","journal-title":"Comput. Educ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"234","DOI":"10.3991\/ijet.v14i03.9289","article-title":"Augmented Reality and Virtual Reality in education. Myth or reality?","volume":"14","author":"Elmqaddem","year":"2019","journal-title":"Int. J. Emerg. Technol. Learn."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Abrar, M.F., Islam, M.R., Hossain, M.S., Islam, M.M., and Kabir, M.A. (2019). Augmented reality in education: A study on preschool children, parents, and teachers in Bangladesh. International Conference on Human-Computer Interaction, Springer.","DOI":"10.1007\/978-3-030-21565-1_14"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sumadio, D.D., and Rambli, D.R.A. (2010, January 19\u201321). Preliminary evaluation on user acceptance of the augmented reality use for education. Proceedings of the 2010 2nd International Conference on Computer Engineering and Applications, ICCEA 2010, Bali Island, Indonesia.","DOI":"10.1109\/ICCEA.2010.239"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1016\/j.sbspro.2012.06.654","article-title":"Augmented Reality in Education: Current Technologies and the Potential for Education","volume":"47","author":"Kesim","year":"2012","journal-title":"Procedia\u2014Soc. Behav. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Garz\u00f3n, J. (2021). An Overview of Twenty-Five Years of Augmented Reality in Education. Multimodal Technol. Interact., 5.","DOI":"10.3390\/mti5070037"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Aydo\u011fdu, F. (2021). Augmented reality for preschool children: An experience with educational contents. Br. J. Educ. Technol., 23.","DOI":"10.1111\/bjet.13168"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1177\/1836939119885311","article-title":"Augmented reality as a form of digital technology in early childhood education","volume":"45","author":"Madanipour","year":"2020","journal-title":"Australas. J. Early Child."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1080\/19411243.2014.975071","article-title":"A pilot study of the effectiveness of the Handwriting Without Tears\u00ae curriculum in first grade","volume":"7","author":"Hape","year":"2014","journal-title":"J. Occup. Ther. Sch. Early Interv."},{"key":"ref_15","unstructured":"(2021, November 25). RV AppStudios ABC Kids. Available online: http:\/\/www.rvappstudios.com."},{"key":"ref_16","unstructured":"(2021, November 25). ShurjoMukhi Ltd. Hatekhori. Available online: https:\/\/shurjomukhi.com.bd."},{"key":"ref_17","unstructured":"(2021, November 25). Plympton Labs Narrator AR. Available online: https:\/\/www.narratorar.com.au."},{"key":"ref_18","unstructured":"Sybenga, S., and Rybarczyk, Y. (2015, January 12\u201314). Using machine learning and image processing for character recognition: An application for teaching handwriting. Proceedings of the 28th International Conference on Computer Applications in Industry and Engineering, San Diego, CA, USA."},{"key":"ref_19","first-page":"8887","article-title":"A Toolkit for Teaching Arabic Handwriting","volume":"975","author":"Abdou","year":"2012","journal-title":"Int. J. Comput. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1080\/10447318.2010.496335","article-title":"Invisible Marker\u2013Based Augmented Reality","volume":"26","author":"Park","year":"2010","journal-title":"Int. J. Hum.\u2014Comput. Interact."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1016\/j.procs.2018.10.426","article-title":"Bornonet: Bangla handwritten characters recognition using convolutional neural network","volume":"143","author":"Rabby","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1016\/j.procs.2018.10.437","article-title":"Ekushnet: Using convolutional neural network for bangla handwritten recognition","volume":"143","author":"Rabby","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201323). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_26","unstructured":"DevPocket (2021, November 25). iTrace. Available online: https:\/\/itraceapp.com."},{"key":"ref_27","unstructured":"L\u2019Escapadou (2021, November 25). Writing Wizard. Available online: https:\/\/lescapadou.com."},{"key":"ref_28","unstructured":"(2021, November 25). TopOfStack Software Ltd. Kids Learn Bangla Alphabet. Available online: https:\/\/topofstacksoftware.com."},{"key":"ref_29","first-page":"18","article-title":"Preschool children handwriting evaluation on paper-based and tablet-based settings","volume":"17","author":"Aizan","year":"2014","journal-title":"Children"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Maxim, B.R., Patel, N.V., Martineau, N.D., and Schwartz, M. (2007, January 10\u201313). Work in progress-learning via gaming: An immersive environment for teaching kids handwriting. Proceedings of the 2007 37th Annual Frontiers In Education Conference-Global Engineering: Knowledge without Borders, Opportunities Without Passports, Milwaukee, WI, USA.","DOI":"10.1109\/FIE.2007.4417971"},{"key":"ref_31","first-page":"42","article-title":"Arab Kids Tutor (AKT) System For Handwriting Stroke Errors Detection","volume":"4","author":"Loey","year":"2016","journal-title":"Int. J. Technol. Enhanc. Emerg. Eng. Res."},{"key":"ref_32","unstructured":"Iwayama, N., Akiyama, K., Tanaka, H., Tamura, H., and Ishigaki, K. (2004, January 26\u201329). Handwriting-based learning materials on a tablet pc: A prototype and its practical studies in an elementary school. Proceedings of the Ninth International Workshop on Frontiers in Handwriting Recognition, Kokubunji, Japan."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1080\/19411243.2016.1178034","article-title":"Effectiveness of an intensive handwriting program for first grade students using the application LetterSchool: A pilot study","volume":"9","author":"Jordan","year":"2016","journal-title":"J. Occup. Ther. Sch. Early Interv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"101","DOI":"10.4304\/jsw.4.2.101-107","article-title":"A Chinese handwriting education system with automatic error detection","volume":"4","author":"Hu","year":"2009","journal-title":"JSW"},{"key":"ref_35","unstructured":"(2021, October 25). Business Empower Australia Pty Ltd. Bangla Alphabet. Available online: https:\/\/www.businessempoweraustralia.com."},{"key":"ref_36","unstructured":"(2021, August 12). Creative Apps BD Kids Alphabet Learning Made Easy. Available online: https:\/\/play.google.com\/store\/apps\/details?id=com.creativeapps.kids_learning_bangla."},{"key":"ref_37","unstructured":"(2021, November 21). Barracuda Library for Unity. Available online: https:\/\/docs.unity3d.com\/Packages\/com.unity.barracuda@1.0\/manual\/index.html."},{"key":"ref_38","unstructured":"(2021, October 25). AR Core SDK Developed by Google. Available online: https:\/\/github.com\/google-ar\/arcore-unity-sdk."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Oufqir, Z., El Abderrahmani, A., and Satori, K. (2020, January 9\u201311). ARKit and ARCore in serve to augmented reality. Proceedings of the 2020 International Conference on Intelligent Systems and Computer Vision (ISCV), Fez, Morocco.","DOI":"10.1109\/ISCV49265.2020.9204243"},{"key":"ref_40","unstructured":"(2021, October 25). Maya 3D Modeling Software Developed by Autodesk. Available online: https:\/\/www.autodesk.com\/products\/maya\/overview."},{"key":"ref_41","unstructured":"(2021, October 25). AR Core Supported Device List. Available online: https:\/\/developers.google.com\/ar\/devices."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/s10032-011-0148-6","article-title":"CMATERdb1: A database of unconstrained handwritten Bangla and Bangla\u2013English mixed script document image","volume":"15","author":"Sarkar","year":"2012","journal-title":"Int. J. Doc. Anal. Recognit. (IJDAR)"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.dib.2017.03.035","article-title":"Banglalekha-isolated: A multi-purpose comprehensive dataset of handwritten bangla isolated characters","volume":"12","author":"Biswas","year":"2017","journal-title":"Data Brief"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1109\/TPAMI.2008.88","article-title":"Handwritten numeral databases of Indian scripts and multistage recognition of mixed numerals","volume":"31","author":"Bhattacharya","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Rabby, A.S.A., Haque, S., Islam, M.S., Abujar, S., and Hossain, S.A. (2018). Ekush: A Multipurpose and Multitype Comprehensive Database for Online Off-Line Bangla Handwritten Characters. International Conference on Recent Trends in Image Processing and Pattern Recognition, Springer.","DOI":"10.1007\/978-981-13-9187-3_14"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Cohen, G., Afshar, S., Tapson, J., and Van Schaik, A. (2017, January 14\u201319). EMNIST: Extending MNIST to handwritten letters. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.","DOI":"10.1109\/IJCNN.2017.7966217"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"L\u00f3pez-Belmonte, J., Moreno-Guerrero, A.J., L\u00f3pez-N\u00fa\u00f1ez, J.A., and Hinojo-Lucena, F.J. (2020). Augmented reality in education. A scientific mapping in Web of Science. Interact. Learn. Environ., 1\u201315.","DOI":"10.1080\/10494820.2020.1859546"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/11\/1\/4\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:54:15Z","timestamp":1760169255000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/11\/1\/4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,27]]},"references-count":47,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["computers11010004"],"URL":"https:\/\/doi.org\/10.3390\/computers11010004","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,27]]}}}