{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T01:42:31Z","timestamp":1775612551785,"version":"3.50.1"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,1,15]],"date-time":"2022-01-15T00:00:00Z","timestamp":1642204800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,15]],"date-time":"2022-01-15T00:00:00Z","timestamp":1642204800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Smart Learn. Environ."],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The education system evolves and transforms towards interactive and immersive learning tools in this digital age. Augmented reality has also evolved as a ubiquitous, robust, and effective technology for providing innovative educational tools. In engineering education, many abstract concepts require technological intervention for conceptual understanding and better instructional content. While learning through the immersive tools, system usability has great importance in terms of effectiveness, efficiency, and satisfaction. Effectiveness refers to users' accuracy and completeness in achieving defined goals; efficiency relates to expended resources about the precision and completeness with which users achieve their objectives; satisfaction deals with a positive attitude towards using the product. If the system fails to provide good usability, it may cause adverse effects such as increasing stress, lacking necessary features, increasing the users' cognitive load, and negatively impacting the student's motivation. In this study, two mobile augmented reality (MAR) applications were developed as an instructional tool to teach the students about Karnaugh maps in the digital electronics course. The first application is a Keypad-based MAR application that uses a keypad matrix for user interaction and the second application is a Marker-based MAR application that uses multiple markers to solve K-Map for producing an optimum solution of the given problem. An experimental study was conducted to determine the student's opinion of the developed MAR applications. The study was designed to determine the system usability of the two MAR applications using the System Usability Score (SUS) and Handheld Augmented Reality Usability Score (HARUS) models. 90 engineering students participated in the study, and they were randomly divided into two different groups: keypad-based group and Marker-based group. The keypad-based group included 47 students who had hands-on experience with a keypad-based MAR application, whereas the marker-based group included 43 students who had hands-on experience with multiple marker-based MAR applications. The experimental outcomes indicated that the keypad-based MAR application has better SUS and HARUS scores than the marker-based MAR application which suggests that the keypad-based MAR application has provided better user interaction.<\/jats:p>","DOI":"10.1186\/s40561-022-00189-8","type":"journal-article","created":{"date-parts":[[2022,1,15]],"date-time":"2022-01-15T12:02:43Z","timestamp":1642248163000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":53,"title":["Evaluating system usability of mobile augmented reality application for teaching Karnaugh-Maps"],"prefix":"10.1186","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9686-8936","authenticated-orcid":false,"given":"Rubina","family":"Dutta","sequence":"first","affiliation":[]},{"given":"Archana","family":"Mantri","sequence":"additional","affiliation":[]},{"given":"Gurjinder","family":"Singh","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,1,15]]},"reference":[{"key":"189_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.edurev.2016.11.002","volume":"20","author":"M Ak\u00e7ay\u0131r","year":"2017","unstructured":"Ak\u00e7ay\u0131r, M., & Ak\u00e7ay\u0131r, G. (2017). Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review, 20, 1\u201311.","journal-title":"Educational Research Review"},{"issue":"2","key":"189_CR2","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1007\/s12008-017-0451-7","volume":"12","author":"R De Amicis","year":"2018","unstructured":"De Amicis, R., Ceruti, A., Francia, D., Frizziero, L., & Sim\u00f5es, B. (2018). Augmented Reality for virtual user manual. International Journal on Interactive Design and Manufacturing, 12(2), 689\u2013697.","journal-title":"International Journal on Interactive Design and Manufacturing"},{"issue":"3","key":"189_CR3","doi-asserted-by":"publisher","first-page":"615","DOI":"10.1002\/cae.22102","volume":"27","author":"C Avil\u00e9s-Cruz","year":"2019","unstructured":"Avil\u00e9s-Cruz, C., & Villegas-Cortez, J. (2019). A smartphone-based augmented reality system for university students for learning digital electronics. Computer Applications in Engineering Education, 27(3), 615\u2013630.","journal-title":"Computer Applications in Engineering Education"},{"key":"189_CR4","doi-asserted-by":"crossref","unstructured":"Az-Zahra, H. M., Fauzi, N., & Kharisma, A. P. (2019). Evaluating E-marketplace mobile application based on people at the center of mobile application development (PACMAD) usability model. In Proceedings of 2019 4th international conference on sustainable information engineering and technology, SIET 2019 (pp. 72\u201377).","DOI":"10.1109\/SIET48054.2019.8986067"},{"issue":"4","key":"189_CR5","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1162\/pres.1997.6.4.355","volume":"6","author":"RT Azuma","year":"1997","unstructured":"Azuma, R. T. (1997). A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4), 355\u2013385.","journal-title":"Presence: Teleoperators and Virtual Environments"},{"key":"189_CR6","doi-asserted-by":"publisher","unstructured":"Boonbrahm, P., Kaewrat, C., & Boonbrahm, S. (2016). Learning and collaboration technologies. In Zaphiris, P., Ioannou, A. (Eds.), vol. 9753. Springer, Cham. https:\/\/doi.org\/10.1007\/978-3-319-39483-1.","DOI":"10.1007\/978-3-319-39483-1"},{"key":"189_CR7","unstructured":"Brooke, J. (2020). SUS: A \u2018quick and dirty\u2019 usability scale\u201d. Usability Evaluation In Industry, No. July (pp. 207\u2013212)."},{"issue":"2","key":"189_CR8","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1007\/s00146-007-0127-0","volume":"22","author":"H Cavallin","year":"2007","unstructured":"Cavallin, H., Martin, W. M., & Heylighen, A. (2007). How relative absolute can be: SUMI and the impact of the nature of the task in measuring perceived software usability. AI and Society, 22(2), 227\u2013235.","journal-title":"AI and Society"},{"key":"189_CR9","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.compedu.2017.09.001","volume":"116","author":"CY Chang","year":"2018","unstructured":"Chang, C. Y., Lai, C. L., & Hwang, G. J. (2018). Trends and research issues of mobile learning studies in nursing education: A review of academic publications from 1971 to 2016. Computers and Education, 116, 28\u201348.","journal-title":"Computers and Education"},{"key":"189_CR10","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1016\/j.compedu.2018.06.007","volume":"125","author":"S-C Chang","year":"2018","unstructured":"Chang, S.-C., & Hwang, G.-J. (2018). Impacts of an augmented reality-based flipped learning guiding approach on students\u2019 scientific project performance and perceptions. Computers &amp; Education, 125, 226\u2013239.","journal-title":"Computers & Education"},{"key":"189_CR11","doi-asserted-by":"crossref","unstructured":"Chin, J. P., Diehl, V. A., Norman, K. L. (1988). Development of an instrument measuring user satisfaction of the human-computer interface. In Conference on human factors in computing systems - proceedings, Vol. Part F1302 (pp. 213\u2013218).","DOI":"10.1145\/57167.57203"},{"key":"189_CR31","doi-asserted-by":"publisher","first-page":"586","DOI":"10.1016\/j.compedu.2012.03.002","volume":"68","author":"\u00c1 Di Serio","year":"2013","unstructured":"Di Serio, \u00c1., Ib\u00e1\u00f1ez, M. B., & Kloos, C. D. (2013). Impact of an augmented reality system on students\u2019 motivation for a visual art course. Computers &amp; Education, 68, 586\u2013596.","journal-title":"Computers & Education"},{"issue":"3","key":"189_CR12","doi-asserted-by":"publisher","first-page":"453","DOI":"10.15507\/1991-9468.100.024.202003.453-464","volume":"24","author":"R Dutta","year":"2020","unstructured":"Dutta, R., Mantri, A., Singh, G., Malhotra, S., & Kumar, A. (2020). Impact of flipped learning approach on students motivation for learning digital electronics course. Integration of Education, 24(3), 453\u2013464.","journal-title":"Integration of Education"},{"issue":"6","key":"189_CR13","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1080\/00140139108967347","volume":"34","author":"KD Eason","year":"1991","unstructured":"Eason, K. D. (1991). Ergonomic perspectives on advances in human-computer interaction. Ergonomics, 34(6), 721\u2013741.","journal-title":"Ergonomics"},{"key":"189_CR14","doi-asserted-by":"crossref","unstructured":"Elfaki, A. O., Duan, Y., Bachok, R., Du, W., Johar, M. G. M., & Fong, S. (2013). Towards measuring of e-learning usability through user interface. In Proceedings - 2nd IIAI international conference on advanced applied informatics, IIAI-AAI 2013, No. January (pp. 192\u2013194).","DOI":"10.1109\/IIAI-AAI.2013.17"},{"key":"189_CR15","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1016\/j.compedu.2018.04.011","volume":"123","author":"F Garcia-Sanjuan","year":"2018","unstructured":"Garcia-Sanjuan, F., Jurdi, S., Jaen, J., & Nacher, V. (2018). Evaluating a tactile and a tangible multi-tablet gamified quiz system for collaborative learning in primary education. Computers &amp; Education, 123, 65\u201384.","journal-title":"Computers & Education"},{"key":"189_CR16","unstructured":"Gohiya, P. (n.d.). E-learning during Covid 19 Pandemic (pp. 4\u20139)."},{"key":"189_CR17","doi-asserted-by":"crossref","unstructured":"Horton, S., & Leventhal, L. (2008). Universal usability (pp. 345\u2013355).","DOI":"10.1007\/978-1-84800-050-6_21"},{"issue":"8","key":"189_CR18","doi-asserted-by":"publisher","first-page":"1895","DOI":"10.1080\/10494820.2015.1057747","volume":"24","author":"G-J Hwang","year":"2016","unstructured":"Hwang, G.-J., Wu, P.-H., Chen, C.-C., & Tu, N.-T. (2016). Effects of an augmented reality-based educational game on students\u2019 learning achievements and attitudes in real-world observations. Interactive Learning Environments, 24(8), 1895\u20131906.","journal-title":"Interactive Learning Environments"},{"key":"189_CR19","doi-asserted-by":"publisher","unstructured":"Is, W., Questionnaire, A. S., Of, A., Usability, S. (2016). Chapter 8\u2014standardized usability questionnaires, quantifying the user experience, second edion. https:\/\/doi.org\/10.1016\/B978-0-12-802308-2\/00008-4.","DOI":"10.1016\/B978-0-12-802308-2\/00008-4"},{"issue":"3","key":"189_CR20","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1111\/j.1467-8535.2005.00472.x","volume":"36","author":"A Koohang","year":"2005","unstructured":"Koohang, A., & Ondracek, J. (2005). Users\u2019 views about the usability of digital libraries. British Journal of Educational Technology, 36(3), 407\u2013423.","journal-title":"British Journal of Educational Technology"},{"issue":"1","key":"189_CR21","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1002\/cae.22245","volume":"29","author":"A Kumar","year":"2020","unstructured":"Kumar, A., Mantri, A., & Dutta, R. (2020). Development of an augmented reality-based scaffold to improve the learning experience of engineering students in embedded system course. Computer Applications in Engineering Education, 29(1), 244\u2013257.","journal-title":"Computer Applications in Engineering Education"},{"issue":"1","key":"189_CR22","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1111\/bjet.12716","volume":"50","author":"A-F Lai","year":"2019","unstructured":"Lai, A.-F., Chen, C.-H., & Lee, G.-Y. (2019). An augmented reality-based learning approach to enhancing students\u2019 science reading performances from the perspective of the cognitive load theory. British Journal of Educational Technology, 50(1), 232\u2013247.","journal-title":"British Journal of Educational Technology"},{"issue":"7","key":"189_CR23","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1080\/10447318.2018.1455307","volume":"34","author":"JR Lewis","year":"2018","unstructured":"Lewis, J. R. (2018). The system usability scale: Past, present, and future. International Journal of Human-Computer Interaction, 34(7), 577\u2013590.","journal-title":"International Journal of Human-Computer Interaction"},{"issue":"4","key":"189_CR24","first-page":"181","volume":"10","author":"HK Lin","year":"2011","unstructured":"Lin, H. K., Hsieh, M., Wang, C., Sie, Z., & Chang, S. (2011). Establishment and usability evaluation of an interactive Ar. Turkish Online Journal of Educational Technology, 10(4), 181\u2013187.","journal-title":"Turkish Online Journal of Educational Technology"},{"issue":"62","key":"189_CR25","doi-asserted-by":"publisher","first-page":"650068","DOI":"10.19101\/IJATEE.2019.650068","volume":"7","author":"ZH Majeed","year":"2020","unstructured":"Majeed, Z. H., & Ali, H. A. (2020). A review of augmented reality in educational applications. International Journal of Advanced Technology and Engineering Exploration, 7(62), 650068.","journal-title":"International Journal of Advanced Technology and Engineering Exploration"},{"issue":"1","key":"189_CR26","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1207\/S15327566IJCE0501_4","volume":"5","author":"SJP McDougall","year":"2001","unstructured":"McDougall, S. J. P., Curry, M. B., & de Bruijn, O. (2001). The effects of visual information on users\u2019 mental models: An evaluation of pathfinder analysis as a measure of icon usability. International Journal of Cognitive Ergonomics, 5(1), 59\u201384.","journal-title":"International Journal of Cognitive Ergonomics"},{"key":"189_CR27","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1016\/j.chb.2019.07.020","volume":"100","author":"O Noroozi","year":"2019","unstructured":"Noroozi, O., J\u00e4rvel\u00e4, S., & Kirschner, P. A. (2019). Introduction paper special issue computers in human behavior multidisciplinary innovations and technologies for facilitation of self-regulated learning. Computers in Human Behavior, 100, 295\u2013297.","journal-title":"Computers in Human Behavior"},{"key":"189_CR28","doi-asserted-by":"publisher","DOI":"10.1080\/03772063.2018.1532822","author":"D Prit Kaur","year":"2018","unstructured":"Prit Kaur, D., Mantri, A., & Horan, B. (2018). A framework utilizing augmented reality to enhance the teaching-learning experience of linear control systems. IETE Journal of Research. https:\/\/doi.org\/10.1080\/03772063.2018.1532822","journal-title":"IETE Journal of Research"},{"key":"189_CR29","unstructured":"Santos, M. E. C., & Sandor, C. (2008). A usability scale for handheld augmented reality."},{"key":"189_CR30","doi-asserted-by":"crossref","unstructured":"Selek, M. (2020). Implementation of the augmented reality to electronic practice, No. November 2018 (pp. 1\u201315).","DOI":"10.1002\/cae.22204"},{"issue":"6","key":"189_CR32","doi-asserted-by":"publisher","first-page":"1361","DOI":"10.1002\/cae.22156","volume":"27","author":"G Singh","year":"2019","unstructured":"Singh, G., Mantri, A., Sharma, O., Dutta, R., & Kaur, R. (2019). Evaluating the impact of the augmented reality learning environment on electronics laboratory skills of engineering students. Computer Applications in Engineering Education, 27(6), 1361\u20131375.","journal-title":"Computer Applications in Engineering Education"},{"issue":"1","key":"189_CR33","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1007\/s10956-006-9037-z","volume":"16","author":"KD Squire","year":"2007","unstructured":"Squire, K. D., & Jan, M. (2007). Mad city mystery: Developing scientific argumentation skills with a place-based augmented reality game on handheld computers. Journal of Science Education and Technology, 16(1), 5\u201329.","journal-title":"Journal of Science Education and Technology"},{"key":"189_CR34","unstructured":"Thamarana, S. (2016). Role of E-learning and virtual learning environment in English language learning role of E-learning and virtual learning environment in English. Research Scholar, No. August (Vol. 1, pp. 1\u20138)."},{"key":"189_CR35","doi-asserted-by":"publisher","first-page":"100335","DOI":"10.1016\/j.cosrev.2020.100335","volume":"39","author":"P Vallejo-Correa","year":"2021","unstructured":"Vallejo-Correa, P., Monsalve-Pulido, J., & Tabares-Betancur, M. (2021). Systematic mapping review of context-aware analysis and its approach to mobile learning and ubiquitous learning processe. Computer Science Review, 39, 100335.","journal-title":"Computer Science Review"},{"issue":"5","key":"189_CR36","doi-asserted-by":"publisher","first-page":"1391","DOI":"10.1007\/s12652-017-0547-8","volume":"9","author":"M Wang","year":"2018","unstructured":"Wang, M., Callaghan, V., Bernhardt, J., White, K., & Pe\u00f1a-Rios, A. (2018). Augmented reality in education and training: Pedagogical approaches and illustrative case studies. Journal of Ambient Intelligence and Humanized Computing, 9(5), 1391\u20131402.","journal-title":"Journal of Ambient Intelligence and Humanized Computing"},{"key":"189_CR37","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1016\/j.compedu.2012.10.024","volume":"62","author":"H-K Wu","year":"2013","unstructured":"Wu, H.-K., Lee, S.W.-Y., Chang, H.-Y., & Liang, J.-C. (2013). Current status, opportunities and challenges of augmented reality in education. Computers &amp; Education, 62, 41\u201349.","journal-title":"Computers & Education"},{"key":"189_CR38","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1016\/j.chb.2016.12.085","volume":"70","author":"R Yilmaz","year":"2017","unstructured":"Yilmaz, R. (2017). Exploring the role of e-learning readiness on student satisfaction and motivation in flipped classroom. Computers in Human Behavior, 70, 251\u2013260.","journal-title":"Computers in Human Behavior"}],"container-title":["Smart Learning Environments"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40561-022-00189-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40561-022-00189-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40561-022-00189-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,15]],"date-time":"2022-01-15T12:20:13Z","timestamp":1642249213000},"score":1,"resource":{"primary":{"URL":"https:\/\/slejournal.springeropen.com\/articles\/10.1186\/s40561-022-00189-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,15]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["189"],"URL":"https:\/\/doi.org\/10.1186\/s40561-022-00189-8","relation":{},"ISSN":["2196-7091"],"issn-type":[{"value":"2196-7091","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,15]]},"assertion":[{"value":"25 November 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 January 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration"}},{"value":"The authors declare that they have no competing interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"6"}}