{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:48:10Z","timestamp":1760233690575,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,2,9]],"date-time":"2021-02-09T00:00:00Z","timestamp":1612828800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>We explore the potential of direct haptic interaction in a novel approach to Tangible Augmented Reality in an educational context. Employing our prototyping platform ACTO, we developed a tabletop Augmented Reality application StARboard for sailing students. In this personal viewpoint environment virtual objects, e.g., sailing ships, are physically represented by actuated micro robots. These align with virtual objects, allowing direct physical interaction with the scene. When a user tries to pick up a virtual ship, its physical robot counterpart is grabbed instead. We also developed a tracking solution TrACTOr, employing a depth sensor to allow tracking independent of the table surface. In this paper we present concept and development of StARboard and TrACTOr. We report results of our user study with 18 participants using our prototype. They show that direct haptic interaction in tabletop AR scores en-par with traditional mouse interaction on a desktop setup in usability (mean SUS = 86.7 vs. 82.9) and performance (mean RTLX = 15.0 vs. 14.8), while outperforming the mouse in factors related to learning like presence (mean 6.0 vs 3.1) and absorption (mean 5.4 vs. 4.2). It was also rated the most fun (13\u00d7 vs. 0\u00d7) and most suitable for learning (9\u00d7 vs. 4\u00d7).<\/jats:p>","DOI":"10.3390\/mti5020006","type":"journal-article","created":{"date-parts":[[2021,2,14]],"date-time":"2021-02-14T02:08:12Z","timestamp":1613268492000},"page":"6","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["StARboard &amp; TrACTOr: Actuated Tangibles in an Educational TAR Application"],"prefix":"10.3390","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3869-9799","authenticated-orcid":false,"given":"Emanuel","family":"Vonach","sequence":"first","affiliation":[{"name":"Institute of Visual Computing and Human-Centered Technology, TU Wien, 1040 Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christoph","family":"Schindler","sequence":"additional","affiliation":[{"name":"Institute of Visual Computing and Human-Centered Technology, TU Wien, 1040 Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0322-9869","authenticated-orcid":false,"given":"Hannes","family":"Kaufmann","sequence":"additional","affiliation":[{"name":"Institute of Visual Computing and Human-Centered Technology, TU Wien, 1040 Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fitzmaurice, G.W., Ishii, H., and Buxton, W.A.S. (1995). Bricks: Laying the foundations for graspable user interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems\u2014CHI \u201995, ACM Press.","DOI":"10.1145\/223904.223964"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ishii, H. (2008, January 18\u201320). Tangible bits: Beyond pixels. Proceedings of the 2nd International Conference on Tangible and Embedded Interaction\u2014TEI \u201908, Bonn, Germany.","DOI":"10.1145\/1347390.1347392"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Poupyrev, I., Nashida, T., and Okabe, M. (2007, January 15\u201317). Actuation and Tangible User Interfaces: The Vaucanson Duck, Robots, and Shape Displays. Proceedings of the 1st International Conference on Tangible and Embedded Interaction\u2014TEI \u201907, Baton Rouge, LA, USA.","DOI":"10.1145\/1226969.1227012"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1109\/TLT.2010.36","article-title":"Benefits of a Tangible Interface for Collaborative Learning and Interaction","volume":"4","author":"Schneider","year":"2011","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Shaer, O., and Hornecker, E. (2010). Tangible User Interfaces: Past, Present, and Future Directions, Now Publishers Inc.","DOI":"10.1561\/9781601983299"},{"key":"ref_6","first-page":"1","article-title":"Tangible augmented reality","volume":"7","author":"Billinghurst","year":"2008","journal-title":"ACM Siggraph Asia"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1109\/TVCG.2017.2745941","article-title":"The Hologram in My Hand: How Effective is Interactive Exploration of 3D Visualizations in Immersive Tangible Augmented Reality?","volume":"24","author":"Bach","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Besan\u00e7on, L., Issartel, P., Ammi, M., and Isenberg, T. (2017, January 6\u201311). Mouse, Tactile, and Tangible Input for 3D Manipulation. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems\u2014CHI\u2019 17, Denver, CO, USA.","DOI":"10.1145\/3025453.3025863"},{"key":"ref_9","unstructured":"Zhou, F., Dun, H.B.L., and Billinghurst, M. (2008, January 15\u201318). Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. Proceedings of the 7th IEEE International Symposium on Mixed and Augmented Reality 2008\u2014ISMAR 2008, Cambridge, UK."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sharlin, E., Watson, B., Kitamura, Y., Kishino, F., and Itoh, Y. (2004). On tangible user interfaces, humans and spatiality. Pers. Ubiquitous Comput.","DOI":"10.1007\/s00779-004-0296-5"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Steptoe, W., Julier, S., and Steed, A. (2014, January 10\u201312). Presence and discernability in conventional and non-photorealistic immersive augmented reality. Proceedings of the IEEE International Symposium on Mixed and Augmented Reality\u2014Science and Technology 2014\u2014ISMAR 2014, Munich, Germany.","DOI":"10.1109\/ISMAR.2014.6948430"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Vonach, E., Gerstweiler, G., and Kaufmann, H. (2014, January 16\u201319). ACTO: A Modular Actuated Tangible User Interface Object. Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces\u2014ITS \u201914, Dresden, Germany.","DOI":"10.1145\/2669485.2669522"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ishii, H., and Ullmer, B. (1997, January 22\u201327). Tangible bits: Towards seamless interfaces between people, bits and atoms. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems\u2014CHI\u2019 97, Atlanta, GA, USA.","DOI":"10.1145\/258549.258715"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"D\u00fcnser, A., Looser, J., Grasset, R., Seichter, H., and Billinghurst, M. (2010, January 7\u201310). Evaluation of Tangible User Interfaces for Desktop AR. Proceedings of the 2010 International Symposium on Ubiquitous Virtual Reality\u2014ISUVR 2010, Gwangju, Korea.","DOI":"10.1109\/ISUVR.2010.19"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Verhaegh, J., Fontijn, W., and Jacobs, A. (2008, January 17\u201319). On the benefits of tangible interfaces for educational games. Proceedings of the 2nd IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning\u2014DIGITEL \u201908, Banff, BC, Canada.","DOI":"10.1109\/DIGITEL.2008.37"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Marshall, P., Price, S., and Rogers, Y. (2003, January 1\u20133). Conceptualising tangibles to support learning. In Proceeding of the 2003 Conference on Interaction Design and Children\u2014IDC \u201903, Preston, UK.","DOI":"10.1145\/953540.953551"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1016\/j.tics.2005.03.006","article-title":"How our hands help us learn","volume":"9","author":"Wagner","year":"2005","journal-title":"Trends Cogn. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Radu, I., and Antle, A. (2017, January 19). Embodied learning mechanics and their relationship to usability of handheld augmented reality. Proceedings of the 2017 IEEE Virtual Reality Workshop on K-12 Embodied Learning through Virtual and Augmented Reality, KELVAR 2017, Los Angeles, CA, USA.","DOI":"10.1109\/KELVAR.2017.7961555"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.edurev.2016.11.002","article-title":"Advantages and challenges associated with augmented reality for education: A systematic review of the literature","volume":"20","author":"Akcayir","year":"2016","journal-title":"Educ. Res. Rev."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Dass, N., Kim, J., Ford, S., Agarwal, S., and Chau, D.H. (2018, January 21\u201326). (Polo) Augmenting Coding. Proceedings of the Sixth International Symposium of Chinese CHI\u2014Chinese CHI \u201918, Montreal, QC, Canada.","DOI":"10.1145\/3202667.3202695"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Shapira, L., Amores, J., and Benavides, X. (2016, January 19\u201323). TactileVR: Integrating Physical Toys into Learn and Play Virtual Reality Experiences. Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality\u2014ISMAR 2016, Merida, Mexico.","DOI":"10.1109\/ISMAR.2016.25"},{"key":"ref_22","first-page":"452","article-title":"Passive real-world interface props for neurosurgical visualization","volume":"Volume 30","author":"Hinckley","year":"1994","journal-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Celebrating Interdependence\u2014CHI \u201994"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Henderson, S.J., and Feiner, S. (2008, January 27\u201329). Opportunistic controls. Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology\u2014VRST \u201908, Bordeaux, France.","DOI":"10.1145\/1450579.1450625"},{"key":"ref_24","unstructured":"Funk, M., Korn, O., and Schmidt, A. (May, January 26). An augmented workplace for enabling user-defined tangibles. Proceedings of the Extended Abstracts of the 32nd Annual ACM Conference on Human Factors in Computing Systems\u2014CHI EA \u201914, Toronto, ON, Canada."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Hettiarachchi, A., and Wigdor, D. (2016, January 7\u201312). Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality. In Proceeding of the SIGCHI Conference on Human Factors in Computing Systems\u2014CHI \u201916, San Jose, CA, USA.","DOI":"10.1145\/2858036.2858134"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kwon, E., Kim, G.J., and Lee, S. (2009, January 19\u201322). Effects of sizes and shapes of props in tangible augmented reality. Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality, Orlando, FL, USA.","DOI":"10.1109\/ISMAR.2009.5336463"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Simeone, A.L., Velloso, E., and Gellersen, H. (2015, January 10\u201315). Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. Proceedings of the ACM Conference on Human Factors in Computing Systems, Seoul, Korea.","DOI":"10.1145\/2702123.2702389"},{"key":"ref_28","unstructured":"Hirota, K., and Hirose, M. (1995, January 11\u201315). Simulation and presentation of curved surface in virtual reality environment through surface display. Proceedings of IEEE Virtual Reality Annual International Symposium \u201995, Research Triangle Park, NC, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Iwata, H., Yano, H., Nakaizumi, F., and Kawamura, R. (2001). Project FEELEX. Proceedings of the 28th annual conference on Computer graphics and Interactive Techniques\u2014SIGGRAPH \u201901, ACM Press.","DOI":"10.1145\/383259.383314"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yamaguchi, K., Kato, G., Kuroda, Y., Kiyokawa, K., and Takemura, H. (2016). A Non-grounded and Encountered-type Haptic Display Using a Drone. Proceedings of the 2016 Symposium on Spatial User Interaction\u2014SUI \u201916, ACM Press.","DOI":"10.1145\/2983310.2985746"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Vonach, E., Gatterer, C., and Kaufmann, H. (2017, January 18\u201322). VRRobot: Robot actuated props in an infinite virtual environment. Proceedings of the IEEE Virtual Reality 2017, Los Angeles, CA, USA.","DOI":"10.1109\/VR.2017.7892233"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/MCG.2004.1255808","article-title":"Physical objects as bidirectional user interface elements","volume":"24","author":"Rosenfeld","year":"2004","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_33","unstructured":"Kojima, M., Sugimoto, M., Nakamura, A., Tomita, M., Inami, M., and Nii, H. (2006, January 5\u20137). Augmented Coliseum: An Augmented Game Environment with Small Vehicles. Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems\u2014TABLETOP \u201906, Adelaide, Australia."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Siu, A.F., Gonzalez, E.J., Yuan, S., Ginsberg, J.B., and Follmer, S. (2018, January 21\u201326). shapeShift: 2D Spatial Manipulation and Self-Actuation of Tabletop Shape Displays for Tangible and Haptic Interaction. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems\u2014CHI \u201918, Montreal, QC, Canada.","DOI":"10.1145\/3173574.3173865"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Kim, L.H., Wang, Y., Le Goc, M., and Follmer, S. (2017, January 10\u201315). Robotic assembly of haptic proxy objects for tangible interaction and virtual reality. Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces\u2014ISS 2017, Atlanta, GA, USA.","DOI":"10.1145\/3132272.3134143"},{"key":"ref_36","first-page":"1","article-title":"Quantifying visually induced motion sickness (VIMS) during stereoscopic 3D viewing using temporal VIMS rating","volume":"2018","author":"Hwang","year":"2018","journal-title":"Electron. Imaging"},{"key":"ref_37","unstructured":"Brooke, J. (1996). SUS: A quick and dirty usability scale. Usability Eval. Ind., 189\u2013194."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Hart, S.G. (2006). NASA-task load index (NASA-TLX) 20 years later. Proceedings of the Human Factors and Ergonomics Society, Sage.","DOI":"10.1037\/e577632012-009"},{"key":"ref_39","unstructured":"Rheinberg, F., Vollmeyer, R., and Engeser, S. (2003). Die Erfassung des Flow-Erlebens [The Assessment of Flow Experience]. Diagnostik von Selbstkonzept, Lernmotivation und Selbstregulation [Diagnosis of Motivation and Self-Concept], Hogrefe-Verlag."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1162\/105474600566989","article-title":"Using Presence Questionnaires in Reality","volume":"9","author":"Usoh","year":"2000","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1037\/h0061470","article-title":"The critical incident technique","volume":"51","author":"Flanagan","year":"1954","journal-title":"Psychol. Bull."},{"key":"ref_42","unstructured":"Sauro, J. (2020, May 26). 5 Ways to Interpret a SUS Score. Available online: https:\/\/measuringu.com\/interpret-sus-score\/."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/5\/2\/6\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:22:00Z","timestamp":1760160120000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/5\/2\/6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,9]]},"references-count":42,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["mti5020006"],"URL":"https:\/\/doi.org\/10.3390\/mti5020006","relation":{},"ISSN":["2414-4088"],"issn-type":[{"type":"electronic","value":"2414-4088"}],"subject":[],"published":{"date-parts":[[2021,2,9]]}}}