{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T11:12:19Z","timestamp":1783941139543,"version":"3.55.0"},"reference-count":42,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2024,2,4]],"date-time":"2024-02-04T00:00:00Z","timestamp":1707004800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This study investigates the feasibility and functionality of accelerometer and gyroscope sensors for gesture-based interactions in mobile app user experience. The core of this innovative approach lies in introducing a dynamic and intuitive user interaction model with the device sensors. The Android app developed for this purpose has been created for its use in controlled experiments. Methodologically, it was created as a stand-alone tool to both capture quantitative (time, automatically captured) and qualitative (behavior, collected with post-task questionnaires) variables. The app\u2019s setting features a set of modules with two levels each (randomized presentation applied, minimizing potential learning effects), allowing users to interact with both sensor-based and traditional touch-based scenarios. Preliminary results with 22 participants reveal that tasks involving sensor-based interactions tend to take longer to complete when compared to the traditional ones. Remarkably, many participants rated sensor-based interactions as a better option than touch-based interactions, as seen in the post-task questionnaires. This apparent discrepancy between objective completion times and subjective user perceptions requires a future in-depth exploration of factors influencing user experiences, including potential learning curves, cognitive load, and task complexity. This study contributes to the evolving landscape of mobile app user experience, emphasizing the benefits of considering the integration of device sensors (and gesture-based interactions) in common mobile usage.<\/jats:p>","DOI":"10.3390\/s24031004","type":"journal-article","created":{"date-parts":[[2024,2,5]],"date-time":"2024-02-05T03:28:29Z","timestamp":1707103709000},"page":"1004","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Gesture-Based Interactions: Integrating Accelerometer and Gyroscope Sensors in the Use of Mobile Apps"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3192-8499","authenticated-orcid":false,"given":"Sergio","family":"Caro-Alvaro","sequence":"first","affiliation":[{"name":"Universidad de Alcal\u00e1, Departamento de Ciencias de la Computaci\u00f3n, 28805 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7598-3289","authenticated-orcid":false,"given":"Eva","family":"Garcia-Lopez","sequence":"additional","affiliation":[{"name":"Universidad de Alcal\u00e1, Departamento de Ciencias de la Computaci\u00f3n, 28805 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-5666-6142","authenticated-orcid":false,"given":"Alexander","family":"Brun-Guajardo","sequence":"additional","affiliation":[{"name":"Universidad de Alcal\u00e1, Departamento de Ciencias de la Computaci\u00f3n, 28805 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0298-3237","authenticated-orcid":false,"given":"Antonio","family":"Garcia-Cabot","sequence":"additional","affiliation":[{"name":"Universidad de Alcal\u00e1, Departamento de Ciencias de la Computaci\u00f3n, 28805 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5076-5891","authenticated-orcid":false,"given":"Aekaterini","family":"Mavri","sequence":"additional","affiliation":[{"name":"Cyprus Interaction Lab, Department of Multimedia and Graphic Arts, Cyprus University of Technology, 30 Archbishop Kyprianou Str., Limassol 3036, Cyprus"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,2,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chen, Y., and Rong, H. (2023). A Customized Extended Kalman Filter for Removing the Impact of the Magnetometer&rsquo;s Measurements on Inclination Determination. Sensors, 23.","DOI":"10.3390\/s23249756"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Fan, B., Li, Q., Wang, C., and Liu, T. (2017). An Adaptive Orientation Estimation Method for Magnetic and Inertial Sensors in the Presence of Magnetic Disturbances. Sensors, 17.","DOI":"10.3390\/s17051161"},{"key":"ref_3","unstructured":"XDA-Developers (2021, September 09). Sensors in Moto G 3rd Gen. Available online: https:\/\/forum.xda-developers.com\/t\/sensors-in-moto-g-3rd-gen.3169020\/."},{"key":"ref_4","unstructured":"Google (2021, September 09). Android Compatibility Definition. Available online: https:\/\/source.android.com\/compatibility\/android-cdd."},{"key":"ref_5","unstructured":"Apple (2021, September 09). iPhone\u2014Technical Specifications. Available online: https:\/\/support.apple.com\/kb\/SP2."},{"key":"ref_6","unstructured":"Apple (2021, September 09). iPhone 4\u2014Technical Specifications. Available online: https:\/\/support.apple.com\/kb\/SP587."},{"key":"ref_7","unstructured":"Dix, A. (2009). Encyclopedia of Database Systems, Springer."},{"key":"ref_8","unstructured":"(2009). Ergonomics of Human System Interaction\u2014Part 210: Human-Centred Design for Interactive Systems (Standard No. ISO 9241\u2013210:2010)."},{"key":"ref_9","unstructured":"Norman, D., and Nielsen, J. (2018, June 28). The Definition of User Experience (UX). Available online: https:\/\/www.nngroup.com\/articles\/definition-user-experience\/."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Law, E.L.C., Roto, V., Hassenzahl, M., Vermeeren, A.P., and Kort, J. (2009, January 4\u20139). Understanding, scoping and defining user experience: A survey approach. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA.","DOI":"10.1145\/1518701.1518813"},{"key":"ref_11","unstructured":"(1998). Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs)\u2014Part 11: Guidance on Usability (Standard No. ISO 9241-11:1998)."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1145\/3511892","article-title":"Metaphoraction: Support Gesture-based Interaction Design with Metaphorical Meanings","volume":"29","author":"Sun","year":"2022","journal-title":"ACM Trans. Comput. -Hum. Interact."},{"key":"ref_13","unstructured":"Meyer, A. (2020). Using Gyroscopes to Enhance Motion Detection, Valparaiso University."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"118","DOI":"10.31681\/jetol.615499","article-title":"Augmented reality: Historical development and area of usage","volume":"2","year":"2019","journal-title":"J. Educ. Technol. Online Learn."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"138","DOI":"10.55524\/ijircst.2022.10.6.21","article-title":"Development of Android-Based Mobile Application Using Gyroscope Sensor","volume":"10","author":"Sushil","year":"2022","journal-title":"Int. J. Innov. Res. Comput. Sci. Technol."},{"key":"ref_16","unstructured":"Pogue, D. (2015). iPhone: The Missing Manual, O\u2019Reilly Media, Inc.. [9th ed.]."},{"key":"ref_17","unstructured":"(2010). Undefined. Shake to undo in iOS. In Mac OSX Hints."},{"key":"ref_18","unstructured":"Wikipedia (2021, September 08). iOS 9\u2014Build 13A340. Available online: https:\/\/en.wikipedia.org\/wiki\/IOS_version_history."},{"key":"ref_19","unstructured":"Apple (2021, September 10). iPhone OS 3.0 Software Update. Available online: www.apple.com\/iphone\/softwareupdate\/."},{"key":"ref_20","unstructured":"Ville-Immonen (2021, September 10). MouseMote AirRemote. Available online: https:\/\/play.google.com\/store\/apps\/details?id=com.vi.mousemote."},{"key":"ref_21","unstructured":"Terminal-Eleven-LLC (2021, September 10). SkyView. Available online: https:\/\/apps.apple.com\/us\/app\/skyview\/id404990064."},{"key":"ref_22","first-page":"45","article-title":"Perceptual user interfaces: Multimodal interfaces that process what comes naturally","volume":"43","author":"Oviatt","year":"2000","journal-title":"Commun. ACM"},{"key":"ref_23","unstructured":"Hare, J., Karam, M., and Lewis, P. (2005). iGesture: A Platform for Investigating Multimodal, Multimedia Gesture-Based Interactions, University of Southampton."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Banu, R.A., Al Siyabi, W.S.A., and Al Minje, Y. (2021, January 24\u201326). A conceptual review on integration of cognitive load theory and human-computer interaction. Proceedings of the 2021 International Conference on Software Engineering & Computer Systems and 4th International Conference on Computational Science and Information Management (ICSECS-ICOCSIM), Pekan, Malaysia.","DOI":"10.1109\/ICSECS52883.2021.00127"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3582272","article-title":"A survey on measuring cognitive workload in human-computer interaction","volume":"55","author":"Kosch","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"e2208","DOI":"10.2196\/jmir.2208","article-title":"Classification accuracies of physical activities using smartphone motion sensors","volume":"14","author":"Wu","year":"2012","journal-title":"J. Med. Internet Res."},{"key":"ref_27","first-page":"44","article-title":"The mobifall dataset: Fall detection and classification with a smartphone","volume":"2","author":"Vavoulas","year":"2014","journal-title":"Int. J. Monit. Surveill. Technol. Res."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Douangphachanh, V., and Oneyama, H. (2014, January 2\u20134). Exploring the use of smartphone accelerometer and gyroscope to study on the estimation of road surface roughness condition. Proceedings of the 2014 11th International Conference on Informatics in Control, Automation and Robotics (ICINCO), Vienna, Austria.","DOI":"10.5220\/0005117407830787"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hern\u00e1ndez S\u00e1nchez, S., Fern\u00e1ndez Pozo, R., and Hern\u00e1ndez G\u00f3mez, L.A. (2018). Estimating Vehicle Movement Direction from Smartphone Accelerometers Using Deep Neural Networks. Sensors, 18.","DOI":"10.3390\/s18082624"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kos, A., Toma\u017ei\u010d, S., and Umek, A. (2016). Suitability of smartphone inertial sensors for real-time biofeedback applications. Sensors, 16.","DOI":"10.3390\/s16030301"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Umek, A., Kos, A., and Tomaic, S. (2015, January 22\u201323). Validation of smartphone gyroscopes for angular tracking in biofeedback applications. Proceedings of the 2015 International Conference on Identification, Information, and Knowledge in the Internet of Things (IIKI), Beijing, China.","DOI":"10.1109\/IIKI.2015.70"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1016\/j.protcy.2013.12.285","article-title":"On the best sensor for keystrokes inference attack on android","volume":"11","author":"Ismail","year":"2013","journal-title":"Procedia Technol."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Chang, Y., L\u2019Yi, S., Koh, K., and Seo, J. (2015, January 18\u201323). Understanding users\u2019 touch behavior on large mobile touch-screens and assisted targeting by tilting gesture. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Republic of Korea.","DOI":"10.1145\/2702123.2702425"},{"key":"ref_34","unstructured":"Lee, H., Yoong, A.C.H., Lui, S., Vaniyar, A., and Balasubramanian, G. (December, January 29). Design exploration for the \u201csqueezable\u201d interaction. Proceedings of the 28th Australian Conference on Computer-Human Interaction, Launceston, Tasmania, Australia."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Huang, Z., Li, W., and Hui, P. (2015, January 26\u201330). Ubii: Towards seamless interaction between digital and physical worlds. Proceedings of the 23rd ACM international conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2806266"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"79","DOI":"10.3233\/AIS-2012-0137","article-title":"Nomadic gestures: A technique for reusing gesture commands for frequent ambient interactions","volume":"4","author":"Vatavu","year":"2012","journal-title":"J. Ambient. Intell. Smart Environ."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Di Geronimo, L., Husmann, M., Patel, A., Tuerk, C., and Norrie, M.C. (2016, January 6\u20139). CTAT: Tilt-and-tap across devices. Proceedings of the International Conference on Web Engineering, Lugano, Switzerland.","DOI":"10.1007\/978-3-319-38791-8_6"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"22","DOI":"10.4018\/IJMHCI.2020010102","article-title":"Framing the design space of multimodal mid-air gesture and speech-based interaction with mobile devices for older people","volume":"12","author":"Mich","year":"2020","journal-title":"Int. J. Mob. Hum. Comput. Interact. (IJMHCI)"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Boring, S., Jurmu, M., and Butz, A. (2009, January 23\u201327). Scroll, tilt or move it: Using mobile phones to continuously control pointers on large public displays. Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24\/7, Melbourne, Australia.","DOI":"10.1145\/1738826.1738853"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Serackis, A., Miniotas, D., Katkevi\u010dius, A., Krukonis, A., and Plonis, D. (2016, January 20\u201322). The study of extraneous conditions that affect tilt-based pointer movements. Proceedings of the 11th International Conference Biomdlore, Druskininkai, Lithuania.","DOI":"10.3846\/biomdlore.2016.24"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yu, S.-B., Yoon, H., Park, S.-H., and Lee, K.-T. (2017, January 3\u20136). Motion UI: Motion-based user interface for movable wrist-worn devices. Proceedings of the 2017 IEEE 7th International Conference on Consumer Electronics-Berlin (ICCE-Berlin), Berlin, Germany.","DOI":"10.1109\/ICCE-Berlin.2017.8210647"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Grossman, T., Fitzmaurice, G., and Attar, R. (2009, January 4\u20139). A survey of software learnability: Metrics, methodologies and guidelines. Proceedings of the CHI \u203209: SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA.","DOI":"10.1145\/1518701.1518803"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/3\/1004\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:54:42Z","timestamp":1760104482000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/3\/1004"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,4]]},"references-count":42,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["s24031004"],"URL":"https:\/\/doi.org\/10.3390\/s24031004","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,4]]}}}