{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T22:36:10Z","timestamp":1776119770941,"version":"3.50.1"},"reference-count":74,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2022,7,4]],"date-time":"2022-07-04T00:00:00Z","timestamp":1656892800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency PRESTO","doi-asserted-by":"crossref","award":["JPMJPR2134"],"award-info":[{"award-number":["JPMJPR2134"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,7,4]]},"abstract":"<jats:p>Conventional motion tutorials rely mainly on a predefined motion and vision-based feedback that normally limits the application scenario and requires professional devices. In this paper, we propose VoLearn, a cross-modal system that provides operability for user-defined motion learning. The system supports the ability to import a desired motion from RGB video and animates the motion in a 3D virtual environment. We built an interface to operate on the input motion, such as controlling the speed, and the amplitude of limbs for the respective directions. With exporting of virtual rotation data, a user can employ a daily device (i.e., smartphone) as a wearable device to train and practice the desired motion according to comprehensive auditory feedback, which is able to provide both temporal and amplitude assessment. The user study demonstrated that the system helps reduce the amplitude and time errors of motion learning. The developed motion-learning system maintains the characteristics of high user accessibility, flexibility, and ubiquity in its application.<\/jats:p>","DOI":"10.1145\/3534576","type":"journal-article","created":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T18:50:18Z","timestamp":1657219818000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["VoLearn"],"prefix":"10.1145","volume":"6","author":[{"given":"Chengshuo","family":"Xia","sequence":"first","affiliation":[{"name":"Keio University, Yokohama, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinrui","family":"Fang","sequence":"additional","affiliation":[{"name":"Keio University, Yokohama, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Riku","family":"Arakawa","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuta","family":"Sugiura","sequence":"additional","affiliation":[{"name":"Keio University, Yokohama, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,7,7]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502045"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445339"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557353"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502056"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1152215.1152222"},{"key":"e_1_2_2_6_1","volume-title":"Motion, Interaction and Games","author":"Canales Ryan","unstructured":"Ryan Canales and Sophie J\u00f6rg. 2020. Performance Is Not Everything: Audio Feedback Preferred Over Visual Feedback for Grasping Task in Virtual Reality. In Motion, Interaction and Games. ACM, New York, NY, USA, 1--6."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376688"},{"key":"e_1_2_2_8_1","volume-title":"OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields","author":"Cao Zhe","year":"2019","unstructured":"Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2019. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. IEEE transactions on pattern analysis and machine intelligence 43, 1 (2019), 172--186."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2494091.2494178"},{"key":"e_1_2_2_10_1","volume-title":"A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities. Research in developmental disabilities 32, 6","author":"Chang Yao-Jen","year":"2011","unstructured":"Yao-Jen Chang, Shu-Fang Chen, and Jun-Da Huang. 2011. A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities. Research in developmental disabilities 32, 6 (2011), 2566--2570."},{"key":"e_1_2_2_11_1","volume-title":"Pose Trainer: correcting exercise posture using pose estimation. arXiv preprint arXiv:2006.11718","author":"Chen Steven","year":"2020","unstructured":"Steven Chen and Richard R Yang. 2020. Pose Trainer: correcting exercise posture using pose estimation. arXiv preprint arXiv:2006.11718 (2020)."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/832289.835983"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415591"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2015.95"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2014.6890243"},{"key":"e_1_2_2_16_1","unstructured":"DeepMotion. 2021. DeepMotion. https:\/\/www.deepmotion.com\/."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909132.2909260"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376851"},{"key":"e_1_2_2_19_1","volume-title":"Age-related differences in corticospinal excitability and inhibition during coordination of upper and lower limbs. Neurobiology of aging 33, 7","author":"Fujiyama Hakuei","year":"2012","unstructured":"Hakuei Fujiyama, Mark R Hinder, Matthew W Schmidt, Michael I Garry, and Jeffery J Summers. 2012. Age-related differences in corticospinal excitability and inhibition during coordination of upper and lower limbs. Neurobiology of aging 33, 7 (2012), 1484-e1."},{"key":"e_1_2_2_20_1","volume-title":"Teaching dance: The spectrum of styles","author":"Gibbons Elizabeth","unstructured":"Elizabeth Gibbons. 2007. Teaching dance: The spectrum of styles. AuthorHouse."},{"key":"e_1_2_2_21_1","unstructured":"GmbH. 2016. Kaia Health. https:\/\/www.kaiahealth.com\/virtual-physical-therapy\/."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3384657.3384658"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3041164.3041194"},{"key":"e_1_2_2_24_1","volume-title":"Advances in psychology.","author":"Hart Sandra G","unstructured":"Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139--183."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971485.2971521"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1519045"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3279778.3279927"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICALT.2017.32"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3139131.3139144"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287063"},{"key":"e_1_2_2_31_1","volume-title":"Amy Chan, and Kimberli Graham.","author":"Kim Seung-Jae","year":"2017","unstructured":"Seung-Jae Kim, Marie Aimee Kayitesi, Amy Chan, and Kimberli Graham. 2017. Effects of partial absence of visual feedback information on gait symmetry. Applied psychophysiology and biofeedback 42, 2 (2017), 107--115."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13414-012-0317-9"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00875"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3010915.3010941"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411841"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCE.2014.6775961"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2007.907481"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450268.3453537"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993369.2996319"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3311823.3311849"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2212776.2223682"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2393408"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/250025.250029"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025688"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2598510.2598519"},{"key":"e_1_2_2_46_1","unstructured":"PumpOne. 2020. FitnessBuilder. https:\/\/www.pumpone.com\/fitnessbuilder\/."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2388676.2388706"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2018.2860579"},{"key":"e_1_2_2_49_1","unstructured":"Seven. 2020. Seven. https:\/\/seven.app\/."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00856.2011"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-012-0333-8"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557251"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207702"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2856767.2856773"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493454"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098279.3098562"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702401"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3399715.3399835"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/CW.2019.00077"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191770"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-20898-5_45"},{"key":"e_1_2_2_62_1","volume-title":"Cognitive load theory in health professional education: design principles and strategies. Medical education 44, 1","author":"Van Merri\u00ebnboer Jeroen JG","year":"2010","unstructured":"Jeroen JG Van Merri\u00ebnboer and John Sweller. 2010. Cognitive load theory in health professional education: design principles and strategies. Medical education 44, 1 (2010), 85--93."},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466171"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2821592.2821607"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123266.3123326"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/2982142.2982160"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2793107.2810336"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415819"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1162\/105474602317473240"},{"key":"e_1_2_2_70_1","volume-title":"Proceedings of the 10th ACM\/IEEE International Conference on Information Processing in Sensor Networks. IEEE","author":"Young Alexander D","year":"2011","unstructured":"Alexander D Young, Martin J Ling, and Damal K Arvind. 2011. IMUSim: A simulation environment for inertial sensing algorithm design and evaluation. In Proceedings of the 10th ACM\/IEEE International Conference on Information Processing in Sensor Networks. IEEE, Long Beach, CA, USA, 199--210."},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3410530.3414329"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01246-5_42"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376516"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01064"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3534576","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3534576","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T04:31:12Z","timestamp":1752467472000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3534576"}},"subtitle":["A Cross-Modal Operable Motion-Learning System Combined with Virtual Avatar and Auditory Feedback"],"short-title":[],"issued":{"date-parts":[[2022,7,4]]},"references-count":74,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,7,4]]}},"alternative-id":["10.1145\/3534576"],"URL":"https:\/\/doi.org\/10.1145\/3534576","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,4]]},"assertion":[{"value":"2022-07-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}