{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:22:03Z","timestamp":1776111723244,"version":"3.50.1"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T00:00:00Z","timestamp":1640563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["Nos. 61832008, 61872174, 61802169, 61902175"],"award-info":[{"award-number":["Nos. 61832008, 61872174, 61802169, 61902175"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004608","name":"JiangSu Natural Science Foundation","doi-asserted-by":"crossref","award":["Nos. BK20180325, BK20190293"],"award-info":[{"award-number":["Nos. BK20180325, BK20190293"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"crossref"}]},{"name":"The Key K&D Program of Jiangsu Province","award":["BE2020001-3"],"award-info":[{"award-number":["BE2020001-3"]}]},{"name":"Hong Kong RGC Research Impact Fund","award":["No. R5060-19"],"award-info":[{"award-number":["No. R5060-19"]}]},{"name":"Hong Kong RGC Collaborative Research Fund","award":["No. C6030-18G"],"award-info":[{"award-number":["No. C6030-18G"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2021,12,27]]},"abstract":"<jats:p>Pen-based handwriting has become one of the major human-computer interaction methods. Traditional approaches either require writing on the specific supporting device like the touch screen, or limit the way of using the pen to pure rotation or translation. In this paper, we propose Handwriting-Assistant, to capture the free handwriting of ordinary pens on regular planes with mm-level accuracy. By attaching the inertial measurement unit (IMU) to the pen tail, we can infer the handwriting on the notebook, blackboard or other planes. Particularly, we build a generalized writing model to correlate the rotation and translation of IMU with the tip displacement comprehensively, thereby we can infer the tip trace accurately. Further, to display the effective handwriting during the continuous writing process, we leverage the principal component analysis (PCA) based method to detect the candidate writing plane, and then exploit the distance variation of each segment relative to the plane to distinguish on-plane strokes. Moreover, our solution can apply to other rigid bodies, enabling smart devices embedded with IMUs to act as handwriting tools. Experiment results show that our approach can capture the handwriting with high accuracy, e.g., the average tracking error is 1.84mm for letters with the size of about 2cmx1cm, and the average character recognition rate of recovered single letters achieves 98.2% accuracy of the ground-truth recorded by touch screen.<\/jats:p>","DOI":"10.1145\/3494956","type":"journal-article","created":{"date-parts":[[2021,12,30]],"date-time":"2021-12-30T17:40:33Z","timestamp":1640886033000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Handwriting-Assistant"],"prefix":"10.1145","volume":"5","author":[{"given":"Yanling","family":"Bu","sequence":"first","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"given":"Lei","family":"Xie","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"given":"Yafeng","family":"Yin","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"given":"Chuyu","family":"Wang","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"given":"Jingyi","family":"Ning","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"given":"Jiannong","family":"Cao","sequence":"additional","affiliation":[{"name":"The Hong Kong Polytechnic University, Hong Kong, China"}]},{"given":"Sanglu","family":"Lu","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]}],"member":"320","published-online":{"date-parts":[[2021,12,30]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2021. Anoto Livescribe Smartpen. https:\/\/www.anoto.com\/solutions\/livescribe\/.  2021. Anoto Livescribe Smartpen. https:\/\/www.anoto.com\/solutions\/livescribe\/."},{"key":"e_1_2_1_2_1","unstructured":"2021. Apple Pencil. https:\/\/www.apple.com\/apple-pencil\/.  2021. Apple Pencil. https:\/\/www.apple.com\/apple-pencil\/."},{"key":"e_1_2_1_3_1","unstructured":"2021. BOSCH. https:\/\/www.bosch-sensortec.com\/products\/motion-sensors\/imus\/.  2021. BOSCH. https:\/\/www.bosch-sensortec.com\/products\/motion-sensors\/imus\/."},{"key":"e_1_2_1_4_1","unstructured":"2021. Google IME. https:\/\/www.google.com\/inputtools\/try\/.  2021. Google IME. https:\/\/www.google.com\/inputtools\/try\/."},{"key":"e_1_2_1_5_1","unstructured":"2021. InvenSense. https:\/\/invensense.tdk.com\/products\/motion-tracking\/6-axis\/.  2021. InvenSense. https:\/\/invensense.tdk.com\/products\/motion-tracking\/6-axis\/."},{"key":"e_1_2_1_6_1","unstructured":"2021. LP-RESEARCH. https:\/\/lp-research.com\/9-axis-bluetooth-imu-lpmsb2-series\/.  2021. LP-RESEARCH. https:\/\/lp-research.com\/9-axis-bluetooth-imu-lpmsb2-series\/."},{"key":"e_1_2_1_7_1","unstructured":"2021. MATLAB-pca. https:\/\/ww2.mathworks.cn\/help\/stats\/pca.html?lang=en.  2021. MATLAB-pca. https:\/\/ww2.mathworks.cn\/help\/stats\/pca.html?lang=en."},{"key":"e_1_2_1_8_1","unstructured":"2021. MyScript. https:\/\/developer.myscript.com\/.  2021. MyScript. https:\/\/developer.myscript.com\/."},{"key":"e_1_2_1_9_1","unstructured":"2021. OptiTrack. https:\/\/optitrack.com\/.  2021. OptiTrack. https:\/\/optitrack.com\/."},{"key":"e_1_2_1_10_1","unstructured":"2021. Samsung S Pen. https:\/\/www.samsung.com\/us\/mobile\/mobile-accessories\/phones\/galaxy-note10-s-pen-black-ej-pn970bbegus\/.  2021. Samsung S Pen. https:\/\/www.samsung.com\/us\/mobile\/mobile-accessories\/phones\/galaxy-note10-s-pen-black-ej-pn970bbegus\/."},{"key":"e_1_2_1_11_1","unstructured":"2021. STMicroelectronics. https:\/\/www.st.com\/en\/mems-and-sensors\/inemo-inertial-modules.html.  2021. STMicroelectronics. https:\/\/www.st.com\/en\/mems-and-sensors\/inemo-inertial-modules.html."},{"key":"e_1_2_1_12_1","unstructured":"2021. Wacom Intuos Pro. https:\/\/www.wacom.com\/en-us\/products\/pen-tablets\/wacom-intuos-pro.  2021. Wacom Intuos Pro. https:\/\/www.wacom.com\/en-us\/products\/pen-tablets\/wacom-intuos-pro."},{"key":"e_1_2_1_13_1","volume-title":"Ninth International Workshop on Frontiers in Handwriting Recognition. IEEE, 106--111","author":"Cho Sung-Jung","year":"2004","unstructured":"Sung-Jung Cho , Jong Koo Oh , Won-Chul Bang , Wook Chang , Eunseok Choi , Yang Jing , Joonkee Cho , and Dong Yoon Kim . 2004 . Magic wand: a hand-drawn gesture input device in 3-D space with inertial sensors . In Ninth International Workshop on Frontiers in Handwriting Recognition. IEEE, 106--111 . Sung-Jung Cho, Jong Koo Oh, Won-Chul Bang, Wook Chang, Eunseok Choi, Yang Jing, Joonkee Cho, and Dong Yoon Kim. 2004. Magic wand: a hand-drawn gesture input device in 3-D space with inertial sensors. In Ninth International Workshop on Frontiers in Handwriting Recognition. IEEE, 106--111."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2014.2365723"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBIO.2007.4522192"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2018.8486285"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/BTAS.2017.8272701"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBIOM.2019.2912401"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2017.8057208"},{"key":"e_1_2_1_20_1","volume-title":"S-Pencil: A Smart Pencil Grip Monitoring System for Kids Using Sensors. In GLOBECOM 2017-2017 IEEE Global Communications Conference. IEEE, 1--6.","author":"Gupta Prakhar","year":"2017","unstructured":"Prakhar Gupta , Rishabh Agarwal , Surbhi Saraswat , Hari Prabhat Gupta , and Tanima Dutta . 2017 . S-Pencil: A Smart Pencil Grip Monitoring System for Kids Using Sensors. In GLOBECOM 2017-2017 IEEE Global Communications Conference. IEEE, 1--6. Prakhar Gupta, Rishabh Agarwal, Surbhi Saraswat, Hari Prabhat Gupta, and Tanima Dutta. 2017. S-Pencil: A Smart Pencil Grip Monitoring System for Kids Using Sensors. In GLOBECOM 2017-2017 IEEE Global Communications Conference. IEEE, 1--6."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3300061.3300117"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340555.3353740"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2017.219"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647376"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264929"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161412"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386901.3389030"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.06.034"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411842"},{"key":"e_1_2_1_30_1","first-page":"261","article-title":"Handwriting trajectory reconstruction using low-cost imu","volume":"3","author":"Pan Tse-Yu","year":"2018","unstructured":"Tse-Yu Pan , Chih-Hsuan Kuo , Hou-Tim Liu , and Min-Chun Hu . 2018 . Handwriting trajectory reconstruction using low-cost imu . IEEE Transactions on Emerging Topics in Computational Intelligence 3 , 3 (2018), 261 -- 270 . Tse-Yu Pan, Chih-Hsuan Kuo, Hou-Tim Liu, and Min-Chun Hu. 2018. Handwriting trajectory reconstruction using low-cost imu. IEEE Transactions on Emerging Topics in Computational Intelligence 3, 3 (2018), 261--270.","journal-title":"IEEE Transactions on Emerging Topics in Computational Intelligence"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173705"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397309"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2019.8737633"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2789168.2790121"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIE.2009.2038339"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3317549.3319722"},{"key":"e_1_2_1_38_1","volume-title":"Echowrite: An acoustic-based finger input system without training","author":"Wu Kaishun","year":"2020","unstructured":"Kaishun Wu , Qiang Yang , Baojie Yuan , Yongpan Zou , Rukhsana Ruby , and Mo Li . 2020 . Echowrite: An acoustic-based finger input system without training . IEEE Transactions on Mobile Computing ( 2020). Kaishun Wu, Qiang Yang, Baojie Yuan, Yongpan Zou, Rukhsana Ruby, and Mo Li. 2020. Echowrite: An acoustic-based finger input system without training. IEEE Transactions on Mobile Computing (2020)."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFCOMW.2018.8406879"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2018.2859246"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2699343.2699350"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397334"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3317687"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971681"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2019.2947448"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3494956","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3494956","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:59Z","timestamp":1750191539000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3494956"}},"subtitle":["Reconstructing Continuous Strokes with Millimeter-level Accuracy via Attachable Inertial Sensors"],"short-title":[],"issued":{"date-parts":[[2021,12,27]]},"references-count":44,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,12,27]]}},"alternative-id":["10.1145\/3494956"],"URL":"https:\/\/doi.org\/10.1145\/3494956","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,27]]},"assertion":[{"value":"2021-12-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}