{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T18:25:56Z","timestamp":1772043956139,"version":"3.50.1"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2020,6,15]],"date-time":"2020-06-15T00:00:00Z","timestamp":1592179200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["61722201, 61720106007, 61832010"],"award-info":[{"award-number":["61722201, 61720106007, 61832010"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"the Funds for Creative Research Groups of China","award":["61921003"],"award-info":[{"award-number":["61921003"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["2019XD-A13"],"award-info":[{"award-number":["2019XD-A13"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2019YFB2102202"],"award-info":[{"award-number":["2019YFB2102202"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100013314","name":"111 Project","doi-asserted-by":"crossref","award":["B18008"],"award-info":[{"award-number":["B18008"]}],"id":[{"id":"10.13039\/501100013314","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2020,6,15]]},"abstract":"<jats:p>For mobile or wearable devices with a small touchscreen, handwriting input (instead of typing on the touchscreen) is highly desirable for efficient human-computer interaction. Previous passive acoustic-based handwriting solutions mainly focus on print-style capital input, which is inconsistent with people's daily habits and thus causes inconvenience. In this paper, we propose WritingRecorder, a novel universal text entry system that enables free-style lowercase handwriting recognition. WritingRecorder leverages the built-in microphone of the smartphones to record the handwritten sound, and then designs an adaptive segmentation method to detect letter fragments in real-time from the recorded sound. Then we design a neural network named Inception-LSTM to extract the hidden and unique acoustic pattern associated with the writing trajectory of each letter and thus classify each letter. Moreover, we adopt a word selection method based on language model, so as to recognize legislate words from all possible letter combinations. We implement WritingRecorder as an APP on mobile phones and conduct the extensive experimental evaluation. The results demonstrate that WritingRecorder works in real-time and can achieve 93.2% accuracy even for new users without collecting and training on their handwriting samples, under a series of practical scenarios.<\/jats:p>","DOI":"10.1145\/3397334","type":"journal-article","created":{"date-parts":[[2020,6,15]],"date-time":"2020-06-15T22:30:37Z","timestamp":1592260237000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":35,"title":["Learning to Recognize Handwriting Input with Acoustic Features"],"prefix":"10.1145","volume":"4","author":[{"given":"Huanpu","family":"Yin","sequence":"first","affiliation":[{"name":"Beijing University of Posts and Telecommunications, Beijing, China"}]},{"given":"Anfu","family":"Zhou","sequence":"additional","affiliation":[{"name":"Beijing University of Posts and Telecommunications, Beijing, China"}]},{"given":"Guangyuan","family":"Su","sequence":"additional","affiliation":[{"name":"Beijing University of Posts and Telecommunications, Beijing, China"}]},{"given":"Bo","family":"Chen","sequence":"additional","affiliation":[{"name":"Beijing University of Posts and Telecommunications, Beijing, China"}]},{"given":"Liang","family":"Liu","sequence":"additional","affiliation":[{"name":"Beijing University of Posts and Telecommunications, Beijing, China"}]},{"given":"Huadong","family":"Ma","sequence":"additional","affiliation":[{"name":"Beijing University of Posts and Telecommunications, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2020,6,15]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338286.3340126"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2015.2492598"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314390"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2011.2134090"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2014.2365723"},{"key":"e_1_2_1_6_1","volume-title":"WordRecorder: Accurate Acoustic-based Handwriting Recognition Using Deep Learning. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications. 1448--1456","author":"Du H."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517351.2517359"},{"key":"e_1_2_1_8_1","volume-title":"Advances in Neural Information Processing Systems 25","author":"Krizhevsky Alex"},{"key":"e_1_2_1_9_1","volume-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 70 (Sept.","author":"Li Sugang","year":"2017"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/2900423.2900657"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2789168.2790122"},{"key":"e_1_2_1_12_1","unstructured":"A. Manashty J. Light and H. Soleimani. 2018. A Concise Temporal Data Representation Model for Prediction in Biomedical Wearable Devices. IEEE Internet of Things Journal (2018) 1--1.  A. Manashty J. Light and H. Soleimani. 2018. A Concise Temporal Data Representation Model for Prediction in Biomedical Wearable Devices. IEEE Internet of Things Journal (2018) 1--1."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2973750.2973755"},{"key":"e_1_2_1_14_1","volume-title":"2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 4207--4215","author":"Molchanov P."},{"key":"e_1_2_1_15_1","unstructured":"Lindasalwa Muda Mumtaj Begam and I. Elamvazuthi. 2010. Voice Recognition Algorithms using Mel Frequency Cepstral Coefficient (MFCC) and Dynamic Time Warping (DTW) Techniques. CoRR abs\/1003.4083 (2010). arXiv:1003.4083  Lindasalwa Muda Mumtaj Begam and I. Elamvazuthi. 2010. Voice Recognition Algorithms using Mel Frequency Cepstral Coefficient (MFCC) and Dynamic Time Warping (DTW) Techniques. CoRR abs\/1003.4083 (2010). arXiv:1003.4083"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742674"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858580"},{"key":"e_1_2_1_18_1","volume-title":"Dropout Improves Recurrent Neural Networks for Handwriting Recognition. In 2014 14th International Conference on Frontiers in Handwriting Recognition. 285--290","author":"Pham V."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2006.872621"},{"key":"e_1_2_1_20_1","volume-title":"CNN-N-Gram for Handwriting Word Recognition. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Poznanski Arik","year":"2016"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2018.8485978"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2015.7218494"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971736"},{"key":"e_1_2_1_24_1","volume-title":"2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 4580--4584","author":"Sainath T. N."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173705"},{"key":"e_1_2_1_26_1","volume-title":"Pen Acoustic Emissions for Text and Gesture Recognition. In 2009 10th International Conference on Document Analysis and Recognition. 872--876","author":"Seniuk A."},{"key":"e_1_2_1_27_1","volume-title":"Benchmarking State-of-the-Art Deep Learning Software Tools. In 2016 7th International Conference on Cloud Computing and Big Data (CCBD). 99--104","author":"Shi S."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210240.3210315"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3241539.3241568"},{"key":"e_1_2_1_30_1","volume-title":"Advances in Neural Information Processing Systems 27","author":"Sutskever Ilya"},{"key":"e_1_2_1_31_1","volume-title":"Rethinking the Inception Architecture for Computer Vision. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2818--2826","author":"Szegedy C."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594368.2594384"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 22Nd Annual International Conference on Mobile Computing and Networking","author":"Wang Wei","year":"2016"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971678"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2016.12.026"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2019.8737470"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2699343.2699350"},{"key":"e_1_2_1_38_1","doi-asserted-by":"crossref","unstructured":"X. Xu J. Yu Y. Chen Y. Zhu and M. Li. 2018. SteerTrack: Acoustic-Based Device-Free Steering Tracking Leveraging Smartphones. In 2018 15th Annual IEEE International Conference on Sensing Communication and Networking (SECON). 1--9. https:\/\/doi.org\/10.1109\/SAHCN.2018.8397115  X. Xu J. Yu Y. Chen Y. Zhu and M. Li. 2018. SteerTrack: Acoustic-Based Device-Free Steering Tracking Leveraging Smartphones. In 2018 15th Annual IEEE International Conference on Sensing Communication and Networking (SECON). 1--9. https:\/\/doi.org\/10.1109\/SAHCN.2018.8397115","DOI":"10.1109\/SAHCN.2018.8397115"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2017.2772253"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2019.2900355"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971681"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742662"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3081333.3081356"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2797044.2797045"},{"key":"e_1_2_1_45_1","volume-title":"Vernier: Accurate and Fast Acoustic Motion Tracking Using Mobile Devices. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications. 1709--1717","author":"Zhang Y.","year":"2018"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2307636.2307638"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131672.3131689"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2660267.2660296"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397334","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3397334","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:12:47Z","timestamp":1750201967000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397334"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,15]]},"references-count":48,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,6,15]]}},"alternative-id":["10.1145\/3397334"],"URL":"https:\/\/doi.org\/10.1145\/3397334","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,15]]},"assertion":[{"value":"2020-06-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}