{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T17:32:49Z","timestamp":1783791169082,"version":"3.55.0"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T00:00:00Z","timestamp":1648512000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2018AAA0101501"],"award-info":[{"award-number":["2018AAA0101501"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Science and Technology project of SGCC (State Grid Corporation of China): fundamental theory of human-in-the-loop hybrid-augmented Intelligence for power grid dispatch and control"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,3,29]]},"abstract":"<jats:p>Recent research demonstrates the potential of touch dynamics as a usable and privacy-preserving scheme for smartphone authentication. Most existing approaches rely on handcrafted features since deep models may be vulnerable to behavioral uncertainty due to the lack of consistent semantic information. Toward this end, we propose an approach to integrating handcrafted features into two phases of the deep learning process. On one hand, we present three fine-grained behavior representations by encoding semantic handcrafted features into the raw touch actions. On the other hand, we devise a deep Feature Regularization Net (FRN) architecture to combine the complementary information in both handcrafted and deep features. FRN involves handcrafted features as regularization to guide the learning process of deep features and selectively fuses these two feature types through a feature re-weighting mechanism. Experimental findings demonstrate that FRN outperforms the existing handcrafted or deep features even with smaller training and template sets. The framework also works for SOTA deep models and further boosts the accuracy. Results show that our approach is more reliable to alleviate behavioral variability and is competitively robust to statistical attacks compared with the most effective handcrafted features, suggesting a promising mechanism to improve the effectiveness and usability of behavioral authentication for multi-touch enabled mobile devices.<\/jats:p>","DOI":"10.1145\/3517332","type":"journal-article","created":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T13:42:46Z","timestamp":1648561366000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Integrating Handcrafted Features with Deep Representations for Smartphone Authentication"],"prefix":"10.1145","volume":"6","author":[{"given":"Yunpeng","family":"Song","sequence":"first","affiliation":[{"name":"MOE KLINNS Lab, Xi'an Jiaotong University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhongmin","family":"Cai","sequence":"additional","affiliation":[{"name":"MOE KLINNS Lab, Xi'an Jiaotong University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,3,29]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.3020076"},{"key":"e_1_2_1_2_1","volume-title":"Typenet: Scaling up keystroke biometrics. arXiv preprint arXiv:2004.03627","author":"Acien Alejandro","year":"2020","unstructured":"Alejandro Acien, John V Monaco, Aythami Morales, Ruben Vera-Rodriguez, and Julian Fierrez. 2020. Typenet: Scaling up keystroke biometrics. arXiv preprint arXiv:2004.03627 (2020)."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.protcy.2016.01.061"},{"key":"e_1_2_1_4_1","first-page":"1","article-title":"Smudge attacks on smartphone touch screens","volume":"10","author":"Aviv Adam J","year":"2010","unstructured":"Adam J Aviv, Katherine L Gibson, Evan Mossop, Matt Blaze, and Jonathan M Smith. 2010. Smudge attacks on smartphone touch screens. Woot 10 (2010), 1--7.","journal-title":"Woot"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/BTAS.2018.8698539"},{"key":"e_1_2_1_6_1","volume-title":"Neural networks: Tricks of the trade","author":"Bottou L\u00e9on","unstructured":"L\u00e9on Bottou. 2012. Stochastic gradient descent tricks. In Neural networks: Tricks of the trade. Springer, 421--436."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-02961-0_48"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01079"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2015.7218660"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2019.2945467"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2019.2930429"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208544"},{"key":"e_1_2_1_13_1","unstructured":"Google Developers. [n.d.]. Android API reference. https:\/\/developer.android.com\/reference"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01352"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/IACS.2015.7103185"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2018.2833042"},{"key":"e_1_2_1_17_1","volume-title":"Touchalytics: On the applicability of touchscreen input as a behavioral biometric for continuous authentication","author":"Frank Mario","year":"2012","unstructured":"Mario Frank, Ralf Biedert, Eugene Ma, Ivan Martinovic, and Dawn Song. 2012. Touchalytics: On the applicability of touchscreen input as a behavioral biometric for continuous authentication. IEEE transactions on information forensics and security 8, 1 (2012), 136--148."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.09.005"},{"key":"e_1_2_1_19_1","volume-title":"Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural networks 18, 5-6","author":"Graves Alex","year":"2005","unstructured":"Alex Graves and J\u00fcrgen Schmidhuber. 2005. Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural networks 18, 5-6 (2005), 602--610."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_21_1","volume-title":"Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531","author":"Hinton Geoffrey","year":"2015","unstructured":"Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015)."},{"key":"e_1_2_1_22_1","volume-title":"Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861","author":"Howard Andrew G","year":"2017","unstructured":"Andrew G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)."},{"key":"e_1_2_1_23_1","volume-title":"Visualizing and understanding recurrent networks. arXiv preprint arXiv:1506.02078","author":"Karpathy Andrej","year":"2015","unstructured":"Andrej Karpathy, Justin Johnson, and Li Fei-Fei. 2015. Visualizing and understanding recurrent networks. arXiv preprint arXiv:1506.02078 (2015)."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173738"},{"key":"e_1_2_1_25_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_1_26_1","volume-title":"Deepfakes: a new threat to face recognition? assessment and detection. arXiv preprint arXiv:1812.08685","author":"Korshunov Pavel","year":"2018","unstructured":"Pavel Korshunov and S\u00e9bastien Marcel. 2018. Deepfakes: a new threat to face recognition? assessment and detection. arXiv preprint arXiv:1812.08685 (2018)."},{"key":"e_1_2_1_27_1","volume-title":"SynSig2Vec: Forgery-free Learning of Dynamic Signature Representations by Sigma Lognormal-based Synthesis","author":"Lai Songxuan","year":"2021","unstructured":"Songxuan Lai, Lianwen Jin, Yecheng Zhu, Zhe Li, and Luojun Lin. 2021. SynSig2Vec: Forgery-free Learning of Dynamic Signature Representations by Sigma Lognormal-based Synthesis. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021)."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8683871"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3488281"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2018.2854765"},{"key":"e_1_2_1_31_1","volume-title":"Swin transformer: Hierarchical vision transformer using shifted windows. arXiv preprint arXiv:2103.14030","author":"Liu Ze","year":"2021","unstructured":"Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. 2021. Swin transformer: Hierarchical vision transformer using shifted windows. arXiv preprint arXiv:2103.14030 (2021)."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2019.00190"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2019.2958756"},{"key":"e_1_2_1_34_1","first-page":"2579","article-title":"Visualizing data using t-SNE","author":"van der Maaten Laurens","year":"2008","unstructured":"Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9, Nov (2008), 2579--2605.","journal-title":"Journal of machine learning research 9"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2016.2557846"},{"key":"e_1_2_1_36_1","volume-title":"26ms inference time for resnet-50: Towards real-time execution of all dnns on smartphone. arXiv preprint arXiv:1905.00571","author":"Niu Wei","year":"2019","unstructured":"Wei Niu, Xiaolong Ma, Yanzhi Wang, and Bin Ren. 2019. 26ms inference time for resnet-50: Towards real-time execution of all dnns on smartphone. arXiv preprint arXiv:1905.00571 (2019)."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2019.2916420"},{"key":"e_1_2_1_38_1","volume-title":"Feature Importance Evaluation of Smartphone Touch Gestures for Biometric Authentication. In 2020 2nd International Workshop on Human-Centric Smart Environments for Health and Well-being (IHSH)","author":"Ouadjer Youcef","unstructured":"Youcef Ouadjer, Mourad Adnane, and Nesrine Bouadjenek. 2021. Feature Importance Evaluation of Smartphone Touch Gestures for Biometric Authentication. In 2020 2nd International Workshop on Human-Centric Smart Environments for Health and Well-being (IHSH). IEEE, 103--107."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208543"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2014.2302582"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2516960"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508859.2516659"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2500423.2500434"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2891411"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2017.2737969"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2015.2503258"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594368.2594375"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479576"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2015.2506542"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2017.54"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359185"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2857705.2857748"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2020.2973832"},{"key":"e_1_2_1_54_1","unstructured":"TSYS. 2018. U.S. Consumer Payment Study. (2018). https:\/\/www.tsys.com\/Assets\/TSYS\/downloads\/rs_2018-us-consumer-payment-study.pdf"},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Verizon. 2020. 2020 Data Breach Investigations Report. https:\/\/enterprise.verizon.com\/resources\/reports\/dbir\/","DOI":"10.1016\/S1361-3723(20)30059-2"},{"key":"e_1_2_1_56_1","volume-title":"Successive Embedding and Classification Loss for Aerial Image Classification. arXiv preprint arXiv:1712.01511","author":"Wang Jiayun","year":"2017","unstructured":"Jiayun Wang, Patrick Virtue, and Stella X Yu. 2017. Successive Embedding and Classification Loss for Aerial Image Classification. arXiv preprint arXiv:1712.01511 (2017)."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.283"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46478-7_31"},{"key":"e_1_2_1_59_1","volume-title":"An enhanced deep feature representation for person re-identification. In 2016 IEEE winter conference on applications of computer vision (WACV)","author":"Wu Shangxuan","unstructured":"Shangxuan Wu, Ying-Cong Chen, Xiang Li, An-Cong Wu, Jin-Jie You, and Wei-Shi Zheng. 2016. An enhanced deep feature representation for person re-identification. In 2016 IEEE winter conference on applications of computer vision (WACV). IEEE, 1--8."},{"key":"e_1_2_1_60_1","volume-title":"10th Symposium On Usable Privacy and Security ({SOUPS}","author":"Xu Hui","year":"2014","unstructured":"Hui Xu, Yangfan Zhou, and Michael R Lyu. 2014. Towards continuous and passive authentication via touch biometrics: An experimental study on smartphones. In 10th Symposium On Usable Privacy and Security ({SOUPS} 2014). 187--198."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372224.3380901"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2018.00099"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/IConAC.2016.7604977"},{"key":"e_1_2_1_64_1","volume-title":"Zhe Jin, Rajendran Parthiban, and Ali Safaa Sadiq.","author":"Zaidi Ahmad Zairi","year":"2021","unstructured":"Ahmad Zairi Zaidi, Chun Yong Chong, Zhe Jin, Rajendran Parthiban, and Ali Safaa Sadiq. 2021. Touch-based continuous mobile device authentication: State-of-the-art, challenges and opportunities. Journal of Network and Computer Applications (2021), 103162."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2015.35"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415213"},{"key":"e_1_2_1_67_1","volume-title":"Continuous mobile authentication using a novel graphic touch gesture feature. In 2013 IEEE sixth international conference on biometrics: theory, applications and systems (BTAS)","author":"Zhao Xi","unstructured":"Xi Zhao, Tao Feng, and Weidong Shi. 2013. Continuous mobile authentication using a novel graphic touch gesture feature. In 2013 IEEE sixth international conference on biometrics: theory, applications and systems (BTAS). IEEE, 1--6."}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3517332","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3517332","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T04:26:47Z","timestamp":1752467207000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3517332"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,29]]},"references-count":67,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,3,29]]}},"alternative-id":["10.1145\/3517332"],"URL":"https:\/\/doi.org\/10.1145\/3517332","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,29]]},"assertion":[{"value":"2022-03-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}