{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T06:09:31Z","timestamp":1782713371523,"version":"3.54.5"},"reference-count":27,"publisher":"Association for Computing Machinery (ACM)","issue":"1","funder":[{"name":"National Natural Science Fundation (General Program) of China","award":["61972211"],"award-info":[{"award-number":["61972211"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Fundation of China","doi-asserted-by":"crossref","award":["62272239"],"award-info":[{"award-number":["62272239"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Future Network Innovation Research and Application Projects","award":["2021FNA02006"],"award-info":[{"award-number":["2021FNA02006"]}]},{"name":"2021 Jiangsu Postgraduate Research Innovation Plan","award":["KYCX210794"],"award-info":[{"award-number":["KYCX210794"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Recomm. Syst."],"published-print":{"date-parts":[[2026,3,31]]},"abstract":"<jats:p>With the popularity and development of smartphones, many mobile applications of various types have emerged. How to recommend mobile applications that match the user\u2019s preferences and usage habits among the massive applications is a problem that needs to be solved. Traditional mobile application recommendation methods cannot dynamically track user behavior and preference changes in time and cannot timely correct the recommendation model, resulting in poor recommendation effects. The continual update of mobile applications will also invalidate the recommendation model based on traffic classification. To solve these problems, this article proposes A Deep Q-Network\u2013 (DQN) based traffic classification method for mobile application recommendation with continual learning, which embeds a DQN-based traffic classification model in the mobile terminal and sets up a reward and punishment mechanism to achieve self-supervised learning. By continuously adjusting and optimizing the model, the effectiveness of the traffic classification model is ensured, and the recommendation model is provided with accurate and reliable user behavior data support. Experiments on the ISCX and private datasets show that the proposed method performs better and can effectively guarantee the accuracy of the classification model.<\/jats:p>","DOI":"10.1145\/3658452","type":"journal-article","created":{"date-parts":[[2024,4,16]],"date-time":"2024-04-16T11:46:56Z","timestamp":1713268016000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["A DQN-based Traffic Classification Method for Mobile Application Recommendation with Continual Learning"],"prefix":"10.1145","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6049-1006","authenticated-orcid":false,"given":"Zixuan","family":"Wang","sequence":"first","affiliation":[{"name":"Nanjing University of Posts and Telecommunications","place":["Nanjing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2006-1129","authenticated-orcid":false,"given":"Pan","family":"Wang","sequence":"additional","affiliation":[{"name":"Nanjing University of Posts and Telecommunications","place":["Nanjing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6536-185X","authenticated-orcid":false,"given":"Zhixin","family":"Sun","sequence":"additional","affiliation":[{"name":"Nanjing University of Posts and Telecommunications","place":["Nanjing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3885-7347","authenticated-orcid":false,"given":"Lu","family":"Chen","sequence":"additional","affiliation":[{"name":"Nanjing Institute of Technology","place":["Nanjing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-3995-3449","authenticated-orcid":false,"given":"Mengyi","family":"Fu","sequence":"additional","affiliation":[{"name":"Nanjing University of Posts and Telecommunications","place":["Nanjing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-2547-5234","authenticated-orcid":false,"given":"Minyao","family":"Liu","sequence":"additional","affiliation":[{"name":"Nanjing University of Posts and Telecommunications","place":["Nanjing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-8849-8508","authenticated-orcid":false,"given":"Ze","family":"Zhang","sequence":"additional","affiliation":[{"name":"Nanjing University of Posts and Telecommunications","place":["Nanjing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,7,29]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3543846"},{"key":"e_1_3_1_3_2","doi-asserted-by":"crossref","unstructured":"Pengfei Wang Yu Fan Long Xia Wayne Xin Zhao ShaoZhang Niu and Jimmy Huang. 2020. KERL: A knowledge-guided reinforcement learning model for sequential recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 209\u2013218.","DOI":"10.1145\/3397271.3401134"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jksuci.2021.11.006"},{"key":"e_1_3_1_5_2","article-title":"Selfless sequential learning","author":"Aljundi Rahaf","year":"2018","unstructured":"Rahaf Aljundi, Marcus Rohrbach, and Tinne Tuytelaars. 2018. Selfless sequential learning. arXiv:1806.05421. Retrieved from https:\/\/arxiv.org\/abs\/1806.05421","journal-title":"arXiv:1806.05421"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.3912"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-15-1301-5_16"},{"issue":"7","key":"e_1_3_1_8_2","first-page":"3366","article-title":"A continual learning survey: Defying forgetting in classification tasks","volume":"44","author":"Lange Matthias De","year":"2021","unstructured":"Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Ale\u0161 Leonardis, Gregory Slabaugh, and Tinne Tuytelaars. 2021. A continual learning survey: Defying forgetting in classification tasks. IEEE Trans. Pattern Anal. Mach. Intell. 44, 7 (2021), 3366\u20133385.","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/1557019.1557067"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1611835114"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2020.3727"},{"key":"e_1_3_1_12_2","article-title":"Deep reinforcement learning based group recommender system","author":"Liu Zefang","year":"2021","unstructured":"Zefang Liu, Shuran Wen, and Yinzhu Quan. 2021. Deep reinforcement learning based group recommender system. arXiv:2106.06900. Retrieved from https:\/\/arxiv.org\/abs\/2106.06900","journal-title":"arXiv:2106.06900"},{"key":"e_1_3_1_13_2","article-title":"Gradient episodic memory for continual learning","volume":"30","author":"Lopez-Paz David","year":"2017","unstructured":"David Lopez-Paz and Marc\u2019Aurelio Ranzato. 2017. Gradient episodic memory for continual learning. In Advances in Neural Information Processing Systems, Vol. 30.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics9020324"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2019.01.012"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.5220\/0006639801080116"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3450054"},{"key":"e_1_3_1_18_2","article-title":"Generative replay with feedback connections as a general strategy for continual learning","author":"Ven Gido M. Van de","year":"2018","unstructured":"Gido M. Van de Ven and Andreas S. Tolias. 2018. Generative replay with feedback connections as a general strategy for continual learning. arXiv:1809.10635. Retrieved from https:\/\/arxiv.org\/abs\/1809.10635","journal-title":"arXiv:1809.10635"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2012.11"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2018.05.001"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2872430"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-47426-3_8"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i5.16579"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10796-008-9131-2"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3001350"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3158369"},{"key":"e_1_3_1_27_2","article-title":"Metric factorization: Recommendation beyond matrix factorization","author":"Zhang Shuai","year":"2018","unstructured":"Shuai Zhang, Lina Yao, Yi Tay, Xiwei Xu, Xiang Zhang, and Liming Zhu. 2018. Metric factorization: Recommendation beyond matrix factorization. arXiv:1802.04606. Retrieved from https:\/\/arxiv.org\/abs\/1802.04606","journal-title":"arXiv:1802.04606"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2014.2320733"}],"container-title":["ACM Transactions on Recommender Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3658452","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,29]],"date-time":"2025-07-29T12:47:42Z","timestamp":1753793262000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658452"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,29]]},"references-count":27,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,3,31]]}},"alternative-id":["10.1145\/3658452"],"URL":"https:\/\/doi.org\/10.1145\/3658452","relation":{},"ISSN":["2770-6699"],"issn-type":[{"value":"2770-6699","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,29]]},"assertion":[{"value":"2023-08-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-26","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}