{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T07:02:07Z","timestamp":1775286127900,"version":"3.50.1"},"reference-count":21,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2018,11,27]],"date-time":"2018-11-27T00:00:00Z","timestamp":1543276800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004735","name":"Natural Science Foundation of\u00a0Hunan Province","doi-asserted-by":"publisher","award":["2016JJ4045"],"award-info":[{"award-number":["2016JJ4045"]}],"id":[{"id":"10.13039\/501100004735","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Educational Commission of Hunan Province of China","award":["17A114"],"award-info":[{"award-number":["17A114"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Wireless Com Network"],"published-print":{"date-parts":[[2018,12]]},"DOI":"10.1186\/s13638-018-1268-1","type":"journal-article","created":{"date-parts":[[2018,11,27]],"date-time":"2018-11-27T05:19:11Z","timestamp":1543295951000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Q-learning-based network content caching method"],"prefix":"10.1186","volume":"2018","author":[{"given":"Haijun","family":"Chen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guanzheng","family":"Tan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2018,11,27]]},"reference":[{"key":"1268_CR1","doi-asserted-by":"crossref","unstructured":"L. Wu, S.K. Garg, R. Buyya, SLA-based resource allocation for software as a service provider (SaaS) in cloud computing environments[C]\/\/ Ieee\/acm international symposium on cluster, cloud and grid IEEE Computer Society 2011:195\u2013204","DOI":"10.1109\/CCGrid.2011.51"},{"issue":"6","key":"1268_CR2","doi-asserted-by":"publisher","first-page":"599","DOI":"10.1016\/j.future.2008.12.001","volume":"25","author":"R Buyya","year":"2009","unstructured":"R. Buyya, C.S. Yeo, S. Venugopal, J. Broberg, I. Brandic, Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Futur. Gener. Comput. Syst. 25(6), 599\u2013616 (2009) Elsevier Science, Amsterdam, The Netherlands","journal-title":"Futur. Gener. Comput. Syst."},{"key":"1268_CR3","doi-asserted-by":"crossref","unstructured":"M. A. Vouk, \u201cCloud Computing-Issues, Research and Implementation\u201d. In Proceedings of 30th International Conference on Information Technology Interfaces ( ITI 2008), Dubrovnik, Croatia","DOI":"10.1109\/ITI.2008.4588381"},{"key":"1268_CR4","doi-asserted-by":"crossref","unstructured":"H. Takahashi, K. Mori, H.F. Ahmad, Efficient I\/O intensive multi tenant SaaS system using L4 level cache[C]\/\/ IEEE international symposium on service oriented system engineering. IEEE Computer Society, 2010:222\u2013228","DOI":"10.1109\/SOSE.2010.14"},{"issue":"3","key":"1268_CR5","first-page":"36","volume":"7","author":"R Wilhelm","year":"2008","unstructured":"R. Wilhelm, J. Engblom, A. Ermedahl, et al., The worst-case execution-time problem\u2014overview of methods and survey of tools. Cheminform 7(3), 36 (2008)","journal-title":"Cheminform"},{"issue":"2","key":"1268_CR6","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1109\/MCOM.2014.6736753","volume":"52","author":"X Wang","year":"2014","unstructured":"X. Wang, M. Chen, T. Taleb, et al., Cache in the air: exploiting content caching and delivery techniques for 5G systems. IEEE Commun. Mag. 52(2), 131\u2013139 (2014)","journal-title":"IEEE Commun. Mag."},{"issue":"12","key":"1268_CR7","first-page":"1352","volume":"50","author":"D Lee","year":"2001","unstructured":"D. Lee, J. Choi, J.H. Kim, et al., LRFU: a spectrum of policies that subsumes the least recently used and least frequently used policies. Acm Sigmetrics Perform. Eval. Rev. 50(12), 1352\u20131361 (2001)","journal-title":"Acm Sigmetrics Perform. Eval. Rev."},{"issue":"1","key":"1268_CR8","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1109\/TC.2015.2409848","volume":"65","author":"Y Wang","year":"2016","unstructured":"Y. Wang, Z. Li, G. Tyson, et al., Design and evaluation of the optimal cache allocation for content-centric networking. IEEE Trans. Comput. 65(1), 95\u2013107 (2016)","journal-title":"IEEE Trans. Comput."},{"issue":"11","key":"1268_CR9","doi-asserted-by":"publisher","first-page":"2920","DOI":"10.1109\/TPDS.2013.304","volume":"25","author":"I Psaras","year":"2014","unstructured":"I. Psaras, K.C. Wei, G. Pavlou, In-network cache management and resource allocation for information-centric networks. IEEE Trans. Parallel Distrib. Syst. 25(11), 2920\u20132931 (2014)","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"1268_CR10","doi-asserted-by":"crossref","unstructured":"D. Jeswani, M. Gupta, P. De, et al., Minimizing latency in serving requests through differential template caching in a cloud[C]\/\/ IEEE, International conference on cloud computing. IEEE, 2012:269\u2013276","DOI":"10.1109\/CLOUD.2012.17"},{"key":"1268_CR11","first-page":"518","volume-title":"Combining query performance with data integrity in the cloud: a hybrid cloud storage framework to enhance data access on the Windows Azure platform","author":"R Neumann","year":"2012","unstructured":"R. Neumann, S. Taggeselle, R. Dumke, et al., Combining query performance with data integrity in the cloud: a hybrid cloud storage framework to enhance data access on the Windows Azure platform (2012), pp. 518\u2013525"},{"issue":"7540","key":"1268_CR12","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"V. Mnih, K. Kavukcuoglu, D. Silver, et al., Human-level control through deep reinforcement learning. Nature 518(7540), 529\u2013533 (2015)","journal-title":"Nature"},{"issue":"7587","key":"1268_CR13","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1038\/nature16961","volume":"529","author":"D Silver","year":"2016","unstructured":"D. Silver, A. Huang, C.J. Maddison, et al., Mastering the game of Go with deep neural networks and tree search. Nature 529(7587), 484\u2013489 (2016)","journal-title":"Nature"},{"key":"1268_CR14","unstructured":"N. Heess, J.J. Hunt, T.P. Lillicrap, et al., Memory-based control with recurrent neural networks. Comp. Sci. (2015)"},{"key":"1268_CR15","volume-title":"Model-Free Episodic Control","author":"C Blundell","year":"2016","unstructured":"C. Blundell, B. Uria, A. Pritzel, et al., Model-Free Episodic Control. 2016"},{"key":"1268_CR16","unstructured":"T. Schaul, J. Quan, I. Antonoglou, et al., Prioritized experience replay. Comp. Sci. (2015)"},{"issue":"3","key":"1268_CR17","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1023\/A:1022628806385","volume":"8","author":"LJ Lin","year":"1992","unstructured":"L.J. Lin, Self-improving reactive agents based on reinforcement learning, planning and teaching. Mach. Learn. 8(3), 293\u2013321 (1992)","journal-title":"Mach. Learn."},{"key":"1268_CR18","doi-asserted-by":"crossref","unstructured":"R. Chiocchetti, D. Perino, G. Carofiglio, et al., INFORM: a dynamic interest forwarding mechanism for information centric networking[C]\/\/ ACM SIGCOMM Workshop on Information-Centric NETWORKING. 2013:9\u201314","DOI":"10.1145\/2491224.2491227"},{"key":"1268_CR19","unstructured":"W. Caarls, E. Hargreaves, D.S. Menasch\u00e9, Q-caching: an integrated reinforcement-learning approach for caching and routing in information-centric networks. Comp. Sci. (2015)"},{"issue":"3\u20134","key":"1268_CR20","first-page":"279","volume":"8","author":"CJCH Watkins","year":"1992","unstructured":"C.J.C.H. Watkins, P. Dayan, Q-learning. Mach. Learn. 8(3\u20134), 279\u2013292 (1992)","journal-title":"Mach. Learn."},{"key":"1268_CR21","doi-asserted-by":"crossref","unstructured":"M. Riedmiller, Neural fitted q iteration \u2013 first experiences with a data efficient neural reinforcement learning method[C]\/\/ European conference on machine learning. Springer-Verlag, 2005:317\u2013328.","DOI":"10.1007\/11564096_32"}],"container-title":["EURASIP Journal on Wireless Communications and Networking"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-018-1268-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13638-018-1268-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-018-1268-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T06:09:58Z","timestamp":1775282998000},"score":1,"resource":{"primary":{"URL":"https:\/\/jwcn-eurasipjournals.springeropen.com\/articles\/10.1186\/s13638-018-1268-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,27]]},"references-count":21,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,12]]}},"alternative-id":["1268"],"URL":"https:\/\/doi.org\/10.1186\/s13638-018-1268-1","relation":{},"ISSN":["1687-1499"],"issn-type":[{"value":"1687-1499","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,27]]},"assertion":[{"value":"28 July 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 October 2018","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 November 2018","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Haijun Chen received B.S. degrees at the School of Computer Science and Technology, National University of Defense Technology, Changsha, China, in 1997, and M.S. degree in software engineering from Hunan University, Changsha, China, in 2006. He is currently pursuing Ph.D. degree at Central South University, Changsha, China. His research interests include wireless sensor networks, machine learning, and neural network.GuanZheng Tan received B.S degree in aeronautical power plant control engineering from Nanjing University Of Aeronautics and Astronautics, Nanjing, China, in 1983, and M.S. degrees in automatic control theory and application from National University of Defense Technology, Changsha, China, in 1988, and Ph.D. degrees in mechanical manufacture and automation from Nanjing University Of Aeronautics and Astronautics, Nanjing, China, in 1992; he worked as a professor at the School of Information Science and Engineering of Central South University, Changsha, China. His research interests include artificial intelligence and application, bionic robot and intelligent bionic system, advanced control theory and advanced calculation, and biomedical image processing.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Authors\u2019 information"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Publisher\u2019s Note"}}],"article-number":"268"}}