{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T19:28:21Z","timestamp":1768073301688,"version":"3.49.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,5]],"date-time":"2024-02-05T00:00:00Z","timestamp":1707091200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,5]],"date-time":"2024-02-05T00:00:00Z","timestamp":1707091200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100019340","name":"Nanning Science and Technology Base Project","doi-asserted-by":"crossref","award":["20221031"],"award-info":[{"award-number":["20221031"]}],"id":[{"id":"10.13039\/501100019340","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Intell Syst"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>With the rapid development of the Internet-of-Things (IoT), a massive amount of transient data is transmitted in edge networks. Transient data are highly time-sensitive, such as monitoring data generated by industrial devices. Due to their inefficiency, traditional caching strategies in edge networks are inadequate for handling transient data. Thus, to improve the efficiency of transient data caching, we construct a freshness model of transient data and propose a maximum entropy Actor\u2013Critic-based caching strategy, TD-MEAC-which can improve the freshness of cached data and reduce the long-term caching cost. Simulation results show that the proposed TD-MEAC achieves a higher cache hit rate and maintains a higher average freshness of cached transient data compared with the existing DRL and baseline caching strategies.<\/jats:p>","DOI":"10.1007\/s44196-023-00377-5","type":"journal-article","created":{"date-parts":[[2024,2,5]],"date-time":"2024-02-05T13:02:51Z","timestamp":1707138171000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Transient Data Caching Based on Maximum Entropy Actor\u2013Critic in Internet-of-Things Networks"],"prefix":"10.1007","volume":"17","author":[{"given":"Yu","family":"Zhang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ningjiang","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siyu","family":"Yu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liangqing","family":"Hu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,2,5]]},"reference":[{"issue":"2","key":"377_CR1","doi-asserted-by":"publisher","first-page":"429","DOI":"10.3390\/smartcities4020024","volume":"4","author":"AS Syed","year":"2021","unstructured":"Syed, A.S., Sierra-Sosa, D., Kumar, A., Elmaghraby, A.: Iot in smart cities: a survey of technologies, practices and challenges. Smart Cities 4(2), 429\u2013475 (2021)","journal-title":"Smart Cities"},{"issue":"1","key":"377_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/JIOT.2021.3095077","volume":"9","author":"A Imteaj","year":"2021","unstructured":"Imteaj, A., Thakker, U., Wang, S., Li, J., Amini, M.H.: A survey on federated learning for resource-constrained iot devices. IEEE Internet Things J. 9(1), 1\u201324 (2021)","journal-title":"IEEE Internet Things J."},{"issue":"6","key":"377_CR3","doi-asserted-by":"publisher","first-page":"854","DOI":"10.1109\/JIOT.2016.2584538","volume":"3","author":"M Chiang","year":"2016","unstructured":"Chiang, M., Zhang, T.: Fog and iot: an overview of research opportunities. IEEE Internet Things J. 3(6), 854\u2013864 (2016). https:\/\/doi.org\/10.1109\/JIOT.2016.2584538","journal-title":"IEEE Internet Things J."},{"issue":"1","key":"377_CR4","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/TWC.2019.2940447","volume":"19","author":"M Samir","year":"2020","unstructured":"Samir, M., Sharafeddine, S., Assi, C.M., Nguyen, T.M., Ghrayeb, A.: Uav trajectory planning for data collection from time-constrained iot devices. IEEE Trans. Wirel. Commun. 19(1), 34\u201346 (2020). https:\/\/doi.org\/10.1109\/TWC.2019.2940447","journal-title":"IEEE Trans. Wirel. Commun."},{"issue":"2","key":"377_CR5","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1109\/TPDS.2020.3016344","volume":"32","author":"X Xia","year":"2020","unstructured":"Xia, X., Chen, F., He, Q., Grundy, J., Abdelrazek, M., Jin, H.: Online collaborative data caching in edge computing. IEEE Trans. Parallel Distrib. Syst. 32(2), 281\u2013294 (2020)","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"issue":"12","key":"377_CR6","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1109\/MCOM.2016.1600492CM","volume":"54","author":"X Sun","year":"2016","unstructured":"Sun, X., Ansari, N.: Edgeiot: mobile edge computing for the internet of things. IEEE Commun. Mag. 54(12), 22\u201329 (2016). https:\/\/doi.org\/10.1109\/MCOM.2016.1600492CM","journal-title":"IEEE Commun. Mag."},{"issue":"9","key":"377_CR7","doi-asserted-by":"publisher","first-page":"5886","DOI":"10.1109\/TCOMM.2021.3086535","volume":"69","author":"X Wu","year":"2021","unstructured":"Wu, X., Li, X., Li, J., Ching, P.C., Leung, V.C.M., Poor, H.V.: Caching transient content for iot sensing: multi-agent soft actor\u2013critic. IEEE Trans. Commun. 69(9), 5886\u20135901 (2021). https:\/\/doi.org\/10.1109\/TCOMM.2021.3086535","journal-title":"IEEE Trans. Commun."},{"issue":"15","key":"377_CR8","doi-asserted-by":"publisher","first-page":"12931","DOI":"10.1109\/JIOT.2022.3163776","volume":"9","author":"B Feng","year":"2022","unstructured":"Feng, B., Tian, A., Yu, S., Li, J., Zhou, H., Zhang, H.: Efficient cache consistency management for transient iot data in content-centric networking. IEEE Internet Things J. 9(15), 12931\u201312944 (2022). https:\/\/doi.org\/10.1109\/JIOT.2022.3163776","journal-title":"IEEE Internet Things J."},{"key":"377_CR9","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.pmcj.2018.12.002","volume":"52","author":"M Meddeb","year":"2019","unstructured":"Meddeb, M., Dhraief, A., Belghith, A., Monteil, T., Drira, K., Mathkour, H.: Least fresh first cache replacement policy for ndn-based iot networks. Pervasive Mob. Comput. 52, 60\u201370 (2019)","journal-title":"Pervasive Mob. Comput."},{"issue":"7","key":"377_CR10","doi-asserted-by":"publisher","first-page":"4411","DOI":"10.1109\/TCOMM.2020.2987899","volume":"68","author":"S Fatale","year":"2020","unstructured":"Fatale, S., Prakash, R.S., Moharir, S.: Caching policies for transient data. IEEE Trans. Commun. 68(7), 4411\u20134422 (2020). https:\/\/doi.org\/10.1109\/TCOMM.2020.2987899","journal-title":"IEEE Trans. Commun."},{"issue":"3","key":"377_CR11","doi-asserted-by":"publisher","first-page":"2031","DOI":"10.1109\/COMST.2020.2986024","volume":"22","author":"WYB Lim","year":"2020","unstructured":"Lim, W.Y.B., Luong, N.C., Hoang, D.T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., Miao, C.: Federated learning in mobile edge networks: a comprehensive survey. IEEE Commun. Surv. Tutor. 22(3), 2031\u20132063 (2020). https:\/\/doi.org\/10.1109\/COMST.2020.2986024","journal-title":"IEEE Commun. Surv. Tutor."},{"issue":"7540","key":"377_CR12","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529\u2013533 (2015)","journal-title":"Nature"},{"key":"377_CR13","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106685","volume":"214","author":"A Heuillet","year":"2021","unstructured":"Heuillet, A., Couthouis, F., D\u00edaz-Rodr\u00edguez, N.: Explainability in deep reinforcement learning. Knowl.-Based Syst. 214, 106685 (2021)","journal-title":"Knowl.-Based Syst."},{"issue":"3","key":"377_CR14","doi-asserted-by":"publisher","first-page":"2525","DOI":"10.1109\/COMST.2019.2908280","volume":"21","author":"J Yao","year":"2019","unstructured":"Yao, J., Han, T., Ansari, N.: On mobile edge caching. IEEE Commun. Surv. Tutor. 21(3), 2525\u20132553 (2019)","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"377_CR15","doi-asserted-by":"crossref","unstructured":"Maniotis, P., Thomos, N.: Viewport-aware deep reinforcement learning approach for 360$$^\\circ $$ video caching. IEEE Trans. Multimedia 24, 386\u2013399 (2021)","DOI":"10.1109\/TMM.2021.3052339"},{"key":"377_CR16","doi-asserted-by":"publisher","first-page":"133212","DOI":"10.1109\/ACCESS.2020.3010329","volume":"8","author":"Y Zhang","year":"2020","unstructured":"Zhang, Y., Feng, B., Quan, W., Tian, A., Sood, K., Lin, Y., Zhang, H.: Cooperative edge caching: a multi-agent deep learning based approach. IEEE Access 8, 133212\u2013133224 (2020)","journal-title":"IEEE Access"},{"key":"377_CR17","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1016\/j.biosystemseng.2021.12.021","volume":"223","author":"FMR Junior","year":"2022","unstructured":"Junior, F.M.R., Bianchi, R.A., Prati, R.C., Kolehmainen, K., Soininen, J.-P., Kamienski, C.A.: Data reduction based on machine learning algorithms for fog computing in iot smart agriculture. Biosys. Eng. 223, 142\u2013158 (2022)","journal-title":"Biosys. Eng."},{"key":"377_CR18","doi-asserted-by":"crossref","unstructured":"Wang, Y., Friderikos, V.: Network orchestration in mobile networks via a synergy of model-driven and ai-based techniques. In: 2020 IEEE Eighth International Conference on Communications and Networking (ComNet), pp. 1\u20135. IEEE (2020)","DOI":"10.1109\/ComNet47917.2020.9306079"},{"issue":"1","key":"377_CR19","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1109\/TCCN.2020.2968326","volume":"6","author":"C Zhong","year":"2020","unstructured":"Zhong, C., Gursoy, M.C., Velipasalar, S.: Deep reinforcement learning-based edge caching in wireless networks. IEEE Trans. Cogn. Commun. Netw. 6(1), 48\u201361 (2020)","journal-title":"IEEE Trans. Cogn. Commun. Netw."},{"issue":"10","key":"377_CR20","doi-asserted-by":"publisher","first-page":"7140","DOI":"10.1109\/JIOT.2021.3075317","volume":"9","author":"MA Naeem","year":"2021","unstructured":"Naeem, M.A., Nguyen, T.N., Ali, R., Cengiz, K., Meng, Y., Khurshaid, T.: Hybrid cache management in iot-based named data networking. IEEE Internet Things J. 9(10), 7140\u20137150 (2021)","journal-title":"IEEE Internet Things J."},{"issue":"2","key":"377_CR21","doi-asserted-by":"publisher","first-page":"1191","DOI":"10.1109\/COMST.2019.2962586","volume":"22","author":"M Stoyanova","year":"2020","unstructured":"Stoyanova, M., Nikoloudakis, Y., Panagiotakis, S., Pallis, E., Markakis, E.K.: A survey on the internet of things (iot) forensics: challenges, approaches, and open issues. IEEE Commun. Surv. Tutor. 22(2), 1191\u20131221 (2020). https:\/\/doi.org\/10.1109\/COMST.2019.2962586","journal-title":"IEEE Commun. Surv. Tutor."},{"issue":"3","key":"377_CR22","doi-asserted-by":"publisher","first-page":"2150","DOI":"10.1109\/TWC.2019.2962798","volume":"19","author":"S Zhang","year":"2020","unstructured":"Zhang, S., Luo, H., Li, J., Shi, W., Shen, X.: Hierarchical soft slicing to meet multi-dimensional qos demand in cache-enabled vehicular networks. IEEE Trans. Wireless Commun. 19(3), 2150\u20132162 (2020)","journal-title":"IEEE Trans. Wireless Commun."},{"key":"377_CR23","doi-asserted-by":"publisher","first-page":"151350","DOI":"10.1109\/ACCESS.2020.3014379","volume":"8","author":"S Bommaraveni","year":"2020","unstructured":"Bommaraveni, S., Vu, T.X., Chatzinotas, S., Ottersten, B.: Active content popularity learning and caching optimization with hit ratio guarantees. IEEE Access 8, 151350\u2013151359 (2020). https:\/\/doi.org\/10.1109\/ACCESS.2020.3014379","journal-title":"IEEE Access"},{"issue":"2","key":"377_CR24","doi-asserted-by":"publisher","first-page":"1048","DOI":"10.1109\/TNET.2016.2616359","volume":"25","author":"S Vural","year":"2016","unstructured":"Vural, S., Wang, N., Navaratnam, P., Tafazolli, R.: Caching transient data in internet content routers. IEEE\/ACM Trans. Netw. 25(2), 1048\u20131061 (2016)","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"377_CR25","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Lung, C.-H., Lambadaris, I., St-Hilaire, M.: Iot data lifetime-based cooperative caching scheme for icn-iot networks. In: 2018 IEEE International Conference on Communications (ICC), pp. 1\u20137. IEEE (2018)","DOI":"10.1109\/ICC.2018.8422100"},{"issue":"2","key":"377_CR26","doi-asserted-by":"publisher","first-page":"2074","DOI":"10.1109\/JIOT.2018.2882583","volume":"6","author":"H Zhu","year":"2018","unstructured":"Zhu, H., Cao, Y., Wei, X., Wang, W., Jiang, T., Jin, S.: Caching transient data for internet of things: a deep reinforcement learning approach. IEEE Internet Things J. 6(2), 2074\u20132083 (2018)","journal-title":"IEEE Internet Things J."},{"issue":"10","key":"377_CR27","doi-asserted-by":"publisher","first-page":"9441","DOI":"10.1109\/JIOT.2020.2986803","volume":"7","author":"X Wang","year":"2020","unstructured":"Wang, X., Wang, C., Li, X., Leung, V.C.M., Taleb, T.: Federated deep reinforcement learning for internet of things with decentralized cooperative edge caching. IEEE Internet Things J. 7(10), 9441\u20139455 (2020). https:\/\/doi.org\/10.1109\/JIOT.2020.2986803","journal-title":"IEEE Internet Things J."},{"issue":"12","key":"377_CR28","doi-asserted-by":"publisher","first-page":"13310","DOI":"10.1109\/TVT.2022.3199677","volume":"71","author":"H Wu","year":"2022","unstructured":"Wu, H., Nasehzadeh, A., Wang, P.: A deep reinforcement learning-based caching strategy for iot networks with transient data. IEEE Trans. Veh. Technol. 71(12), 13310\u201313319 (2022)","journal-title":"IEEE Trans. Veh. Technol."},{"key":"377_CR29","doi-asserted-by":"crossref","unstructured":"Sharma, S., Peddoju, S.K.: Iot-cache: Caching transient data at the iot edge. In: 2022 IEEE 47th Conference on Local Computer Networks (LCN), pp. 307\u2013310. IEEE (2022)","DOI":"10.1109\/LCN53696.2022.9843211"},{"key":"377_CR30","unstructured":"Haarnoja, T., Zhou, A., Hartikainen, K., Tucker, G., Ha, S., Tan, J., Kumar, V., Zhu, H., Gupta, A., Abbeel, P., et al.: Soft actor-critic algorithms and applications. arXiv preprint arXiv:1812.05905 (2018)"}],"container-title":["International Journal of Computational Intelligence Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-023-00377-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44196-023-00377-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-023-00377-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,8]],"date-time":"2024-02-08T17:20:39Z","timestamp":1707412839000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44196-023-00377-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,5]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["377"],"URL":"https:\/\/doi.org\/10.1007\/s44196-023-00377-5","relation":{},"ISSN":["1875-6883"],"issn-type":[{"value":"1875-6883","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,5]]},"assertion":[{"value":"3 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that there is no conflict of interest regarding the publication of this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"20"}}