{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T03:21:59Z","timestamp":1779247319470,"version":"3.51.4"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"14","license":[{"start":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T00:00:00Z","timestamp":1759104000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T00:00:00Z","timestamp":1759104000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Manipal Academy of Higher Education - Kasturba Medical College, Mangalore"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cluster Comput"],"published-print":{"date-parts":[[2025,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The rapid growth of Internet of Things (IoT) applications has increased the demand for ultra-low-latency and energy-efficient computing. While Mobile Edge Computing (MEC) addresses these demands by shifting computation from the centralized cloud to edge servers, its limited resources pose a major challenge. In particular, making optimal decisions for service caching and task offloading under dynamic network conditions and energy constraints remains a critical issue. Efficient caching is essential for latency-sensitive IoT tasks, yet only a subset of services can be stored at MEC-enabled base stations (BSs) due to storage limitations. This paper proposes a Cloud-assisted MEC framework that jointly optimizes service caching, service replacement, and task offloading to enhance long-term system performance. A two-phase solution is developed: first, an Irregular Cellular Learning Automata (ICLA)-based algorithm classifies traffic patterns and timescales, and a Distributed Deep Reinforcement Learning (DDRL) algorithm performs adaptive, decentralized task offloading. To address caching constraints, a dynamic 0\u20131 knapsack approach selects services based on popularity, while a Q-learning-based policy handles service replacement. Simulation results validate the framework\u2019s effectiveness, showing significant reductions in service latency and energy usage, with improved scalability and adaptability over traditional centralized approaches. The proposed method offers a robust and practical solution for next-generation MEC systems supporting real-time IoT services.<\/jats:p>","DOI":"10.1007\/s10586-025-05629-x","type":"journal-article","created":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T20:12:14Z","timestamp":1759176734000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Time-and-Traffic-aware collaborative task offloading with service caching-replacement in cloud-assisted mobile edge computing"],"prefix":"10.1007","volume":"28","author":[{"given":"Gurpreet Singh","family":"Chhabra","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Satish Kumar","family":"Satti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Goluguri N. V.","family":"Rajareddy","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Abhijeet","family":"Mahapatra","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gondi","family":"Lakshmeeswari","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kaushik","family":"Mishra","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,9,29]]},"reference":[{"key":"5629_CR1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2024.110593","author":"N Li","year":"2024","unstructured":"Li, N., Zhai, L., Ma, Z., Zhu, X., Li, Y.: Lyapunov-guided Deep Reinforcement Learning for service caching and task offloading in Mobile Edge Computing. Comput. Netw. (2024). https:\/\/doi.org\/10.1016\/j.comnet.2024.110593","journal-title":"Comput. Netw."},{"key":"5629_CR2","doi-asserted-by":"publisher","first-page":"124716","DOI":"10.1016\/j.eswa.2024.124716","volume":"255","author":"J Liu","year":"2024","unstructured":"Liu, J., Li, C., Luo, Y.: Efficient resource allocation for IoT applications in mobile edge computing via dynamic request scheduling optimization. Expert Syst. Appl. 255, 124716 (2024). https:\/\/doi.org\/10.1016\/j.eswa.2024.124716","journal-title":"Expert Syst. Appl."},{"issue":"3","key":"5629_CR3","doi-asserted-by":"publisher","first-page":"4050","DOI":"10.1109\/JSYST.2023.3260028","volume":"17","author":"MK Somesula","year":"2023","unstructured":"Somesula, M.K., Mothku, S.K., Annadanam, S.C.: Cooperative service placement and request routing in mobile edge networks for latency-sensitive applications. IEEE Syst. J. 17(3), 4050\u20134061 (2023). https:\/\/doi.org\/10.1109\/JSYST.2023.3260028","journal-title":"IEEE Syst. J."},{"issue":"2","key":"5629_CR4","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1007\/s11276-022-03056-7","volume":"29","author":"MK Somesula","year":"2023","unstructured":"Somesula, M.K., Mothku, S.K., Kotte, A.: Deep reinforcement learning mechanism for deadline-aware cache placement in device-to-device mobile edge networks. Wireless Netw. 29(2), 569\u2013588 (2023). https:\/\/doi.org\/10.1007\/s11276-022-03056-7","journal-title":"Wireless Netw."},{"key":"5629_CR5","doi-asserted-by":"publisher","first-page":"110564","DOI":"10.1016\/j.comnet.2024.110564","volume":"250","author":"M Xie","year":"2024","unstructured":"Xie, M., Ye, J., Zhang, G., Ni, X.: Deep reinforcement Learning-based computation offloading and distributed edge service caching for mobile edge computing. Comput. Netw. 250, 110564 (2024). https:\/\/doi.org\/10.1016\/j.comnet.2024.110564","journal-title":"Comput. Netw."},{"issue":"4","key":"5629_CR6","doi-asserted-by":"publisher","first-page":"4851","DOI":"10.1109\/TITS.2025.3539839","volume":"26","author":"GNV Rajareddy","year":"2025","unstructured":"Rajareddy, G.N.V., Mishra, K., Majhi, S.K., Sahoo, K.S., Bilal, M.: M-SOS: Mobility-aware secured offloading and scheduling in dew-enabled vehicular fog of things. IEEE Trans. Intell. Transp. Syst. 26(4), 4851\u20134864 (2025). https:\/\/doi.org\/10.1109\/TITS.2025.3539839","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"5629_CR7","doi-asserted-by":"publisher","first-page":"103941","DOI":"10.1016\/j.jnca.2024.103941","volume":"229","author":"X Zhao","year":"2024","unstructured":"Zhao, X., Wu, Y., Zhao, T., Wang, F., Li, M.: Federated deep reinforcement learning for task offloading and resource allocation in mobile edge computing-assisted vehicular networks. J. Netw. Comput. Appl. 229, 103941 (2024). https:\/\/doi.org\/10.1016\/j.jnca.2024.103941","journal-title":"J. Netw. Comput. Appl."},{"issue":"1","key":"5629_CR8","doi-asserted-by":"publisher","first-page":"662","DOI":"10.1109\/TII.2022.3186641","volume":"19","author":"X Dai","year":"2023","unstructured":"Dai, X., Xiao, Z., Jiang, H., Alazab, M., Lui, J.C., Min, G., Dustdar, S., Liu, J.: Task offloading for cloud-assisted fog computing with dynamic service caching in enterprise management systems. IEEE Trans. Industr. Inf. 19(1), 662\u2013672 (2023). https:\/\/doi.org\/10.1109\/TII.2022.3186641","journal-title":"IEEE Trans. Industr. Inf."},{"key":"5629_CR9","doi-asserted-by":"publisher","first-page":"109606","DOI":"10.1016\/j.compeleceng.2024.109606","volume":"119","author":"MK Somesula","year":"2024","unstructured":"Somesula, M.K., Raju, M.R., Dorsala, M.R., Brahma, B., Mothku, S.K.: Service caching and user association in cache enabled multi-UAV assisted MEN for latency-sensitive applications. Comput. Electr. Eng. 119, 109606 (2024). https:\/\/doi.org\/10.1016\/j.compeleceng.2024.109606","journal-title":"Comput. Electr. Eng."},{"issue":"5","key":"5629_CR10","doi-asserted-by":"publisher","first-page":"1510","DOI":"10.1109\/TC.2025.3533091","volume":"74","author":"L Zhao","year":"2025","unstructured":"Zhao, L., Zhao, Z., Hawbani, A., Liu, Z., Tan, Z., Yu, K.: Dynamic caching Dependency-Aware task offloading in mobile edge computing. IEEE Trans. Comput. 74(5), 1510\u20131523 (2025). https:\/\/doi.org\/10.1109\/TC.2025.3533091","journal-title":"IEEE Trans. Comput."},{"key":"5629_CR11","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2024.3452117","author":"C Shang","year":"2024","unstructured":"Shang, C., Huang, Y., Sun, Y., Guizani, M.: Joint computation offloading and service caching in mobile Edge-Cloud computing via deep reinforcement learning. IEEE Internet Things J. (2024). https:\/\/doi.org\/10.1109\/JIOT.2024.3452117","journal-title":"IEEE Internet Things J."},{"key":"5629_CR12","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2024.3443168","author":"Y Xu","year":"2024","unstructured":"Xu, Y., Peng, Z., Song, N., Qiu, Y., Zhang, C., Zhang, Y.: Joint optimization of service caching and task offloading for customer application in mec: A hybrid sac scheme. IEEE Trans. Consum. Electron. (2024). https:\/\/doi.org\/10.1109\/TCE.2024.3443168","journal-title":"IEEE Trans. Consum. Electron."},{"key":"5629_CR13","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2025.3555978","author":"B Xie","year":"2025","unstructured":"Xie, B., Xie, J., Cui, H., He, Y., Guizani, M.: Dynamic service caching aided computation offloading optimization algorithm for mobile edge networks. IEEE Internet Things J. (2025). https:\/\/doi.org\/10.1109\/JIOT.2025.3555978","journal-title":"IEEE Internet Things J."},{"issue":"2","key":"5629_CR14","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1007\/s12083-025-01499-1","volume":"18","author":"Y Li","year":"2025","unstructured":"Li, Y., Zhang, Z., Chao, H.C.: Service caching with multi-agent reinforcement learning in cloud-edge collaboration computing. Peer-to-Peer Netw. Appl. 18(2), 93 (2025). https:\/\/doi.org\/10.1007\/s12083-025-01499-1","journal-title":"Peer-to-Peer Netw. Appl."},{"key":"5629_CR15","doi-asserted-by":"publisher","first-page":"111030","DOI":"10.1016\/j.comnet.2024.111030","volume":"258","author":"L Zhai","year":"2025","unstructured":"Zhai, L., Zhao, P., Xue, K., Li, Y., Cheng, C.: Task offloading and multi-cache placement in multi-access mobile edge computing. Comput. Netw. 258, 111030 (2025). https:\/\/doi.org\/10.1016\/j.comnet.2024.111030","journal-title":"Comput. Netw."},{"key":"5629_CR16","doi-asserted-by":"publisher","first-page":"103743","DOI":"10.1016\/j.adhoc.2024.103743","volume":"169","author":"S Wang","year":"2025","unstructured":"Wang, S., Zhao, S., Gui, H., He, X., Lu, Z., Chen, B., Fan, Z., Pang, S.: Energy-efficient collaborative task offloading in multi-access edge computing based on deep reinforcement learning. Ad Hoc Netw. 169, 103743 (2025). https:\/\/doi.org\/10.1016\/j.adhoc.2024.103743","journal-title":"Ad Hoc Netw."},{"issue":"3","key":"5629_CR17","doi-asserted-by":"publisher","first-page":"1405","DOI":"10.1007\/s11831-023-10021-2","volume":"31","author":"A Mahapatra","year":"2024","unstructured":"Mahapatra, A., Mishra, K., Pradhan, R., Majhi, S.K.: Next generation task offloading techniques in evolving computing paradigms: Comparative analysis, current challenges, and future research perspectives. Arch. Comput. Methods Eng. 31(3), 1405\u20131474 (2024). https:\/\/doi.org\/10.1007\/s11831-023-10021-2","journal-title":"Arch. Comput. Methods Eng."},{"key":"5629_CR18","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2024.3394486","author":"S Pallewatta","year":"2024","unstructured":"Pallewatta, S., Kostakos, V., Buyya, R.: Reliability-aware Proactive Placement of Microservices-based IoT Applications in Fog Computing Environments. IEEE Trans. Mob. Comput. (2024). https:\/\/doi.org\/10.1109\/TMC.2024.3394486","journal-title":"IEEE Trans. Mob. Comput."},{"key":"5629_CR19","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2024.3396511","author":"Z Chen","year":"2024","unstructured":"Chen, Z., Xiong, B., Chen, X., Min, G., Li, J.: Joint Computation Offloading and Resource Allocation in Multi-edge Smart Communities with Personalized Federated Deep Reinforcement Learning. IEEE Trans. Mob. Comput. (2024). https:\/\/doi.org\/10.1109\/TMC.2024.3396511","journal-title":"IEEE Trans. Mob. Comput."},{"issue":"1","key":"5629_CR20","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1109\/TCC.2025.3538090","volume":"13","author":"Z He","year":"2025","unstructured":"He, Z., Guo, Y., Zhai, X., Zhao, M., Zhou, W., Li, K.: Joint computation offloading and resource allocation in mobile-edge cloud computing: A two-layer game approach. IEEE Trans. Cloud Comput. 13(1), 411\u2013428 (2025). https:\/\/doi.org\/10.1109\/TCC.2025.3538090","journal-title":"IEEE Trans. Cloud Comput."},{"key":"5629_CR21","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-024-06603-x","author":"B Xie","year":"2025","unstructured":"Xie, B., Cui, H.: Deep reinforcement learning-based dynamical task offloading for mobile edge computing. J. Supercomputing (2025). https:\/\/doi.org\/10.1007\/s11227-024-06603-x","journal-title":"J. Supercomputing"},{"issue":"3","key":"5629_CR22","doi-asserted-by":"publisher","first-page":"1683","DOI":"10.1109\/TSC.2025.3552338","volume":"18","author":"J Zhou","year":"2025","unstructured":"Zhou, J., Hou, X., Zeng, Y., Cong, P., Jiang, W., Guo, S.: Quality of experience and reliability-aware task offloading and scheduling for multi-user mobile-edge computing systems. IEEE Trans. Serv. Comput. 18(3), 1683\u20131696 (2025). https:\/\/doi.org\/10.1109\/TSC.2025.3552338","journal-title":"IEEE Trans. Serv. Comput."},{"key":"5629_CR23","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-024-04833-5","author":"BB Naik","year":"2025","unstructured":"Naik, B.B., Priyanka, B., Ansari, M.S.A.: Energy-efficient task offloading and efficient resource allocation for edge computing: A quantum inspired particle swarm optimization approach. Cluster Comput. (2025). https:\/\/doi.org\/10.1007\/s10586-024-04833-5","journal-title":"Cluster Comput."},{"key":"5629_CR24","doi-asserted-by":"publisher","first-page":"101185","DOI":"10.1016\/j.iot.2024.101185","volume":"26","author":"S Sarker","year":"2024","unstructured":"Sarker, S., Arafat, M.T., Lameesa, A., Afrin, M., Mahmud, R., Razzaque, M.A., Iqbal, T.: FOLD: Fog-dew infrastructure-aided optimal workload distribution for cloud robotic operations. Internet Things. 26, 101185 (2024). https:\/\/doi.org\/10.1016\/j.iot.2024.101185","journal-title":"Internet Things"},{"key":"5629_CR25","doi-asserted-by":"publisher","unstructured":"Nardelli, M., Russo, G.: Function Offloading and Data Migration for Stateful Serverless Edge Computing. In Proceedings of the 15th ACM\/SPEC International Conference on Performance Engineering, 247\u2013257. (2024). https:\/\/doi.org\/10.1145\/3629526.3649293","DOI":"10.1145\/3629526.3649293"},{"key":"5629_CR26","doi-asserted-by":"publisher","first-page":"110575","DOI":"10.1016\/j.comnet.2024.110575","volume":"250","author":"W Ren","year":"2024","unstructured":"Ren, W., Xu, Z., Liang, W., Dai, H., Rana, O.F., Zhou, P., Xia, Q., Ren, H., Li, M., Wu, G.: Learning-driven service caching in MEC networks with bursty data traffic and uncertain delays. Comput. Netw. 250, 110575 (2024). https:\/\/doi.org\/10.1016\/j.comnet.2024.110575","journal-title":"Comput. Netw."},{"key":"5629_CR27","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.comcom.2024.05.020","volume":"224","author":"C Cheng","year":"2024","unstructured":"Cheng, C., Zhai, L., Zhu, X., Jia, Y., Li, Y.: Dynamic task offloading and service caching based on game theory in vehicular edge computing networks. Comput. Commun. 224, 29\u201341 (2024). https:\/\/doi.org\/10.1016\/j.comcom.2024.05.020","journal-title":"Comput. Commun."},{"issue":"2","key":"5629_CR28","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1109\/LCOMM.2023.3347218","volume":"28","author":"M Wu","year":"2024","unstructured":"Wu, M., Li, K., Qian, L., Wu, Y., Lee, I.: Secure computation offloading and service caching in mobile edge computing networks. IEEE Commun. Lett. 28(2), 432\u2013436 (2024). https:\/\/doi.org\/10.1109\/LCOMM.2023.3347218","journal-title":"IEEE Commun. Lett."},{"key":"5629_CR29","doi-asserted-by":"publisher","first-page":"14334","DOI":"10.1109\/ACCESS.2024.3357122","volume":"12","author":"A Mahapatra","year":"2024","unstructured":"Mahapatra, A., Majhi, S.K., Mishra, K., Pradhan, R., Rao, D.C., Panda, S.K.: An energy-aware task offloading and load balancing for latency-sensitive IoT applications in the Fog-Cloud continuum. IEEE Access. 12, 14334\u201314349 (2024). https:\/\/doi.org\/10.1109\/ACCESS.2024.3357122","journal-title":"IEEE Access."},{"issue":"4","key":"5629_CR30","doi-asserted-by":"publisher","first-page":"4600","DOI":"10.1109\/TNSM.2023.3282795","volume":"20","author":"K Mishra","year":"2023","unstructured":"Mishra, K., Rajareddy, G.N., Ghugar, U., Chhabra, G.S., Gandomi, A.H.: A collaborative computation and offloading for compute-intensive and latency-sensitive dependency-aware tasks in dew-enabled vehicular fog computing: A federated deep Q-learning approach. IEEE Trans. Netw. Serv. Manage. 20(4), 4600\u20134614 (2023). https:\/\/doi.org\/10.1109\/TNSM.2023.3282795","journal-title":"IEEE Trans. Netw. Serv. Manage."},{"key":"5629_CR31","doi-asserted-by":"publisher","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O.: Proximal policy optimization algorithms. (2017). https:\/\/doi.org\/10.48550\/arXiv.1707.06347","DOI":"10.48550\/arXiv.1707.06347"},{"key":"5629_CR32","unstructured":"Petrenko, A., Huang, Z., Kumar, T., Sukhatme, G., Koltun, V.: Sample factory: Egocentric 3d control from pixels at 100000 fps with asynchronous reinforcement learning. In International Conference on Machine Learning, PMLR. 119, 7652\u20137662. (2020)"},{"key":"5629_CR33","doi-asserted-by":"publisher","unstructured":"Xu, J., Chen, L., Zhou, P.: Joint service caching and task offloading for mobile edge computing in dense networks. In IEEE INFOCOM 2018-IEEE Conference on Computer Communications, 207\u2013215. (2018). https:\/\/doi.org\/10.1109\/INFOCOM.2018.8485977","DOI":"10.1109\/INFOCOM.2018.8485977"},{"issue":"14","key":"5629_CR34","doi-asserted-by":"publisher","first-page":"4677","DOI":"10.3390\/s24144677","volume":"24","author":"C Zhan","year":"2024","unstructured":"Zhan, C., Zheng, S., Chen, J., Liang, J., Zhou, X.: Integrated quality of service for offline and online services in edge networks via task offloading and service caching. Sensors. 24(14), 4677 (2024). https:\/\/doi.org\/10.3390\/s24144677","journal-title":"Sensors"},{"issue":"11","key":"5629_CR35","doi-asserted-by":"publisher","first-page":"e3493","DOI":"10.1002\/ett.3493","volume":"29","author":"C Sonmez","year":"2018","unstructured":"Sonmez, C., Ozgovde, A., Ersoy, C.: Edgecloudsim: An environment for performance evaluation of edge computing systems. Trans. Emerg. Telecommunications Technol. 29(11), e3493 (2018). https:\/\/doi.org\/10.1002\/ett.3493","journal-title":"Trans. Emerg. Telecommunications Technol."}],"container-title":["Cluster Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-025-05629-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10586-025-05629-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-025-05629-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,27]],"date-time":"2025-11-27T10:05:04Z","timestamp":1764237904000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10586-025-05629-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,29]]},"references-count":35,"journal-issue":{"issue":"14","published-print":{"date-parts":[[2025,11]]}},"alternative-id":["5629"],"URL":"https:\/\/doi.org\/10.1007\/s10586-025-05629-x","relation":{},"ISSN":["1386-7857","1573-7543"],"issn-type":[{"value":"1386-7857","type":"print"},{"value":"1573-7543","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,29]]},"assertion":[{"value":"28 October 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 June 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 July 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 September 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"900"}}