{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T09:45:52Z","timestamp":1785836752469,"version":"3.56.0"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T00:00:00Z","timestamp":1678665600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T00:00:00Z","timestamp":1678665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100014718","name":"Innovative Research Group Project of the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62061009"],"award-info":[{"award-number":["62061009"]}],"id":[{"id":"10.13039\/100014718","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Wireless Com Network"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Compressive data gathering (CDG) is an adequate method to reduce the amount of data transmission, thereby decreasing energy expenditure for wireless sensor networks (WSNs). Sleep scheduling integrated with CDG can further promote energy efficiency. Most of existing sleep scheduling methods for CDG were formulated as centralized optimization problems which introduced many extra control message exchanges. Meanwhile, a few distributed methods usually adopted stochastic decision which could not adapt to variance in residual energy of nodes. A part of nodes were prone to prematurely run out of energy. In this paper, a reinforcement learning-based sleep scheduling algorithm for CDG (RLSSA-CDG) is proposed. Active nodes selection is modeled as a finite Markov decision process. The mode-free Q learning algorithm is used to search optimal decision strategies. Residual energy of nodes and sampling uniformity are considered into the reward function of the Q learning algorithm for load balance of energy consumption and accurate data reconstruction. It is a distributed algorithm that avoids large amounts of control message exchanges. Each node takes part in one step of the decision process. Thus, computation overhead for sensor nodes is affordable. Simulation experiments are carried out on the MATLAB platform to validate the effectiveness of the proposed RLSSA-CDG against the distributed random sleep scheduling algorithm for CDG (DSSA-CDG) and the original sparse-CDG algorithm without sleep scheduling. The simulation results indicate that the proposed RLSSA-CDG outperforms the two contrast algorithms in terms of energy consumption, network lifetime, and data recovery accuracy. The proposed RLSSA-CDG reduces energy consumption by 4.64% and 42.42%, respectively, compared to the DSSA-CDG and the original sparse-CDG, prolongs life span by 57.3%, and promotes data recovery accuracy by 84.7% compared to the DSSA-CDG.<\/jats:p>","DOI":"10.1186\/s13638-023-02237-4","type":"journal-article","created":{"date-parts":[[2023,3,26]],"date-time":"2023-03-26T20:26:39Z","timestamp":1679862399000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["A reinforcement learning-based sleep scheduling algorithm for compressive data gathering in wireless sensor networks"],"prefix":"10.1186","volume":"2023","author":[{"given":"Xun","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongbin","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6858-5031","authenticated-orcid":false,"given":"Shichao","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,3,13]]},"reference":[{"key":"2237_CR1","unstructured":"Statista, Internet of Things (IoT) and Non-IoT Active Device Connections Worldwide From 2010 to 2025 (2021). http:\/\/www.statista.com\/statistics\/1101442\/iot-number-of-connected-devices-worldwide\/"},{"key":"2237_CR2","doi-asserted-by":"crossref","unstructured":"C. Luo, F. Wu, J. Sun, and W. C. Chen, \u201cCompressive data gathering for large-scale wireless sensor network,\u201d in Fifth ACM International Conference on Mobile Computing and Networking (MOBICOM), Beijing, China (2009), pp. 145\u2013156","DOI":"10.1145\/1614320.1614337"},{"issue":"12","key":"2237_CR3","doi-asserted-by":"publisher","first-page":"3728","DOI":"10.1109\/TWC.2010.092810.100063","volume":"9","author":"C Luo","year":"2010","unstructured":"C. Luo, F. Wu, J. Sun, W.C. Chen, Efficient measurement generation and pervasive sparsity for compressive data gathering. IEEE Trans. Wirel. Commun. 9(12), 3728\u20133738 (2010)","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"2237_CR4","doi-asserted-by":"crossref","unstructured":"J. Luo and L. Xiang, \u201cDoes compressed sensing improve the throughput of wireless sensor networks?\u201d in 2010 IEEE International Conference on Communications, Cape Town, South Africa (2010).","DOI":"10.1109\/ICC.2010.5502565"},{"issue":"8","key":"2237_CR5","doi-asserted-by":"publisher","first-page":"1572","DOI":"10.1109\/LCOMM.2013.13.0621130828","volume":"13","author":"D Ebrahimi","year":"2013","unstructured":"D. Ebrahimi, C. Assi, Optimal and efficient algorithms for projection-based compressive data gathering. IEEE Commun. Lett. 13(8), 1572\u20131575 (2013)","journal-title":"IEEE Commun. Lett."},{"key":"2237_CR6","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/j.adhoc.2013.12.004","volume":"16","author":"D Ebrahimi","year":"2014","unstructured":"D. Ebrahimi, C. Assi, Compressive data gathering using random projection for energy efficient wireless sensor networks. Ad Hoc Netw. 16, 105\u2013119 (2014)","journal-title":"Ad Hoc Netw."},{"issue":"1","key":"2237_CR7","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1109\/TPDS.2014.2308212","volume":"26","author":"HF Zheng","year":"2015","unstructured":"H.F. Zheng, F. Yang, X.H. Tian, X.Y. Gan, X.B. Wang, Data gathering with compressive sensing in wireless sensor networks: a random walk based approach. IEEE Trans. Parallel Distrib. Syst. 26(1), 35\u201344 (2015)","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"issue":"2","key":"2237_CR8","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1109\/MSP.2007.914731","volume":"25","author":"EJ Cand\u0450s","year":"2008","unstructured":"E.J. Cand\u0450s, M.B. Wakin, An introduction to compressive sampling. IEEE Signal Process. Mag. 25(2), 21\u201330 (2008)","journal-title":"IEEE Signal Process. Mag."},{"issue":"2","key":"2237_CR9","doi-asserted-by":"publisher","first-page":"827","DOI":"10.1109\/TVT.2015.2400635","volume":"65","author":"W Chen","year":"2016","unstructured":"W. Chen, I.J. Wassell, Optimized node selection for compressive sleeping wireless sensor networks. IEEE Trans. Veh. Technol. 65(2), 827\u2013836 (2016)","journal-title":"IEEE Trans. Veh. Technol."},{"issue":"9","key":"2237_CR10","doi-asserted-by":"publisher","first-page":"2314","DOI":"10.1109\/TSP.2016.2521608","volume":"64","author":"W Chen","year":"2016","unstructured":"W. Chen, I.J. Wassell, Cost-aware activity scheduling for compressive sleeping wireless sensor networks. IEEE Trans. Signal Process. 64(9), 2314\u20132323 (2016)","journal-title":"IEEE Trans. Signal Process."},{"key":"2237_CR11","doi-asserted-by":"publisher","first-page":"49477","DOI":"10.1109\/ACCESS.2020.2974879","volume":"8","author":"Y Wu","year":"2020","unstructured":"Y. Wu, Y. He, L. Shi, Energy-saving measurement in LoRaWAN-based wireless sensor networks by using compressed sensing. IEEE Access 8, 49477\u201349486 (2020)","journal-title":"IEEE Access"},{"issue":"3","key":"2237_CR12","doi-asserted-by":"crossref","first-page":"4677","DOI":"10.1002\/dac.4677","volume":"34","author":"R Manchanda","year":"2020","unstructured":"R. Manchanda, K. Sharma, A novel framework for energy-efficient compressive data gathering in heterogeneous wireless sensor network. Int. J. Commun. Syst. 34(3), 4677 (2020)","journal-title":"Int. J. Commun. Syst."},{"issue":"7","key":"2237_CR13","doi-asserted-by":"publisher","first-page":"3816","DOI":"10.1109\/TSP.2010.2047721","volume":"58","author":"Q Ling","year":"2010","unstructured":"Q. Ling, Z. Tian, Decentralized sparse signal recovery for compressive sleeping wireless sensor networks. IEEE Trans. Signal Process. 58(7), 3816\u20133827 (2010)","journal-title":"IEEE Trans. Signal Process."},{"issue":"5","key":"2237_CR14","doi-asserted-by":"publisher","first-page":"830","DOI":"10.1049\/iet-com.2019.0077","volume":"14","author":"S Mehrjoo","year":"2020","unstructured":"S. Mehrjoo, F. Khunjush, A. Ghaedi, Fully distributed sleeping compressive data gathering in wireless sensor networks. IET Commun. 14(5), 830\u2013837 (2020)","journal-title":"IET Commun."},{"key":"2237_CR15","doi-asserted-by":"publisher","first-page":"10847","DOI":"10.1007\/s13369-022-06858-7","volume":"47","author":"N Chauhan","year":"2022","unstructured":"N. Chauhan, P. Rawat, S. Chauhan, Reinforcement learning-based technique to restore coverage holes with minimal coverage overlap in wireless sensor networks. Arab. J. Sci. Eng. 47, 10847\u201310863 (2022)","journal-title":"Arab. J. Sci. Eng."},{"key":"2237_CR16","doi-asserted-by":"publisher","first-page":"44123","DOI":"10.1109\/ACCESS.2022.3167058","volume":"10","author":"AFE Abadi","year":"2022","unstructured":"A.F.E. Abadi, S.A. Asghari, M.B. Marvasti, G. Abaei, M. Nabavi, Y. Savaria, RLBEEP: Reinforcement- learning-based energy efficient control and routing protocol for wireless sensor networks. IEEE Access 10, 44123\u201344135 (2022)","journal-title":"IEEE Access"},{"issue":"8","key":"2237_CR17","doi-asserted-by":"publisher","first-page":"2763","DOI":"10.1109\/JSEN.2016.2517084","volume":"16","author":"H Chen","year":"2016","unstructured":"H. Chen, X. Li, F. Zhao, A reinforcement learning-based sleep scheduling algorithm for desired area coverage in solar-powered wireless sensor networks. IEEE Sens. J. 16(8), 2763\u20132774 (2016)","journal-title":"IEEE Sens. J."},{"key":"2237_CR18","first-page":"1","volume":"26","author":"PS Banerjee","year":"2020","unstructured":"P.S. Banerjee, S.N. Mandal, D. De, B. Maiti, RL-Sleep: temperature adaptive sleep scheduling using reinforcement learning for sustainable connectivity in wireless sensor networks. Sustain. Comput. Inform. Syst. 26, 1\u201318 (2020)","journal-title":"Sustain. Comput. Inform. Syst."},{"issue":"3","key":"2237_CR19","doi-asserted-by":"publisher","first-page":"979","DOI":"10.1109\/TCYB.2017.2669996","volume":"48","author":"D Ye","year":"2018","unstructured":"D. Ye, M. Zhang, A self-adaptive sleep\/wake-up scheduling approach for wireless sensor networks. IEEE Trans. Cybern. 48(3), 979\u2013992 (2018)","journal-title":"IEEE Trans. Cybern."},{"issue":"2","key":"2237_CR20","doi-asserted-by":"publisher","first-page":"1243","DOI":"10.1007\/s11277-020-07100-z","volume":"112","author":"KP Mhatre","year":"2020","unstructured":"K.P. Mhatre, U.P. Khot, Energy efficient opportunistic routing with sleep scheduling in wireless sensor networks. Wirel. Pers. Commun. 112(2), 1243\u20131263 (2020)","journal-title":"Wirel. Pers. Commun."},{"key":"2237_CR21","first-page":"197817","volume":"8","author":"M Mukherjee","year":"2019","unstructured":"M. Mukherjee, L. Shu, R.V. Prasad, D. Wang, G.P. Hancke, Sleep scheduling for unbalanced energy harvesting in industrial wireless sensor networks. IEEE Commun. Mag. 8, 197817\u2013197827 (2019)","journal-title":"IEEE Commun. Mag."},{"key":"2237_CR22","doi-asserted-by":"publisher","first-page":"197817","DOI":"10.1109\/ACCESS.2020.3035473","volume":"8","author":"M Tian","year":"2020","unstructured":"M. Tian, W. Jiao, G. Shen, The charging strategy combining with the node sleep mechanism in the wireless rechargeable sensor network. IEEE Access 8, 197817\u2013197827 (2020)","journal-title":"IEEE Access"},{"key":"2237_CR23","doi-asserted-by":"publisher","first-page":"12232","DOI":"10.1109\/ACCESS.2020.2965206","volume":"8","author":"NM Shagari","year":"2020","unstructured":"N.M. Shagari, M.Y.I. Idris, R.B. Salleh, I. Ahmedy, G. Murtaza, H.A. Shehadeh, Heterogeneous energy and traffic aware sleep-awake cluster-based routing protocol for wireless sensor network. IEEE Access 8, 12232\u201312252 (2020)","journal-title":"IEEE Access"},{"issue":"6","key":"2237_CR24","doi-asserted-by":"publisher","first-page":"2471","DOI":"10.1007\/s11276-022-02981-3","volume":"28","author":"C Lin","year":"2022","unstructured":"C. Lin, Y. Peng, L. Chang, Z. Chen, Joint deployment and sleep scheduling of the internet of things. Wirel. Netw. 28(6), 2471\u20132483 (2022)","journal-title":"Wirel. Netw."},{"issue":"16","key":"2237_CR25","doi-asserted-by":"publisher","first-page":"16662","DOI":"10.1109\/JSEN.2022.3189431","volume":"22","author":"M Ibrahim","year":"2022","unstructured":"M. Ibrahim, H. Harb, A. Nasser, A. Mansour, C. Osswald, Aggregation-scheduling based mechanism for energy-efficient multivariate sensor networks. IEEE Sensors J. 22(16), 16662\u201316672 (2022)","journal-title":"IEEE Sensors J."},{"issue":"10","key":"2237_CR26","doi-asserted-by":"publisher","first-page":"3450","DOI":"10.3390\/s18103450","volume":"18","author":"H Jaward","year":"2018","unstructured":"H. Jaward, R. Nordin, A. Gharghan, A. Jawad, M. Ismail, M. Abu-AlShaeer, Power reduction with sleep\/wake on redundant data (SWORD) in a wireless sensor network for energy-efficient precision agriculture. Sensors 18(10), 3450 (2018)","journal-title":"Sensors"},{"issue":"3","key":"2237_CR27","doi-asserted-by":"publisher","first-page":"1417","DOI":"10.1007\/s12083-022-01307-6","volume":"15","author":"P Rawat","year":"2022","unstructured":"P. Rawat, S. Chauhan, Particle swarm optimization based sleep scheduling and clustering protocol in wireless sensor network. Peer-to-Peer Netw. Appl. 15(3), 1417\u20131436 (2022)","journal-title":"Peer-to-Peer Netw. Appl."},{"issue":"1083","key":"2237_CR28","first-page":"1","volume":"22","author":"J Akram","year":"2022","unstructured":"J. Akram, H.S. Munawar, A.Z. Kouzani, M.A.P. Mahmud, Using adaptive sensors for optimized target coverage in wireless sensor networks. Sensors 22(1083), 1\u201323 (2022)","journal-title":"Sensors"},{"issue":"3","key":"2237_CR29","doi-asserted-by":"publisher","first-page":"1040","DOI":"10.1109\/JSEN.2018.2878788","volume":"19","author":"N Jain","year":"2019","unstructured":"N. Jain, V.A. Bohara, A. Gupta, iDEG: integrated data and energy gathering framework for practical wireless sensor networks using compressive sensing. IEEE Sens. J. 19(3), 1040\u20131051 (2019)","journal-title":"IEEE Sens. J."},{"issue":"2","key":"2237_CR30","doi-asserted-by":"publisher","first-page":"138","DOI":"10.23919\/JCN.2021.000003","volume":"23","author":"MA Mazaideh","year":"2021","unstructured":"M.A. Mazaideh, J. Levendovszky, A multi-hop routing algorithm for WSNs based on compressive sensing and multiple objective genetic algorithm. J. Commun. Netw. 23(2), 138\u2013147 (2021)","journal-title":"J. Commun. Netw."},{"issue":"5","key":"2237_CR31","doi-asserted-by":"publisher","first-page":"3395","DOI":"10.1007\/s11276-020-02265-8","volume":"26","author":"A Aziz","year":"2020","unstructured":"A. Aziz, W. Osamy, A.M. Khedr, A.A. EI-Sawy, K. Singh, Grey wolf based compressive sensing scheme for data gathering in IoT based heterogeneous WSNs. Wirel. Netw. 26(5), 3395\u20133418 (2020)","journal-title":"Wirel. Netw."},{"issue":"6","key":"2237_CR32","doi-asserted-by":"publisher","first-page":"4411","DOI":"10.1109\/TII.2020.3027840","volume":"17","author":"C Lin","year":"2021","unstructured":"C. Lin, G.J. Han, X.Y. Qi, J.X. Du, T.T. Xu, M.M. Garcla, Energy-optimal data collection for unmanned aerial vehicle-aided industrial wireless sensor network-based agricultural monitoring system: a clustering compressed sampling approach. IEEE Trans. Ind. Inf. 17(6), 4411\u20134420 (2021)","journal-title":"IEEE Trans. Ind. Inf."},{"issue":"3","key":"2237_CR33","doi-asserted-by":"publisher","first-page":"1905","DOI":"10.1007\/s11277-020-07454-4","volume":"114","author":"A Aziz","year":"2020","unstructured":"A. Aziz, K. Singh, W. Osamy, A.M. Khedr, An efficient compressive sensing routing scheme for Internet of things based wireless sensor networks. Wirel. Pers. Commun. 114(3), 1905\u20131925 (2020)","journal-title":"Wirel. Pers. Commun."},{"issue":"14","key":"2237_CR34","doi-asserted-by":"publisher","first-page":"11732","DOI":"10.1109\/JIOT.2021.3059735","volume":"8","author":"MQ Zhang","year":"2021","unstructured":"M.Q. Zhang, H.X. Zhang, D.F. Yuan, M.G. Zhang, Learning-based sparse data reconstruction for compressed data aggregation in IoT networks. IEEE Internet Things J. 8(14), 11732\u201311742 (2021)","journal-title":"IEEE Internet Things J."},{"issue":"5","key":"2237_CR35","doi-asserted-by":"publisher","first-page":"1540","DOI":"10.3390\/s20051540","volume":"20","author":"R Sinde","year":"2020","unstructured":"R. Sinde, F. Begum, K. Njay, S. Kaijage, Refining network lifetime of wireless sensor network using energy-efficient clustering and DRL-based sleep scheduling. Sensors 20(5), 1540 (2020)","journal-title":"Sensors"},{"key":"2237_CR36","doi-asserted-by":"publisher","first-page":"102837","DOI":"10.1016\/j.adhoc.2022.102837","volume":"130","author":"Z Guo","year":"2022","unstructured":"Z. Guo, H. Chen, A reinforcement learning-based sleep scheduling algorithm for cooperative computing in event-driven wireless sensor networks. Ad Hoc Netw. 130, 102837 (2022)","journal-title":"Ad Hoc Netw."},{"key":"2237_CR37","doi-asserted-by":"crossref","unstructured":"W. Wang, M. Garofalakis, and K. Ramchandran, \u201cDistributed sparse random projections for refinable approximation,\u201d in 6th International Symposium on Information Processing Sensor Networks (2007) pp. 331\u2013339","DOI":"10.1109\/IPSN.2007.4379693"},{"issue":"4","key":"2237_CR38","doi-asserted-by":"publisher","first-page":"660","DOI":"10.1109\/TWC.2002.804190","volume":"1","author":"W Heinzelman","year":"2002","unstructured":"W. Heinzelman, A. Chandrakasan, H. Balakrishnan, An application-specific protocol architecture for wireless microsensor networks. IEEE Trans. Wireless Commun. 1(4), 660\u2013670 (2002)","journal-title":"IEEE Trans. Wireless Commun."},{"issue":"1","key":"2237_CR39","doi-asserted-by":"publisher","first-page":"2629662","DOI":"10.1145\/2629662","volume":"11","author":"M Shan","year":"2014","unstructured":"M. Shan, G. Chen, D. Luo, X. Zhu, X. Wu, Building maximum lifetime shortest path data aggregation trees in wireless sensor networks. ACM Trans. Sensor Netw. 11(1), 2629662 (2014)","journal-title":"ACM Trans. Sensor Netw."}],"container-title":["EURASIP Journal on Wireless Communications and Networking"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-023-02237-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13638-023-02237-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-023-02237-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,9]],"date-time":"2023-12-09T16:52:53Z","timestamp":1702140773000},"score":1,"resource":{"primary":{"URL":"https:\/\/jwcn-eurasipjournals.springeropen.com\/articles\/10.1186\/s13638-023-02237-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,13]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2237"],"URL":"https:\/\/doi.org\/10.1186\/s13638-023-02237-4","relation":{},"ISSN":["1687-1499"],"issn-type":[{"value":"1687-1499","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,13]]},"assertion":[{"value":"31 October 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 March 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"28"}}