{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:05:55Z","timestamp":1760144755530,"version":"build-2065373602"},"reference-count":25,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,5,21]],"date-time":"2024-05-21T00:00:00Z","timestamp":1716249600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Regional Innovation and Development of the National Natural Science Foundation of China","award":["U21A20449"],"award-info":[{"award-number":["U21A20449"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this article, a novel cross-domain knowledge transfer method is implemented to optimize the tradeoff between energy consumption and information freshness for all pieces of equipment powered by heterogeneous energy sources within smart factory. Three distinct groups of use cases are considered, each utilizing a different energy source: grid power, green energy source, and mixed energy sources. Differing from mainstream algorithms that require consistency among groups, the proposed method enables knowledge transfer even across varying state and\/or action spaces. With the advantage of multiple layers of knowledge extraction, a lightweight knowledge transfer is achieved without the need for neural networks. This facilitates broader applications in self-sustainable wireless networks. Simulation results reveal a notable improvement in the \u2019warm start\u2019 policy for each equipment, manifesting as a 51.32% increase in initial reward compared to a random policy approach.<\/jats:p>","DOI":"10.3390\/s24113265","type":"journal-article","created":{"date-parts":[[2024,5,21]],"date-time":"2024-05-21T05:40:47Z","timestamp":1716270047000},"page":"3265","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Cross-Domain Knowledge Transfer for Sustainable Heterogeneous Industrial Internet-of-Things Networks"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-5525-0410","authenticated-orcid":false,"given":"Zhenzhen","family":"Gong","sequence":"first","affiliation":[{"name":"National Engineering Laboratory for Mobile Network Technologies, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qimei","family":"Cui","sequence":"additional","affiliation":[{"name":"National Engineering Laboratory for Mobile Network Technologies, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Ni","sequence":"additional","affiliation":[{"name":"Data61, Commonwealth Science and Industrial Research Organization (CSIRO), Marsfield, NSW 2122, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1109\/MNET.001.1900287","article-title":"A vision of 6G wireless systems: Applications, trends, technologies, and open research problems","volume":"34","author":"Saad","year":"2019","journal-title":"IEEE Netw."},{"key":"ref_2","unstructured":"(2024, April 06). The Sustainable Development Goals Report. Available online: https:\/\/unstats.un.org\/sdgs\/report\/2019\/The-Sustainable-Development-Goals-Report-2019.pdf."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, X., Cui, Q., Feng, D., Gong, Z., and Tao, X. (2023, January 4\u20138). Deep Reinforcement Learning-Based Solution for Minimizing the Alterable Urgency of Information in UAV-Enabled IIoT System. Proceedings of the GLOBECOM 2023\u20142023 IEEE Global Communications Conference, Kuala Lumpur, Malaysia.","DOI":"10.1109\/GLOBECOM54140.2023.10437208"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.comcom.2020.11.016","article-title":"Industrial Internet of Things and its applications in industry 4.0: State of the art","volume":"166","author":"Malik","year":"2021","journal-title":"Comput. Commun."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5732","DOI":"10.1109\/JSEN.2024.3352402","article-title":"RF Energy Harvesting Techniques for Battery-less Wireless Sensing, Industry 4.0 and Internet of Things: A Review","volume":"24","author":"Moloudian","year":"2024","journal-title":"IEEE Sens. J."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Folgado, F.J., Calder\u00f3n, D., Gonz\u00e1lez, I., and Calder\u00f3n, A.J. (2024). Review of Industry 4.0 from the Perspective of Automation and Supervision Systems: Definitions, Architectures and Recent Trends. Electronics, 13.","DOI":"10.3390\/electronics13040782"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cort\u00e9s-Leal, A., C\u00e1rdenas, C., and Del-Valle-Soto, C. (2022). Maintenance 5.0: Towards a Worker-in-the-Loop Framework for Resilient Smart Manufacturing. Appl. Sci., 12.","DOI":"10.3390\/app122211330"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2589","DOI":"10.1016\/j.renene.2019.08.092","article-title":"A survey on smart grid technologies and applications","volume":"146","author":"Dileep","year":"2020","journal-title":"Renew. Energy"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"124766","DOI":"10.1016\/j.cej.2020.124766","article-title":"Solar energy conversion and utilization: Towards the emerging photo-electrochemical devices based on perovskite photovoltaics","volume":"393","author":"Zhang","year":"2020","journal-title":"Chem. Eng. J."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ibrahim, H.H., Singh, M.J., Al-Bawri, S.S., Ibrahim, S.K., Islam, M.T., Alzamil, A., and Islam, M.S. (2022). Radio frequency energy harvesting technologies: A comprehensive review on designing, methodologies, and potential applications. Sensors, 22.","DOI":"10.3390\/s22114144"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kaul, S., Yates, R., and Gruteser, M. (2012, January 25\u201330). Real-time status: How often should one update?. Proceedings of the 2012 Proceedings IEEE INFOCOM, Orlando, FL, USA.","DOI":"10.1109\/INFCOM.2012.6195689"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Dang, Q., Cui, Q., Gong, Z., Zhang, X., Huang, X., and Tao, X. (2022, January 10\u201313). AoI oriented UAV trajectory planning in wireless powered IoT networks. Proceedings of the 2022 IEEE Wireless Communications and Networking Conference (WCNC), Austin, TX, USA.","DOI":"10.1109\/WCNC51071.2022.9771588"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"6458","DOI":"10.1109\/JIOT.2021.3110996","article-title":"LoRa-RL: Deep reinforcement learning for resource management in hybrid energy LoRa wireless networks","volume":"9","author":"Hamdi","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"990","DOI":"10.1109\/TGCN.2020.3045075","article-title":"Deep reinforcement learning-assisted energy harvesting wireless networks","volume":"5","author":"Ye","year":"2020","journal-title":"IEEE Trans. Green Commun. Netw."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Gong, Z., Cui, Q., Chaccour, C., Zhou, B., Chen, M., and Saad, W. (2021, January 14\u201323). Lifelong learning for minimizing age of information in Internet of Things networks. Proceedings of the ICC 2021-IEEE International Conference on Communications, Montreal, QC, Canada.","DOI":"10.1109\/ICC42927.2021.9500646"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Gong, Z., Hashash, O., Wang, Y., Cui, Q., Ni, W., Saad, W., and Sakaguchi, K. (2023). UAV-aided lifelong learning for AoI and energy optimization in non-stationary IoT networks. arXiv.","DOI":"10.1109\/JIOT.2024.3406220"},{"key":"ref_17","first-page":"2755","article-title":"Dynamic weighted majority: An ensemble method for drifting concepts","volume":"8","author":"Kolter","year":"2007","journal-title":"J. Mach. Learn. Res."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wu, Q., Iyer, N., and Wang, H. (2018, January 8\u201312). Learning contextual bandits in a non-stationary environment. Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, Ann Arbor, MI, USA.","DOI":"10.1145\/3209978.3210051"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1109\/MNET.011.2100134","article-title":"Federated imitation learning: A cross-domain knowledge sharing framework for traffic scheduling in 6G ubiquitous IoT","volume":"35","author":"Yu","year":"2021","journal-title":"IEEE Netw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/MCOM.2019.1800644","article-title":"Stochastic online learning for mobile edge computing: Learning from changes","volume":"57","author":"Cui","year":"2019","journal-title":"IEEE Commun. Mag."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1109\/LWC.2017.2759114","article-title":"Resource allocation for D2D communications underlaying a NOMA-based cellular network","volume":"7","author":"Pan","year":"2017","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1109\/COMST.2014.2368999","article-title":"Wireless networks with RF energy harvesting: A contemporary survey","volume":"17","author":"Lu","year":"2014","journal-title":"IEEE Commun. Surv. Tutorials"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1007\/BF00992696","article-title":"Simple Statistical Gradient-following Algorithms for Connectionist Reinforcement Learning","volume":"8","author":"Williams","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1180","DOI":"10.1016\/j.neucom.2007.11.026","article-title":"Natural Actor-critic","volume":"71","author":"Peters","year":"2008","journal-title":"Neurocomputing"},{"key":"ref_25","unstructured":"Ammar, H.B., Eaton, E., Ruvolo, P., and Taylor, M. (2014, January 21\u201326). Online multi-task learning for policy gradient methods. Proceedings of the International Conference on Machine Learning. PMLR, Beijing, China."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3265\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:45:37Z","timestamp":1760107537000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3265"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,21]]},"references-count":25,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["s24113265"],"URL":"https:\/\/doi.org\/10.3390\/s24113265","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2024,5,21]]}}}