{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:35:08Z","timestamp":1760142908178,"version":"build-2065373602"},"reference-count":31,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2024,1,7]],"date-time":"2024-01-07T00:00:00Z","timestamp":1704585600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Kongju National University","award":["2021RIS-003"],"award-info":[{"award-number":["2021RIS-003"]}]},{"name":"National Research Foundation of Korea (NRF)","award":["2021RIS-003"],"award-info":[{"award-number":["2021RIS-003"]}]},{"name":"Ministry of Education (MOE)","award":["2021RIS-003"],"award-info":[{"award-number":["2021RIS-003"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In heterogeneous wireless networked control systems (WNCSs), the age of information (AoI) of the actuation update and actuation update cost are important performance metrics. To reduce the monetary cost, the control system can wait for the availability of a WiFi network for the actuator and then conduct the update using a WiFi network in an opportunistic manner, but this leads to an increased AoI of the actuation update. In addition, since there are different AoI requirements according to the control priorities (i.e., robustness of AoI of the actuation update), these need to be considered when delivering the actuation update. To jointly consider the monetary cost and AoI with priority, this paper proposes a priority-aware actuation update scheme (PAUS) where the control system decides whether to deliver or delay the actuation update to the actuator. For the optimal decision, we formulate a Markov decision process model and derive the optimal policy based on Q-learning, which aims to maximize the average reward that implies the balance between the monetary cost and AoI with priority. Simulation results demonstrate that the PAUS outperforms the comparison schemes in terms of the average reward under various settings.<\/jats:p>","DOI":"10.3390\/s24020357","type":"journal-article","created":{"date-parts":[[2024,1,8]],"date-time":"2024-01-08T06:12:58Z","timestamp":1704694378000},"page":"357","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Priority-Aware Actuation Update Scheme in Heterogeneous Industrial Networks"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5247-0296","authenticated-orcid":false,"given":"Yeunwoong","family":"Kyung","sequence":"first","affiliation":[{"name":"Division of Information & Communication Engineering, Kongju National University, Cheonan-daero, Cheonan 31080, Republic of Korea"}]},{"given":"Jihoon","family":"Sung","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, KAIST, 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9067-445X","authenticated-orcid":false,"given":"Haneul","family":"Ko","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Kyung Hee University, Yongin-si 17104, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2447-9613","authenticated-orcid":false,"given":"Taewon","family":"Song","sequence":"additional","affiliation":[{"name":"Department of Internet of Things, SCH MediaLabs, Soonchunhyang University, 22 Soonchunhyang-ro, Shinchang-myeon, Asan-si 31538, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9840-4075","authenticated-orcid":false,"given":"Youngjun","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Kyungnam University, Changwon-si 51767, Republic of Korea"}]}],"member":"1968","published-online":{"date-parts":[[2024,1,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/MIAS.2018.2875184","article-title":"A New Adaptive Controller in Wireless Networked Control Systems: Developing a Robust and Effective Controller for Energy Efficiency","volume":"25","author":"Mansano","year":"2019","journal-title":"IEEE Ind. Appl. Mag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"8464","DOI":"10.1109\/JIOT.2020.3046742","article-title":"AoI-Aware Control and Communication Co-Design for Industrial IoT Systems","volume":"8","author":"Wang","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1788","DOI":"10.1109\/JIOT.2019.2957433","article-title":"Wireless Networked Control Systems With Coding-Free Data Transmission for Industrial IoT","volume":"7","author":"Liu","year":"2020","journal-title":"IEEE Internet Things J."},{"doi-asserted-by":"crossref","unstructured":"Wang, Y., Wu, S., Lei, C., Jiao, J., and Zhang, Q. (2023). A Review on Wireless Networked Control System: The Communication Perspective. IEEE Internet Things J.","key":"ref_4","DOI":"10.1109\/JIOT.2023.3342032"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4401","DOI":"10.1109\/TWC.2022.3225085","article-title":"Throughput Maximization of Wireless-Powered Communication Network With Mobile Access Points","volume":"22","author":"Liu","year":"2023","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"21946","DOI":"10.1109\/JSEN.2023.3301489","article-title":"Control-Aware Resource Scheduling Method for Wireless Networked Control Systems","volume":"23","author":"Zheng","year":"2023","journal-title":"IEEE Sens. J."},{"doi-asserted-by":"crossref","unstructured":"Zheng, K., Luo, R., Wang, Z., Liu, X., and Yao, Y. (2023). Short-Term and Long-Term Throughput Maximization in Mobile Wireless-Powered Internet of Things. IEEE Internet Things J.","key":"ref_7","DOI":"10.1109\/JIOT.2023.3326440"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1223","DOI":"10.1109\/TAC.2022.3153275","article-title":"Effects of Jamming Attacks on Wireless Networked Control Systems Under Disturbance","volume":"68","author":"Cetinkaya","year":"2023","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"7492","DOI":"10.1109\/TIT.2017.2735804","article-title":"Update or Wait: How to Keep Your Data Fresh","volume":"63","author":"Sun","year":"2017","journal-title":"IEEE Trans. Inf. Theory"},{"doi-asserted-by":"crossref","unstructured":"Kaul, S., Yates, R., and Gruteser, M. (2012, January 25\u201330). Real-time status: How often should one update?. Proceedings of the 2012 Proceedings IEEE INFOCOM, Orlando, FL, USA.","key":"ref_10","DOI":"10.1109\/INFCOM.2012.6195689"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1109\/TCOMM.2020.3027877","article-title":"Statistical Guarantee Optimization for AoI in Single-Hop and Two-Hop FCFS Systems With Periodic Arrivals","volume":"69","author":"Champati","year":"2021","journal-title":"IEEE Trans. Commun."},{"doi-asserted-by":"crossref","unstructured":"Chang, B., Li, L., Zhao, G., Meng, Z., Imran, M.A., and Chen, Z. (2020, January 6\u20139). Age of Information for Actuation Update in Real-Time Wireless Control Systems. Proceedings of the IEEE INFOCOM 2020\u2014IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Toronto, ON, Canada.","key":"ref_12","DOI":"10.1109\/INFOCOMWKSHPS50562.2020.9163049"},{"doi-asserted-by":"crossref","unstructured":"Xu, C., Xu, Q., Wang, J., Wu, K., Lu, K., and Qiao, C. (2022, January 2\u20135). AoI-centric Task Scheduling for Autonomous Driving Systems. Proceedings of the IEEE INFOCOM 2022\u2014IEEE Conference on Computer Communications, London, UK.","key":"ref_13","DOI":"10.1109\/INFOCOM48880.2022.9796958"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3944","DOI":"10.1109\/JIOT.2022.3150070","article-title":"Cooperative Transmission Scheduling and Computation Offloading With Collaboration of Fog and Cloud for Industrial IoT Applications","volume":"10","author":"Hazra","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2065","DOI":"10.1109\/TII.2022.3215231","article-title":"A Survey of Network Automation for Industrial Internet-of-Things Toward Industry 5.0","volume":"19","author":"Chi","year":"2023","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1109\/MCOM.001.2100615","article-title":"5G-CLARITY: 5G-Advanced Private Networks Integrating 5GNR, WiFi, and LiFi","volume":"60","author":"Cogalan","year":"2022","journal-title":"IEEE Commun. Mag."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"7174","DOI":"10.1109\/TII.2022.3140792","article-title":"Fog Computing and Blockchain-Based Security Service Architecture for 5G Industrial IoT-Enabled Cloud Manufacturing","volume":"18","author":"Hewa","year":"2022","journal-title":"IEEE Trans. Ind. Inform."},{"doi-asserted-by":"crossref","unstructured":"Altman, E., El-Azouzi, R., Menasche, D.S., and Xu, Y. (2019, January 2\u20135). Forever Young: Aging Control For Hybrid Networks. Proceedings of the Mobihoc \u201919: Twentieth ACM International Symposium on Mobile Ad Hoc Networking and Computing, New York, NY, USA.","key":"ref_18","DOI":"10.1145\/3323679.3326507"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"7027","DOI":"10.1109\/TMC.2022.3205292","article-title":"Age-Optimal Scheduling Over Hybrid Channels","volume":"22","author":"Pan","year":"2023","journal-title":"IEEE Trans. Mob. Comput."},{"doi-asserted-by":"crossref","unstructured":"Bhati, A., Pillai, S.R.B., and Vaze, R. (2021, January 27\u201330). On the Age of Information of a Queuing System with Heterogeneous Servers. Proceedings of the 2021 National Conference on Communications (NCC), Kanpur, India.","key":"ref_20","DOI":"10.1109\/NCC52529.2021.9530190"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1109\/JSAIT.2023.3328766","article-title":"Statistical Age-of-Information Bounds for Parallel Systems: When Do Independent Channels Make a Difference?","volume":"4","author":"Fidler","year":"2023","journal-title":"IEEE J. Sel. Areas Inf. Theory"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1109\/TII.2023.3268749","article-title":"Scheduling for Minimizing the Age of Information in Multi-Sensor Multi-Server Industrial IoT Systems","volume":"20","author":"Xie","year":"2023","journal-title":"IEEE Trans. Ind. Inform."},{"doi-asserted-by":"crossref","unstructured":"Raiss-el fenni, M., El-Azouzi, R., Menasche, D.S., and Xu, Y. (2012, January 9\u201312). Optimal sensing policies for smartphones in hybrid networks: A POMDP approach. Proceedings of the 6th International ICST Conference on Performance Evaluation Methodologies and Tools, Corsica, France.","key":"ref_23","DOI":"10.4108\/valuetools.2012.250332"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"10203","DOI":"10.1109\/TVT.2022.3179658","article-title":"Performance Analysis and Optimization of Delayed Offloading System With Opportunistic Fog Node","volume":"71","author":"Ko","year":"2022","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3813","DOI":"10.1109\/TVT.2015.2437325","article-title":"Efficiency Analysis of WiFi Offloading Techniques","volume":"65","author":"Suh","year":"2016","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1109\/JIOT.2019.2950054","article-title":"Age-Upon-Decisions Minimizing Scheduling in Internet of Things: To Be Random or To Be Deterministic?","volume":"7","author":"Dong","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3541","DOI":"10.1109\/TNSM.2021.3073244","article-title":"A Service-Centric Q-Learning Algorithm for Mobility Robustness Optimization in LTE","volume":"18","author":"Mwanje","year":"2021","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"6452","DOI":"10.1109\/TVT.2020.2985873","article-title":"Energy-Efficient Power Allocation and Q-Learning-Based Relay Selection for Relay-Aided D2D Communication","volume":"69","author":"Wang","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1619","DOI":"10.1109\/LWC.2022.3169109","article-title":"Q-Learning NOMA Random Access for IoT-Satellite Terrestrial Relay Networks","volume":"11","author":"Tubiana","year":"2022","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1109\/TCOMM.2022.3221422","article-title":"DDPG-Based Joint Time and Energy Management in Ambient Backscatter-Assisted Hybrid Underlay CRNs","volume":"71","author":"Zheng","year":"2023","journal-title":"IEEE Trans. Commun."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1109\/TNSM.2021.3074618","article-title":"AI-Based Network-Aware Service Function Chain Migration in 5G and Beyond Networks","volume":"19","author":"Addad","year":"2022","journal-title":"IEEE Trans. Netw. Serv. Manag."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/2\/357\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:41:34Z","timestamp":1760103694000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/2\/357"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,7]]},"references-count":31,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["s24020357"],"URL":"https:\/\/doi.org\/10.3390\/s24020357","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2024,1,7]]}}}