{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T05:07:41Z","timestamp":1784092061592,"version":"3.55.0"},"reference-count":47,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,1,4]],"date-time":"2023-01-04T00:00:00Z","timestamp":1672790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Shandong Provincial Natural Science Foundation, China","award":["ZR2020MF059"],"award-info":[{"award-number":["ZR2020MF059"]}]},{"name":"Shandong Provincial Natural Science Foundation, China","award":["62072287"],"award-info":[{"award-number":["62072287"]}]},{"DOI":"10.13039\/501100001809","name":"China NSFC","doi-asserted-by":"publisher","award":["ZR2020MF059"],"award-info":[{"award-number":["ZR2020MF059"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"China NSFC","doi-asserted-by":"publisher","award":["62072287"],"award-info":[{"award-number":["62072287"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Autonomous underwater vehicles (AUVs)-assisted mobile data collection in underwater wireless sensor networks (UWSNs) has received significant attention because of their mobility and flexibility. To satisfy the increasing demand of diverse application requirements for underwater data collection, such as time-sensitive data freshness, emergency event security as well as energy efficiency, in this paper, we propose a novel multi-modal AUV-assisted data collection scheme which integrates both acoustic and optical technologies and takes advantage of their complementary strengths in terms of communication distance and data rate. In this scheme, we consider the age of information (AoI) of the data packet, node transmission energy as well as energy consumption of the AUV movement, and we make a trade-off between them to retrieve data in a timely and reliable manner. To optimize these, we leverage a deep reinforcement learning (DRL) approach to find the optimal motion trajectory of AUV by selecting the suitable communication options. In addition to that, we also design an optimal angle steering algorithm for AUV navigation under different communication scenarios to reduce energy consumption further. We conduct extensive simulations to verify the effectiveness of the proposed scheme, and the results show that the proposed scheme can significantly reduce the weighted sum of AoI as well as energy consumption.<\/jats:p>","DOI":"10.3390\/s23020578","type":"journal-article","created":{"date-parts":[[2023,1,4]],"date-time":"2023-01-04T05:02:30Z","timestamp":1672808550000},"page":"578","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["AUV-Aided Optical\u2014Acoustic Hybrid Data Collection Based on Deep Reinforcement Learning"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4595-402X","authenticated-orcid":false,"given":"Fanfeng","family":"Bu","sequence":"first","affiliation":[{"name":"College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6796-9658","authenticated-orcid":false,"given":"Hanjiang","family":"Luo","sequence":"additional","affiliation":[{"name":"College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Saisai","family":"Ma","sequence":"additional","affiliation":[{"name":"College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiang","family":"Li","sequence":"additional","affiliation":[{"name":"College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8373-9542","authenticated-orcid":false,"given":"Rukhsana","family":"Ruby","sequence":"additional","affiliation":[{"name":"College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6921-7369","authenticated-orcid":false,"given":"Guangjie","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Systems, Hohai University, Changzhou 213022, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1109\/COMST.2021.3053118","article-title":"Internet of underwater things and big marine data analytics\u2014A comprehensive survey","volume":"23","author":"Jahanbakht","year":"2021","journal-title":"IEEE Commun. Surveys Tuts."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1109\/COMST.2021.3134955","article-title":"Reliable data collection techniques in underwater wireless sensor networks: A survey","volume":"24","author":"Wei","year":"2021","journal-title":"IEEE Commun. Surveys Tuts."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2855","DOI":"10.1109\/COMST.2018.2842060","article-title":"Software-defined architectures and technologies for underwater wireless sensor networks: A survey","volume":"20","author":"Luo","year":"2018","journal-title":"IEEE Commun. Surveys Tuts."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"8360","DOI":"10.1109\/JSEN.2022.3162600","article-title":"Recent progress of air\/water cross-boundary communications for underwater sensor networks: A review","volume":"22","author":"Luo","year":"2022","journal-title":"IEEE Sens. J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"14559","DOI":"10.1109\/JIOT.2021.3049239","article-title":"AoI-inspired collaborative information collection for AUV-assisted internet of underwater things","volume":"8","author":"Fang","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1329","DOI":"10.1109\/TII.2018.2848290","article-title":"An architecture for using autonomous underwater vehicles in wireless sensor networks for underwater pipeline monitoring","volume":"15","author":"Jawhar","year":"2018","journal-title":"IEEE Trans. Ind. Informat."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mahmoodi, K.A., and Uysal, M. (2021, January 24\u201328). AUV Trajectory Optimization for an Optical Underwater Sensor Network in the Presence of Ocean Currents. Proceedings of the 2021 IEEE International Black Sea Conference on Communications and Networking (BlackSeaCom), Bucharest, Romania.","DOI":"10.1109\/BlackSeaCom52164.2021.9527844"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, X., Luo, H., Yang, Y., Ruby, R., and Wu, K. (2021, January 14\u201316). Underwater Real-time Video Transmission via Optical Channels with Swarms of AUVs. Proceedings of the 2021 IEEE 27th International Conference on Parallel and Distributed Systems (ICPADS), Beijing, China.","DOI":"10.1109\/ICPADS53394.2021.00113"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1109\/TVT.2020.3044994","article-title":"A novel underwater acoustic signal denoising algorithm for Gaussian\/non-Gaussian impulsive noise","volume":"70","author":"Wang","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4254","DOI":"10.1109\/ACCESS.2016.2593398","article-title":"Cellular underwater wireless optical CDMA network: Potentials and challenges","volume":"4","author":"Akhoundi","year":"2016","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wang, J., Luo, H., Ruby, R., Liu, J., Guo, K., and Wu, K. (2022, January 26\u201329). Reliable Water-Air Direct Wireless Communication: Kalman Filter-Assisted Deep Reinforcement Learning Approach. Proceedings of the 2022 IEEE 47th Conference on Local Computer Networks (LCN), Edmonton, AB, Canada.","DOI":"10.1109\/LCN53696.2022.9843503"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"134954","DOI":"10.1109\/ACCESS.2019.2942060","article-title":"Multimodal acoustic-RF adaptive routing protocols for underwater wireless sensor networks","volume":"7","author":"Luo","year":"2019","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhao, Z., Liu, C., Qu, W., and Yu, T. (2020, January 6\u20139). An Energy Efficiency Multi-Level Transmission Strategy based on underwater multimodal communication in UWSNs. Proceedings of the IEEE INFOCOM 2020-IEEE Conference on Computer Communications, Toronto, ON, Canada.","DOI":"10.1109\/INFOCOM41043.2020.9155381"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1007\/s11277-020-07883-1","article-title":"Design and analysis of co-operative acoustic and optical hybrid communication for underwater communication","volume":"117","author":"Gauni","year":"2021","journal-title":"Wireless Pers. Commun."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yu, T., Liu, C., Qu, W., and Zhao, Z. (2021, January 25\u201327). OD-PPS: An On-Demand Path Planning Scheme for Maximizing Data Completeness in Multi-modal UWSNs. Proceedings of the International Conference on Wireless Algorithms, Systems, and Applications, Nanjing, China.","DOI":"10.1007\/978-3-030-85928-2_2"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1109\/TMC.2017.2706689","article-title":"Path finding for maximum value of information in multi-modal underwater wireless sensor networks","volume":"17","author":"Gjanci","year":"2018","journal-title":"IEEE Trans. Mobile Comput."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hu, Y., Zheng, Y., Liu, H., Wang, Z., Mao, Y., and Han, H. (2018, January 9\u201311). Mobile sink path planning research for underwater heterogeneous sensor network. Proceedings of the 2018 Chinese Control And Decision Conference (CCDC), Shenyang, China.","DOI":"10.1109\/CCDC.2018.8407899"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1109\/CC.2014.6880460","article-title":"Evaluation of underwater optical-acoustic hybrid network","volume":"11","author":"Han","year":"2014","journal-title":"China Commun."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"7492","DOI":"10.1109\/TIT.2017.2735804","article-title":"Update or wait: How to keep your data fresh","volume":"63","author":"Sun","year":"2017","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Talak, R., Karaman, S., and Modiano, E. (2018, January 26\u201329). Optimizing information freshness in wireless networks under general interference constraints. Proceedings of the Eighteenth ACM International Symposium on Mobile Ad Hoc Networking and Computing, Los Angeles, CA, USA.","DOI":"10.1145\/3209582.3209589"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yi, M., Wang, X., Liu, J., Zhang, Y., and Bai, B. (2020, January 6\u20139). Deep reinforcement learning for fresh data collection in UAV-assisted IoT networks. Proceedings of the IEEE INFOCOM 2020\u2014IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Toronto, ON, Canada.","DOI":"10.1109\/INFOCOMWKSHPS50562.2020.9162896"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.adhoc.2018.08.003","article-title":"MARLIN-Q: Multi-modal communications for reliable and low-latency underwater data delivery","volume":"82","author":"Basagni","year":"2019","journal-title":"Ad Hoc Netw."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1109\/JSEN.2021.3128594","article-title":"A Cooperative Routing Protocol Based on Q-Learning for Underwater Optical-Acoustic Hybrid Wireless Sensor Networks","volume":"22","author":"Shen","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_24","first-page":"1","article-title":"CAPTAIN: A data collection algorithm for underwater optical-acoustic sensor networks","volume":"171","author":"Vieira","year":"2020","journal-title":"Comput. Netw."},{"key":"ref_25","first-page":"1","article-title":"Reinforcement Learning-Based Adaptive Switching Scheme for Hybrid Optical-Acoustic AUV Mobile Network","volume":"2022","author":"Luo","year":"2022","journal-title":"Wirel. Commun. Mob. Com."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"6944","DOI":"10.1109\/JIOT.2021.3115800","article-title":"AUV-Aided Hybrid Data Collection Scheme Based on Value of Information for Internet of Underwater Things","volume":"9","author":"Liu","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"9870","DOI":"10.1109\/JIOT.2020.2994909","article-title":"Value-based hierarchical information collection for AUV-enabled internet of underwater things","volume":"7","author":"Duan","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"10132","DOI":"10.1109\/TVT.2022.3176819","article-title":"Average Peak Age of Information in Underwater Information Collection with Sleep-scheduling","volume":"71","author":"Fang","year":"2022","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Khan, M.T.R., Jembre, Y.Z., Ahmed, S.H., Seo, J., and Kim, D. (2019, January 9\u201313). Data freshness based AUV path planning for UWSN in the internet of underwater things. Proceedings of the 2019 IEEE Global Communications Conference (GLOBECOM), Waikoloa, HI, USA.","DOI":"10.1109\/GLOBECOM38437.2019.9013635"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"13129","DOI":"10.1109\/TVT.2021.3117536","article-title":"Age-optimal information gathering in linear underwater networks: A deep reinforcement learning approach","volume":"70","author":"Dobre","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wu, T., Wen, P., and Tang, S. (2022). Optimal scheduling strategy of AUV based on importance and age of information. Wirel. Netw., 1\u20139.","DOI":"10.1007\/s11276-022-03101-x"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"9904","DOI":"10.1109\/JIOT.2020.2988035","article-title":"An AUV-assisted data gathering scheme based on clustering and matrix completion for smart ocean","volume":"7","author":"Huang","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cheng, W., Teymorian, A.Y., Ma, L., Cheng, X., Lu, X., and Lu, Z. (2008, January 13\u201318). Underwater localization in sparse 3D acoustic sensor networks. Proceedings of the IEEE INFOCOM 2008\u2014The 27th Conference on Computer Communications, Phoenix, AZ, USA.","DOI":"10.1109\/INFOCOM.2008.56"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1109\/MCOM.2009.4752682","article-title":"Underwater acoustic communication channels: Propagation models and statistical characterization","volume":"47","author":"Stojanovic","year":"2009","journal-title":"IEEE Commun. Mag."},{"key":"ref_35","unstructured":"Brekhovskikh, L.M., Lysanov, Y.P., and Beyer, R.T. (2003). Fundamentals of Ocean Acoustics, Springer Science & Business Media."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1145\/1347364.1347373","article-title":"On the relationship between capacity and distance in an underwater acoustic communication channel","volume":"Volume 11","author":"Stojanovic","year":"2007","journal-title":"Proceedings of the ACM SIGMOBILE Mobile Computing and Communications Review"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1109\/TCOMM.2018.2867498","article-title":"Performance characterization of underwater visible light communication","volume":"67","author":"Elamassie","year":"2018","journal-title":"IEEE Trans. Commun."},{"key":"ref_38","unstructured":"Giles, J.W., and Bankman, I.N. (2005, January 17\u201320). Underwater optical communications systems. Part 2: Basic design considerations. Proceedings of the MILCOM 2005\u20132005 IEEE Military Communications Conference, Atlantic City, NJ, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"B1","DOI":"10.1364\/AO.48.0000B1","article-title":"Laser system range calculations and the Lambert W function","volume":"48","author":"Steinvall","year":"2009","journal-title":"Appl. Opt."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Farr, N., Chave, A., Freitag, L., Preisig, J., White, S., Yoerger, D., and Titterton, P. (2005, January 17\u201323). Optical modem technology for seafloor observatories. Proceedings of the OCEANS 2005 MTS\/IEEE, Washington, DC, USA.","DOI":"10.1109\/OCEANS.2006.306806"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Liu, J., Wang, X., Bai, B., and Dai, H. (2018, January 15\u201319). Age-optimal trajectory planning for UAV-assisted data collection. Proceedings of the IEEE INFOCOM 2018-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Honolulu, HI, USA.","DOI":"10.1109\/INFCOMW.2018.8406973"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.oceaneng.2015.12.014","article-title":"Understanding the power requirements of autonomous underwater systems, Part I: An analytical model for optimum swimming speeds and cost of transport","volume":"133","author":"Phillips","year":"2017","journal-title":"Ocean Eng."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Furlong, M.E., McPhail, S.D., and Stevenson, P. (2007, January 18\u201321). A concept design for an ultra-long-range survey class AUV. Proceedings of the OCEANS 2007-Europe, Aberdeen, UK.","DOI":"10.1109\/OCEANSE.2007.4302453"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Rigby, P., Pizarro, O., and Williams, S.B. (2006, January 18\u201321). Towards geo-referenced AUV navigation through fusion of USBL and DVL measurements. Proceedings of the OCEANS 2006, Boston, MA, USA.","DOI":"10.1109\/OCEANS.2006.306898"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"19773","DOI":"10.1109\/JIOT.2022.3168589","article-title":"Unmanned-Surface-Vehicle-Aided Maritime Data Collection Using Deep Reinforcement Learning","volume":"9","author":"Su","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1146","DOI":"10.1016\/j.procs.2017.05.431","article-title":"An adaptive implementation of \u03f5-greedy in reinforcement learning","volume":"109","year":"2017","journal-title":"Procedia Comput. Sci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/578\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T17:58:37Z","timestamp":1760119117000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/578"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,4]]},"references-count":47,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23020578"],"URL":"https:\/\/doi.org\/10.3390\/s23020578","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,4]]}}}