{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T13:42:34Z","timestamp":1762004554978,"version":"build-2065373602"},"reference-count":24,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2013,11,4]],"date-time":"2013-11-04T00:00:00Z","timestamp":1383523200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Vehicular communication platforms that provide real-time access to wireless networks have drawn more and more attention in recent years. IEEE 802.11p is the main radio access technology that supports communication for high mobility terminals, however, due to its limited coverage, IEEE 802.11p is usually deployed by coupling with cellular networks to achieve seamless mobility. In a heterogeneous cellular\/802.11p network, vehicular communication is characterized by its short time span in association with a wireless local area network (WLAN). Moreover, for the media access control (MAC) scheme used for WLAN, the network throughput dramatically decreases with increasing user quantity. In response to these compelling problems, we propose a reinforcement sensor (RFS) embedded vertical handoff control strategy to support mobility management. The RFS has online learning capability and can provide optimal handoff decisions in an adaptive fashion without prior knowledge. The algorithm integrates considerations including vehicular mobility, traffic load, handoff latency, and network status. Simulation results verify that the proposed algorithm can adaptively adjust the handoff strategy, allowing users to stay connected to the best network. Furthermore, the algorithm can ensure that RSUs are adequate, thereby guaranteeing a high quality user experience.<\/jats:p>","DOI":"10.3390\/s131115026","type":"journal-article","created":{"date-parts":[[2013,11,4]],"date-time":"2013-11-04T10:44:54Z","timestamp":1383561894000},"page":"15026-15047","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A Reinforcement Sensor Embedded Vertical Handoff Controller for Vehicular Heterogeneous Wireless Networks"],"prefix":"10.3390","volume":"13","author":[{"given":"Limin","family":"Li","sequence":"first","affiliation":[{"name":"CRC, School of Electronics and Information Engineering, Harbin Institute of Technology,  Nan Gang District, Harbin 150001, China"},{"name":"INFINITUS, School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue 639798, Singapore"}]},{"given":"Yubin","family":"Xu","sequence":"additional","affiliation":[{"name":"CRC, School of Electronics and Information Engineering, Harbin Institute of Technology,  Nan Gang District, Harbin 150001, China"}]},{"given":"Boon-Hee","family":"Soong","sequence":"additional","affiliation":[{"name":"INFINITUS, School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue 639798, Singapore"}]},{"given":"Lin","family":"Ma","sequence":"additional","affiliation":[{"name":"CRC, School of Electronics and Information Engineering, Harbin Institute of Technology,  Nan Gang District, Harbin 150001, China"}]}],"member":"1968","published-online":{"date-parts":[[2013,11,4]]},"reference":[{"key":"ref_1","unstructured":"IEEE 802 Working Group (2010). IEEE Standard for Information Technology\u2014Telecommunications and Information Exchange Between Systems\u2014Local and Metropolitan Area Networks\u2014Specific Requirements; Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications, Amendment 6: Wireless Access in Vehicular Environments, IEEE Std. 802."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1467","DOI":"10.3390\/s130201467","article-title":"Virtual induction loops based on cooperative vehicular communications","volume":"13","author":"Gramaglia","year":"2013","journal-title":"Sensors"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"10146","DOI":"10.3390\/s101110146","article-title":"Sensor based framework for secure multimedia communication in VANET","volume":"10","author":"Rahim","year":"2010","journal-title":"Sensors"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1109\/MWC.2003.1182111","article-title":"Always best connected","volume":"10","author":"Gustafsson","year":"2003","journal-title":"IEEE Wirel. Commun."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MWC.2004.1308935","article-title":"Vertical handoffs in fourth-generation multinetwork environments","volume":"11","author":"McNair","year":"2004","journal-title":"IEEE Wirel. Commun."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1268","DOI":"10.1109\/TCE.2007.4429211","article-title":"Movement-aware vertical handoff of WLAN and mobile Wimax for seamless ubiquitous access","volume":"53","author":"Lee","year":"2007","journal-title":"IEEE Trans. Consum. Electr."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yang, K., Gondal, I., Qiu, B., and Dooley, L.S. (2007, January 26\u201330). Combined SINR Based Vertical Handoff Algorithm for Next Generation Heterogeneous Wireless Networks. Washington DC, USA.","DOI":"10.1109\/GLOCOM.2007.852"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3679","DOI":"10.1109\/TVT.2008.921619","article-title":"Cross-layer-based adaptive vertical handoff with predictive RSS in heterogeneous wireless networks","volume":"57","author":"Chang","year":"2008","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Haider, A., Gondal, I., and Kamruzzaman, J. (2011, January 15\u201318). Dynamic Dwell Timer for Hybrid Vertical Handover in 4G Coupled Networks. Yokohama, Japan.","DOI":"10.1109\/VETECS.2011.5956636"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tabrizi, H., Farhadi, G., and Cioffi, J. (2012, January 10\u201315). Dynamic Handoff Decision in Heterogeneous Wireless Systems: Q-Learning Approach. Ottawa, ON, Canada.","DOI":"10.1109\/ICC.2012.6364194"},{"key":"ref_11","unstructured":"Zhang, J., Chan, H., and Leung, V. (December, January 27). WLC14\u20136: A Location-Based Vertical Handoff Decision Algorithm for Heterogeneous Mobile Networks. San Francisco, CA, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1109\/JSAC.2011.110304","article-title":"Optimal distributed vertical handoff strategies in vehicular heterogeneous networks","volume":"29","author":"Shafiee","year":"2011","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1109\/TVT.2008.925301","article-title":"Vertical handoff decision algorithms for providing optimized performance in heterogeneous wireless networks","volume":"58","author":"Lee","year":"2009","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_14","unstructured":"Souza, A.B., Barros, A.L.B., Vieira, A.S., Roberto, F.M., and Junior, J.C. (2011, January 23\u201328). An Adaptive Mechanism for Access Control in VANETs. St. Maarten, The Netherlands Antilles."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/TITS.2012.2206387","article-title":"VIP-WAVE: On the feasibility of IP communications in 802.11p vehicular networks","volume":"14","author":"Cespedes","year":"2013","journal-title":"IEEE Trans. Intell. Transport. Sys."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1484","DOI":"10.1109\/26.729393","article-title":"Measurements and models for radio path loss and penetration loss in and around homes and trees at 5.85 GHz","volume":"46","author":"Durgin","year":"1998","journal-title":"IEEE Trans. Commun."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhou, T., Sharif, H., Hempel, M., Mahasukhon, P., Wang, W., and Ma, T. (2009, January 20\u201323). A Deterministic Approach to Evaluate Path Loss Exponents in Large-Scale Outdoor 802.11 WLANs. Zurich, Switzerland.","DOI":"10.1109\/LCN.2009.5355111"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1989","journal-title":"J. Mach. Learn."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Hossain, E. (2009). Heterogeneous Wireless Access Networks, Springer. [1st].","DOI":"10.1007\/978-0-387-09777-0"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1109\/TSMC.1985.6313399","article-title":"Fuzzy identification of systems and its applications to modeling and control","volume":"15","author":"Takagi","year":"1985","journal-title":"IEEE Trans. Syst. Man. Cyb."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/JSAC.2004.826921","article-title":"A Seamless and proactive end-to-end mobility solution for roaming across heterogeneous wireless networks","volume":"22","author":"Guo","year":"2004","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"88","DOI":"10.4236\/jtts.2013.31009","article-title":"Simulation based evaluation of highway road scenario between DSRC\/802.11p MAC protocol and STDMA for vehicle-to-vehicle communication","volume":"3","author":"Khairnar","year":"2013","journal-title":"J. Transport. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1023\/A:1016637622896","article-title":"A capacity analysis for the IEEE 802.11 MAC protocol","volume":"2","author":"Tay","year":"2001","journal-title":"Wirel. Netw."},{"key":"ref_24","unstructured":"(2006). CDMA2000 Wireless IP Network Standard: Packet Data Mobility and Resource Management, 3GPP2 Std. 3GPP2 X. S0011-003-C v3.0."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/13\/11\/15026\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:50:22Z","timestamp":1760219422000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/13\/11\/15026"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,11,4]]},"references-count":24,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2013,11]]}},"alternative-id":["s131115026"],"URL":"https:\/\/doi.org\/10.3390\/s131115026","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2013,11,4]]}}}