{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T03:31:08Z","timestamp":1761708668377},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2011,3,27]],"date-time":"2011-03-27T00:00:00Z","timestamp":1301184000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Wireless Netw"],"published-print":{"date-parts":[[2011,5]]},"DOI":"10.1007\/s11276-011-0335-x","type":"journal-article","created":{"date-parts":[[2011,3,26]],"date-time":"2011-03-26T04:09:36Z","timestamp":1301112576000},"page":"1063-1081","source":"Crossref","is-referenced-by-count":18,"title":["A constrained MDP-based vertical handoff decision algorithm for 4G heterogeneous wireless networks"],"prefix":"10.1007","volume":"17","author":[{"given":"Chi","family":"Sun","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Enrique","family":"Stevens-Navarro","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vahid","family":"Shah-Mansouri","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vincent W. S.","family":"Wong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2011,3,27]]},"reference":[{"key":"335_CR1","unstructured":"3rd Generation Partnership Project (3GPP) http:\/\/www.3gpp.org ."},{"key":"335_CR2","unstructured":"3rd Generation Partnership Project 2 (3GPP2) http:\/\/www.3gpp2.org ."},{"key":"335_CR3","unstructured":"IEEE 802.21 Media Independent Handover Working Group, http:\/\/www.ieee802.org\/21\/ ."},{"issue":"3","key":"335_CR4","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MWC.2004.1308935","volume":"11","author":"J. McNair","year":"2004","unstructured":"McNair, J., & Zhu, F. (2004). Vertical handoffs in fourth-generation multi-network environments. IEEE Wireless Communications, 11(3), 8\u201315.","journal-title":"IEEE Wireless Communications"},{"key":"335_CR5","unstructured":"Chen, W., Liu, J., & Huang, H. (2004). An adaptive scheme for vertical handoff in wireless overlay networks. In Proceedings of ICPAD\u201904, Newport Beach, CA."},{"key":"335_CR6","doi-asserted-by":"crossref","unstructured":"Xia, L., Jiang, L. G., & He, C. (2007). A novel fuzzy logic vertical handoff algorithm with aid of differential prediction and pre-decision method. In Proceedings of IEEE ICC\u201907, Glasgow, Scotland.","DOI":"10.1109\/ICC.2007.939"},{"key":"335_CR7","doi-asserted-by":"crossref","unstructured":"Nasser, N., Guizani, S., & Al-Masri, E. (2007). Middleware vertical handoff manager: A neural network-based solution. In Proceedings of IEEE ICC\u201907, Glasgow, Scotland.","DOI":"10.1109\/ICC.2007.940"},{"key":"335_CR8","doi-asserted-by":"crossref","unstructured":"Mani, M., & Crespi, N. (2006). Handover criteria considerations in future convergent networks. In Proceedings of IEEE GLOBECOM\u201906, San Francisco, CA.","DOI":"10.1109\/GLOCOM.2006.696"},{"issue":"2","key":"335_CR9","doi-asserted-by":"crossref","first-page":"1142","DOI":"10.1109\/TVT.2007.906347","volume":"57","author":"A. V. Garmonov","year":"2008","unstructured":"Garmonov, A. V., Cheon, S. H., Yim, D. H., Han, K. T., Park, Y. S., Savinkov, A. Y., et\u00a0al. (2008). QoS-oriented intersystem handover between IEEE 802.11b and overlay networks. IEEE Transactions on Vehicular Technology, 57(2), 1142\u20131154.","journal-title":"IEEE Transactions on Vehicular Technology"},{"key":"335_CR10","unstructured":"Zhang, W. (2004). Handover decision using fuzzy MADM in heterogeneous networks. In Proceedings of IEEE WCNC\u201904, Atlanta, GA."},{"key":"335_CR11","unstructured":"Bari, F., & Leung, V. (2007). Application of ELECTRE to network selection in a heterogeneous wireless network environment. In Proceedings of IEEE WCNC\u201907, Hong Kong, China."},{"key":"335_CR12","doi-asserted-by":"crossref","unstructured":"Yang, K., Gondal, I., Qiu, B., & Dooley, L. S. (2007). Combined SINR based vertical handoff algorithm for next generation heterogeneous wireless networks. In Proceedings of IEEE GLOBECOM\u201907, Washington, DC.","DOI":"10.1109\/GLOCOM.2007.852"},{"issue":"7","key":"335_CR13","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1109\/TMC.2007.70768","volume":"7","author":"M. Liu","year":"2008","unstructured":"Liu, M., Li, Z., Guo, X., & Dutkiewicz, E. (2008). Performance analysis and optimization of handoff algorithms in heterogeneous wireless networks. IEEE Transactions on Mobile Computing, 7(7), 846\u2013857.","journal-title":"IEEE Transactions on Mobile Computing"},{"key":"335_CR14","doi-asserted-by":"crossref","unstructured":"Chien, S., Liu, H., Low, A. L. Y., Maciocco, C., & Ho, Y. (2008). Smart predictive trigger for effective handover in wireless networks. In Proceedings of IEEE ICC\u201908, Beijing, China.","DOI":"10.1109\/ICC.2008.416"},{"key":"335_CR15","doi-asserted-by":"crossref","unstructured":"Ormond, O., Murphy, J., & Muntean, G. (2006). Utility-based intelligent network selection in beyond 3G systems. In Proceedings of IEEE ICC\u201906, Istanbul, Turkey.","DOI":"10.1109\/ICC.2006.254986"},{"key":"335_CR16","doi-asserted-by":"crossref","unstructured":"Zhang, J., Chan, H. C., & Leung, V. (2006). A location-based vertical handoff decision algorithm for heterogeneous mobile networks. In Proceedings of IEEE GLOBECOM\u201906, San Francisco, CA.","DOI":"10.1109\/GLOCOM.2006.697"},{"key":"335_CR17","unstructured":"Guo, Q., Zhu, J., & Xu, X. (2005). An adaptive multi-criteria vertical handoff decision algorithm for radio heterogeneous networks. In Proceedings of IEEE ICC\u201905, Seoul, Korea."},{"issue":"4","key":"335_CR18","doi-asserted-by":"crossref","first-page":"1268","DOI":"10.1109\/TCE.2007.4429211","volume":"53","author":"W. Lee","year":"2007","unstructured":"Lee, W., Kim, E., Kim, J., Lee, I., & Lee, C. (2007). Movement-aware vertical handoff of WLAN and mobile WiMAX for seamless ubiquitous access. IEEE Transactions on Consumers Electronics, 53(4), 1268\u20131275.","journal-title":"IEEE Transactions on Consumers Electronics"},{"key":"335_CR19","doi-asserted-by":"crossref","unstructured":"Zahran, A., & Liang, B. (2005). Performance evaluation framework for vertical handoff algorithms in heterogeneous networks. In Proceedings of IEEE ICC\u201905, Seoul, Korea.","DOI":"10.1109\/ICC.2005.1494342"},{"key":"335_CR20","doi-asserted-by":"crossref","unstructured":"Wang, J., Prasad, R. V., & Niemegeers, I. (2008). Solving the incertitude of vertical handovers in heterogeneous mobile wireless network using mdp. In Proceedings of IEEE ICC\u201908, Beijing, China.","DOI":"10.1109\/ICC.2008.418"},{"issue":"2","key":"335_CR21","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1109\/TVT.2007.907072","volume":"57","author":"E. Stevens-Navarro","year":"2008","unstructured":"Stevens-Navarro, E., Lin, Y., & Wong, V.W.S. (2008). An MDP-based vertical handoff decision algorithm for heterogeneous wireless networks. IEEE Transactions on Vehicular Technology, 57(2), 1243\u20131254.","journal-title":"IEEE Transactions on Vehicular Technology"},{"key":"335_CR22","doi-asserted-by":"crossref","unstructured":"Sun, C., Stevens-Navarro, E., & Wong, V. (2008). A constrained MDP-based vertical handoff decision algorithm for 4G wireless networks. In Proceedings of IEEE ICC\u201908, Beijing, China.","DOI":"10.1109\/ICC.2008.415"},{"key":"335_CR23","doi-asserted-by":"crossref","unstructured":"Sun, C. (2008). A constrained MDP-based vertical handoff decision algorithm for wireless networks. Master\u2019s thesis, University of British Columbia, Vancouver, BC.","DOI":"10.1109\/ICC.2008.415"},{"key":"335_CR24","volume-title":"Constrained Markov decision processes","author":"E. Altman","year":"1999","unstructured":"Altman, E. (1999). Constrained Markov decision processes. London: Chapman and Hall."},{"issue":"5","key":"335_CR25","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1109\/TNET.2003.815301","volume":"11","author":"B. Liang","year":"2003","unstructured":"Liang, B., & Haas, Z. (2003). Predictive distance-based mobility management for multidimensional PCS networks. IEEE\/ACM Transactions on Networking, 11(5), 718\u2013732.","journal-title":"IEEE\/ACM Transactions on Networking"},{"key":"335_CR26","unstructured":"Tang, S., & Li, W. (2005). Performance analysis of the 3G network with complementary WLANs. In Proceedings of IEEE GLOBECOM\u201905, St. Louis, MO."},{"issue":"7","key":"335_CR27","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1109\/MCOM.2003.1215640","volume":"41","author":"A. Doufexi","year":"2003","unstructured":"Doufexi, A., Tameh, E., Nix, A., Armour, S., & Molina, A. (2003). Hotspot wireless LANs to enhance the performance of 3G and beyond cellular networks. IEEE Communications Magazine, 41(7), 58\u201365.","journal-title":"IEEE Communications Magazine"},{"key":"335_CR28","unstructured":"The network simulator\u2014ns-2, http:\/\/www.isi.edu\/nsnam\/ns ."},{"key":"335_CR29","unstructured":"WiMAX module for ns-2 simulator, http:\/\/ndsl.csie.cgu.edu.tw\/wimaxns2.php ."},{"key":"335_CR30","doi-asserted-by":"crossref","DOI":"10.1002\/9780470316887","volume-title":"Markov decision processes: Discrete stochastic dynamic programming","author":"M. Puterman","year":"1994","unstructured":"Puterman, M. (1994). Markov decision processes: Discrete stochastic dynamic programming. New York: Wiley."},{"key":"335_CR31","volume-title":"Dynamic programming and optimal control","author":"D. P. Bertsekas","year":"2007","unstructured":"Bertsekas, D. P. (2007). Dynamic programming and optimal control (3rd ed.). Boston, MA: Athena Scientific.","edition":"3"},{"issue":"5","key":"335_CR32","doi-asserted-by":"crossref","first-page":"2170","DOI":"10.1109\/TSP.2007.893228","volume":"55","author":"V. Djonin","year":"2007","unstructured":"Djonin, V., & Krishnamurthy, V. (2007). Q-learning algorithms for constrained Markov decision process with randomized monotone policies: Application to MIMO transmission control. IEEE Transactions on Signal Processing, 55(5), 2170\u20132181.","journal-title":"IEEE Transactions on Signal Processing"},{"key":"335_CR33","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/0022-247X(85)90288-4","volume":"112","author":"F. Beutler","year":"1985","unstructured":"Beutler, F., & Ross, K. (1985). Optimal policies for controlled markov chains with a constraint. Journal of Mathematical Analysis and Applications, 112, 236\u2013252.","journal-title":"Journal of Mathematical Analysis and Applications"},{"key":"335_CR34","doi-asserted-by":"crossref","DOI":"10.1515\/9781400822539","volume-title":"Supermodularity and complementary","author":"D. M. Topkis","year":"1998","unstructured":"Topkis, D. M. (1998). Supermodularity and complementary. Princeton: Princeton University Press."}],"container-title":["Wireless Networks"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11276-011-0335-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11276-011-0335-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11276-011-0335-x","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,6,17]],"date-time":"2020-06-17T16:36:19Z","timestamp":1592411779000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11276-011-0335-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,3,27]]},"references-count":34,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2011,5]]}},"alternative-id":["335"],"URL":"https:\/\/doi.org\/10.1007\/s11276-011-0335-x","relation":{},"ISSN":["1022-0038","1572-8196"],"issn-type":[{"value":"1022-0038","type":"print"},{"value":"1572-8196","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,3,27]]}}}