{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T14:14:01Z","timestamp":1761401641139},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2012,11,29]],"date-time":"2012-11-29T00:00:00Z","timestamp":1354147200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/2.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Wireless Com Network"],"published-print":{"date-parts":[[2012,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Wireless relay transmission has been considered as a supplementary technology for future wireless communication system, and handover is a key element in wireless relay transmissions to support users\u2019 mobility. Handover failure will result in the forced termination of an ongoing call, and a good handover scheme will provide good system performance. This article focuses on the handover decision problem in wireless relay transmission systems. Initially, the architecture of a single-cell relay system is introduced. The handover decision problem is formulated as a Markov decision process (MDP). In the proposed model, a profit function is used to evaluate the quality-of-service of the chosen serving node, and a cost function is used to model processing load and signaling cost. Based on the profit and cost functions, the reward function is formulated. Moreover, the objective is to maximize the expected total reward per connection. The value iteration algorithm is employed to determine the optimal handover policy. Furthermore, the analysis is generalized to multi-cell relay systems. Numerical results show that the proposed MDP-based handover policy is well behaved in wireless relay systems.<\/jats:p>","DOI":"10.1186\/1687-1499-2012-358","type":"journal-article","created":{"date-parts":[[2012,11,30]],"date-time":"2012-11-30T01:15:05Z","timestamp":1354238105000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["MDP-based handover policy in wireless relay systems"],"prefix":"10.1186","volume":"2012","author":[{"given":"Xiaoyu","family":"Dang","sequence":"first","affiliation":[]},{"given":"Jin-Yuan","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Zhe","family":"Cao","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2012,11,29]]},"reference":[{"issue":"1","key":"574_CR1","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1109\/49.909617","volume":"19","author":"J Wang","year":"2001","unstructured":"Wang J, Chen J: Performance of wideband CDMA systems with complex spreading and imperfect channel estimation. IEEE J. Sel. Areas Commun 2001, 19(1):152-163. 10.1109\/49.909617","journal-title":"IEEE J. Sel. Areas Commun"},{"issue":"1","key":"574_CR2","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1109\/TVT.2008.924983","volume":"58","author":"J-B Wang","year":"2009","unstructured":"Wang J-B, Chen M, Wan X, Wei C: Ant-colony-optimization-based scheduling algorithm for uplink CDMA nonreal-time data. IEEE Trans. Veh. Technol 2009, 58(1):231-241.","journal-title":"IEEE Trans. Veh. Technol"},{"issue":"9","key":"574_CR3","doi-asserted-by":"publisher","first-page":"2734","DOI":"10.1109\/TCOMM.2009.09.080067","volume":"57","author":"H Zhu","year":"2009","unstructured":"Zhu H, Wang J, Chunk-based resource allocation in OFDMA systems\u2014Part: I chunk allocation: IEEE Trans. Commun. 2009, 57(9):2734-2744.","journal-title":"IEEE Trans. Commun"},{"issue":"14","key":"574_CR4","doi-asserted-by":"publisher","first-page":"764","DOI":"10.1049\/el:20070786","volume":"43","author":"J-B Wang","year":"2007","unstructured":"Wang J-B, Chen M: Optimal uplink packet scheduling for CDMA non-real time data. IEE Electron. Lett 2007, 43(14):764-766. 10.1049\/el:20070786","journal-title":"IEE Electron. Lett"},{"key":"574_CR5","volume-title":"IEEE Standard","author":"IEEE","year":"2007","unstructured":"IEEE: Draft Standard for Local and Metropolitan Area Networks\u2014Part 16: Air Interface for Fixed and Mobile Broadband Wireless Access Systems: Multihop Relay Specification. IEEE Standard 2007. 2007. 4312731"},{"key":"574_CR6","volume-title":"Part 16: Air Interface for Fixed and Mobile Broadband Wireless Access Systems: Multihop Relay Specification, IEEE P802.16j Base Line Document","author":"IEEE","year":"2007","unstructured":"IEEE: Part 16: Air Interface for Fixed and Mobile Broadband Wireless Access Systems: Multihop Relay Specification, IEEE P802.16j Base Line Document. 2007."},{"issue":"1","key":"574_CR7","doi-asserted-by":"publisher","first-page":"120","DOI":"10.2307\/1426331","volume":"3","author":"EC van der Meulen","year":"1971","unstructured":"van der Meulen EC, Three-terminal communication channels: Adv. Appl. Probab. 1971, 3(1):120-154. 10.2307\/1426331","journal-title":"Adv. Appl. Probab"},{"issue":"5","key":"574_CR8","doi-asserted-by":"publisher","first-page":"572","DOI":"10.1109\/TIT.1979.1056084","volume":"IT-25","author":"TM Cover","year":"1979","unstructured":"Cover TM, El Gamal AA: Capacity theorems for the relay channel. IEEE Trans. Inf. Theory 1979, IT-25(5):572-584.","journal-title":"IEEE Trans. Inf. Theory"},{"issue":"3","key":"574_CR9","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1109\/LCOMM.2011.012511.102192","volume":"15","author":"X Lei","year":"2011","unstructured":"Lei X, Li W: Exact closed-form expression for ergodic capacity of amplify-and-forward relaying in channel-noise-assisted cooperative networks with relay selection. IEEE Commun. Lett 2011, 15(3):332-333.","journal-title":"IEEE Commun. Lett"},{"issue":"2","key":"574_CR10","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1109\/TIT.2008.2009822","volume":"55","author":"Y Ding","year":"2009","unstructured":"Ding Y, Zhang J-K, Wong KM: Ergodic channel capacities for the amplify-and-forward half-duplex cooperative systems. IEEE Trans. Inf. Theory 2009, 55(2):713-730.","journal-title":"IEEE Trans. Inf. Theory"},{"issue":"11","key":"574_CR11","doi-asserted-by":"publisher","first-page":"5449","DOI":"10.1109\/TWC.2009.090209","volume":"8","author":"U-K Kwon","year":"2009","unstructured":"Kwon U-K, Choi C-H, Im G-H: Full-rate cooperative communications with spatial diversity for half-duplex uplink relay channels. IEEE Trans. Wirel. Commun 2009, 8(11):5449-5454.","journal-title":"IEEE Trans. Wirel. Commun"},{"issue":"5","key":"574_CR12","first-page":"102","volume":"8","author":"J-B Wang","year":"2011","unstructured":"Wang J-B, Jiao Y, Chen M, Wang J-Y, Cao Z: Multi-hop free space optical communications using serial decode-and-forward relay transmissions. China Commun 2011, 8(5):102-110.","journal-title":"China Commun"},{"issue":"3","key":"574_CR13","doi-asserted-by":"publisher","first-page":"1247","DOI":"10.1109\/TWC.2009.07051022","volume":"8","author":"Z Ding","year":"2009","unstructured":"Ding Z, Leung KK, Goeckel DL, Towsley D: On the study of network coding with diversity. IEEE Trans. Wirel. Commun 2009, 8(3):1247-1259.","journal-title":"IEEE Trans. Wirel. Commun"},{"issue":"3","key":"574_CR14","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1109\/TWC.2007.05272","volume":"6","author":"J Luo","year":"2007","unstructured":"Luo J, Blum RS, Cimini LJ, Greenstein LJ, Haimovich AM: Decode-and-forward cooperative diversity with power allocation in wireless networks. IEEE Trans. Wirel. Commun 2007, 6(3):793-799.","journal-title":"IEEE Trans. Wirel. Commun"},{"issue":"2","key":"574_CR15","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1109\/JSAC.2007.070209","volume":"25","author":"TC-Y Ng","year":"2007","unstructured":"Ng TC-Y, Yu W: Joint optimization of relay strategies and resource allocations in cooperative cellular networks. IEEE J. Sel. Areas Commun 2007, 25(2):328-339.","journal-title":"IEEE J. Sel. Areas Commun"},{"issue":"9","key":"574_CR16","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1109\/MCOM.2004.1336724","volume":"42","author":"R Pabst","year":"2004","unstructured":"Pabst R, Walke BH, Schultz DC, Herhold P, Yanikomeroglu H, Mukherjee S, Viswanathan H, Lott M, Zirwas W, Dohler M, Aghvami H, Falconer DD, Fettweis GP: Relay-based deployment concepts for wireless and mobile broadband radio. IEEE Commun. Mag 2004, 42(9):80-89. 10.1109\/MCOM.2004.1336724","journal-title":"IEEE Commun. Mag"},{"issue":"10","key":"574_CR17","doi-asserted-by":"publisher","first-page":"2105","DOI":"10.1109\/49.957326","volume":"19","author":"H Wu","year":"2001","unstructured":"Wu H, Qiao C, De S, Tonguz O: Integrated cellular and ad hoc relaying systems: iCAR. IEEE J. Sel. Areas Commun 2001, 19(10):2105-2115. 10.1109\/49.957326","journal-title":"IEEE J. Sel. Areas Commun"},{"issue":"7","key":"574_CR18","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1109\/MCOM.2009.5183474","volume":"47","author":"S Cho","year":"2009","unstructured":"Cho S, Jang EW, Cioffi JM: Handover in multihop cellular networks. IEEE Commun. Mag 2009, 47(7):64-73.","journal-title":"IEEE Commun. Mag"},{"issue":"4","key":"574_CR19","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1023\/A:1019197320544","volume":"3","author":"M Stemm","year":"1998","unstructured":"Stemm M, Katz RH: Vertical handoffs in wireless overlay networks. ACM\/Baltzer Mobile Netw. Appl 1998, 3(4):335-350. 10.1023\/A:1019197320544","journal-title":"ACM\/Baltzer Mobile Netw. Appl"},{"issue":"2","key":"574_CR20","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/98.839330","volume":"7","author":"K Pahlavan","year":"2000","unstructured":"Pahlavan K, Krishnamurthy P, Hatami A, Ylianttila M, Makela JP, Pichna R, Vallstron J: Handoff in hybrid mobile data networks. IEEE Personal Commun 2000, 7(2):34-47. 10.1109\/98.839330","journal-title":"IEEE Personal Commun"},{"key":"574_CR21","first-page":"46","volume-title":"Proceedings of the 10th WSEAS International Conference on Signal Processing, Computational Geometry and Artificial Vision","author":"Y-F Huang","year":"2010","unstructured":"Huang Y-F, Gao F-B, Hsu H-C: Performance of an adaptive timer-based handoff scheme for wireless mobile communications. In Proceedings of the 10th WSEAS International Conference on Signal Processing, Computational Geometry and Artificial Vision. Stevens Point, Wisconsin, USA; 2010:46-51."},{"issue":"5","key":"574_CR22","doi-asserted-by":"publisher","first-page":"530","DOI":"10.1109\/TMC.2005.70","volume":"4","author":"H-P Lin","year":"2005","unstructured":"Lin H-P, Juang R-T, Lin D-B: Validation of an improved location-based handover algorithm using GSM measurement data. IEEE Trans. Mobile Comput 2005, 4(5):530-536.","journal-title":"IEEE Trans. Mobile Comput"},{"key":"574_CR23","first-page":"1","volume-title":"Proceedings of the International Conference on Wireless Communications & Signal Processing","author":"J Jiang","year":"2009","unstructured":"Jiang J, Heng W, Zhang H, Wu G, Wang H: A novel handover scheme for multi-hop transparent relay network. In Proceedings of the International Conference on Wireless Communications & Signal Processing. Nanjing, China; November 2009:1-5."},{"key":"574_CR24","first-page":"3439","volume-title":"Proceedings of the IEEE Global Telecommunications Conference","author":"M Ylianttila","year":"2001","unstructured":"Ylianttila M, Pande M, Makela J, Mahonen P: Optimization scheme for mobile users performing vertical handoffs between IEEE 802.11 and GPRS\/EDGE networks. In Proceedings of the IEEE Global Telecommunications Conference. San Antonio, TX, USA; November 2001:3439-3443."},{"issue":"12","key":"574_CR25","doi-asserted-by":"publisher","first-page":"2369","DOI":"10.1007\/s11432-009-0219-1","volume":"52","author":"J-B Wang","year":"2009","unstructured":"Wang J-B, Chen H, Chen M, Wang J: Cross-layer packet scheduling for downlink multiuser OFDM systems. Sci. China Ser. F - Inf. Sci 2009, 52(12):2369-2377. 10.1007\/s11432-009-0219-1","journal-title":"Sci. China Ser. F - Inf. Sci"},{"issue":"11","key":"574_CR26","doi-asserted-by":"publisher","first-page":"3403","DOI":"10.1093\/ietfec\/e91-a.11.3403","volume":"91","author":"W Li","year":"2008","unstructured":"Li W, Wang J-B, Chen M: Outage probability of dual-hop amplify-and-forward relaying systems over shadowed Nakagami-m fading channel. IEICE Trans. Fund. Electron. Commun. Comput. Sci 2008, 91(11):3403-3405.","journal-title":"IEICE Trans. Fund. Electron. Commun. Comput. Sci"},{"key":"574_CR27","doi-asserted-by":"publisher","DOI":"10.1002\/9780470316887","volume-title":"Markov Decision Processes: Discrete Stochastic Dynamic Programming","author":"M Puterman","year":"1994","unstructured":"Puterman M: Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, Hoboken, NJ; 1994."},{"key":"574_CR28","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-0805-2","volume-title":"Handbook of Markov decision processes, ch. Markov Decision Processes in Finance and Dynamic Options","author":"EA Feinberg","year":"2002","unstructured":"Feinberg EA, Schwartz A, Feinberg EA: Handbook of Markov decision processes, ch. Markov Decision Processes in Finance and Dynamic Options. Kluwer, Netherlands; 2002."},{"issue":"2","key":"574_CR29","doi-asserted-by":"publisher","first-page":"542","DOI":"10.1109\/TSP.2005.861785","volume":"54","author":"F Yu","year":"2006","unstructured":"Yu F, Krishnamurthy V, Leung VCM: Cross-layer optimal connection admission control for variable bit rate multimedia traffic in packet wireless CDMA networks. IEEE Trans. Signal Process 2006, 54(2):542-555.","journal-title":"IEEE Trans. Signal Process"},{"issue":"1","key":"574_CR30","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1007\/s11036-005-4464-2","volume":"11","author":"F Yu","year":"2006","unstructured":"Yu F, Wong VWS, Leung VCM: Efficient QoS provisioning for adaptive multimedia in mobile communication networks by reinforcement learning. Mobile Netw. Appl 2006, 11(1):101-110. 10.1007\/s11036-005-4464-2","journal-title":"Mobile Netw. Appl"},{"key":"574_CR31","first-page":"423","volume-title":"Proceedings of the Second International Conference on Intelligent Sensors, Sensor Networks and Information Processing","author":"CK Tham","year":"2005","unstructured":"Tham CK, Renaud JC: Multi-agent systems on sensor networks: a distributed reinforcement learning pproach. In Proceedings of the Second International Conference on Intelligent Sensors, Sensor Networks and Information Processing. Melbourne, Australia; December 2005:423-429."},{"issue":"2","key":"574_CR32","doi-asserted-by":"publisher","first-page":"1243","DOI":"10.1109\/TVT.2007.907072","volume":"57","author":"E Stevens-Navarro","year":"2008","unstructured":"Stevens-Navarro E, Lin Y, Wong VWS: An MDP-based vertical handoff decision algorithm for heterogeneous wireless networks. IEEE Trans. Veh. Technol 2008, 57(2):1243-1254.","journal-title":"IEEE Trans. Veh. Technol"},{"key":"574_CR33","volume-title":"Annex B: Test Environments and Deployment Models","author":"UMTS","year":"1998","unstructured":"UMTS: Annex B: Test Environments and Deployment Models. 1998. UMTS 30.03"},{"key":"574_CR34","doi-asserted-by":"publisher","first-page":"1943","DOI":"10.1109\/VETECF.2002.1040557","volume-title":"Proceedings of the IEEE 56th Vehicular Technology Conference","author":"J Moon","year":"2002","unstructured":"Moon J, Hong S: Adaptive code-rate and modulation for multi-user OFDM system in wireless communications. In Proceedings of the IEEE 56th Vehicular Technology Conference. Vancouver, Canada; September 2002:1943-1947."}],"container-title":["EURASIP Journal on Wireless Communications and Networking"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1687-1499-2012-358.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/1687-1499-2012-358\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1687-1499-2012-358.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T22:21:55Z","timestamp":1630534915000},"score":1,"resource":{"primary":{"URL":"https:\/\/jwcn-eurasipjournals.springeropen.com\/articles\/10.1186\/1687-1499-2012-358"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,11,29]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,12]]}},"alternative-id":["574"],"URL":"https:\/\/doi.org\/10.1186\/1687-1499-2012-358","relation":{},"ISSN":["1687-1499"],"issn-type":[{"value":"1687-1499","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,11,29]]},"assertion":[{"value":"29 May 2012","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 November 2012","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 November 2012","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"358"}}