{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T13:28:20Z","timestamp":1740144500528,"version":"3.37.3"},"reference-count":14,"publisher":"EDP Sciences","issue":"5","license":[{"start":{"date-parts":[[2019,10,9]],"date-time":"2019-10-09T00:00:00Z","timestamp":1570579200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.edpsciences.org\/en\/authors\/copyright-and-licensing"}],"funder":[{"name":"Science and Technology Planning Project of Guangdong Province, China","award":["2015A010103021"],"award-info":[{"award-number":["2015A010103021"]}]},{"name":"Natural Science Foundation of Guangdong Province, China","award":["2015A030313649"],"award-info":[{"award-number":["2015A030313649"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61703102"],"award-info":[{"award-number":["61703102"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["RAIRO-Oper. Res."],"accepted":{"date-parts":[[2018,9,19]]},"published-print":{"date-parts":[[2019,11]]},"abstract":"<jats:p>We study a time homogeneous discrete composite-action Markov decision process (CMDP) which needs to make multiple decisions at each state. In this particular Markov decision process, the state variables are divided into two separable sets and a two-dimensional composite action is chosen at each decision epoch. To solve a composite-action Markov decision process, we propose a novel linear programming model (Contracted Linear Programming Model, CLPM). We show that the CLPM model obtains the optimal state values of a CMDP process. We analyze and compare the number of variables and constraints of the CLPM model and the Traditional Linear Programming Model (TLPM). Computational experiments compare running times and memory usage of the two models. The CLPM model outperforms the TLPM model in both time complexity and space complexity by theoretical analysis and computational experiments.<\/jats:p>","DOI":"10.1051\/ro\/2018081","type":"journal-article","created":{"date-parts":[[2018,9,21]],"date-time":"2018-09-21T08:43:55Z","timestamp":1537519435000},"page":"1749-1761","source":"Crossref","is-referenced-by-count":0,"title":["A linear programming based approach for composite-action Markov decision processes"],"prefix":"10.1051","volume":"53","author":[{"given":"Zhicong","family":"Zhang","sequence":"first","affiliation":[]},{"given":"Shuai","family":"Li","sequence":"additional","affiliation":[]},{"given":"Xiaohui","family":"Yan","sequence":"additional","affiliation":[]},{"given":"Liangwei","family":"Zhang","sequence":"additional","affiliation":[]}],"member":"250","published-online":{"date-parts":[[2019,10,9]]},"reference":[{"key":"R1","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1017\/S0269964802164047","volume":"16","author":"Ahn","year":"2002","journal-title":"Prob. Eng. Inf Sci."},{"key":"R2","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1017\/S0021900200000024","volume":"42","author":"Ahn","year":"2005","journal-title":"J. Appl. Prob."},{"key":"R3","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1287\/opre.1040.0200","volume":"53","author":"Andrad\u00f3ttir","year":"2005","journal-title":"Oper. Res."},{"key":"R4","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1007\/s11134-011-9222-5","volume":"67","author":"Hasenbein","year":"2011","journal-title":"Queue. Syst."},{"key":"R5","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1007\/s11134-005-2441-x","volume":"51","author":"Kaufman","year":"2005","journal-title":"Queue. Syst."},{"key":"R6","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.cie.2011.03.003","volume":"61","author":"Kim","year":"2011","journal-title":"Comput. Ind. Eng."},{"key":"R7","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1002\/nav.20424","volume":"57","author":"Krkzlar","year":"2010","journal-title":"Nav. Res. Logist."},{"key":"R8","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1111\/j.1937-5956.2011.01295.x","volume":"21","author":"Krkzlar","year":"2012","journal-title":"Prod. Oper. Manage."},{"key":"R9","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1017\/S0269964808000077","volume":"22","author":"Pandelis","year":"2008","journal-title":"Prob. Eng. Inf. Sci."},{"key":"R10","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1016\/j.orl.2007.12.002","volume":"36","author":"Pandelis","year":"2008","journal-title":"Oper. Res. Lett."},{"key":"R11","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1016\/j.ejor.2009.01.039","volume":"200","author":"Pandelis","year":"2010","journal-title":"Eur. J. Oper. Res."},{"key":"R12","unstructured":"Puterman M.L., Markov Decision Processes: Discrete Dynamic Stochastic Programming. John Wiley & Sons Inc, New York, NY (1994)."},{"key":"R13","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1080\/07408170701744819","volume":"40","author":"Wu","year":"2008","journal-title":"IIE Trans."},{"key":"R14","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1061\/(ASCE)TE.1943-5436.0000341","volume":"138","author":"Yang","year":"2012","journal-title":"J. Transp. Eng."}],"container-title":["RAIRO - Operations Research"],"original-title":[],"link":[{"URL":"https:\/\/www.rairo-ro.org\/10.1051\/ro\/2018081\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,3,20]],"date-time":"2020-03-20T07:47:35Z","timestamp":1584690455000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.rairo-ro.org\/10.1051\/ro\/2018081"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,9]]},"references-count":14,"journal-issue":{"issue":"5"},"alternative-id":["ro180006"],"URL":"https:\/\/doi.org\/10.1051\/ro\/2018081","relation":{},"ISSN":["0399-0559","1290-3868"],"issn-type":[{"type":"print","value":"0399-0559"},{"type":"electronic","value":"1290-3868"}],"subject":[],"published":{"date-parts":[[2019,10,9]]}}}