{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:49:57Z","timestamp":1750308597657,"version":"3.41.0"},"reference-count":64,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2017,1,9]],"date-time":"2017-01-09T00:00:00Z","timestamp":1483920000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100015894","name":"ARC Centre of Excellence for Mathematical and Statistical Frontiers","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100015894","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Math. Softw."],"published-print":{"date-parts":[[2017,9,30]]},"abstract":"<jats:p>\n            Markov chains (MC) are a powerful tool for modeling complex stochastic systems. Whereas a number of tools exist for\n            <jats:italic>solving<\/jats:italic>\n            different types of MC models, the first step in MC modeling is to define the model parameters. This step is, however, error prone and far from trivial when modeling complex systems. In this article, we introduce jMarkov, a framework for MC modeling that provides the user with the ability to define MC models from the basic rules underlying the system dynamics. From these rules, jMarkov automatically obtains the MC parameters and solves the model to determine steady-state and transient performance measures. The jMarkov framework is composed of four modules: (i) the main module supports MC models with a finite state space; (ii) the jQBD module enables the modeling of Quasi-Birth-and-Death processes, a class of MCs with infinite state space; (iii) the jMDP module offers the capabilities to determine optimal decision rules based on Markov Decision Processes; and (iv) the jPhase module supports the manipulation and inclusion of phase-type variables to represent more general behaviors than that of the standard exponential distribution. In addition, jMarkov is highly extensible, allowing the users to introduce new modeling abstractions and solvers.\n          <\/jats:p>","DOI":"10.1145\/3009968","type":"journal-article","created":{"date-parts":[[2017,1,10]],"date-time":"2017-01-10T15:41:17Z","timestamp":1484062877000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Algorithm 972"],"prefix":"10.1145","volume":"43","author":[{"given":"Juan F.","family":"P\u00e9rez","sequence":"first","affiliation":[{"name":"University of Melbourne"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel F.","family":"Silva","sequence":"additional","affiliation":[{"name":"Auburn University, AL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julio C.","family":"G\u00f3ez","sequence":"additional","affiliation":[{"name":"NHH Norwegian School of Economics"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andr\u00e9s","family":"Sarmiento","sequence":"additional","affiliation":[{"name":"Universidad de los Andes"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andr\u00e9s","family":"Sarmiento-Romero","sequence":"additional","affiliation":[{"name":"Universidad de los Andes, Colombia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raha","family":"Akhavan-Tabatabaei","sequence":"additional","affiliation":[{"name":"Universidad de los Andes and Sabanci University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Germ\u00e1n","family":"Ria\u00f1o","sequence":"additional","affiliation":[{"name":"Universidad de los Andes"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,1,9]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Advanced Logistic Department 2013. RAM Commander Version 8.3. Advanced Logistic Department. Retrieved from http:\/\/aldservice.com\/en\/reliability-products\/markov.html.  Advanced Logistic Department 2013. RAM Commander Version 8.3. Advanced Logistic Department. Retrieved from http:\/\/aldservice.com\/en\/reliability-products\/markov.html."},{"key":"e_1_2_2_2_1","unstructured":"D. Applegate W. Cook S. Dash and M. Mevenkamp. 2003. QSopt Reference Manual. Retrieved from http:\/\/www2.isye.gatech.edu\/&sim;wcook\/qsopt\/index.html.  D. Applegate W. Cook S. Dash and M. Mevenkamp. 2003. QSopt Reference Manual. Retrieved from http:\/\/www2.isye.gatech.edu\/&sim;wcook\/qsopt\/index.html."},{"key":"e_1_2_2_3_1","first-page":"419","article-title":"Fitting phase type distributions via the EM algorithm","volume":"23","author":"Asmussen S.","year":"1996","unstructured":"S. Asmussen , O. Nerman , and M. Olsson . 1996 . Fitting phase type distributions via the EM algorithm . Scand. J. Stat. 23 (1996), 419 ,441. S. Asmussen, O. Nerman, and M. Olsson. 1996. Fitting phase type distributions via the EM algorithm. Scand. J. Stat. 23 (1996), 419,441.","journal-title":"Scand. J. Stat."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.44.1.21"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1018409.1018761"},{"volume-title":"Dynamic Programming","author":"Bellman R.","key":"e_1_2_2_6_1","unstructured":"R. Bellman . 1957. Dynamic Programming . Princeton University Press , Princeton, New Jersey. R. Bellman. 1957. Dynamic Programming. Princeton University Press, Princeton, New Jersey."},{"volume-title":"Proceedings of the 2006 IEEE Systems and Information Engineering Design Symposium. 93--98","author":"Bello D.","key":"e_1_2_2_7_1","unstructured":"D. Bello and G. Ria\u00f1o . 2006. Linear programming solvers for Markov decision processes . In Proceedings of the 2006 IEEE Systems and Information Engineering Design Symposium. 93--98 . D. Bello and G. Ria\u00f1o. 2006. Linear programming solvers for Markov decision processes. In Proceedings of the 2006 IEEE Systems and Information Engineering Design Symposium. 93--98."},{"volume-title":"Dynamic Programming and Optimal Control","author":"Bertsekas D.","key":"e_1_2_2_8_1","unstructured":"D. Bertsekas . 1995. Dynamic Programming and Optimal Control . Athena Scientific , Belmont, MA . D. Bertsekas. 1995. Dynamic Programming and Optimal Control. Athena Scientific, Belmont, MA."},{"key":"e_1_2_2_9_1","doi-asserted-by":"crossref","unstructured":"D. Bini G. Latouche and B. Meini. 2005. Numerical Methods for Structured Markov Chains. Oxford.   D. Bini G. Latouche and B. Meini. 2005. Numerical Methods for Structured Markov Chains. Oxford.","DOI":"10.1093\/acprof:oso\/9780198527688.001.0001"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.4108\/ICST.VALUETOOLS2009.7443"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1081\/STM-200056210"},{"key":"e_1_2_2_12_1","unstructured":"Butools. 2016. Homepage. Retrieved from http:\/\/webspn.hit.bme.hu\/&sim;telek\/tools\/butools\/index.php.  Butools. 2016. Homepage. Retrieved from http:\/\/webspn.hit.bme.hu\/&sim;telek\/tools\/butools\/index.php."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/ecog.00888"},{"volume-title":"Kluwer\u2019s International Series in Operations Research and Management Science","author":"Ciardo G.","key":"e_1_2_2_14_1","unstructured":"G. Ciardo . 2000. Tools for formulating Markov models . In Computational Probability, Winfried K. Grassman (Ed.). Kluwer\u2019s International Series in Operations Research and Management Science , Boston, MA . G. Ciardo. 2000. Tools for formulating Markov models. In Computational Probability, Winfried K. Grassman (Ed.). Kluwer\u2019s International Series in Operations Research and Management Science, Boston, MA."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/647883.738572"},{"key":"e_1_2_2_16_1","unstructured":"S. Cordwell. 2013. PyMDPtoolbox. Retrieved from http:\/\/code.google.com\/p\/pymdptoolbox\/. (2013).  S. Cordwell. 2013. PyMDPtoolbox. Retrieved from http:\/\/code.google.com\/p\/pymdptoolbox\/. (2013)."},{"key":"e_1_2_2_17_1","unstructured":"CPLEX Optimizer. 2015. Gurobi Optimizer Reference Manual. Retrieved from http:\/\/www-03.ibm.com\/software\/products\/en\/ibmilogcpleoptistud.  CPLEX Optimizer. 2015. Gurobi Optimizer Reference Manual. Retrieved from http:\/\/www-03.ibm.com\/software\/products\/en\/ibmilogcpleoptistud."},{"key":"e_1_2_2_18_1","unstructured":"Dash Optimization. 2005. Xpress-BCL Reference Manual (release 2.6 ed.). Dash optimization. Retrieved from http:\/\/www.dashoptimization.com.  Dash Optimization. 2005. Xpress-BCL Reference Manual (release 2.6 ed.). Dash optimization. Retrieved from http:\/\/www.dashoptimization.com."},{"volume-title":"Computing Minimum and Maximum Reachability Times in Probabilistic Systems","author":"De Alfaro L.","key":"e_1_2_2_19_1","unstructured":"L. De Alfaro . 1999. Computing Minimum and Maximum Reachability Times in Probabilistic Systems . Springer . L. De Alfaro. 1999. Computing Minimum and Maximum Reachability Times in Probabilistic Systems. Springer."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1977.tb01600.x"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1530873.1530881"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-5316(02)00179-7"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1287\/moor.1040.0089"},{"volume-title":"Proceedings of TRISTAN VIII.","author":"Gomez A.","key":"e_1_2_2_24_1","unstructured":"A. Gomez , R. Mari\u00f1o , R. Akhavan-Tabatabaei , A. Medaglia , and J. Mendoza . 2013. A unified framework for vehicle routing problems with stochastic travel and service times . In Proceedings of TRISTAN VIII. A. Gomez, R. Mari\u00f1o, R. Akhavan-Tabatabaei, A. Medaglia, and J. Mendoza. 2013. A unified framework for vehicle routing problems with stochastic travel and service times. In Proceedings of TRISTAN VIII."},{"key":"e_1_2_2_25_1","unstructured":"Gurobi Optimizaton. 2014. Gurobi Optimizer Reference Manual. (2014). Retrieved from http:\/\/www.gurobi.com.  Gurobi Optimizaton. 2014. Gurobi Optimizer Reference Manual. (2014). Retrieved from http:\/\/www.gurobi.com."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.19.1.240"},{"key":"e_1_2_2_28_1","unstructured":"B. Heimsund. 2005. Matrix Toolkits for Java (MTJ). Retrieved from http:\/\/rs.cipr.uib.no\/mtj\/.  B. Heimsund. 2005. Matrix Toolkits for Java (MTJ). Retrieved from http:\/\/rs.cipr.uib.no\/mtj\/."},{"key":"e_1_2_2_29_1","volume-title":"JAMA: A Java Matrix Package. (July","author":"Hicklin J.","year":"2005","unstructured":"J. Hicklin , C. Moler , P. Webb , R. F. Boisvert , B. Miller , R. Pozo , and K. Remington . 2005 . JAMA: A Java Matrix Package. (July 2005). MathWorks and the National Institute of Standards and Technology (NIST) . Retrieved from http:\/\/math.nist.gov\/javanumerics\/jama\/. J. Hicklin, C. Moler, P. Webb, R. F. Boisvert, B. Miller, R. Pozo, and K. Remington. 2005. JAMA: A Java Matrix Package. (July 2005). MathWorks and the National Institute of Standards and Technology (NIST). Retrieved from http:\/\/math.nist.gov\/javanumerics\/jama\/."},{"volume-title":"Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann, 279--288","author":"Hoey J.","key":"e_1_2_2_30_1","unstructured":"J. Hoey , R. St-Aubin , A. Hu , and C. Boutilier . 1999. SPUDD: Stochastic planning using decision diagrams . In Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann, 279--288 . J. Hoey, R. St-Aubin, A. Hu, and C. Boutilier. 1999. SPUDD: Stochastic planning using decision diagrams. In Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann, 279--288."},{"key":"e_1_2_2_31_1","volume-title":"Phfit: A general phase-type fitting tool. In Computer Performance Evaluation: Modelling Techniques and Tools","author":"Horv\u00e1th A.","year":"2002","unstructured":"A. Horv\u00e1th and M. Telek . 2002 . Phfit: A general phase-type fitting tool. In Computer Performance Evaluation: Modelling Techniques and Tools . Springer , 82--91. A. Horv\u00e1th and M. Telek. 2002. Phfit: A general phase-type fitting tool. In Computer Performance Evaluation: Modelling Techniques and Tools. Springer, 82--91."},{"key":"e_1_2_2_32_1","unstructured":"ITEM Software (USA) Inc. 2011. ITEM TOOLKIT Version 7. ITEM Software (USA) Inc. Retrieved from http:\/\/www.itemuk.com\/assets\/docs\/ToolKit_Manual.pdf.  ITEM Software (USA) Inc. 2011. ITEM TOOLKIT Version 7. ITEM Software (USA) Inc. Retrieved from http:\/\/www.itemuk.com\/assets\/docs\/ToolKit_Manual.pdf."},{"key":"e_1_2_2_33_1","unstructured":"jMarkov website. 2016. Homepage. Retrieved from https:\/\/projects.coin-or.org\/jMarkov\/.  jMarkov website. 2016. Homepage. Retrieved from https:\/\/projects.coin-or.org\/jMarkov\/."},{"key":"e_1_2_2_34_1","unstructured":"jUnit. 2016. Homepage. Retrieved from http:\/\/junit.org\/.  jUnit. 2016. Homepage. Retrieved from http:\/\/junit.org\/."},{"volume-title":"Generalised Markovian Analysis of Timed Transitions Systems. Master\u2019s thesis. Department of Computer Science","author":"Knottenbelt W.","key":"e_1_2_2_35_1","unstructured":"W. Knottenbelt . 1996. Generalised Markovian Analysis of Timed Transitions Systems. Master\u2019s thesis. Department of Computer Science , Faculty of Science, University of Cape Town. W. Knottenbelt. 1996. Generalised Markovian Analysis of Timed Transitions Systems. Master\u2019s thesis. Department of Computer Science, Faculty of Science, University of Cape Town."},{"volume-title":"Modeling and Analysis of Stochastic Systems","author":"Kulkarni V.","key":"e_1_2_2_36_1","unstructured":"V. Kulkarni . 1995. Modeling and Analysis of Stochastic Systems . Chapman 8 Hall. V. Kulkarni. 1995. Modeling and Analysis of Stochastic Systems. Chapman 8 Hall."},{"key":"e_1_2_2_37_1","volume-title":"Proc. 23rd International Conference on Computer Aided Verification (CAV\u201911)","volume":"6806","author":"Kwiatkowska M.","unstructured":"M. Kwiatkowska , G. Norman , and D. Parker . 2011. PRISM 4.0: Verification of probabilistic real-time systems . In Proc. 23rd International Conference on Computer Aided Verification (CAV\u201911) (LNCS), G. Gopalakrishnan and S. Qadeer (Eds.) , Vol. 6806 . Springer, 585--591. M. Kwiatkowska, G. Norman, and D. Parker. 2011. PRISM 4.0: Verification of probabilistic real-time systems. In Proc. 23rd International Conference on Computer Aided Verification (CAV\u201911) (LNCS), G. Gopalakrishnan and S. Qadeer (Eds.), Vol. 6806. Springer, 585--591."},{"key":"e_1_2_2_38_1","doi-asserted-by":"crossref","unstructured":"G. Latouche and V. Ramaswami. 1999. Introduction to Matrix Analytic Methods in Stochastic Modeling. Society for Industrial and Applied Mathematics (SIAM) Philadelphia PA.  G. Latouche and V. Ramaswami. 1999. Introduction to Matrix Analytic Methods in Stochastic Modeling. Society for Industrial and Applied Mathematics (SIAM) Philadelphia PA.","DOI":"10.1137\/1.9780898719734"},{"volume-title":"Proceedings of the 2005 Winter Simulation Conference.","author":"L\u2019Ecuyer P.","key":"e_1_2_2_39_1","unstructured":"P. L\u2019Ecuyer and E. Buist . 2005. Simulation in java with SSJ . In Proceedings of the 2005 Winter Simulation Conference. P. L\u2019Ecuyer and E. Buist. 2005. Simulation in java with SSJ. In Proceedings of the 2005 Winter Simulation Conference."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.9.3.383"},{"key":"e_1_2_2_41_1","unstructured":"S. Mahadevan N. Khaleeli and N. Marchalleck. 1997. Designing Agent controllers using Discrete-Event Markov Models. (1997). Department of Computer Science Michigan State University.  S. Mahadevan N. Khaleeli and N. Marchalleck. 1997. Designing Agent controllers using Discrete-Event Markov Models. (1997). Department of Computer Science Michigan State University."},{"volume-title":"Proceedings of the 2007 IEEE Systems and Information Engineering Design Symposium.","author":"Medina J.","key":"e_1_2_2_42_1","unstructured":"J. Medina , G. Ria\u00f1o , and J. Villarreal . 2007. A dynamic programming model for structuring mortgage backed securities . In Proceedings of the 2007 IEEE Systems and Information Engineering Design Symposium. J. Medina, G. Ria\u00f1o, and J. Villarreal. 2007. A dynamic programming model for structuring mortgage backed securities. In Proceedings of the 2007 IEEE Systems and Information Engineering Design Symposium."},{"key":"e_1_2_2_43_1","unstructured":"K. Murphy. 2002. Markov Decision Process (MDP) Toolbox for Matlab. Retrieved from http:\/\/www.cs.ubc.ca\/&sim;murphyk\/Software\/MDP\/mdp.html\/.  K. Murphy. 2002. Markov Decision Process (MDP) Toolbox for Matlab. Retrieved from http:\/\/www.cs.ubc.ca\/&sim;murphyk\/Software\/MDP\/mdp.html\/."},{"volume-title":"Proceedings of the Winter Simulation Conference.","author":"Neuts M.","key":"e_1_2_2_44_1","unstructured":"M. Neuts and M. Pagano . 1981. Generating random variates from a distribution of phase-type . In Proceedings of the Winter Simulation Conference. M. Neuts and M. Pagano. 1981. Generating random variates from a distribution of phase-type. In Proceedings of the Winter Simulation Conference."},{"volume-title":"Matrix-Geometrix Solutions in Stochastic Models","author":"Neuts M. F.","key":"e_1_2_2_45_1","unstructured":"M. F. Neuts . 1981. Matrix-Geometrix Solutions in Stochastic Models . The John Hopkings University Press . M. F. Neuts. 1981. Matrix-Geometrix Solutions in Stochastic Models. The John Hopkings University Press."},{"volume-title":"The EMpht-programme. Manual","author":"Olsson M.","key":"e_1_2_2_46_1","unstructured":"M. Olsson . 1998. The EMpht-programme. Manual . Chalmers University of Technology, and G\u00f6tborg University , Retrieved from http:\/\/www.maths.lth.se\/matstat\/staff\/asmus\/pspapers.html. M. Olsson. 1998. The EMpht-programme. Manual. Chalmers University of Technology, and G\u00f6tborg University, Retrieved from http:\/\/www.maths.lth.se\/matstat\/staff\/asmus\/pspapers.html."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.peva.2005.06.002"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1190366.1190370"},{"volume-title":"Markov Decision Processes: Discrete Stochastic Dynamic Programming","author":"Puterman M. L.","key":"e_1_2_2_49_1","unstructured":"M. L. Puterman . 1994. Markov Decision Processes: Discrete Stochastic Dynamic Programming . John Wiley 8 Sons, New York. M. L. Puterman. 1994. Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley 8 Sons, New York."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.24.11.1127"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/QEST.2012.29"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1190366.1190371"},{"key":"e_1_2_2_53_1","unstructured":"G. Ria\u00f1o J. G\u00f3ez and J. P. Alvarado. 2006. Modeling bucket brigades using phase-type distributions. In Memorias del XIII Congreso Latino-Iberoamericano de Investigaci\u00f3n de Operaciones y Sistemas. Montevideo 1--6.  G. Ria\u00f1o J. G\u00f3ez and J. P. Alvarado. 2006. Modeling bucket brigades using phase-type distributions. In Memorias del XIII Congreso Latino-Iberoamericano de Investigaci\u00f3n de Operaciones y Sistemas. Montevideo 1--6."},{"key":"e_1_2_2_55_1","unstructured":"G. Ria\u00f1o J. G\u00f3ez and J. F. P\u00e9rez. jMarkov User\u2019s Guide. Retrieved from https:\/\/projects.coin-or.org\/jMarkov\/.  G. Ria\u00f1o J. G\u00f3ez and J. F. P\u00e9rez. jMarkov User\u2019s Guide. Retrieved from https:\/\/projects.coin-or.org\/jMarkov\/."},{"key":"e_1_2_2_56_1","unstructured":"G. Ria\u00f1o A. Sarmiento and D. F. Silva. jMDP User\u2019s Guide. Retrieved from https:\/\/projects.coin-or.org\/jMarkov\/.  G. Ria\u00f1o A. Sarmiento and D. F. Silva. jMDP User\u2019s Guide. Retrieved from https:\/\/projects.coin-or.org\/jMarkov\/."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1287\/ijoc.1050.0160"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.27.3.616"},{"volume-title":"Proceedings of the IIE Conference.","author":"Silva D. F.","key":"e_1_2_2_59_1","unstructured":"D. F. Silva , C. Amaya , and G. Ria\u00f1o . 2009. Continuous-time models for estimating picker blocking in order-picking-systems . In Proceedings of the IIE Conference. D. F. Silva, C. Amaya, and G. Ria\u00f1o. 2009. Continuous-time models for estimating picker blocking in order-picking-systems. In Proceedings of the IIE Conference."},{"key":"e_1_2_2_60_1","volume-title":"MARCA: Markov Cahin Analyzer, A software Package for Markov Modelling, Version 3.0.","author":"Stewart W.","year":"1996","unstructured":"W. Stewart . 1996 . MARCA: Markov Cahin Analyzer, A software Package for Markov Modelling, Version 3.0. Retrieved from http:\/\/www.csc.ncsu.edu\/faculty\/stewart\/. W. Stewart. 1996. MARCA: Markov Cahin Analyzer, A software Package for Markov Modelling, Version 3.0. Retrieved from http:\/\/www.csc.ncsu.edu\/faculty\/stewart\/."},{"key":"e_1_2_2_61_1","unstructured":"Sun Microsystems. 2006. Java Technology. Retrieved from http:\/\/www.java.sun.com\/.  Sun Microsystems. 2006. Java Technology. Retrieved from http:\/\/www.java.sun.com\/."},{"key":"e_1_2_2_62_1","volume-title":"Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems","volume":"1","author":"Teichteil-K\u00f6nigsbuch F.","unstructured":"F. Teichteil-K\u00f6nigsbuch , U. Kuter , and G. Infantes . 2010. Incremental plan aggregation for generating policies in MDPs . In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems : volume 1-Volume 1 . International Foundation for Autonomous Agents and Multiagent Systems, 1231--1238. F. Teichteil-K\u00f6nigsbuch, U. Kuter, and G. Infantes. 2010. Incremental plan aggregation for generating policies in MDPs. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1-Volume 1. International Foundation for Autonomous Agents and Multiagent Systems, 1231--1238."},{"key":"e_1_2_2_63_1","first-page":"3","article-title":"Matching moments for acyclic discrete and continuous phase-type distributions of second order","volume":"3","author":"Telek M.","year":"2002","unstructured":"M. Telek and A. Heindl . 2002 . Matching moments for acyclic discrete and continuous phase-type distributions of second order . Int. J. Simul. 3 , 3 -- 4 (2002), 47--57. M. Telek and A. Heindl. 2002. Matching moments for acyclic discrete and continuous phase-type distributions of second order. Int. J. Simul. 3, 3--4 (2002), 47--57.","journal-title":"Int. J. Simul."},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSN.2005.11"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2006.27"},{"key":"e_1_2_2_66_1","unstructured":"J. J. Ucr\u00f3s Ospino. 2012. Application of phase-type distribution in cycle time estimation of queueing networks: A case of semiconductor manufacturing systems. Master thesis Universidad de los Andes.  J. J. Ucr\u00f3s Ospino. 2012. Application of phase-type distribution in cycle time estimation of queueing networks: A case of semiconductor manufacturing systems. Master thesis Universidad de los Andes."}],"container-title":["ACM Transactions on Mathematical Software"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3009968","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3009968","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:05:35Z","timestamp":1750273535000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3009968"}},"subtitle":["jMarkov: An Integrated Framework for Markov Chain Modeling"],"short-title":[],"issued":{"date-parts":[[2017,1,9]]},"references-count":64,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,9,30]]}},"alternative-id":["10.1145\/3009968"],"URL":"https:\/\/doi.org\/10.1145\/3009968","relation":{},"ISSN":["0098-3500","1557-7295"],"issn-type":[{"type":"print","value":"0098-3500"},{"type":"electronic","value":"1557-7295"}],"subject":[],"published":{"date-parts":[[2017,1,9]]},"assertion":[{"value":"2015-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-01-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}