{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T17:58:43Z","timestamp":1781632723223,"version":"3.54.5"},"reference-count":26,"publisher":"Public Library of Science (PLoS)","issue":"6","license":[{"start":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T00:00:00Z","timestamp":1781568000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:p>A Markov model is the kind of state transition model most widely used in Health Economic Evaluation (HEE) to analyse the efficiency of an intervention and support decision-making. However, it is has transition probabilities which remain constant over time, which limits its use for chronic diseases. Thus, to allow transition probabilities, rewards, or both, to vary over time, we use two types of methods: The first is \u201cImplementing Time Dependency into Markov Transition Probabilities\u201d, which allows probabilities to vary over time as measured from the start of the simulation. The second is \u201cRelaxing the Markov Assumption\u201d, by adding additional health states to the model, called tunnel states. In this tutorial, a case study on breast cancer is used to illustrate how to implement time dependence in a Markov model and how to conduct analyses of cost-effectiveness, probabilistic sensitivity, and the value of perfect information analyses with R.<\/jats:p>","DOI":"10.1371\/journal.pone.0350698","type":"journal-article","created":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T17:31:37Z","timestamp":1781631097000},"page":"e0350698","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Markov modeling in R: Advanced method using a cost-effectiveness analysis"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8810-7221","authenticated-orcid":true,"given":"Jean Martial","family":"Kouame","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2077-165X","authenticated-orcid":true,"given":"Christian","family":"Kouakou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soualio","family":"Gnanou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bil\u00e9","family":"Yacouba","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0240-3618","authenticated-orcid":true,"given":"Carole","family":"Siani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,6,16]]},"reference":[{"issue":"11","key":"pone.0350698.ref001","article-title":"Cost-effectiveness of screening for chronic hepatitis B and C among migrant populations in a low endemic country","volume":"13","author":"AWM Suijkerbuijk","year":"2018","journal-title":"PLoS One"},{"issue":"6","key":"pone.0350698.ref002","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1016\/j.eururo.2018.10.055","article-title":"Cost-effectiveness Analysis of Active Surveillance Strategies for Men with Low-risk Prostate Cancer","volume":"75","author":"NJ Sathianathen","year":"2019","journal-title":"Eur Urol"},{"issue":"10","key":"pone.0350698.ref003","article-title":"Cost-effectiveness of ALK testing and first-line crizotinib therapy for non-small-cell lung cancer in China","volume":"13","author":"S Lu","year":"2018","journal-title":"PLoS One"},{"issue":"4","key":"pone.0350698.ref004","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1007\/s41669-018-0075-2","article-title":"Cost-Effectiveness of Aspirin Adherence for Secondary Prevention of Cardiovascular Events","volume":"2","author":"LM Djatche","year":"2018","journal-title":"Pharmacoecon Open"},{"issue":"1","key":"pone.0350698.ref005","doi-asserted-by":"crossref","first-page":"18","DOI":"10.7326\/M13-0768","article-title":"Cost-effectiveness of treatment of diabetic macular edema","volume":"160","author":"S Pershing","year":"2014","journal-title":"Ann Intern Med"},{"issue":"8","key":"pone.0350698.ref006","doi-asserted-by":"crossref","first-page":"481","DOI":"10.7326\/0003-4819-152-8-201004200-00212","article-title":"Population strategies to decrease sodium intake and the burden of cardiovascular disease: a cost-effectiveness analysis","volume":"152","author":"CM Smith-Spangler","year":"2010","journal-title":"Ann Intern Med"},{"issue":"1","key":"pone.0350698.ref007","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1177\/0272989X221121747","article-title":"A Tutorial on Time-Dependent Cohort State-Transition Models in R Using a Cost-Effectiveness Analysis Example","volume":"43","author":"F Alarid-Escudero","year":"2023","journal-title":"Med Decis Making"},{"issue":"1","key":"pone.0350698.ref008","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1186\/s13561-025-00686-9","article-title":"Modeling in R: a practical application using a cost-effectiveness analysis","volume":"15","author":"JM Kouame","year":"2025","journal-title":"Health Econ Rev"},{"key":"pone.0350698.ref009","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198526629.001.0001","volume-title":"Decision modeling for health economic evaluation","author":"A Briggs","year":"2006"},{"issue":"10","key":"pone.0350698.ref010","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3310\/hta3100","article-title":"Methods for the analysis of quality-of-life and survival data in health technology assessment","volume":"3","author":"LJ Billingham","year":"1999","journal-title":"Health Technol Assess"},{"issue":"3","key":"pone.0350698.ref011","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1080\/10618600.1996.10474713","article-title":"R: A Language for Data Analysis and Graphics","volume":"5","author":"R Ihaka","year":"1996","journal-title":"J Comput Graph Stat"},{"issue":"1","key":"pone.0350698.ref012","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1177\/0272989X15585121","article-title":"Theoretical Foundations and Practical Applications of Within-Cycle Correction Methods","volume":"36","author":"EH Elbasha","year":"2016","journal-title":"Med Decis Making"},{"issue":"1","key":"pone.0350698.ref013","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/s40273-015-0337-0","article-title":"Myths and Misconceptions of Within-Cycle Correction: A Guide for Modelers and Decision Makers","volume":"34","author":"EH Elbasha","year":"2016","journal-title":"Pharmacoeconomics"},{"issue":"5","key":"pone.0350698.ref014","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1177\/0272989X12458348","article-title":"Model parameter estimation and uncertainty analysis: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force Working Group-6","volume":"32","author":"AH Briggs","year":"2012","journal-title":"Med Decis Making"},{"issue":"4","key":"pone.0350698.ref015","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1177\/027298902400448867","article-title":"Probabilistic analysis of cost-effectiveness models: choosing between treatment strategies for gastroesophageal reflux disease","volume":"22","author":"AH Briggs","year":"2002","journal-title":"Med Decis Making"},{"issue":"4","key":"pone.0350698.ref016","doi-asserted-by":"crossref","first-page":"102912","DOI":"10.1016\/j.jogoh.2025.102912","article-title":"Modelling the cost effectiveness and budget impact of uterine botulinum toxin injections versus conventional treatment in severe dysmenorrhoea: A French perspective","volume":"54","author":"JM Kouame","year":"2025","journal-title":"J Gynecol Obstet Hum Reprod"},{"issue":"5","key":"pone.0350698.ref017","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1177\/0272989X05280562","article-title":"Cost-effectiveness analysis of treatments for chronic disease: using R to incorporate time dependency of treatment response","volume":"25","author":"N Hawkins","year":"2005","journal-title":"Med Decis Making"},{"issue":"5","key":"pone.0350698.ref018","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1177\/0272989X12455463","article-title":"State-transition modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-3","volume":"32","author":"U Siebert","year":"2012","journal-title":"Med Decis Making"},{"issue":"3","key":"pone.0350698.ref019","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1177\/0272989X18754513","article-title":"Microsimulation Modeling for Health Decision Sciences Using R: A Tutorial","volume":"38","author":"EM Krijkamp","year":"2018","journal-title":"Med Decis Making"},{"issue":"6","key":"pone.0350698.ref020","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1177\/0272989X13476763","article-title":"Development of a framework for cohort simulation in cost-effectiveness analyses using a multistep ordinary differential equation solver algorithm in R","volume":"33","author":"GWJ Frederix","year":"2013","journal-title":"Med Decis Making"},{"issue":"1","key":"pone.0350698.ref021","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1186\/s12911-017-0458-9","article-title":"CMOST: an open-source framework for the microsimulation of colorectal cancer screening strategies","volume":"17","author":"MK Prakash","year":"2017","journal-title":"BMC Med Inform Decis Mak"},{"issue":"6","key":"pone.0350698.ref022","doi-asserted-by":"crossref","first-page":"908","DOI":"10.1093\/jamia\/ocaa022","article-title":"Simulation modeling validity and utility in colorectal cancer screening delivery: A systematic review","volume":"27","author":"H Smith","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"pone.0350698.ref023","unstructured":"Filipovic\u00b4-Pierucci A, Zarca K, Durand-Zaleski I. Markov models for health economic evaluation: the R package heemod. arXiv:170203252v1. 2017. Available from: http:\/\/arxiv.org\/abs\/1702.03252"},{"key":"pone.0350698.ref024","unstructured":"Incerti D, Jansen JP. hesim: health economic simulation modeling and decision analysis. arXiv:210209437v2. 2021. Available from: http:\/\/arxiv.org\/abs\/2102.09437"},{"key":"pone.0350698.ref025","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-55718-2","volume-title":"Bayesian cost-effectiveness analysis with the R package BCEA","author":"G Baio","year":"2017"},{"key":"pone.0350698.ref026","article-title":"Health economic evaluation using Markov models in R for Microsoft Excel users: a tutorial","author":"N Green","journal-title":"PharmacoEconomics"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0350698","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T17:31:45Z","timestamp":1781631105000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0350698"}},"subtitle":[],"editor":[{"given":"Rashidul Alam","family":"Mahumud","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,6,16]]},"references-count":26,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,6,16]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0350698","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,16]]}}}