{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T08:13:49Z","timestamp":1793088829811,"version":"4.5.0"},"reference-count":69,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2011,10,19]],"date-time":"2011-10-19T00:00:00Z","timestamp":1318982400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Med Decis Making"],"published-print":{"date-parts":[[2012,3]]},"abstract":"<jats:p>Aim. Cost-effectiveness analyses (CEAs) may use data from cluster randomized trials (CRTs), where the unit of randomization is the cluster, not the individual. However, most studies use analytical methods that ignore clustering. This article compares alternative statistical methods for accommodating clustering in CEAs of CRTs. Methods. Our simulation study compared the performance of statistical methods for CEAs of CRTs with 2 treatment arms. The study considered a method that ignored clustering\u2014seemingly unrelated regression (SUR) without a robust standard error (SE)\u2014and 4 methods that recognized clustering\u2014SUR and generalized estimating equations (GEEs), both with robust SE, a \u201c2-stage\u201d nonparametric bootstrap (TSB) with shrinkage correction, and a multilevel model (MLM). The base case assumed CRTs with moderate numbers of balanced clusters (20 per arm) and normally distributed costs. Other scenarios included CRTs with few clusters, imbalanced cluster sizes, and skewed costs. Performance was reported as bias, root mean squared error (rMSE), and confidence interval (CI) coverage for estimating incremental net benefits (INBs). We also compared the methods in a case study. Results. Each method reported low levels of bias. Without the robust SE, SUR gave poor CI coverage (base case: 0.89 v. nominal level: 0.95). The MLM and TSB performed well in each scenario (CI coverage, 0.92\u20130.95). With few clusters, the GEE and SUR (with robust SE) had coverage below 0.90. In the case study, the mean INBs were similar across all methods, but ignoring clustering underestimated statistical uncertainty and the value of further research. Conclusions. MLMs and the TSB are appropriate analytical methods for CEAs of CRTs with the characteristics described. SUR and GEE are not recommended for studies with few clusters.<\/jats:p>","DOI":"10.1177\/0272989x11418372","type":"journal-article","created":{"date-parts":[[2011,10,20]],"date-time":"2011-10-20T00:54:56Z","timestamp":1319072096000},"page":"350-361","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":128,"title":["Developing Appropriate Methods for Cost-Effectiveness Analysis of Cluster Randomized Trials"],"prefix":"10.1177","volume":"32","author":[{"given":"Manuel","family":"Gomes","sequence":"first","affiliation":[{"name":"Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK (MG, ESWN, RG)"},{"name":"Modeling and Simulation Group, Novartis Pharma AG, Basel, Switzerland (RN)"},{"name":"Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, UK (JC)"},{"name":"MRC Biostatistics Unit, Cambridge, UK (SGT)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edmond S.-W.","family":"Ng","sequence":"additional","affiliation":[{"name":"Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK (MG, ESWN, RG)"},{"name":"Modeling and Simulation Group, Novartis Pharma AG, Basel, Switzerland (RN)"},{"name":"Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, UK (JC)"},{"name":"MRC Biostatistics Unit, Cambridge, UK (SGT)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"Grieve","sequence":"additional","affiliation":[{"name":"Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK (MG, ESWN, RG)"},{"name":"Modeling and Simulation Group, Novartis Pharma AG, Basel, Switzerland (RN)"},{"name":"Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, UK (JC)"},{"name":"MRC Biostatistics Unit, Cambridge, UK (SGT)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"Nixon","sequence":"additional","affiliation":[{"name":"Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK (MG, ESWN, RG)"},{"name":"Modeling and Simulation Group, Novartis Pharma AG, Basel, Switzerland (RN)"},{"name":"Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, UK (JC)"},{"name":"MRC Biostatistics Unit, Cambridge, UK (SGT)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Carpenter","sequence":"additional","affiliation":[{"name":"Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK (MG, ESWN, RG)"},{"name":"Modeling and Simulation Group, Novartis Pharma AG, Basel, Switzerland (RN)"},{"name":"Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, UK (JC)"},{"name":"MRC Biostatistics Unit, Cambridge, UK (SGT)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simon G.","family":"Thompson","sequence":"additional","affiliation":[{"name":"Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK (MG, ESWN, RG)"},{"name":"Modeling and Simulation Group, Novartis Pharma AG, Basel, Switzerland (RN)"},{"name":"Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, UK (JC)"},{"name":"MRC Biostatistics Unit, Cambridge, UK (SGT)"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2011,10,19]]},"reference":[{"key":"bibr1-0272989X11418372","author":"Gomes M","year":"2011","journal-title":"Med Decis Making."},{"key":"bibr2-0272989X11418372","volume-title":"Design and Analysis of Cluster Randomization Trials in Health Research","author":"Donner A","year":"2000"},{"key":"bibr3-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1201\/9781584888178"},{"key":"bibr4-0272989X11418372","unstructured":"National Institute for Health and Clinical Excellence (NICE). Methods for development of NICE public health guidance. Available from URL: http:\/\/www.nice.org.uk\/media\/CE1\/F7\/CPHE_Methods_manual_LR.pdf"},{"key":"bibr5-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/hec.1161"},{"key":"bibr6-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/hec.1586"},{"key":"bibr7-0272989X11418372","volume-title":"Economic Evaluation in Clinical Trials","author":"Glick HA","year":"2007"},{"key":"bibr8-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780195108248.001.0001"},{"key":"bibr9-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/0470856289"},{"key":"bibr10-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1586\/14737167.6.3.337"},{"key":"bibr11-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/sim.2731"},{"key":"bibr12-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/sim.2813"},{"key":"bibr13-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-0258(19960830)15:16<1793::AID-SIM332>3.0.CO;2-2"},{"key":"bibr14-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1483"},{"key":"bibr15-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/1097-0258(20010215)20:3<417::AID-SIM802>3.0.CO;2-G"},{"key":"bibr16-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1016\/j.spl.2008.03.008"},{"key":"bibr17-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/sim.2657"},{"key":"bibr18-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/1097-0258(20001015)19:19<2675::AID-SIM556>3.0.CO;2-A"},{"key":"bibr19-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-0258(19991215)18:23<3245::AID-SIM314>3.0.CO;2-2"},{"key":"bibr20-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/hec.1008"},{"key":"bibr21-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/hec.843"},{"key":"bibr22-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-985X.2008.00564.x"},{"key":"bibr23-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511802843"},{"key":"bibr24-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1258\/1355819053559065"},{"key":"bibr25-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X09341752"},{"key":"bibr26-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1186\/1478-7547-5-12"},{"key":"bibr27-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/hec.617"},{"key":"bibr28-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1974.10480150"},{"key":"bibr29-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1016\/j.jeconom.2010.04.005"},{"key":"bibr30-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2009.12.012"},{"key":"bibr31-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1016\/S0197-2456(02)00208-8"},{"key":"bibr32-0272989X11418372","volume-title":"Generalized Estimating Equations","author":"Hardin JW","year":"2003"},{"key":"bibr33-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1177\/096228020000900205"},{"key":"bibr34-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6963-4-33"},{"key":"bibr35-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/hec.699"},{"key":"bibr36-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X05276862"},{"key":"bibr37-0272989X11418372","doi-asserted-by":"crossref","unstructured":"Austin PC. A comparison of the statistical power of different methods for the analysis of repeated cross-sectional cluster randomization trials with binary outcomes. Int J Biostat. 2010;6(1).","DOI":"10.2202\/1557-4679.1179"},{"key":"bibr38-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.2307\/2983404"},{"key":"bibr39-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/sim.2537"},{"key":"bibr40-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/sim.2078"},{"key":"bibr41-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/hec.941"},{"key":"bibr42-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1093\/ije\/dyl129"},{"key":"bibr43-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/hec.1477"},{"key":"bibr44-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.a2396"},{"key":"bibr45-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.39474.922025.BE"},{"key":"bibr46-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.331.7519.750"},{"key":"bibr47-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1016\/S0022-3999(02)00569-X"},{"key":"bibr48-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.a3045"},{"key":"bibr49-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1136\/jech.2003.014225"},{"key":"bibr50-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.b4220"},{"key":"bibr51-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6963-8-174"},{"key":"bibr52-0272989X11418372","unstructured":"R. The R project for statistical computing. Available from URL: http:\/\/www.r-project.org\/"},{"key":"bibr53-0272989X11418372","volume-title":"Stata Programming Reference Manual, Version 11","author":"STATA","year":"2009"},{"key":"bibr54-0272989X11418372","volume-title":"WinBUGS User Manual, Version 1.4","author":"Spiegehalter D","year":"2003"},{"key":"bibr55-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1996.10477003"},{"key":"bibr56-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6296(98)00039-3"},{"key":"bibr57-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1111\/j.1524-4733.2007.00254.x"},{"key":"bibr58-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1177\/1740774507079237"},{"key":"bibr59-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhealeco.2006.02.001"},{"key":"bibr60-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/1097-0258(20010215)20:3<453::AID-SIM803>3.0.CO;2-L"},{"key":"bibr61-0272989X11418372","first-page":"95","volume":"47","author":"Donner A","year":"1998","journal-title":"Appl Stat."},{"key":"bibr62-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1191\/1740774505cn071oa"},{"key":"bibr63-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1744"},{"key":"bibr64-0272989X11418372","unstructured":"OECD. Country statistical profiles: South Africa. Available from URL: http:\/\/stats.oecd.org\/index.aspx?queryid=23123"},{"key":"bibr65-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.2307\/1912934"},{"key":"bibr66-0272989X11418372","first-page":"221","volume-title":"Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability","volume":"1","author":"Huber P","year":"1967"},{"key":"bibr67-0272989X11418372","doi-asserted-by":"crossref","unstructured":"Williams RL. A note on robust variance for cluster-correlated data. Biometrics. 2000;56(June):645\u20136.","DOI":"10.1111\/j.0006-341X.2000.00645.x"},{"key":"bibr68-0272989X11418372","doi-asserted-by":"publisher","DOI":"10.1201\/9780203489437"},{"key":"bibr69-0272989X11418372","unstructured":"Ng ESW. A review of mixed-effects models in S-plus (version 6.2). Available from URL: http:\/\/www.bristol.ac.uk\/cmm\/learning\/mmsoftware\/reviewsplus.pdf"}],"container-title":["Medical Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X11418372","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0272989X11418372","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X11418372","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:55:32Z","timestamp":1777658132000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0272989X11418372"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,10,19]]},"references-count":69,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2012,3]]}},"alternative-id":["10.1177\/0272989X11418372"],"URL":"https:\/\/doi.org\/10.1177\/0272989x11418372","relation":{},"ISSN":["0272-989X","1552-681X"],"issn-type":[{"value":"0272-989X","type":"print"},{"value":"1552-681X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,10,19]]}}}