{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T04:26:56Z","timestamp":1772166416245,"version":"3.50.1"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,5,7]],"date-time":"2020-05-07T00:00:00Z","timestamp":1588809600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,5,7]],"date-time":"2020-05-07T00:00:00Z","timestamp":1588809600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Trials"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Exploration and modelling of heterogeneous treatment effects as a function of baseline covariates is an important aspect of precision medicine in randomised controlled trials (RCTs). Randomisation generally guarantees the internal validity of an RCT, but heterogeneity in treatment effect can reduce external validity. Estimation of heterogeneous treatment effects is usually done via a predictive model for individual outcomes, where one searches for interactions between treatment allocation and important patient baseline covariates. However, such models are prone to overfitting and multiple testing and typically demand a transformation of the outcome measurement, for example, from the absolute risk in the original RCT to log-odds of risk in the predictive model.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We show how reference classes derived from baseline covariates can be used to explore heterogeneous treatment effects via a two-stage approach. We first estimate a risk score which captures on a single dimension some of the heterogeneity in outcomes of the trial population. Heterogeneity in the treatment effect can then be explored via reweighting schemes along this axis of variation. This two-stage approach bypasses the search for interactions with multiple covariates, thus protecting against multiple testing. It also allows for exploration of heterogeneous treatment effects on the original outcome scale of the RCT. This approach would typically be applied to multivariable models of baseline risk to assess the stability of average treatment effects with respect to the distribution of risk in the population studied.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Case study<\/jats:title>\n                    <jats:p>We illustrate this approach using the single largest randomised treatment trial in severe falciparum malaria and demonstrate how the estimated treatment effect in terms of absolute mortality risk reduction increases considerably in higher risk strata.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>\u2018Local\u2019 and \u2018tilting\u2019 reweighting schemes based on ranking patients by baseline risk can be used as a general approach for exploring, graphing and reporting heterogeneity of treatment effect in RCTs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Trial registration<\/jats:title>\n                    <jats:p>\n                      ISRCTN clinical trials registry:\n                      <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"http:\/\/www.isrctn.com\/ISRCTN50258054\">ISRCTN50258054<\/jats:ext-link>\n                      . Prospectively registered on 22 July 2005.\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s13063-020-04306-1","type":"journal-article","created":{"date-parts":[[2020,5,7]],"date-time":"2020-05-07T05:03:25Z","timestamp":1588827805000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Graphing and reporting heterogeneous treatment effects through reference classes"],"prefix":"10.1186","volume":"21","author":[{"given":"James A.","family":"Watson","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris C.","family":"Holmes","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,5,7]]},"reference":[{"issue":"6","key":"4306_CR1","first-page":"2075","volume":"45","author":"DM Kent","year":"2016","unstructured":"Kent DM, Nelson J, Dahabreh IJ, Rothwell PM, Altman DG, Hayward RA. Risk and treatment effect heterogeneity: re-analysis of individual participant data from 32 large clinical trials. Int J Epidemiol. 2016; 45(6):2075\u201388.","journal-title":"Int J Epidemiol"},{"issue":"10","key":"4306_CR2","doi-asserted-by":"publisher","first-page":"1209","DOI":"10.1001\/jama.298.10.1209","volume":"298","author":"DM Kent","year":"2007","unstructured":"Kent DM, Hayward RA. Limitations of applying summary results of clinical trials to individual patients: the need for risk stratification. J Am Med Assoc. 2007; 298(10):1209\u201312.","journal-title":"J Am Med Assoc"},{"issue":"1","key":"4306_CR3","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1186\/1471-2288-6-18","volume":"6","author":"RA Hayward","year":"2006","unstructured":"Hayward RA, Kent DM, Vijan S, Hofer TP. Multivariable risk prediction can greatly enhance the statistical power of clinical trial subgroup analysis. BMC Med Res Methodol. 2006; 6(1):18.","journal-title":"BMC Med Res Methodol"},{"issue":"1","key":"4306_CR4","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1186\/1745-6215-11-85","volume":"11","author":"DM Kent","year":"2010","unstructured":"Kent DM, Rothwell PM, Ioannidis JPA, Altman DG, Hayward RA. Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal. Trials. 2010; 11(1):85.","journal-title":"Trials"},{"key":"4306_CR5","doi-asserted-by":"publisher","first-page":"k4245","DOI":"10.1136\/bmj.k4245","volume":"363","author":"DM Kent","year":"2018","unstructured":"Kent DM, Steyerberg E, van Klaveren D. Personalized evidence based medicine: predictive approaches to heterogeneous treatment effects. Br Med J. 2018; 363:k4245.","journal-title":"Br Med J"},{"issue":"2","key":"4306_CR6","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1093\/biomet\/asn004","volume":"95","author":"BB Hansen","year":"2008","unstructured":"Hansen BB. The prognostic analogue of the propensity score. Biometrika. 2008; 95(2):481\u20138.","journal-title":"Biometrika"},{"key":"4306_CR7","doi-asserted-by":"publisher","first-page":"h454","DOI":"10.1136\/bmj.h454","volume":"350","author":"JB Sussman","year":"2015","unstructured":"Sussman JB, Kent DM, Nelson JP, Hayward RA. Improving diabetes prevention with benefit based tailored treatment: risk based reanalysis of diabetes prevention program. Br Med J. 2015; 350:h454.","journal-title":"Br Med J"},{"key":"4306_CR8","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809477.031","volume-title":"Intuitive prediction: biases and corrective procedures","author":"D Kahneman","year":"1982","unstructured":"Kahneman D, Tversky A. Intuitive prediction: biases and corrective procedures. Cambridge: Cambridge University Press; 1982, pp. 414\u201321. https:\/\/doi.org\/10.1017\/CBO9780511809477.031."},{"issue":"4","key":"4306_CR9","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1001\/jama.2013.285063","volume":"311","author":"XIoannidis Sun","year":"2014","unstructured":"Sun XIoannidis JPA, Agoritsas T, Alba AC, Guyatt G. How to use a subgroup analysis: users\u2019 guide to the medical literature. J Am Med Assoc. 2014; 311(4):405\u201311.","journal-title":"J Am Med Assoc"},{"issue":"9454","key":"4306_CR10","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1016\/S0140-6736(05)17709-5","volume":"365","author":"PM Rothwell","year":"2005","unstructured":"Rothwell PM. Subgroup analysis in randomised controlled trials: importance, indications, and interpretation. Lancet. 2005; 365(9454):176\u201386.","journal-title":"Lancet"},{"key":"4306_CR11","doi-asserted-by":"publisher","DOI":"10.1201\/b14876","volume-title":"Kernel smoothing","author":"MP Wand","year":"1994","unstructured":"Wand MP, Chris Jones M. Kernel smoothing. London: Chapman and Hall\/CRC; 1994."},{"issue":"1","key":"4306_CR12","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1137\/1109020","volume":"9","author":"EA Nadaraya","year":"1964","unstructured":"Nadaraya EA. On estimating regression. Theory Probab Appl. 1964; 9(1):141\u20132.","journal-title":"Theory Probab Appl"},{"issue":"4","key":"4306_CR13","first-page":"359","volume":"26","author":"GS Watson","year":"1964","unstructured":"Watson GS. Smooth regression analysis. Sankhy\u0101 Indian J Stat Seri A. 1964; 26(4):359\u201372.","journal-title":"Sankhy\u0101 Indian J Stat Seri A"},{"issue":"1","key":"4306_CR14","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1161\/CIRCOUTCOMES.113.000497","volume":"7","author":"JF Burke","year":"2014","unstructured":"Burke JF, Hayward RA, Nelson JP, Kent DM. Using internally developed risk models to assess heterogeneity in treatment effects in clinical trials. Circ Cardiovasc Qual Outcome. 2014; 7(1):163\u20139.","journal-title":"Circ Cardiovasc Qual Outcome"},{"issue":"5","key":"4306_CR15","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1086\/649928","volume":"50","author":"J Hanson","year":"2010","unstructured":"Hanson J, Lee SJ, Mohanty S, Faiz M, Anstey NM, kaew Charunwatthana P, Yunus EB, Mishra SK, Tjitra E, Price RN, et al.A simple score to predict the outcome of severe malaria in adults. Clin Infect Dis. 2010; 50(5):679\u201385.","journal-title":"Clin Infect Dis"},{"issue":"Supplement 1","key":"4306_CR16","first-page":"7","volume":"19","author":"WHO","year":"2014","unstructured":"WHO. Severe malaria. Trop Med Int Health. 2014; 19(Supplement 1):7\u2013131. https:\/\/doi.org\/10.1111\/tmi.12313_2. https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1111\/tmi.12313_2.","journal-title":"Trop Med Int Health"},{"issue":"9487","key":"4306_CR17","doi-asserted-by":"publisher","first-page":"717","DOI":"10.1016\/S0140-6736(05)67176-0","volume":"366","author":"AM Dondorp","year":"2005","unstructured":"Dondorp AM, Nosten F, Stepniewska K, Day N, White N. Artesunate versus quinine for treatment of severe falciparum malaria: a randomised trial. Lancet. 2005; 366(9487):717\u201325.","journal-title":"Lancet"},{"issue":"9753","key":"4306_CR18","doi-asserted-by":"publisher","first-page":"1647","DOI":"10.1016\/S0140-6736(10)61924-1","volume":"376","author":"AM Dondorp","year":"2010","unstructured":"Dondorp AM, Fanello CI, Hendriksen ICE, Gomes E, Seni A, Chhaganlal KD, Bojang K, Olaosebikan R, Anunobi N, Maitland K, et al.Artesunate versus quinine in the treatment of severe falciparum malaria in African children (AQUAMAT): an open-label, randomised trial. Lancet. 2010; 376(9753):1647\u201357.","journal-title":"Lancet"},{"issue":"5","key":"4306_CR19","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1056\/NEJMoa1314981","volume":"371","author":"EA Ashley","year":"2014","unstructured":"Ashley EA, Dhorda M, Fairhurst RM, Amaratunga C, Lim P, Suon S, Sreng S, Anderson JM, Mao S, et al.Spread of artemisinin resistance in Plasmodium falciparum malaria. New Engl J Med. 2014; 371(5):411\u201323.","journal-title":"New Engl J Med"},{"issue":"10","key":"4306_CR20","doi-asserted-by":"publisher","first-page":"1022","DOI":"10.1016\/S1473-3099(17)30524-8","volume":"17","author":"M Imwong","year":"2017","unstructured":"Imwong M, Hien TT, Thuy-Nhien NT, Dondorp AM, White NJ. Spread of a single multidrug resistant malaria parasite lineage (PfPailin) to Vietnam. Lancet Infect Dis. 2017; 17(10):1022\u20133.","journal-title":"Lancet Infect Dis"},{"issue":"11","key":"4306_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0027273","volume":"6","author":"RJ Maude","year":"2011","unstructured":"Maude RJ, Hoque G, Hasan MU, Sayeed A, Akter S, Samad R, Alam B, Yunus EB, Rahman R, Rahman W, Chowdhury R, Seal T, Charunwatthana P, Chang CC, White NJ, Abul Faiz M, Day NPJ, Dondorp AM, Hossain Amir. Timing of enteral feeding in cerebral malaria in resource-poor settings: a randomized trial. PLOS One. 2011; 6(11):1\u20137. https:\/\/doi.org\/10.1371\/journal.pone.0027273.","journal-title":"PLOS One"},{"issue":"1","key":"4306_CR22","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1093\/infdis\/jit410","volume":"209","author":"RJ Maude","year":"2013","unstructured":"Maude RJ, Silamut K, Plewes K, Charunwatthana P, Ho M, Abul Faiz M, Rahman R, Hossain MA, Hassan MU, Yunus EB. Randomized controlled trial of levamisole hydrochloride as adjunctive therapy in severe falciparum malaria with high parasitemia. J Infect Dis. 2013; 209(1):120\u20139.","journal-title":"J Infect Dis"},{"issue":"1","key":"4306_CR23","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1086\/375059","volume":"37","author":"PN Newton","year":"2003","unstructured":"Newton PN, Angus BJ, Chierakul W, Dondorp A, Ruangveerayuth R, Silamut K, Teerapong P, Suputtamongkol Y, Looareesuwan S, White NJ. Randomized comparison of artesunate and quinine in the treatment of severe falciparum malaria. Clin Infect Dis. 2003; 37(1):7\u201316. https:\/\/doi.org\/10.1086\/375059.","journal-title":"Clin Infect Dis"},{"key":"4306_CR24","doi-asserted-by":"publisher","unstructured":"Plewes K, Kingston HWF, Ghose A, Wattanakul T, Uddin Hassan MM, Haider MS, Dutta PK, Islam MA, Alam S, Jahangir SM, Zahed ASM, Sattar MA, Hassan Chowdhury MA, Herdmen MT, Leopold SJ, Ishioka H, Piera KA, Charunwatthana P, Silamut K, Yeo TW, Lee SJ, Mukaka M, Maude RJ, Turner GDH, Faiz MA, Tarning J, Oates JA, Anstey NM, White NJ, Day NPJ, Hossain MA, Jackson Roberts II L, Dondorp AM. Acetaminophen as a renoprotective adjunctive treatment in patients with severe and moderately severe falciparum malaria: a randomized, controlled, open-label trial. Clin Infect Dis. 2018; April. https:\/\/doi.org\/10.1093\/cid\/ciy213\/4930781.","DOI":"10.1093\/cid\/ciy213\/4930781"},{"issue":"1","key":"4306_CR25","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1186\/1475-2875-9-97","volume":"9","author":"NH Phu","year":"2010","unstructured":"Phu NH, Tuan PQ, Day N, Mai NTH, Chau TTH, Chuong LV, Sinh DX, White NJ, Farrar J, Hien TT. Randomized controlled trial of artesunate or artemether in Vietnamese adults with severe falciparum malaria. Malar J. 2010; 9(1):97.","journal-title":"Malar J"},{"issue":"9487","key":"4306_CR26","doi-asserted-by":"publisher","first-page":"717","DOI":"10.1016\/S0140-6736(05)67176-0","volume":"366","author":"SEAQUAMAT group","year":"2005","unstructured":"SEAQUAMAT group. Artesunate versus quinine for treatment of severe falciparum malaria: a randomised trial. Lancet. 2005; 366(9487):717\u201325. https:\/\/doi.org\/10.1016\/438S0140-6736(05)67176-0.","journal-title":"Lancet"},{"issue":"2","key":"4306_CR27","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1056\/NEJM199607113350202","volume":"335","author":"TT Hien","year":"1996","unstructured":"Hien TT, Day NPJ, Phu NH, Mai NTH, Chau TTH, Loc PP, Sinh DX, Chuong LV, Vinh H, Waller D, et al.A controlled trial of artemether or quinine in Vietnamese adults with severe falciparum malaria. New Engl J Med. 1996; 335(2):76\u201383.","journal-title":"New Engl J Med"}],"updated-by":[{"DOI":"10.1186\/s13063-020-04782-5","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2020,10,20]],"date-time":"2020-10-20T00:00:00Z","timestamp":1603152000000}}],"container-title":["Trials"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13063-020-04306-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13063-020-04306-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13063-020-04306-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,6]],"date-time":"2021-05-06T19:32:46Z","timestamp":1620329566000},"score":1,"resource":{"primary":{"URL":"https:\/\/trialsjournal.biomedcentral.com\/articles\/10.1186\/s13063-020-04306-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,7]]},"references-count":27,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["4306"],"URL":"https:\/\/doi.org\/10.1186\/s13063-020-04306-1","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/708958","asserted-by":"object"}]},"ISSN":["1745-6215"],"issn-type":[{"value":"1745-6215","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,7]]},"assertion":[{"value":"21 July 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 April 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 May 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 October 2020","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"An amendment to this paper has been published and can be accessed via the original article.","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1. UK: Oxford Tropical Medicine Research Ethics Committee (OXTREC) (UK), 11th August 2008 (ref. 03402) 2. The Gambia: The Gambia Government\/MRC Laboratories Joint Ethics Committee, 5th October 2005 (ref. L2005.91) 3. Kenya: KEMRI National Ethics Review Committee, 21st October 2005 (ref. KEMRI\/RES\/7\/3\/1) 4. Ghana: University of Science and Technology School of Medical Science, Committee on Human Research Publication and Ethics, 23rd January 2006 (ref. CHRPE\/01\/06) 5. Mozambique: Ministry of Health, Comit\u00e9 Nacional de Bio\u00e9tica para a sa\u00f9de, 4th June 2007 (ref. IRB 00002657-105\/CNBS\/07) 6. Tanzania: Ministry of Health, National Institute for Medical Research (NIMR), 20th April 2007 (ref. NIMR\/HQ\/R.8c\/ Vol. 1\/22) 7. Uganda: Mbarara University of Science and Technology, Institutional Ethical Review Committee, 22nd August 2007 (ref. Dos 1\/6) 8. Nigeria: University of Ilorin Teaching Hospital, Ethical Review Committee, 26th October 2007 (ref. UITH\/CAT\/189\/10\/659) 9. Rwanda: Ministry of Health National Ethics Committee, 3rd April 2008 (ref. IRB 00001497 of IORG 0001100)All patients or their attendant relative or guardian gave fully informed written consent before enrolment into the study.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"386"}}