{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T04:51:36Z","timestamp":1787028696895,"version":"build-2736575974"},"reference-count":51,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T00:00:00Z","timestamp":1772755200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMAHP"],"abstract":"<jats:p>Population-adjusted indirect comparisons (PAICs), including Matching-Adjusted Indirect Comparison and Simulated Treatment Comparison, are increasingly used to inform health technology assessments. These methods offer a pragmatic approach to generating comparative evidence between treatments when head-to-head trial data are unavailable and standard indirect treatment comparison methods are unfeasible. In rare diseases, however, PAICs often face substantial methodological challenges arising from small sample sizes, limited covariate overlap, and the frequent use of unanchored comparisons that rely on unverifiable assumptions. These limitations can lead to unstable estimates, reduced precision, and bias that may undermine the reliability of findings. Methodological refinements\u2014such as optimized weighting, Bayesian approaches, and doubly robust estimators\u2014provide some improvements but do not resolve these fundamental issues. Current European Joint Clinical Assessment guidance recommends that anchored PAICs be applied with great caution, while unanchored PAICs are considered highly problematic, and other methods should be used instead. We argue that PAICs can play a supportive role within a multidimensional and deliberative HTA process, contributing to comparative assessment alongside other evidence sources when available data are limited. However, their results require careful interpretation and transparent communication of uncertainty. Future research should prioritize the further development of formal frameworks to quantify bias and systematically assess robustness, thereby preventing overstatement of the credibility of PAIC-derived evidence in rare disease contexts.<\/jats:p>","DOI":"10.3390\/jmahp14010014","type":"journal-article","created":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T09:22:14Z","timestamp":1772788934000},"page":"14","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Can We Trust PAICs in Rare Diseases? Methodological Challenges and Limitations"],"prefix":"10.3390","volume":"14","author":[{"given":"Mikolaj","family":"Parkitny","sequence":"first","affiliation":[{"name":"Public Health Department, Faculty of Medicine, Aix-Marseille University, 13385 Marseille, France"},{"name":"Clever-Access, Wadowicka 8a, 30-415 Krakow, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6037-2039","authenticated-orcid":false,"given":"Samuel","family":"Aball\u00e9a","sequence":"additional","affiliation":[{"name":"Public Health Department, Faculty of Medicine, Aix-Marseille University, 13385 Marseille, France"},{"name":"InovIntell, 215 rue du Faubourg St Honor\u00e9, 75008 Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8400-1171","authenticated-orcid":false,"given":"Piotr","family":"Wojciechowski","sequence":"additional","affiliation":[{"name":"Clever-Access, Wadowicka 8a, 30-415 Krakow, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mondher","family":"Toumi","sequence":"additional","affiliation":[{"name":"Public Health Department, Faculty of Medicine, Aix-Marseille University, 13385 Marseille, France"},{"name":"Clever-Access, Wadowicka 8a, 30-415 Krakow, Poland"},{"name":"InovIntell, 215 rue du Faubourg St Honor\u00e9, 75008 Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1716","DOI":"10.1111\/1471-0528.15199","article-title":"Randomised Controlled Trials\u2014The Gold Standard for Effectiveness Research: Study Design: Randomised Controlled Trials","volume":"125","author":"Hariton","year":"2018","journal-title":"BJOG"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1177\/0272989X12458724","article-title":"Evidence Synthesis for Decision Making 2: A Generalized Linear Modeling Framework for Pairwise and Network Meta-Analysis of Randomized Controlled Trials","volume":"33","author":"Dias","year":"2013","journal-title":"Med. Decis. Mak."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1016\/S0895-4356(97)00049-8","article-title":"The Results of Direct and Indirect Treatment Comparisons in Meta-Analysis of Randomized Controlled Trials","volume":"50","author":"Bucher","year":"1997","journal-title":"J. Clin. Epidemiol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Baio, G., Thom, H., and Pechlivanoglou, P. (2025). R for Health Technology Assessment, Chapman and Hall\/CRC. [1st ed.].","DOI":"10.1201\/9781003031819"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1177\/0272989X17725740","article-title":"Methods for Population-Adjusted Indirect Comparisons in Health Technology Appraisal","volume":"38","author":"Phillippo","year":"2018","journal-title":"Med. Decis. Mak."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1017\/S0266462319000333","article-title":"Population Adjustment Methods for Indirect Comparisons: A Review of National Institute for Health and Care Excellence Technology Appraisals","volume":"35","author":"Phillippo","year":"2019","journal-title":"Int. J. Technol. Assess. Health Care"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"S464","DOI":"10.1016\/j.jval.2025.09.2082","article-title":"HTA299 Simulated Treatment Comparisons in NICE Technology Appraisals: Frequency Trends and Implications","volume":"28","author":"Broster","year":"2025","journal-title":"Value Health"},{"key":"ref_8","first-page":"1","article-title":"A Methodological Review of Population-Adjusted Indirect Comparisons Reveals Inconsistent Reporting and Suggests Publication Bias","volume":"163","author":"Zenati","year":"2023","journal-title":"J. Clin. Epidemiol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"935","DOI":"10.2165\/11538370-000000000-00000","article-title":"Comparative Effectiveness Without Head-to-Head Trials: A Method for Matching-Adjusted Indirect Comparisons Applied to Psoriasis Treatment with Adalimumab or Etanercept","volume":"28","author":"Signorovitch","year":"2010","journal-title":"PharmacoEconomics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"957","DOI":"10.2165\/11537420-000000000-00000","article-title":"No Head-to-Head Trial? Simulate the Missing Arms","volume":"28","author":"Caro","year":"2010","journal-title":"PharmacoEconomics"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1271","DOI":"10.1007\/s40273-025-01538-4","article-title":"HTA Evidence in Rare Diseases: Just Rare or Also Special?","volume":"43","author":"Basu","year":"2025","journal-title":"PharmacoEconomics"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"53","DOI":"10.29245\/2572-9411\/2016\/3.1054","article-title":"Design and Analysis of Clinical Trials for Small Rare Disease Populations","volume":"1","author":"Hilgers","year":"2016","journal-title":"J. Rare Dis. Res. Treat."},{"key":"ref_13","unstructured":"Phillippo, D., Ades, T., Dias, S., Palmer, S., Abrams, K.R., and Welton, N. (2023, November 15). NICE DSU Technical Support Document 18: Methods for Population-Adjusted Indirect Comparisons in Submissions to NICE. Available online: https:\/\/research-information.bris.ac.uk\/ws\/portalfiles\/portal\/94868463\/Population_adjustment_TSD_FINAL.pdf."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1002\/jrsm.1718","article-title":"Advancing Unanchored Simulated Treatment Comparisons: A Novel Implementation and Simulation Study","volume":"15","author":"Ren","year":"2024","journal-title":"Res. Synth. Methods"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1002\/jrsm.1511","article-title":"Methods for Population Adjustment with Limited Access to Individual Patient Data: A Review and Simulation Study","volume":"12","author":"Heath","year":"2021","journal-title":"Res. Synth. Methods"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1002\/jrsm.1565","article-title":"Parametric G-computation for Compatible Indirect Treatment Comparisons with Limited Individual Patient Data","volume":"13","author":"Heath","year":"2022","journal-title":"Res. Synth. Methods"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"e073242","DOI":"10.1136\/bmj-2022-073242","article-title":"FDA Approval, Clinical Trial Evidence, Efficacy, Epidemiology, and Price for Non-Orphan and Ultra-Rare, Rare, and Common Orphan Cancer Drug Indications: Cross Sectional Analysis","volume":"381","author":"Michaeli","year":"2023","journal-title":"BMJ"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/s44162-025-00099-6","article-title":"Rare Diseases: A Comprehensive Literature Review and Future Directions","volume":"4","author":"Chaudhary","year":"2025","journal-title":"J. Rare Dis."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"42","DOI":"10.56012\/chhh9584","article-title":"Population Diversity in Clinical Trials for Rare Diseases: A Regulatory Writer\u2019s Perspective","volume":"34","author":"Roberts","year":"2025","journal-title":"Med. Writ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"S38","DOI":"10.1002\/jcph.2134","article-title":"Natural History and Real-World Data in Rare Diseases: Applications, Limitations, and Future Perspectives","volume":"62","author":"Liu","year":"2022","journal-title":"J. Clin. Pharma"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"4885","DOI":"10.1002\/sim.8759","article-title":"Assessing the Performance of Population Adjustment Methods for Anchored Indirect Comparisons: A Simulation Study","volume":"39","author":"Phillippo","year":"2020","journal-title":"Stat. Med."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"674\u2013677; discussion 678\u2013681","DOI":"10.1093\/aje\/kwp436","article-title":"Invited Commentary: Positivity in Practice","volume":"171","author":"Westreich","year":"2010","journal-title":"Am. J. Epidemiol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"974","DOI":"10.1002\/pst.2210","article-title":"Geometric Approaches to Assessing the Numerical Feasibility for Conducting Matching-adjusted Indirect Comparisons","volume":"21","author":"Glimm","year":"2022","journal-title":"Pharm. Stat."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1515","DOI":"10.1002\/sim.4780081211","article-title":"Efficiency of the Logistic Regression and Cox Proportional Hazards Models in Longitudinal Studies","volume":"8","author":"Annesi","year":"1989","journal-title":"Stat. Med."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1002\/jrsm.1759","article-title":"Uncertain about Uncertainty in Matching-adjusted Indirect Comparisons? A Simulation Study to Compare Methods for Variance Estimation","volume":"15","author":"Chandler","year":"2024","journal-title":"Res. Synth. Methods"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"133","DOI":"10.2307\/2554780","article-title":"Estimation and Inference in Econometrics","volume":"62","author":"Davidson","year":"1995","journal-title":"Economica"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Harrell, F.E. (2015). Regression Modeling Strategies: With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis, Springer International Publishing. Springer Series in Statistics.","DOI":"10.1007\/978-3-319-19425-7"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1016\/S0895-4356(96)00236-3","article-title":"A Simulation Study of the Number of Events per Variable in Logistic Regression Analysis","volume":"49","author":"Peduzzi","year":"1996","journal-title":"J. Clin. Epidemiol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1503","DOI":"10.1016\/0895-4356(95)00048-8","article-title":"Importance of Events per Independent Variable in Proportional Hazards Regression Analysis II. Accuracy and Precision of Regression Estimates","volume":"48","author":"Peduzzi","year":"1995","journal-title":"J. Clin. Epidemiol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1495","DOI":"10.1016\/0895-4356(95)00510-2","article-title":"Importance of Events per Independent Variable in Proportional Hazards Analysis I. Background, Goals, and General Strategy","volume":"48","author":"Concato","year":"1995","journal-title":"J. Clin. Epidemiol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1016\/j.jval.2023.11.011","article-title":"Unanchored Population-Adjusted Indirect Comparison Methods for Time-to-Event Outcomes Using Inverse Odds Weighting, Regression Adjustment, and Doubly Robust Methods with Either Individual Patient or Aggregate Data","volume":"27","author":"Park","year":"2024","journal-title":"Value Health"},{"key":"ref_32","unstructured":"Campbell, H., and Remiro-Az\u00f3car, A. (2025). Doubly Robust Augmented Weighting Estimators for the Analysis of Externally Controlled Single-Arm Trials and Unanchored Indirect Treatment Comparisons. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2613","DOI":"10.1158\/1078-0432.CCR-12-2938","article-title":"Missing Data and Measurement Variability in Assessing Progression-Free Survival Endpoint in Randomized Clinical Trials","volume":"19","author":"Sridhara","year":"2013","journal-title":"Clin. Cancer Res."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1093\/jnci\/djk091","article-title":"When You Look Matters: The Effect of Assessment Schedule on Progression-Free Survival","volume":"99","author":"Panageas","year":"2007","journal-title":"JNCI J. Natl. Cancer Inst."},{"key":"ref_35","first-page":"e1527","article-title":"The Frequency of Assessment of Progression in Randomized Oncology Clinical Trials","volume":"5","author":"Haslam","year":"2022","journal-title":"Cancer Rep."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"S450","DOI":"10.1016\/j.jval.2024.10.2299","article-title":"MSR65 Can Low Effective Sample Size in Matching-Adjusted Indirect Comparisons (MAICS) Lead to Bias? Findings From a Simulation Study","volume":"27","author":"Ishak","year":"2024","journal-title":"Value Health"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Jiang, Y., and Ni, W. (2020). Performance of Unanchored Matching-Adjusted Indirect Comparison (MAIC) for the Evidence Synthesis of Single-Arm Trials with Time-to-Event Outcomes. BMC Med. Res. Methodol., 20.","DOI":"10.1186\/s12874-020-01124-6"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1002\/jrsm.1466","article-title":"Alternative Weighting Schemes When Performing Matching-adjusted Indirect Comparisons","volume":"12","author":"Jackson","year":"2021","journal-title":"Res. Synth. Methods"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Remiro-Az\u00f3car, A. (2022). Two-Stage Matching-Adjusted Indirect Comparison. BMC Med. Res. Methodol., 22.","DOI":"10.1186\/s12874-022-01692-9"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1515\/em-2012-0006","article-title":"Comparison of Approaches to Weight Truncation for Marginal Structural Cox Models","volume":"2","author":"Xiao","year":"2013","journal-title":"Epidemiol. Methods"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1080\/10705511.2016.1186549","article-title":"On Using Bayesian Methods to Address Small Sample Problems","volume":"23","author":"McNeish","year":"2016","journal-title":"Struct. Equ. Model. Multidiscip. J."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1186\/s13023-022-02342-5","article-title":"Application of Bayesian Methods to Accelerate Rare Disease Drug Development: Scopes and Hurdles","volume":"17","author":"Kidwell","year":"2022","journal-title":"Orphanet J. Rare Dis."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1111\/rssa.12579","article-title":"Multilevel Network Meta-Regression for Population-Adjusted Treatment Comparisons","volume":"183","author":"Phillippo","year":"2020","journal-title":"J. R. Stat. Soc. Ser. A Stat. Soc."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1038\/s41746-022-00666-x","article-title":"Generation of Realistic Synthetic Data Using Multimodal Neural Ordinary Differential Equations","volume":"5","author":"Wendland","year":"2022","journal-title":"NPJ Digit. Med."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Elvatun, S., Knoors, D., Brant, S., Jonasson, C., and Nyg\u00e5rd, J.F. (2025). Synthetic Data as External Control Arms in Scarce Single-Arm Clinical Trials. PLoS Digit. Health, 4.","DOI":"10.1371\/journal.pdig.0000581"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Mosquera, L., El Emam, K., Ding, L., Sharma, V., Zhang, X.H., Kababji, S.E., Carvalho, C., Hamilton, B., Palfrey, D., and Kong, L. (2023). A Method for Generating Synthetic Longitudinal Health Data. BMC Med. Res. Methodol., 23.","DOI":"10.1186\/s12874-023-01869-w"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"S462","DOI":"10.1016\/j.jval.2024.10.2361","article-title":"MSR127 Synthetic Data Generation: A New Approach for Population-Adjusted Indirect Treatment Comparisons Tested in Diabetic Macular Edema","volume":"27","author":"Aballea","year":"2024","journal-title":"Value Health"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1017\/rsm.2025.13","article-title":"Quantitative Bias Analysis for Unmeasured Confounding in Unanchored Population-Adjusted Indirect Comparisons","volume":"16","author":"Ren","year":"2025","journal-title":"Res. Synth. Methods"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"S443","DOI":"10.1016\/j.jval.2024.10.2261","article-title":"MSR27 An Extension of Unanchored Matching-Adjusted Indirect Comparison to Verify the Results of the Comparisons Between Poorly Overlapping Studies","volume":"27","author":"Parkitny","year":"2024","journal-title":"Value Health"},{"key":"ref_50","unstructured":"Member State Coordination Group on HTA (2025, January 16). Practical Guideline for Quantitative Evidence Synthesis: Direct and Indirect Comparisons. Available online: https:\/\/health.ec.europa.eu\/publications\/practical-guideline-quantitative-evidence-synthesis-direct-and-indirect-comparisons_en."},{"key":"ref_51","unstructured":"Member State Coordination Group on HTA (2025, January 16). Methodological Guideline for Quantitative Evidence Synthesis: Direct and Indirect Comparisons. Available online: https:\/\/health.ec.europa.eu\/publications\/methodological-guideline-quantitative-evidence-synthesis-direct-and-indirect-comparisons_en."}],"container-title":["Journal of Market Access &amp; Health Policy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2001-6689\/14\/1\/14\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T10:23:32Z","timestamp":1772792612000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2001-6689\/14\/1\/14"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,6]]},"references-count":51,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["jmahp14010014"],"URL":"https:\/\/doi.org\/10.3390\/jmahp14010014","relation":{},"ISSN":["2001-6689"],"issn-type":[{"value":"2001-6689","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,6]]}}}