{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,6]],"date-time":"2025-12-06T07:08:38Z","timestamp":1765004918688,"version":"build-2065373602"},"reference-count":15,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,3,28]],"date-time":"2023-03-28T00:00:00Z","timestamp":1679961600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Canadian Institutes of Health Research","award":["#HRC-154126","# 2020-706936"],"award-info":[{"award-number":["#HRC-154126","# 2020-706936"]}]},{"name":"Canadian Centre for Applied Research in Cancer Control (ARCC)","award":["#HRC-154126","# 2020-706936"],"award-info":[{"award-number":["#HRC-154126","# 2020-706936"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Current Oncology"],"abstract":"<jats:p>The Canadian Real-world Evidence for Value of Cancer Drugs (CanREValue) collaboration developed an MCDA rating tool to assess and prioritize potential post-market real-world evidence (RWE) questions\/uncertainties emerging from public drug funding decisions in Canada. In collaboration with a group of multidisciplinary stakeholders from across Canada, the rating tool was developed following a three-step process: (1) selection of criteria to assess the importance and feasibility of an RWE question; (2) development of rating scales, application of weights and calculating aggregate scores; and (3) validation testing. An initial MCDA rating tool was developed, composed of seven criteria, divided into two groups. Group A criteria assess the importance of an RWE question by examining the (1) drug\u2019s perceived clinical benefit, (2) magnitude of uncertainty identified, and (3) relevance of the uncertainty to decision-makers. Group B criteria assess the feasibility of conducting an RWE analysis including the (1) feasibility of identifying a comparator, (2) ability to identify cases, (3) availability of comprehensive data, and (4) availability of necessary expertise and methodology. Future directions include partnering with the Canadian Agency for Drugs and Technology in Health\u2019s Provincial Advisory Group for further tool refinement and to gain insight into incorporating the tool into drug funding deliberations.<\/jats:p>","DOI":"10.3390\/curroncol30040286","type":"journal-article","created":{"date-parts":[[2023,3,29]],"date-time":"2023-03-29T03:32:25Z","timestamp":1680060745000},"page":"3776-3786","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Development of a Multi-Criteria Decision Analysis Rating Tool to Prioritize Real-World Evidence Questions for the Canadian Real-World Evidence for Value of Cancer Drugs (CanREValue) Collaboration"],"prefix":"10.3390","volume":"30","author":[{"given":"Ambica","family":"Parmar","sequence":"first","affiliation":[{"name":"Division of Medical Oncology & Hematology, Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M3, Canada"},{"name":"Temerty Faculty of Medicine, University of Toronto, Toronto, ON M5S 1A8, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei Fang","family":"Dai","sequence":"additional","affiliation":[{"name":"Temerty Faculty of Medicine, University of Toronto, Toronto, ON M5S 1A8, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francois","family":"Dionne","sequence":"additional","affiliation":[{"name":"Prioritize Consulting Ltd., Vancouver, BC V6S 2B3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marc","family":"Geirnaert","sequence":"additional","affiliation":[{"name":"CancerCare Manitoba, Winnipeg, MB R3E 0V9, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0039-0742","authenticated-orcid":false,"given":"Avram","family":"Denburg","sequence":"additional","affiliation":[{"name":"Division of Haematology\/Oncology, The Hospital for Sick Children, Toronto, ON M5G 1X8, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tarry","family":"Ahuja","sequence":"additional","affiliation":[{"name":"Canadian Agency for Drugs and Technologies in Health, Ottawa, ON K1S 5S8, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8858-9566","authenticated-orcid":false,"given":"Jaclyn","family":"Beca","sequence":"additional","affiliation":[{"name":"Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada"},{"name":"Canadian Centre for Applied Research in Cancer Control, Toronto, ON M5G 2L3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sylvie","family":"Bouchard","sequence":"additional","affiliation":[{"name":"Institut National d\u2019Excellence en Sant\u00e9 et en Services Sociaux (INESSS), Qu\u00e9bec, QC G1V 4M3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carole","family":"Chambers","sequence":"additional","affiliation":[{"name":"Alberta Health Services, Calgary, AB T5J 3E4, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9899-0396","authenticated-orcid":false,"given":"Melissa J.","family":"Hunt","sequence":"additional","affiliation":[{"name":"Health Canada, Ottawa, ON K1A 0K9, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4416-6876","authenticated-orcid":false,"given":"Don","family":"Husereau","sequence":"additional","affiliation":[{"name":"School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON K1G 5Z3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elena","family":"Lungu","sequence":"additional","affiliation":[{"name":"Patented Medicine Prices Review Board, Ottawa, ON K1P 1C1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Valerie","family":"McDonald","sequence":"additional","affiliation":[{"name":"Independent Researcher, Toronto, ON M6G 2V3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9264-7797","authenticated-orcid":false,"given":"Rebecca E.","family":"Mercer","sequence":"additional","affiliation":[{"name":"Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada"},{"name":"Canadian Centre for Applied Research in Cancer Control, Toronto, ON M5G 2L3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gunita","family":"Mitera","sequence":"additional","affiliation":[{"name":"Canadian Association of Provincial Cancer Agencies, Toronto, ON M5H 1J8, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Caroline","family":"Mu\u00f1oz","sequence":"additional","affiliation":[{"name":"Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rohini","family":"Naipaul","sequence":"additional","affiliation":[{"name":"Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8243-8721","authenticated-orcid":false,"given":"Stuart","family":"Peacock","sequence":"additional","affiliation":[{"name":"Canadian Centre for Applied Research in Cancer Control, Toronto, ON M5G 2L3, Canada"},{"name":"BC Cancer Agency, Vancouver, BC V5Z 1G1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tanya","family":"Potashnik","sequence":"additional","affiliation":[{"name":"Patented Medicine Prices Review Board, Ottawa, ON K1P 1C1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mina","family":"Tadrous","sequence":"additional","affiliation":[{"name":"Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, ON M5S 3M2, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pam","family":"Takhar","sequence":"additional","affiliation":[{"name":"Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marianne","family":"Taylor","sequence":"additional","affiliation":[{"name":"BC Cancer, Kelowna, BC V1Y 5L3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maureen","family":"Trudeau","sequence":"additional","affiliation":[{"name":"Division of Medical Oncology & Hematology, Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M3, Canada"},{"name":"Temerty Faculty of Medicine, University of Toronto, Toronto, ON M5S 1A8, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danica","family":"Wasney","sequence":"additional","affiliation":[{"name":"CancerCare Manitoba, Winnipeg, MB R3E 0V9, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8635-6889","authenticated-orcid":false,"given":"Scott","family":"Gavura","sequence":"additional","affiliation":[{"name":"Ontario Health (Cancer Care Ontario), Toronto, ON M5G 2L3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kelvin K. W.","family":"Chan","sequence":"additional","affiliation":[{"name":"Division of Medical Oncology & Hematology, Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M3, Canada"},{"name":"Temerty Faculty of Medicine, University of Toronto, Toronto, ON M5S 1A8, Canada"},{"name":"Canadian Centre for Applied Research in Cancer Control, Toronto, ON M5G 2L3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.1200\/EDBK_100028","article-title":"An Arm and a Leg: The Rising Cost of Cancer Drugs and Impact on Access","volume":"41","author":"Leighl","year":"2021","journal-title":"Am. Soc. Clin. Oncol. Educ. Book"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"622","DOI":"10.1016\/j.jval.2021.10.004","article-title":"Parametric Survival Extrapolation of Early Survival Data in Economic Analyses: A Comparison of Projected Versus Observed Updated Survival","volume":"25","author":"Everest","year":"2022","journal-title":"Value Health"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e032884","DOI":"10.1136\/bmjopen-2019-032884","article-title":"Developing a framework to incorporate real-world evidence in cancer drug funding decisions: The Canadian Real-world Evidence for Value of Cancer Drugs (CanREValue) collaboration","volume":"10","author":"Chan","year":"2020","journal-title":"BMJ Open"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1007\/s40258-015-0203-4","article-title":"Making Good Decisions in Healthcare with Multi-Criteria Decision Analysis: The Use, Current Research and Future Development of MCDA","volume":"14","author":"Muhlbacher","year":"2016","journal-title":"Appl. Health Econ. Health Policy"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jval.2015.12.003","article-title":"Multiple Criteria Decision Analysis for Health Care Decision Making\u2014An Introduction: Report 1 of the ISPOR MCDA Emerging Good Practices Task Force","volume":"19","author":"Thokala","year":"2016","journal-title":"Value Health"},{"key":"ref_6","unstructured":"Hansen, P., and Devlin, N. (2022, October 17). Multi-Criteria Decision Analysis (MCDA) in Healthcare Decision-Making. Oxford Research Encylopedia of Economics and Finance. Available online: https:\/\/oxfordre.com\/economics\/view\/10.1093\/acrefore\/9780190625979.001.0001\/acrefore-9780190625979-e-98."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1017\/S0266462313000639","article-title":"Implementation of EUnetHTA core Model(R) in Lombardia: The VTS framework","volume":"30","author":"Radaelli","year":"2014","journal-title":"Int. J. Technol. Assess. Health Care"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Goetghebeur, M.M., Wagner, M., Khoury, H., Levitt, R.J., Erickson, L.J., and Rindress, D. (2008). Evidence and Value: Impact on DecisionMaking\u2014The EVIDEM framework and potential applications. BMC Health Serv. Res., 8.","DOI":"10.1186\/1472-6963-8-270"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Tony, M., Wagner, M., Khoury, H., Rindress, D., Papastravros, T., Oh, P., and Goetghebeur, M.M. (2011). Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): Field testing of the EVIDEM framework for coverage decisions by a public payer in Canada. BMC Health Serv. Res., 11.","DOI":"10.1186\/1472-6963-11-329"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1269","DOI":"10.1016\/j.jval.2018.01.021","article-title":"Assessing Lung Cancer Screening Programs under Uncertainty in a Heterogeneous Population","volume":"21","author":"Broekhuizen","year":"2018","journal-title":"Value Health"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1177\/0272989X17736769","article-title":"The Feasibility of Sophisticated Multicriteria Support for Clinical Decisions","volume":"38","author":"Dolan","year":"2018","journal-title":"Med. Decis. Mak."},{"key":"ref_12","unstructured":"Mujoomdar, M., Russel, E., Dionne, F., Moulton, K., Murray, C., McGill, S., and Lambe, K. (2012). Optimizing Health System Use of Medical Isotopes and Other Imaging Modalities, Optimal Use Report."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1017\/S0266462320000525","article-title":"Can Multi-criteria decision analysis (MCDA) be implemented into real-world drug decision-making processes? A Canadian provincial experience","volume":"36","author":"Laba","year":"2020","journal-title":"Int. J. Technol. Assess. Health Care"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.jval.2015.12.016","article-title":"Multiple Criteria Decision Analysis for Health Care Decision Making\u2014Emerging Good Practices: Report 2 of the ISPOR MCDA Emerging Good Practices Task Force","volume":"19","author":"Marsh","year":"2016","journal-title":"Value Health"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1547","DOI":"10.1093\/annonc\/mdv249","article-title":"A standardised, generic, validated approach to stratify the magnitude of clinical benefit that can be anticipated from anti-cancer therapies: The European Society for Medical Oncology Magnitude of Clinical Benefit Scale (ESMO-MCBS)","volume":"26","author":"Cherny","year":"2015","journal-title":"Ann. Oncol."}],"container-title":["Current Oncology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1718-7729\/30\/4\/286\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:05:29Z","timestamp":1760123129000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1718-7729\/30\/4\/286"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,28]]},"references-count":15,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["curroncol30040286"],"URL":"https:\/\/doi.org\/10.3390\/curroncol30040286","relation":{},"ISSN":["1718-7729"],"issn-type":[{"type":"electronic","value":"1718-7729"}],"subject":[],"published":{"date-parts":[[2023,3,28]]}}}