{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T03:07:43Z","timestamp":1761102463717,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,3,18]],"date-time":"2021-03-18T00:00:00Z","timestamp":1616025600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003635","name":"Health Insurance Review and Assessment Service","doi-asserted-by":"publisher","award":["2019"],"award-info":[{"award-number":["2019"]}],"id":[{"id":"10.13039\/501100003635","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>This study sought to adapt the existing value framework (VF) to produce a reliable and valid Korean oncology VF. Two VFs developed by The American Society of Clinical Oncology (ASCO) and the European Society for Medical Oncology (ESMO) were selected for examination in the present study. Forward and backward translations were conducted for six high-priced drugs indicated for non-small-cell lung cancer and multiple myeloma. Inter-rater reliability was measured based on the intraclass correlation coefficient (ICC) and variation was described using the coefficient of variation. The relative weights of factors critically considered by Korean oncologists were derived following the analytic hierarchy process (AHP), and focus group interviews (FGIs) were used to obtain qualitative data regarding the applications of these two VFs in the Korean setting. The ICCs of the Korean VFs were 0.895 (0.654\u20130.983) for ASCO and 0.726 (0\u20130.982) for ESMO translations, suggesting excellent reliability for ASCO and good reliability for ESMO. AHP demonstrated that clinical benefit has the highest priority, which is consistent with the ASCO VF. The FGIs suggested that the result for AHP is acceptable and that both ESMO and ASCO VFs should be used complementarily. Although further evaluation with a larger sample size is needed, the Korean versions of ESMO\/ASCO VFs are valid and reliable tools and are acceptable to Korean stakeholders, yet they should be applied with caution.<\/jats:p>","DOI":"10.3390\/ijerph18063139","type":"journal-article","created":{"date-parts":[[2021,3,18]],"date-time":"2021-03-18T11:41:06Z","timestamp":1616067666000},"page":"3139","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Value Frameworks: Adaptation of Korean Versions of Value Frameworks for Oncology"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3894-4958","authenticated-orcid":false,"given":"Green","family":"Bae","sequence":"first","affiliation":[{"name":"College of Pharmacy, Ewha Womans University, Seoul 03760, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8993-8884","authenticated-orcid":false,"given":"SeungJin","family":"Bae","sequence":"additional","affiliation":[{"name":"College of Pharmacy, Ewha Womans University, Seoul 03760, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3878-6876","authenticated-orcid":false,"given":"Donghwan","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Statistics, Ewha Womans University, Seoul 03760, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juhee","family":"Han","sequence":"additional","affiliation":[{"name":"College of Pharmacy, Ewha Womans University, Seoul 03760, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong-Hoe","family":"Koo","sequence":"additional","affiliation":[{"name":"Division of Hematology\/Oncology, Department of Internal Medicine, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Seoul 03063, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Do Yeun","family":"Kim","sequence":"additional","affiliation":[{"name":"Division of Hematology\/Oncology, Department of Internal Medicine, Dongguk University Ilsan Hospital, Seoul 10326, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hee-Jun","family":"Kim","sequence":"additional","affiliation":[{"name":"Division of Hematology\/Medical Oncology, Department of Internal Medicine, Chung-Ang University Hospital, Seoul 06974, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sung Young","family":"Oh","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, Dong-A University Hospital, Dong-A University College of Medicine, Busan 49236, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9281-8082","authenticated-orcid":false,"given":"Hee Yeon","family":"Lee","sequence":"additional","affiliation":[{"name":"Division of Oncology, Department of Internal Medicine, Yeouido St. Mary\u2019s Hospital, The Catholic University of Korea, Seoul 07345, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jong Hwan","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Pharmaceutical Benefits, Health Insurance Review &amp; Assessment, Wonju 26465, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hye Sook","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, College of Medicine, Chungbuk National University, Cheongju 28644, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hyerim","family":"Ha","sequence":"additional","affiliation":[{"name":"Division of Hematology &amp; Oncology, Department of Internal Medicine, Inha University Hospital, Incheon 400 711, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3741-5168","authenticated-orcid":false,"given":"Jin Hyoung","family":"Kang","sequence":"additional","affiliation":[{"name":"Medical Oncology, Seoul St. Mary\u2019s Hospital, The Catholic University of Korea, Seoul 07345, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"960","DOI":"10.1001\/jamaoncol.2016.0648","article-title":"Drug Pricing Trends for Orally Administered Anticancer Medications Reimbursed by Commercial Health Plans, 2000-2014","volume":"2","author":"Dusetzina","year":"2016","journal-title":"JAMA Oncol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3900","DOI":"10.1002\/cncr.28321","article-title":"Market spiral pricing of cancer drugs","volume":"119","author":"Light","year":"2013","journal-title":"Cancer"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1225","DOI":"10.1001\/jamaoto.2014.1570","article-title":"Unintended consequences of expensive cancer therapeutics\u2014The pursuit of marginal indications and a me-too mentality that stifles innovation and creativity: The John Conley Lecture","volume":"140","author":"Fojo","year":"2014","journal-title":"JAMA Otolaryngol. Head Neck Surg."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1238","DOI":"10.1001\/jamaoncol.2016.0931","article-title":"An appraisal of clinically meaningful outcomes guidelines for oncology clinical trials","volume":"2","author":"Kumar","year":"2016","journal-title":"JAMA Oncol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1634\/theoncologist.2010-S1-13","article-title":"The role of the US Food and Drug Administration review process: Clinical trial endpoints in oncology","volume":"15","author":"McKee","year":"2010","journal-title":"Oncologist"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3372","DOI":"10.1002\/cncr.29512","article-title":"Are high drug prices for hematologic malignancies justified? A critical analysis","volume":"121","author":"Chhatwal","year":"2015","journal-title":"Cancer"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1007\/s40273-012-0021-6","article-title":"Korean Guidelines for Pharmacoeconomic Evaluation (Second and Updated Version)","volume":"31","author":"Bae","year":"2013","journal-title":"PharmacoEconomics"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1222","DOI":"10.1016\/j.clinthera.2020.05.006","article-title":"Are Recently Evaluated Drugs More Likely to Receive Positive Reimbursement Recommendations in South Korea? 11-Year Experience of the South Korean Positive List System","volume":"42","author":"Gong","year":"2020","journal-title":"Clin. Ther."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1200\/JCO.18.00729","article-title":"Comparative assessment of clinical benefit using the ESMO-magnitude of clinical benefit scale version 1.1 and the ASCO value framework net health benefit score","volume":"37","author":"Cherny","year":"2019","journal-title":"J. Clin. Oncol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1547","DOI":"10.1093\/annonc\/mdv249","article-title":"A standardised, generic, validated approach to stratify the magnitude of clinical benefit that can be anticipated from anti-cancer therapies: The European Society for Medical Oncology Magnitude of Clinical Benefit Scale (ESMO-MCBS)","volume":"26","author":"Cherny","year":"2015","journal-title":"Ann. Oncol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e653","DOI":"10.1200\/JOP.2016.020339","article-title":"Exploration of the ASCO and ESMO value frameworks for antineoplastic drugs","volume":"13","author":"Becker","year":"2017","journal-title":"J. Oncol. Pract."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e470s","DOI":"10.6061\/clinics\/2018\/e470s","article-title":"Value-based medicine in oncology: The importance of perspective in the emerging value frameworks","volume":"73","author":"Campolina","year":"2018","journal-title":"Clinics"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2134","DOI":"10.1093\/annonc\/mdw297","article-title":"Utilisation of the ESMO-MCBS in practice of HTA","volume":"27","author":"Wild","year":"2016","journal-title":"Ann. Oncol."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Rodriguez, A., Esposito, F., Oliveres, H., Torres, F., and Maurel, J. (2021). Are Quality of Randomized Clinical Trials and ESMO-Magnitude of Clinical Benefit Scale Two Sides of the Same Coin, to Grade Recommendations for Drug Approval?. J. Clin. Med., 10.","DOI":"10.3390\/jcm10040746"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e19391","DOI":"10.1200\/JCO.2020.38.15_suppl.e19391","article-title":"Do we consider to apply the value framework of cancer drugs to clinical practice and health insurance coverage in Korea?","volume":"38","author":"Kim","year":"2020","journal-title":"J. Clin. Oncol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.jval.2013.10.006","article-title":"From Translation to Version Management: A History and Review of Methods for the Cultural Adaptation of the EuroQol Five-Dimensional Questionnaire","volume":"17","author":"Rabin","year":"2014","journal-title":"Value Health"},{"key":"ref_17","unstructured":"Clinical Trial Guidelines."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3972","DOI":"10.1002\/sim.5466","article-title":"Sample size formulas for estimating intraclass correlation coefficients with precision and assurance","volume":"31","author":"Zou","year":"2012","journal-title":"Stat. Med."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1016\/j.jval.2016.12.011","article-title":"Validity and reliability of value assessment frameworks for new cancer drugs","volume":"20","author":"Bentley","year":"2017","journal-title":"Value Health"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1177\/096228029900800204","article-title":"Measuring agreement in method comparison studies","volume":"8","author":"Bland","year":"1999","journal-title":"Stat. Methods Med Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1037\/0033-2909.86.2.420","article-title":"Intraclass correlations: Uses in assessing rater reliability","volume":"86","author":"Shrout","year":"1979","journal-title":"Psychol. Bull."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1001\/jamaoncol.2019.0818","article-title":"Assessment of whether the American Society of Clinical Oncology\u2019s Value Framework and the European Society for Medical Oncology\u2019s Magnitude of Clinical Benefit Scale measure absolute or relative clinical survival benefit: An analysis of randomized clinical trials","volume":"5","author":"Saluja","year":"2019","journal-title":"JAMA Oncol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Saaty, T.L. (2014). Analytic heirarchy process. Wiley StatsRef: Statistics Reference Online, Wiley Online Library.","DOI":"10.1002\/9781118445112.stat05310"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2340","DOI":"10.1093\/annonc\/mdx310","article-title":"ESMO-magnitude of clinical benefit scale version 1.1","volume":"28","author":"Cherny","year":"2017","journal-title":"Ann. Oncol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2925","DOI":"10.1200\/JCO.2016.68.2518","article-title":"Updating the American Society of Clinical Oncology value framework: Revisions and reflections in response to comments received","volume":"34","author":"Schnipper","year":"2016","journal-title":"J. Clin. Oncol."},{"key":"ref_26","first-page":"163","article-title":"Evaluation of the ASCO value framework for anticancer drugs at an academic medical center","volume":"23","author":"Wilson","year":"2017","journal-title":"J. Manag. Care Spec. Pharm."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2764","DOI":"10.1200\/JCO.2016.71.6894","article-title":"Do the American society of clinical oncology value framework and the European society of medical oncology magnitude of clinical benefit scale measure the same construct of clinical benefit?","volume":"35","author":"Cheng","year":"2017","journal-title":"J. Clin. Oncol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1093\/annonc\/mdx721","article-title":"Re-aligning the ASCO and ESMO clinical benefit frameworks for modern cancer therapies","volume":"29","author":"Sullivan","year":"2018","journal-title":"Ann. Oncol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"887","DOI":"10.1016\/S1470-2045(17)30415-1","article-title":"Delivery of meaningful cancer care: A retrospective cohort study assessing cost and benefit with the ASCO and ESMO frameworks","volume":"18","author":"Sullivan","year":"2017","journal-title":"Lancet Oncol."}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/18\/6\/3139\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:37:34Z","timestamp":1760161054000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/18\/6\/3139"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,18]]},"references-count":29,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["ijerph18063139"],"URL":"https:\/\/doi.org\/10.3390\/ijerph18063139","relation":{},"ISSN":["1660-4601"],"issn-type":[{"type":"electronic","value":"1660-4601"}],"subject":[],"published":{"date-parts":[[2021,3,18]]}}}