{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T18:01:21Z","timestamp":1784224881779,"version":"3.55.0"},"reference-count":57,"publisher":"SAGE Publications","issue":"7","license":[{"start":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T00:00:00Z","timestamp":1726790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T00:00:00Z","timestamp":1726790400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100005416","name":"norges forskningsr\u00e5d","doi-asserted-by":"publisher","award":["298854"],"award-info":[{"award-number":["298854"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Med Decis Making"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:p>The net value of reducing decision uncertainty through collecting additional data is quantified by the expected net benefit of sampling (ENBS). The ENBS is the difference between the population-level expected value of sample information (EVSI) for the data collection exercise and the costs associated with the data collection. ENBS calculations for studies that collect survival data are complicated by the need to take into account censoring, and this has limited the application of value-of-information analysis in this setting. In this tutorial article, we present a general-purpose algorithm for calculating the ENBS for a study that collects survival data along with a step-by-step implementation in R. The algorithm is based on recently published methods for simulating survival data and computing EVSI that do not rely on the survival data being from a distribution with any particular parametric form and that can take into account any arbitrary censoring process. We illustrate the method using a real-life case study drawn from an appraisal of pembrolizumab plus axitinib for treating advanced renal cell carcinoma in which the initial decision was informed by immature survival data.<\/jats:p>\n                  <jats:sec>\n                    <jats:title>Highlights<\/jats:title>\n                    <jats:list list-type=\"bullet\">\n                      <jats:list-item>\n                        <jats:p>The net value of reducing decision uncertainty by collecting additional data is quantified by the expected net benefit of sampling (ENBS). This tutorial presents a general-purpose algorithm for computing the ENBS for collecting survival data along with a step-by-step implementation in R.<\/jats:p>\n                      <\/jats:list-item>\n                      <jats:list-item>\n                        <jats:p>The algorithm is based on recently published methods for simulating survival data and computing expected value of sample information that do not rely on the survival data to follow any particular parametric distribution and that can take into account any arbitrary censoring process.<\/jats:p>\n                      <\/jats:list-item>\n                      <jats:list-item>\n                        <jats:p>We demonstrate in a case study based on a previous cancer technology appraisal that ENBS calculations are useful not only for designing new studies but also for optimizing reimbursement decisions for new health technologies based on immature evidence from ongoing trials.<\/jats:p>\n                      <\/jats:list-item>\n                    <\/jats:list>\n                  <\/jats:sec>","DOI":"10.1177\/0272989x241279459","type":"journal-article","created":{"date-parts":[[2024,10,19]],"date-time":"2024-10-19T01:12:19Z","timestamp":1729300339000},"page":"719-741","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":3,"title":["Calculating the Expected Net Benefit of Sampling for Survival Data: A Tutorial and Case Study"],"prefix":"10.1177","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2678-0132","authenticated-orcid":false,"given":"Mathyn","family":"Vervaart","sequence":"first","affiliation":[{"name":"Department of Health Management and Health Economics, University of Oslo, Oslo, Norway"},{"name":"Clinical Trial Unit, Oslo University Hospital, Oslo, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2024,9,20]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"ISPOR. Pharmacoeconomic guidelines around the world. Available from: Ispor.org"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2020.10.016"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.2147\/CMAR.S328058"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12885-022-10350-8"},{"key":"e_1_3_3_6_2","unstructured":"European Medicines Agency. Adaptive pathways. European Medicines Agency. https:\/\/www.ema.europa.eu\/en\/human-regulatory\/research-development\/adaptive-pathways"},{"key":"e_1_3_3_7_2","unstructured":"European Medicines Agency. Conditional marketing authorisation. European Medicines Agency. https:\/\/www.ema.europa.eu\/en\/human-regulatory\/marketing-authorisation\/conditional-marketing-authorisation"},{"key":"e_1_3_3_8_2","unstructured":"United States Food and Drug Administration. Fast track breakthrough therapy accelerated approval priority review. https:\/\/www.fda.gov\/patients\/learn-about-drug-and-device-approvals\/fast-track-breakthrough-therapy-accelerated-approval-priority-review"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.healthpol.2018.09.016"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.healthpol.2020.06.007"},{"key":"e_1_3_3_11_2","unstructured":"Drug Commission of the German Medical Association. Opinion on the \u2018cost-sharing initiatives\u2019 and \u2018risk-sharing agreements\u2019 between pharmaceutical manufacturers and health and hospital. https:\/\/www.akdae.de\/fileadmin\/user_upload\/akdae\/Stellungnahmen\/Weitere\/20080508.pdf"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2016.09.001"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2016.03.2003"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1002\/hec.1586"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X211068019"},{"key":"e_1_3_3_16_2","volume-title":"Applied Statistical Decision Theory","author":"Rai\ufb00a H","year":"1961","unstructured":"Rai\ufb00a H, Schlaifer R. Applied Statistical Decision Theory. Boston: Division of Research, Graduate School of Business Administration, Harvard University; 1961."},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2020.01.004"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X231162069"},{"key":"e_1_3_3_19_2","volume-title":"R: A Language and Environment for Statistical Computing","author":"R Core Team","year":"2021","unstructured":"R Core Team. R: A Language and Environment for Statistical Computing. Vienna (Austria): R Foundation for Statistical Computing; 2021."},{"key":"e_1_3_3_20_2","volume-title":"Guide to the Methods of Technology Appraisal 2013","author":"National Institute for Health and Care Excellence","year":"2013","unstructured":"National Institute for Health and Care Excellence. Guide to the Methods of Technology Appraisal 2013. London: NICE; 2013."},{"key":"e_1_3_3_21_2","volume-title":"Guidelines for the Economic Evaluation of Health Technologies: Canada","author":"Canada\u2019s Drug and Health Technology Agency (CADTH)","unstructured":"Canada\u2019s Drug and Health Technology Agency (CADTH). Guidelines for the Economic Evaluation of Health Technologies: Canada. 4th ed. https:\/\/www.cadth.ca\/sites\/default\/files\/pdf\/guidelines_for_the_economic_evaluation_of_health_technologies_canada_4th_ed.pdf","edition":"4"},{"key":"e_1_3_3_22_2","volume-title":"Guidelines for Preparing a Submission to the Pharmaceutical Bene\ufb01ts Advisory Committee","author":"Commonwealth of Australia","year":"2016","unstructured":"Commonwealth of Australia. Guidelines for Preparing a Submission to the Pharmaceutical Bene\ufb01ts Advisory Committee. Version 5.0. Canberra (Australia): Australian Government, Department of Health; 2016."},{"key":"e_1_3_3_23_2","unstructured":"European Network for Health Technology Assessment. Practical considerations when critically assessing economic evaluations. https:\/\/www.eunethta.eu\/wp-content\/uploads\/2020\/03\/EUnetHTA-JA3WP6B2-5-Guidance-Critical-Assessment-EE_v1-0.pdf"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1201\/b18041"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmjmed-2021-000094"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1080\/03007995.2023.2167442"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/s41669-022-00369-9"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2020.01.001"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X211026292"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X04263162"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-985X.2008.00573.x"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X12472398"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2022.07.009"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X15575286"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X07312724"},{"key":"e_1_3_3_36_2","volume-title":"Value of Information for Healthcare Decision-Making","author":"Heath A","year":"2024","unstructured":"Heath A, Kunst N, Jackson C, eds. Value of Information for Healthcare Decision-Making. 1st ed. Boca Raton (FL): Chapman and Hall\/CRC; 2024."},{"key":"e_1_3_3_37_2","unstructured":"National Institute for Health and Care Excellence. Published guidance NICE advice and quality standards. Guidance. https:\/\/www.nice.org.uk\/guidance\/published"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1050(199611)5:6<513::AID-HEC237>3.0.CO;2-9"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2022.21140"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2015.05.003"},{"key":"e_1_3_3_41_2","unstructured":"National Institute for Health and Care Excellence. Pembrolizumab with axitinib for untreated advanced renal cell carcinoma [TA650]. Available from: https:\/\/www.nice.org.uk\/guidance\/ta650"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1816714"},{"key":"e_1_3_3_43_2","unstructured":"Merck Sharp & Dohme LLC. A phase III randomized open-label study to evaluate e\ufb03cacy and safety of pembrolizumab (MK-3475) in combination with axitinib versus sunitinib monotherapy as a first-line treatment for locally advanced or metastatic renal cell carcinoma (mRCC) (KEYNOTE-426). Clinical Trial Registration NCT02853331. August 2022. Available from: clinicaltrials.gov"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1186\/2046-4053-3-151"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-12-9"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-11-139"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2020.08.2094"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40273-019-00837-x"},{"key":"e_1_3_3_49_2","volume-title":"VOI: Expected Value of Information","author":"Jackson C","year":"2023","unstructured":"Jackson C, Heath A. VOI: Expected Value of Information. Manual, 2023. https:\/\/cran.r-project.org\/web\/packages\/voi\/index.html"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X13505910"},{"key":"e_1_3_3_51_2","unstructured":"Ritz C Strebig JC. DRC: analysis of dose-response curves. https:\/\/cran.r-project.org\/web\/packages\/drc\/index.html"},{"key":"e_1_3_3_52_2","unstructured":"Wickham H Chang W Henry L et al. Ggplot2: create elegant data visualisations using the grammar of graphics. https:\/\/cran.r-project.org\/web\/packages\/ggplot2\/index.html"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.healthpol.2023.104800"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X11406986"},{"key":"e_1_3_3_55_2","unstructured":"National Institute for Health and Care Excellence. Technology appraisal data: cancer appraisal recommendations https:\/\/www.nice.org.uk\/about\/what-we-do\/our-programmes\/nice-guidance\/nice-technology-appraisal-guidance\/data\/cancer-appraisal-recommendations"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/s41669-018-0113-0"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1002\/sim.8295"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2019.01.003"}],"updated-by":[{"DOI":"10.1177\/0272989x251405237","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T00:00:00Z","timestamp":1764892800000}}],"container-title":["Medical Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X241279459","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0272989X241279459","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X241279459","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T18:03:00Z","timestamp":1777658580000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0272989X241279459"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,20]]},"references-count":57,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["10.1177\/0272989X241279459"],"URL":"https:\/\/doi.org\/10.1177\/0272989x241279459","relation":{},"ISSN":["0272-989X","1552-681X"],"issn-type":[{"value":"0272-989X","type":"print"},{"value":"1552-681X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,20]]}}}