{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T10:32:31Z","timestamp":1792146751366,"version":"4.4.0"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,3,17]],"date-time":"2021-03-17T00:00:00Z","timestamp":1615939200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2021,3,17]],"date-time":"2021-03-17T00:00:00Z","timestamp":1615939200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ther Innov Regul Sci"],"published-print":{"date-parts":[[2021,7]]},"DOI":"10.1007\/s43441-021-00268-x","type":"journal-article","created":{"date-parts":[[2021,3,17]],"date-time":"2021-03-17T15:02:46Z","timestamp":1615993366000},"page":"705-716","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Interdisciplinary Safety Evaluation for Learning and Decision-Making"],"prefix":"10.1007","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5626-904X","authenticated-orcid":false,"given":"Greg","family":"Ball","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Barbara A.","family":"Hendrickson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy L.","family":"Freedman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Gordon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brenda","family":"Crowe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Melissa F.","family":"Veenhuizen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Buchanan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,3,17]]},"reference":[{"key":"268_CR1","unstructured":"Ball G, Bhattacharyya A, Binkowitz B, Corrigan-Curay J, Duke SP, Herson J, et al. Interdisciplinary Aggregate Assessments for IND Safety Reporting: A Dialogue among Colleagues from Industry, Academia and the FDA. ASA Biopharmaceutical Section Regulatory-Industry Statistics Workshop. 2018."},{"issue":"4","key":"268_CR2","doi-asserted-by":"publisher","first-page":"821","DOI":"10.1007\/s43441-019-00021-5","volume":"54","author":"G Ball","year":"2020","unstructured":"Ball G, Reblin T, Buchanan J, Hendrickson BA, Lewis E, Schnell PM, et al. A framework for safety evaluation throughout the product development life-cycle. Ther Innov Regul Sci. 2020;54(4):821\u201330.","journal-title":"Ther Innov Regul Sci"},{"key":"268_CR3","volume-title":"Management of Safety Information from Clinical Trials","author":"CIOMS Working Group VI","year":"2005","unstructured":"CIOMS Working Group VI. Management of Safety Information from Clinical Trials. Geneva: Council for International Organizations of Medical Sciences; 2005."},{"key":"268_CR4","unstructured":"U.S. Food and Drug Administration. Safety Assessment for IND Safety Reporting: Guidance for Industry. 2015. http:\/\/www.fda.gov\/downloads\/drugs\/guidancecomplianceregulatoryinformation\/guidances\/ucm477584.pdf."},{"issue":"1","key":"268_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1214\/aoms\/1177704711","volume":"33","author":"JW Tukey","year":"1962","unstructured":"Tukey JW. The future of data analysis. Ann Math Stat. 1962;33(1):1\u201367.","journal-title":"Ann Math Stat"},{"key":"268_CR6","unstructured":"US Food and Drug Administration. Final Rule: Investigational New Drug Safety Reporting Requirements for Human Drug and Biological Products and Safety Reporting Requirements for Bioavailability and Bioequivalence Studies in Humans. 2010. https:\/\/www.federalregister.gov\/documents\/2010\/09\/29\/2010-24296\/investigational-new-drug-safety-reporting-requirements-for-human-drug-and-biological-products-and."},{"key":"268_CR7","unstructured":"U.S. Food and Drug Administration. Guidance for Industry and Investigators: Safety Reporting Requirements for INDs and BA\/BE Studies. 2012. http:\/\/www.fda.gov\/downloads\/Drugs\/GuidanceComplianceRegulatoryInformation\/Guidances\/UCM227351.pdf."},{"key":"268_CR8","unstructured":"Clinical Trial Facilitation Group (CTFG). Q&A Document\u2014Reference Safety Information. 2017. https:\/\/www.hma.eu\/fileadmin\/dateien\/Human_Medicines\/01-About_HMA\/Working_Groups\/CTFG\/2017_11_CTFG_Question_and_Answer_on_Reference_Safety_Information_2017.pdf."},{"issue":"2","key":"268_CR9","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1007\/s43441-019-00076-4","volume":"54","author":"G Ball","year":"2020","unstructured":"Ball G, Kurek R, Hendrickson BA, Buchanan J, Wang WW, Duke SP, et al. Global regulatory landscape for aggregate safety assessments: recent developments and future directions. Ther Innov Regul Sci. 2020;54(2):447\u201361.","journal-title":"Ther Innov Regul Sci"},{"issue":"5","key":"268_CR10","doi-asserted-by":"publisher","first-page":"430","DOI":"10.1177\/1740774509344101","volume":"6","author":"B Crowe","year":"2009","unstructured":"Crowe B, Xia HA, Berlin J, Watson DJ, Shi H, Lin SL, et al. Recommendations for safety planning, data collection, evaluation and reporting during drug, biologic and vaccine development: a report of the safety planning, evaluation, and reporting team. Clin Trials. 2009;6(5):430\u201340.","journal-title":"Clin Trials"},{"issue":"9","key":"268_CR11","doi-asserted-by":"publisher","first-page":"1117","DOI":"10.1002\/sim.4780140932","volume":"14","author":"RT O\u2019Neill","year":"1995","unstructured":"O\u2019Neill RT. Statistical concepts in the planning and evaluation of drug safety from clinical trials in drug development: issues of international harmonization. Stat Med. 1995;14(9):1117\u201327.","journal-title":"Stat Med"},{"issue":"4","key":"268_CR12","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1177\/2168479017739268","volume":"52","author":"KA Buhr","year":"2018","unstructured":"Buhr KA, Downs M, Rhorer J, Bechhofer R, Wittes J. Reports to independent data monitoring committees: an appeal for clarity, completeness, and comprehensibility. Ther Innov Regul Sci. 2018;52(4):459\u201368.","journal-title":"Ther Innov Regul Sci"},{"issue":"5","key":"268_CR13","doi-asserted-by":"publisher","first-page":"510","DOI":"10.1002\/pst.1949","volume":"18","author":"G Ball","year":"2019","unstructured":"Ball G, Lievano F. The importance of cross-disciplinary scientific engagement in the development of quantitative procedures for aggregate safety assessments. Pharm Stat. 2019;18(5):510\u20132.","journal-title":"Pharm Stat"},{"key":"268_CR14","unstructured":"Bhuyan P, Chen C, Desai J, Hart C, Helvering L, Jia D, et al. Development and Implementation of a Pharma-Collaborative Large Historical Control Database. 2015. http:\/\/www.transceleratebiopharmainc.com\/wp-content\/uploads\/2015\/04\/TransCelerate-PSoC-Data-Sharing-White-Paper.pdf."},{"key":"268_CR15","doi-asserted-by":"publisher","DOI":"10.1007\/s43441-020-00145-z","author":"P Bonomi","year":"2020","unstructured":"Bonomi P, Stuccio N, Delgra C, Chuk MK, Spira A, Deitz AC, et al. Reducing uninformative IND safety reports: a list of serious adverse events anticipated to ocur in patients with lung cancer. Ther Innov Regul Sci. 2020. https:\/\/doi.org\/10.1007\/s43441-020-00145-z.","journal-title":"Ther Innov Regul Sci"},{"key":"268_CR16","unstructured":"U.S. Food and Drug Administration. Guidance for Industry: Premarketing Risk Assessment. 2005. https:\/\/www.fda.gov\/regulatory-information\/search-fda-guidance-documents\/premarketing-risk-assessment."},{"key":"268_CR17","unstructured":"Tremmel L, Hendrickson BA, Buckanan J. Drug Safety Monitoring in a Complex World-Wide Regulatory Environment\u2014Strategy Meets Methodologies. Joint Statistical Meetings; Vancouver, British Columbia, Canada. 2018."},{"issue":"1","key":"268_CR18","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","volume":"57","author":"YHY Benjamini","year":"1995","unstructured":"Benjamini YHY. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B Stat Methodol. 1995;57(1):289\u2013300.","journal-title":"J R Stat Soc Ser B Stat Methodol"},{"key":"268_CR19","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1191\/0962280204sm363ra","volume":"13","author":"DV Mehrotra","year":"2004","unstructured":"Mehrotra DV, Heyse JF. Use of the false discovery rate for evaluating clinical safety data. Stat Methods Med Res. 2004;13:227\u201338.","journal-title":"Stat Methods Med Res"},{"issue":"Supplement 1","key":"268_CR20","first-page":"4197","volume":"130","author":"CN Harrison","year":"2017","unstructured":"Harrison CN, Mesa RA, Jamieson C, Hood J, Bykowski J, Zuccoli G, et al. Case series of potential Wernicke\u2019s encephalopathy in patients treated with Fedratinib. Blood. 2017;130(Supplement 1):4197.","journal-title":"Blood"},{"key":"268_CR21","first-page":"201","volume-title":"Blinded Safety Signal Monitoring for the FDA IND Reporting Final Rule. Statistical Applications from Clinical Trials and Personalized Medicine to Finance and Business Analytics","author":"G Ball","year":"2016","unstructured":"Ball G, Schnell PM. Blinded Safety Signal Monitoring for the FDA IND Reporting Final Rule. Statistical Applications from Clinical Trials and Personalized Medicine to Finance and Business Analytics. Cham: Springer; 2016. p. 201\u201311."},{"key":"268_CR22","doi-asserted-by":"publisher","first-page":"S11","DOI":"10.1016\/j.cct.2011.05.008","volume":"32","author":"G Ball","year":"2011","unstructured":"Ball G. Continuous safety monitoring for randomized controlled clinical trials with blinded treatment information: part 4: one method. Contemp Clin Trials. 2011;32:S11\u20137.","journal-title":"Contemp Clin Trials"},{"key":"268_CR23","doi-asserted-by":"publisher","first-page":"1557","DOI":"10.1007\/s43441-020-00183-7","volume":"54","author":"E Goren","year":"2020","unstructured":"Goren E, Lin L-A, Blaustein RO, Ball G. Bayesian meta-analysis of safety outcomes using blinded clinical trial data. Ther Innov Regul Sci. 2020;54:1557\u201365.","journal-title":"Ther Innov Regul Sci"},{"issue":"6","key":"268_CR24","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1177\/2168479016656702","volume":"50","author":"PM Schnell","year":"2016","unstructured":"Schnell PM, Ball G. A Bayesian exposure-time method for clinical trial safety monitoring with blinded data. Ther Innov Regul Sci. 2016;50(6):833\u20138.","journal-title":"Ther Innov Regul Sci"},{"issue":"6","key":"268_CR25","doi-asserted-by":"publisher","first-page":"823","DOI":"10.1002\/pst.1898","volume":"17","author":"S Mukhopadhyay","year":"2018","unstructured":"Mukhopadhyay S, Waterhouse B, Hartford A. Bayesian detection of potential risk using inference on blinded safety data. Pharm Stat. 2018;17(6):823\u201334.","journal-title":"Pharm Stat"},{"key":"268_CR26","doi-asserted-by":"publisher","DOI":"10.1016\/j.cct.2020.106068","volume":"95","author":"L-A Lin","year":"2020","unstructured":"Lin L-A, Yuan SS, Li L, Ball G. Meta-analysis of blinded and unblinded studies for ongoing aggregate safety monitoring and evaluation. Contemp Clin Trials. 2020;95:","journal-title":"Contemp Clin Trials"},{"key":"268_CR27","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1016\/j.cct.2019.06.022","volume":"83","author":"L-A Lin","year":"2019","unstructured":"Lin L-A, Zhan Y, Li H, Yuan SS, Ball G, Wang W. Bridging blinded and unblinded analysis for ongoing safety monitoring and evaluation. Contemp Clin Trials. 2019;83:81\u20137.","journal-title":"Contemp Clin Trials"},{"issue":"30","key":"268_CR28","doi-asserted-by":"publisher","first-page":"5561","DOI":"10.1002\/sim.7073","volume":"35","author":"AL Gould","year":"2016","unstructured":"Gould AL. Control charts for monitoring accumulating adverse event count frequencies from single and multiple blinded trials. Stat Med. 2016;35(30):5561\u201378.","journal-title":"Stat Med"},{"key":"268_CR29","unstructured":"U.S. Food and Drug Administration. Guidance for Industry: Determining the Extent of Safety Data Collection Needed in Late-Stage Premarket and Postapproval Clinical Investigations. 2016. https:\/\/www.fda.gov\/media\/82664\/download."},{"key":"268_CR30","unstructured":"International Conference on Harmonisation. E19 Optimisation of Safety Data Collection. 2019. https:\/\/www.fda.gov\/media\/128313\/download."},{"key":"268_CR31","unstructured":"CIOMS Working Group X. Evidence Synthesis and Meta-Analysis for Drug Safety: Report of the CIOMS Working Group X. Geneva: Council for International Organizations of Medical Sciences (CIOMS); 2016."},{"key":"268_CR32","unstructured":"US Food and Drug Administration. Meta-Analyses of Randomized Controlled Clinical Trials to Evaluate the Safety of Human Drugs or Biological Products. 2018. https:\/\/www.fda.gov\/regulatory-information\/search-fda-guidance-documents\/meta-analyses-randomized-controlled-clinical-trials-evaluate-safety-human-drugs-or-biological."},{"key":"268_CR33","first-page":"295","volume":"58","author":"AB Hill","year":"1965","unstructured":"Hill AB. The environment and disease: association or causation? Proc R Soc Med. 1965;58:295\u2013300.","journal-title":"Proc R Soc Med"},{"key":"268_CR34","unstructured":"CIOMS Working Groups III and V. Guidelines for Preparing Core Clinical Safety Information on Drugs. Geneva: Council for International Organizations of Medical Sciences. 1999."},{"key":"268_CR35","unstructured":"PHUSE. Analysis and Displays Associated with Adverse Events: Focus on Adverse Events in Phase 2-4 Clinical Trials and Integrated Summary Documents 2017. https:\/\/www.phuse.eu\/documents\/\/working-groups\/deliverables\/adverse-events-white-paper-version-10-03-feb-17-11796-19835.pdf."},{"issue":"3","key":"268_CR36","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1080\/19466315.2015.1043395","volume":"7","author":"J Wittes","year":"2015","unstructured":"Wittes J, Crowe B, Chuang-Stein C, Guettner A, Hall D, Jiang Q, et al. The FDA\u2019s final rule on expedited safety reporting: statistical considerations. Stat Biopharm Res. 2015;7(3):174\u201390.","journal-title":"Stat Biopharm Res"},{"issue":"1","key":"268_CR37","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1002\/pst.397","volume":"10","author":"C Chuang-Stein","year":"2011","unstructured":"Chuang-Stein C, Beltangady M. Reporting cumulative proportion of subjects with an adverse event based on data from multiple studies. Pharm Stat. 2011;10(1):3\u20137.","journal-title":"Pharm Stat"},{"issue":"1","key":"268_CR38","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1186\/1468-6708-3-6","volume":"3","author":"M Li\u00e8vre","year":"2002","unstructured":"Li\u00e8vre M, Cucherat M, Leizorovicz A. Pooling, meta-analysis, and the evaluation of drug safety. Curr Control Trials Cardiovasc Med. 2002;3(1):6.","journal-title":"Curr Control Trials Cardiovasc Med"},{"key":"268_CR39","doi-asserted-by":"crossref","unstructured":"Crowe B, Wang WV, Nilsson ME. Advances in techniques for combining data from multiple clinical trials. 2014. In: Advances in Collating and Using Trial Data [Internet]. Future Science; [20-37].","DOI":"10.4155\/ebo.13.631"},{"key":"268_CR40","unstructured":"U.S. Food and Drug Administration. E6(R2) Good Clinical Practice: Integrated Addendum to ICH E6(R1): Guidance for Industry. 2018. https:\/\/www.fda.gov\/media\/93884\/download."},{"key":"268_CR41","unstructured":"European Medicines Agency. Guideline on Good Pharmacovigilance Practices (GVP): Module IX\u2014Signal Management (Rev 1). 2017. https:\/\/www.ema.europa.eu\/en\/documents\/scientific-guideline\/guideline-good-pharmacovigilance-practices-gvp-module-ix-signal-management-rev-1_en.pdf."},{"key":"268_CR42","unstructured":"Strauss A. Determining the Threshold for Reporting of Adverse Events. Duke Margolis Public Workshop: Safety Assessment for Investigational New Drug Reporting. 2018."}],"container-title":["Therapeutic Innovation & Regulatory Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43441-021-00268-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s43441-021-00268-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43441-021-00268-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,26]],"date-time":"2024-08-26T05:02:00Z","timestamp":1724648520000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s43441-021-00268-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,17]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,7]]}},"alternative-id":["268"],"URL":"https:\/\/doi.org\/10.1007\/s43441-021-00268-x","relation":{},"ISSN":["2168-4790","2168-4804"],"issn-type":[{"value":"2168-4790","type":"print"},{"value":"2168-4804","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,17]]},"assertion":[{"value":"7 October 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 February 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 March 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}