{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,21]],"date-time":"2026-10-21T16:29:47Z","timestamp":1792600187459,"version":"4.5.0"},"reference-count":32,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,8,12]],"date-time":"2024-08-12T00:00:00Z","timestamp":1723420800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Med."],"abstract":"<jats:p>Computational models of patients and medical devices can be combined to perform an <jats:italic>in silico<\/jats:italic> clinical trial (ISCT) to investigate questions related to device safety and\/or effectiveness across the total product life cycle. ISCTs can potentially accelerate product development by more quickly informing device design and testing or they could be used to refine, reduce, or in some cases to completely replace human subjects in a clinical trial. There are numerous potential benefits of ISCTs. An important caveat, however, is that an ISCT is a virtual representation of the real world that has to be shown to be credible before being relied upon to make decisions that have the potential to cause patient harm. There are many challenges to establishing ISCT credibility. ISCTs can integrate many different submodels that potentially use different modeling types (e.g., physics-based, data-driven, rule-based) that necessitate different strategies and approaches for generating credibility evidence. ISCT submodels can include those for the medical device, the patient, the interaction of the device and patient, generating virtual patients, clinical decision making and simulating an intervention (e.g., device implantation), and translating acute physics-based simulation outputs to health-related clinical outcomes (e.g., device safety and\/or effectiveness endpoints). Establishing the credibility of each ISCT submodel is challenging, but is nonetheless important because inaccurate output from a single submodel could potentially compromise the credibility of the entire ISCT. The objective of this study is to begin addressing some of these challenges and to identify general strategies for establishing ISCT credibility. Most notably, we propose a hierarchical approach for assessing the credibility of an ISCT that involves systematically gathering credibility evidence for each ISCT submodel in isolation before demonstrating credibility of the full ISCT. Also, following FDA Guidance for assessing computational model credibility, we provide suggestions for ways to clearly describe each of the ISCT submodels and the full ISCT, discuss considerations for performing an ISCT model risk assessment, identify common challenges to demonstrating ISCT credibility, and present strategies for addressing these challenges using our proposed hierarchical approach. Finally, in the <jats:xref>Appendix<\/jats:xref> we illustrate the many concepts described here using a hypothetical ISCT example.<\/jats:p>","DOI":"10.3389\/fmed.2024.1433372","type":"journal-article","created":{"date-parts":[[2024,8,12]],"date-time":"2024-08-12T13:54:22Z","timestamp":1723470862000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges"],"prefix":"10.3389","volume":"11","author":[{"given":"Kenneth I.","family":"Aycock","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"Battisti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ashley","family":"Peterson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiang","family":"Yao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven","family":"Kreuzer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claudio","family":"Capelli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sanjay","family":"Pant","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pras","family":"Pathmanathan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David M.","family":"Hoganson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steve M.","family":"Levine","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brent A.","family":"Craven","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,8,12]]},"reference":[{"key":"ref1","author":"Craven","year":"2024"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"024503","DOI":"10.1115\/1.4035866","article-title":"The role of computational modeling and simulation in the total product life cycle of peripheral vascular devices","volume":"11","author":"Morrison","year":"2017","journal-title":"J Med Devices"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"3977","DOI":"10.1109\/JBHI.2021.3090469","article-title":"Possible contexts of use for in silico trials methodologies: A consensus-based review","volume":"25","author":"Viceconti","year":"2021","journal-title":"IEEE J Biomed Health"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10439-022-03116-7","article-title":"Modeling and simulation in biomedical engineering: regulatory science and innovation for advancing public health","volume":"51","author":"Morrison","year":"2023","journal-title":"Ann Biomed Eng"},{"key":"ref5","year":"2019"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"030947","DOI":"10.1115\/1.4033870","article-title":"Augmenting a clinical study with virtual patient models: Food and Drug Administration and industry collaboration","volume":"10","author":"Himes","year":"2016","journal-title":"J Med Devices"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"1089","DOI":"10.1080\/10543406.2017.1300907","article-title":"Incorporation of stochastic engineering models as prior information in Bayesian medical device trials","volume":"27","author":"Haddad","year":"2017","journal-title":"J Biopharm Stat"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"e185474","DOI":"10.1001\/jamanetworkopen.2018.5474","article-title":"Evaluation of digital breast tomosynthesis as replacement of full-field digital mammography using an in silico imaging trial","volume":"1","author":"Badano","year":"2018","journal-title":"JAMA Netw Open"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1186\/s13063-020-05002-w","article-title":"In silico imaging clinical trials: cheaper, faster, better, safer, and more scalable","volume":"22","author":"Badano","year":"2021","journal-title":"Trials"},{"key":"ref10","doi-asserted-by":"crossref","DOI":"10.1201\/9780367815493","volume-title":"Surrogates: Gaussian Process Modeling, Design, and Optimization for the Applied Sciences","author":"Gramacy","year":"2020"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"021001","DOI":"10.1115\/1.4053565","article-title":"A framework for in silico clinical trials for medical devices using concepts from model verification, validation, and uncertainty quantification","volume":"7","author":"Bodner","year":"2022","journal-title":"J Verif Valid Uncertain Quantif"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"3213","DOI":"10.1007\/s10439-021-02787-y","article-title":"In silico clinical trials in the orthopedic device industry: From fantasy to reality?","volume":"49","author":"Favre","year":"2021","journal-title":"Ann Biomed Eng"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"1350","DOI":"10.1056\/NEJMra1512592","article-title":"An FDA viewpoint on unique considerations for medical-device clinical trials","volume":"376","author":"Faris","year":"2017","journal-title":"N Engl J Med"},{"key":"ref14","year":"2023"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1371\/journal.pcbi.1012289","article-title":"Credibility assessment of in silico clinical trials for medical devices","volume":"2024","author":"Pathmanathan","year":"2024","journal-title":"PLoS Comput Biol"},{"key":"ref16","year":"2016"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"20190558","DOI":"10.1098\/rsta.2019.0558","article-title":"Creation and application of virtual patient cohorts of heart models","volume":"378","author":"Niederer","year":"2020","journal-title":"Phil Trans R Soc A"},{"key":"ref18","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511760396","volume-title":"Verification and Validation in Scientific Computing","author":"Oberkampf","year":"2010"},{"key":"ref19","volume-title":"V&V 10\u20132019. Standard for Verification and Validation in Computational Solid Mechanics","year":"2019"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"106","DOI":"10.3389\/fphys.2018.00106","article-title":"Validation and trustworthiness of multiscale models of cardiac electrophysiology","volume":"9","author":"Pathmanathan","year":"2018","journal-title":"Front Physiol"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"2375","DOI":"10.1016\/j.cma.2007.10.016","article-title":"Validation challenge workshop","volume":"197","author":"Hills","year":"2008","journal-title":"Comput Methods in Appl Mech Eng"},{"key":"ref22","volume-title":"V&V 40\u20132018. Assessing Credibility of Computational Modeling Through Verification and Validation: Application to Medical Devices","year":"2018"},{"key":"ref23","volume-title":"Medical devices \u2014 Application of risk management to medical devices","year":"2019"},{"key":"ref24","volume-title":"Medical devices \u2014 Guidance on the application of ISO 14971","year":"2020"},{"key":"ref25","volume-title":"Fundamentals of Verification and Validation","author":"Roache","year":"2009"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"106175","DOI":"10.1016\/j.compstruc.2019.106175","article-title":"Method of manufactured solutions code verification of elastostatic solid mechanics problems in a commercial finite element solver","volume":"229","author":"Aycock","year":"2020","journal-title":"Comput Struct"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"110357","DOI":"10.1016\/j.commatsci.2021.110357","article-title":"A probabilistic approach with built-in uncertainty quantification for the calibration of a superelastic constitutive model from full-field strain data","volume":"192","author":"Paranjape","year":"2021","journal-title":"Comput Mater Sci"},{"key":"ref28","doi-asserted-by":"publisher","first-page":"107727","DOI":"10.1016\/j.cmpb.2023.107727","article-title":"Credibility assessment of computational models according to ASME V&V40: Application to the Bologna Biomechanical Computed Tomography solution","volume":"240","author":"Aldieri","year":"2023","journal-title":"Comput Methods Prog Biomed"},{"key":"ref29","doi-asserted-by":"publisher","first-page":"107813","DOI":"10.1016\/j.cmpb.2023.107813","article-title":"A risk and credibility framework for in silico clinical trials of medical devices","volume":"242","author":"Bischoff","year":"2023","journal-title":"Comput Methods Prog Biomed"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"e1010541","DOI":"10.1371\/journal.pcbi.1010541","article-title":"Credibility assessment of patient-specific computational modeling using patient-specific cardiac modeling as an exemplar","volume":"18","author":"Galappaththige","year":"2022","journal-title":"PLoS Comput Biol"},{"key":"ref31","doi-asserted-by":"crossref","first-page":"1399","DOI":"10.1007\/978-3-319-52636-2_102","article-title":"Chapter 73: Device Trials","volume-title":"Principles and Practice of Clinical Trials","author":"Li","year":"2022"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"107735","DOI":"10.1016\/j.cmpb.2023.107735","article-title":"Identifying the patient harms to include in an in silico clinical trial","volume":"241","author":"Favre","year":"2023","journal-title":"Comput Methods Prog Biomed"}],"container-title":["Frontiers in Medicine"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmed.2024.1433372\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,12]],"date-time":"2024-08-12T13:54:29Z","timestamp":1723470869000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmed.2024.1433372\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,12]]},"references-count":32,"alternative-id":["10.3389\/fmed.2024.1433372"],"URL":"https:\/\/doi.org\/10.3389\/fmed.2024.1433372","relation":{},"ISSN":["2296-858X"],"issn-type":[{"value":"2296-858X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,12]]},"article-number":"1433372"}}