No Cover Image

Journal article 162 views 37 downloads

Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges

Kenneth I. Aycock, Tom Battisti, Ashley Peterson, Jiang Yao, Steven Kreuzer, Claudio Capelli, Sanjay Pant Orcid Logo, Pras Pathmanathan, David M. Hoganson, Steve M. Levine, Brent A. Craven

Frontiers in Medicine, Volume: 11

Swansea University Author: Sanjay Pant Orcid Logo

  • 67610.VOR.pdf

    PDF | Version of Record

    © 2024 Aycock, Battisti, Peterson, Yao, Kreuzer, Capelli, Pant, Pathmanathan, Hoganson, Levine and Craven. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY).

    Download (2.1MB)

Abstract

Computational models of patients and medical devices can be combined to perform an in silico clinical trial (ISCT) to investigate questions related to device safety and/or effectiveness across the total product life cycle. ISCTs can potentially accelerate product development by more quickly informin...

Full description

Published in: Frontiers in Medicine
ISSN: 2296-858X 2296-858X
Published: Frontiers Media SA 2024
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa67610
first_indexed 2024-09-09T15:24:37Z
last_indexed 2024-11-25T14:20:29Z
id cronfa67610
recordtype SURis
fullrecord <?xml version="1.0"?><rfc1807><datestamp>2024-10-25T12:18:50.3807344</datestamp><bib-version>v2</bib-version><id>67610</id><entry>2024-09-09</entry><title>Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges</title><swanseaauthors><author><sid>43b388e955511a9d1b86b863c2018a9f</sid><ORCID>0000-0002-2081-308X</ORCID><firstname>Sanjay</firstname><surname>Pant</surname><name>Sanjay Pant</name><active>true</active><ethesisStudent>false</ethesisStudent></author></swanseaauthors><date>2024-09-09</date><deptcode>ACEM</deptcode><abstract>Computational models of patients and medical devices can be combined to perform an in silico clinical trial (ISCT) to investigate questions related to device safety and/or effectiveness across the total product life cycle. ISCTs can potentially accelerate product development by more quickly informing device design and testing or they could be used to refine, reduce, or in some cases to completely replace human subjects in a clinical trial. There are numerous potential benefits of ISCTs. An important caveat, however, is that an ISCT is a virtual representation of the real world that has to be shown to be credible before being relied upon to make decisions that have the potential to cause patient harm. There are many challenges to establishing ISCT credibility. ISCTs can integrate many different submodels that potentially use different modeling types (e.g., physics-based, data-driven, rule-based) that necessitate different strategies and approaches for generating credibility evidence. ISCT submodels can include those for the medical device, the patient, the interaction of the device and patient, generating virtual patients, clinical decision making and simulating an intervention (e.g., device implantation), and translating acute physics-based simulation outputs to health-related clinical outcomes (e.g., device safety and/or effectiveness endpoints). Establishing the credibility of each ISCT submodel is challenging, but is nonetheless important because inaccurate output from a single submodel could potentially compromise the credibility of the entire ISCT. The objective of this study is to begin addressing some of these challenges and to identify general strategies for establishing ISCT credibility. Most notably, we propose a hierarchical approach for assessing the credibility of an ISCT that involves systematically gathering credibility evidence for each ISCT submodel in isolation before demonstrating credibility of the full ISCT. Also, following FDA Guidance for assessing computational model credibility, we provide suggestions for ways to clearly describe each of the ISCT submodels and the full ISCT, discuss considerations for performing an ISCT model risk assessment, identify common challenges to demonstrating ISCT credibility, and present strategies for addressing these challenges using our proposed hierarchical approach. Finally, in the Appendix we illustrate the many concepts described here using a hypothetical ISCT example.</abstract><type>Journal Article</type><journal>Frontiers in Medicine</journal><volume>11</volume><journalNumber/><paginationStart/><paginationEnd/><publisher>Frontiers Media SA</publisher><placeOfPublication/><isbnPrint/><isbnElectronic/><issnPrint>2296-858X</issnPrint><issnElectronic>2296-858X</issnElectronic><keywords>In silico clinical trial, ISCT, model credibility, computational modeling and simulation, hierarchical verification and validation</keywords><publishedDay>12</publishedDay><publishedMonth>8</publishedMonth><publishedYear>2024</publishedYear><publishedDate>2024-08-12</publishedDate><doi>10.3389/fmed.2024.1433372</doi><url/><notes/><college>COLLEGE NANME</college><department>Aerospace, Civil, Electrical, and Mechanical Engineering</department><CollegeCode>COLLEGE CODE</CollegeCode><DepartmentCode>ACEM</DepartmentCode><institution>Swansea University</institution><apcterm>Another institution paid the OA fee</apcterm><funders>The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was funded in part by the U.S. FDA Center for Devices and Radiological Health (CDRH) Critical Path program.</funders><projectreference/><lastEdited>2024-10-25T12:18:50.3807344</lastEdited><Created>2024-09-09T15:03:29.2771734</Created><path><level id="1">Faculty of Science and Engineering</level><level id="2">School of Aerospace, Civil, Electrical, General and Mechanical Engineering - Mechanical Engineering</level></path><authors><author><firstname>Kenneth I.</firstname><surname>Aycock</surname><order>1</order></author><author><firstname>Tom</firstname><surname>Battisti</surname><order>2</order></author><author><firstname>Ashley</firstname><surname>Peterson</surname><order>3</order></author><author><firstname>Jiang</firstname><surname>Yao</surname><order>4</order></author><author><firstname>Steven</firstname><surname>Kreuzer</surname><order>5</order></author><author><firstname>Claudio</firstname><surname>Capelli</surname><order>6</order></author><author><firstname>Sanjay</firstname><surname>Pant</surname><orcid>0000-0002-2081-308X</orcid><order>7</order></author><author><firstname>Pras</firstname><surname>Pathmanathan</surname><order>8</order></author><author><firstname>David M.</firstname><surname>Hoganson</surname><order>9</order></author><author><firstname>Steve M.</firstname><surname>Levine</surname><order>10</order></author><author><firstname>Brent A.</firstname><surname>Craven</surname><order>11</order></author></authors><documents><document><filename>67610__31285__0083e652563f461c9bdb99f01c6c76e1.pdf</filename><originalFilename>67610.VOR.pdf</originalFilename><uploaded>2024-09-09T16:20:47.4384419</uploaded><type>Output</type><contentLength>2207029</contentLength><contentType>application/pdf</contentType><version>Version of Record</version><cronfaStatus>true</cronfaStatus><documentNotes>&#xA9; 2024 Aycock, Battisti, Peterson, Yao, Kreuzer, Capelli, Pant, Pathmanathan, Hoganson, Levine and Craven. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY).</documentNotes><copyrightCorrect>true</copyrightCorrect><language>eng</language><licence>http://creativecommons.org/licenses/by/4.0/</licence></document></documents><OutputDurs/></rfc1807>
spelling 2024-10-25T12:18:50.3807344 v2 67610 2024-09-09 Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges 43b388e955511a9d1b86b863c2018a9f 0000-0002-2081-308X Sanjay Pant Sanjay Pant true false 2024-09-09 ACEM Computational models of patients and medical devices can be combined to perform an in silico clinical trial (ISCT) to investigate questions related to device safety and/or effectiveness across the total product life cycle. ISCTs can potentially accelerate product development by more quickly informing device design and testing or they could be used to refine, reduce, or in some cases to completely replace human subjects in a clinical trial. There are numerous potential benefits of ISCTs. An important caveat, however, is that an ISCT is a virtual representation of the real world that has to be shown to be credible before being relied upon to make decisions that have the potential to cause patient harm. There are many challenges to establishing ISCT credibility. ISCTs can integrate many different submodels that potentially use different modeling types (e.g., physics-based, data-driven, rule-based) that necessitate different strategies and approaches for generating credibility evidence. ISCT submodels can include those for the medical device, the patient, the interaction of the device and patient, generating virtual patients, clinical decision making and simulating an intervention (e.g., device implantation), and translating acute physics-based simulation outputs to health-related clinical outcomes (e.g., device safety and/or effectiveness endpoints). Establishing the credibility of each ISCT submodel is challenging, but is nonetheless important because inaccurate output from a single submodel could potentially compromise the credibility of the entire ISCT. The objective of this study is to begin addressing some of these challenges and to identify general strategies for establishing ISCT credibility. Most notably, we propose a hierarchical approach for assessing the credibility of an ISCT that involves systematically gathering credibility evidence for each ISCT submodel in isolation before demonstrating credibility of the full ISCT. Also, following FDA Guidance for assessing computational model credibility, we provide suggestions for ways to clearly describe each of the ISCT submodels and the full ISCT, discuss considerations for performing an ISCT model risk assessment, identify common challenges to demonstrating ISCT credibility, and present strategies for addressing these challenges using our proposed hierarchical approach. Finally, in the Appendix we illustrate the many concepts described here using a hypothetical ISCT example. Journal Article Frontiers in Medicine 11 Frontiers Media SA 2296-858X 2296-858X In silico clinical trial, ISCT, model credibility, computational modeling and simulation, hierarchical verification and validation 12 8 2024 2024-08-12 10.3389/fmed.2024.1433372 COLLEGE NANME Aerospace, Civil, Electrical, and Mechanical Engineering COLLEGE CODE ACEM Swansea University Another institution paid the OA fee The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was funded in part by the U.S. FDA Center for Devices and Radiological Health (CDRH) Critical Path program. 2024-10-25T12:18:50.3807344 2024-09-09T15:03:29.2771734 Faculty of Science and Engineering School of Aerospace, Civil, Electrical, General and Mechanical Engineering - Mechanical Engineering Kenneth I. Aycock 1 Tom Battisti 2 Ashley Peterson 3 Jiang Yao 4 Steven Kreuzer 5 Claudio Capelli 6 Sanjay Pant 0000-0002-2081-308X 7 Pras Pathmanathan 8 David M. Hoganson 9 Steve M. Levine 10 Brent A. Craven 11 67610__31285__0083e652563f461c9bdb99f01c6c76e1.pdf 67610.VOR.pdf 2024-09-09T16:20:47.4384419 Output 2207029 application/pdf Version of Record true © 2024 Aycock, Battisti, Peterson, Yao, Kreuzer, Capelli, Pant, Pathmanathan, Hoganson, Levine and Craven. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). true eng http://creativecommons.org/licenses/by/4.0/
title Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges
spellingShingle Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges
Sanjay Pant
title_short Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges
title_full Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges
title_fullStr Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges
title_full_unstemmed Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges
title_sort Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges
author_id_str_mv 43b388e955511a9d1b86b863c2018a9f
author_id_fullname_str_mv 43b388e955511a9d1b86b863c2018a9f_***_Sanjay Pant
author Sanjay Pant
author2 Kenneth I. Aycock
Tom Battisti
Ashley Peterson
Jiang Yao
Steven Kreuzer
Claudio Capelli
Sanjay Pant
Pras Pathmanathan
David M. Hoganson
Steve M. Levine
Brent A. Craven
format Journal article
container_title Frontiers in Medicine
container_volume 11
publishDate 2024
institution Swansea University
issn 2296-858X
2296-858X
doi_str_mv 10.3389/fmed.2024.1433372
publisher Frontiers Media SA
college_str Faculty of Science and Engineering
hierarchytype
hierarchy_top_id facultyofscienceandengineering
hierarchy_top_title Faculty of Science and Engineering
hierarchy_parent_id facultyofscienceandengineering
hierarchy_parent_title Faculty of Science and Engineering
department_str School of Aerospace, Civil, Electrical, General and Mechanical Engineering - Mechanical Engineering{{{_:::_}}}Faculty of Science and Engineering{{{_:::_}}}School of Aerospace, Civil, Electrical, General and Mechanical Engineering - Mechanical Engineering
document_store_str 1
active_str 0
description Computational models of patients and medical devices can be combined to perform an in silico clinical trial (ISCT) to investigate questions related to device safety and/or effectiveness across the total product life cycle. ISCTs can potentially accelerate product development by more quickly informing device design and testing or they could be used to refine, reduce, or in some cases to completely replace human subjects in a clinical trial. There are numerous potential benefits of ISCTs. An important caveat, however, is that an ISCT is a virtual representation of the real world that has to be shown to be credible before being relied upon to make decisions that have the potential to cause patient harm. There are many challenges to establishing ISCT credibility. ISCTs can integrate many different submodels that potentially use different modeling types (e.g., physics-based, data-driven, rule-based) that necessitate different strategies and approaches for generating credibility evidence. ISCT submodels can include those for the medical device, the patient, the interaction of the device and patient, generating virtual patients, clinical decision making and simulating an intervention (e.g., device implantation), and translating acute physics-based simulation outputs to health-related clinical outcomes (e.g., device safety and/or effectiveness endpoints). Establishing the credibility of each ISCT submodel is challenging, but is nonetheless important because inaccurate output from a single submodel could potentially compromise the credibility of the entire ISCT. The objective of this study is to begin addressing some of these challenges and to identify general strategies for establishing ISCT credibility. Most notably, we propose a hierarchical approach for assessing the credibility of an ISCT that involves systematically gathering credibility evidence for each ISCT submodel in isolation before demonstrating credibility of the full ISCT. Also, following FDA Guidance for assessing computational model credibility, we provide suggestions for ways to clearly describe each of the ISCT submodels and the full ISCT, discuss considerations for performing an ISCT model risk assessment, identify common challenges to demonstrating ISCT credibility, and present strategies for addressing these challenges using our proposed hierarchical approach. Finally, in the Appendix we illustrate the many concepts described here using a hypothetical ISCT example.
published_date 2024-08-12T08:28:26Z
_version_ 1821302804320354304
score 11.047609