Credibility assessment of computational models according to ASME V&V40: Application to the Bologna Biomechanical Computed Tomography solution.
ASME V&V40
Fracture risk prediction
Hip fracture
In silico trial
Model credibility
VVUQ
Journal
Computer methods and programs in biomedicine
ISSN: 1872-7565
Titre abrégé: Comput Methods Programs Biomed
Pays: Ireland
ID NLM: 8506513
Informations de publication
Date de publication:
Oct 2023
Oct 2023
Historique:
received:
27
01
2023
revised:
17
07
2023
accepted:
18
07
2023
medline:
29
8
2023
pubmed:
1
8
2023
entrez:
31
7
2023
Statut:
ppublish
Résumé
When a computational model aims to be adopted beyond research purposes, e.g. to inform a clinical or regulatory decision, trust must be placed in its predictive accuracy. This practically translates into the need to demonstrate its credibility. In fact, prior to its adoption for regulatory purposes, an in silico methodology should be proven credible enough for the scope. This has become especially relevant as, although evidence of the safety and efficacy of new medical products or interventions has been traditionally provided to the regulator experimentally, i.e., in vivo or ex vivo, recently the idea to inform a regulatory decision in silico has made its way in the regulatory scenario. While a harmonised technical standard is currently missing in the EU regulatory system, in 2018 the ASME issued V&V40-2018, where a risk-based framework to assess the credibility of a computational model through the performance of predefined credibility activities is provided. The credibility framework is here applied to Bologna Biomechanical Computed Tomography (BBCT) solution, which predicts the absolute risk of fracture at the femur for a subject. BBCT has recently been the object of a qualification advice request to the European Medicine Agency. The full implementation of ASME V&V40-2018 framework on BBCT is shown. Starting from BBCT proposed context of use the whole credibility plan is presented and the credibility activities (Verification, Validation, Applicability) described together with the achieved credibility levels. BBCT risk is judged medium, and the credibility levels achieved considered acceptable. The uncertainties intrinsically present in the material properties assignment affected BBCT predictions to the highest extent. This work provides the practical application of the ASME V&V40-2018 risk-based credibility assessment framework, which could be applied to demonstrate model credibility in any field and support future regulatory submissions and foster the adoption of In Silico Trials.
Sections du résumé
BACKGROUND AND OBJECTIVE
OBJECTIVE
When a computational model aims to be adopted beyond research purposes, e.g. to inform a clinical or regulatory decision, trust must be placed in its predictive accuracy. This practically translates into the need to demonstrate its credibility. In fact, prior to its adoption for regulatory purposes, an in silico methodology should be proven credible enough for the scope. This has become especially relevant as, although evidence of the safety and efficacy of new medical products or interventions has been traditionally provided to the regulator experimentally, i.e., in vivo or ex vivo, recently the idea to inform a regulatory decision in silico has made its way in the regulatory scenario. While a harmonised technical standard is currently missing in the EU regulatory system, in 2018 the ASME issued V&V40-2018, where a risk-based framework to assess the credibility of a computational model through the performance of predefined credibility activities is provided. The credibility framework is here applied to Bologna Biomechanical Computed Tomography (BBCT) solution, which predicts the absolute risk of fracture at the femur for a subject. BBCT has recently been the object of a qualification advice request to the European Medicine Agency.
METHODS
METHODS
The full implementation of ASME V&V40-2018 framework on BBCT is shown. Starting from BBCT proposed context of use the whole credibility plan is presented and the credibility activities (Verification, Validation, Applicability) described together with the achieved credibility levels.
RESULTS
RESULTS
BBCT risk is judged medium, and the credibility levels achieved considered acceptable. The uncertainties intrinsically present in the material properties assignment affected BBCT predictions to the highest extent.
CONCLUSIONS
CONCLUSIONS
This work provides the practical application of the ASME V&V40-2018 risk-based credibility assessment framework, which could be applied to demonstrate model credibility in any field and support future regulatory submissions and foster the adoption of In Silico Trials.
Identifiants
pubmed: 37523955
pii: S0169-2607(23)00393-0
doi: 10.1016/j.cmpb.2023.107727
pii:
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
107727Informations de copyright
Copyright © 2023 The Author(s). Published by Elsevier B.V. All rights reserved.
Déclaration de conflit d'intérêts
Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.