Reproducibility in modeling and simulation of the knee: Academic, industry, and regulatory perspectives.
credibility
knee
modeling
regulatory
reproducibility
simulation
Journal
Journal of orthopaedic research : official publication of the Orthopaedic Research Society
ISSN: 1554-527X
Titre abrégé: J Orthop Res
Pays: United States
ID NLM: 8404726
Informations de publication
Date de publication:
12 2023
12 2023
Historique:
revised:
23
04
2023
received:
17
10
2022
accepted:
30
05
2023
medline:
15
11
2023
pubmed:
23
6
2023
entrez:
23
6
2023
Statut:
ppublish
Résumé
Stakeholders in the modeling and simulation (M&S) community organized a workshop at the 2019 Annual Meeting of the Orthopaedic Research Society (ORS) entitled "Reproducibility in Modeling and Simulation of the Knee: Academic, Industry, and Regulatory Perspectives." The goal was to discuss efforts among these stakeholders to address irreproducibility in M&S focusing on the knee joint. An academic representative from a leading orthopedic hospital in the United States described a multi-institutional, open effort funded by the National Institutes of Health to assess model reproducibility in computational knee biomechanics. A regulatory representative from the United States Food and Drug Administration indicated the necessity of standards for reproducibility to increase utility of M&S in the regulatory setting. An industry representative from a major orthopedic implant company emphasized improving reproducibility by addressing indeterminacy in personalized modeling through sensitivity analyses, thereby enhancing preclinical evaluation of joint replacement technology. Thought leaders in the M&S community stressed the importance of data sharing to minimize duplication of efforts. A survey comprised 103 attendees revealed strong support for the workshop and for increasing emphasis on computational modeling at future ORS meetings. Nearly all survey respondents (97%) considered reproducibility to be an important issue. Almost half of respondents (45%) tried and failed to reproduce the work of others. Two-thirds of respondents (67%) declared that individual laboratories are most responsible for ensuring reproducible research whereas 44% thought that journals are most responsible. Thought leaders and survey respondents emphasized that computational models must be reproducible and credible to advance knee M&S.
Types de publication
Journal Article
Review
Research Support, N.I.H., Extramural
Langues
eng
Sous-ensembles de citation
IM
Pagination
2569-2578Subventions
Organisme : NIBIB NIH HHS
ID : R01EB024573
Pays : United States
Organisme : NIBIB NIH HHS
ID : R01EB024573
Pays : United States
Informations de copyright
© 2023 Orthopaedic Research Society.
Références
Peirce CS. The fixation of belief. Popular Sci Month. 1877;12:1-15.
Macleod M. Improving the reproducibility and integrity of research: what can different stakeholders contribute? BMC Res Notes. 2022;15:146.
Collins FS, Tabak LA. Policy: NIH plans to enhance reproducibility. Nature. 2014;505:612-613.
Ioannidis JPA. Why most published research findings are false. PLoS Med. 2005;2:e124.
Carlin SP, Standing LG. Is intelligence enhanced by letter priming? A failure to replicate the results of Ciani and Sheldon (2010). Psychol Rep. 2013;112:533-544.
Sena ES, van der Worp HB, Bath PMW, Howells DW, Macleod MR. Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. PLoS Biol. 2010;8:e1000344.
Haibe-Kains B, El-Hachem N, Birkbak NJ, et al. Inconsistency in large pharmacogenomic studies. Nature. 2013;504:389-393.
Begley CG, Ioannidis JPA. Reproducibility in science: improving the standard for basic and preclinical research. Circ Res. 2015;116:116-126.
Ellis BJ, Lujan TJ, Dalton MS, Weiss JA. Medial collateral ligament insertion site and contact forces in the ACL-deficient knee. J Orthop Res. 2006;24:800-810.
Kia M, Schafer K, Lipman J, et al. A multibody knee model corroborates subject-specific experimental measurements of low ligament forces and kinematic coupling during passive flexion. J Biomech Eng. 2016;138:051010.
Guo H, Santner TJ, Chen T, et al. A statistically-augmented computational platform for evaluating meniscal function. J Biomech. 2015;48:1444-1453.
Ali AA, Harris MD, Shalhoub S, Maletsky LP, Rullkoetter PJ, Shelburne KB. Combined measurement and modeling of specimen-specific knee mechanics for healthy and ACL-deficient conditions. J Biomech. 2017;57:117-124.
Garavelli C, Curreli C, Palanca M, Aldieri A, Cristofolini L, Viceconti M. Experimental validation of a subject-specific finite element model of lumbar spine segment using digital image correlation. PLoS One. 2022;17:e0272529.
Palazzi E, Siegler S, Balakrishnan V, Leardini A, Caravaggi P, Belvedere C. Estimating the stabilizing function of ankle and subtalar ligaments via a morphology-specific three-dimensional dynamic model. J Biomech. 2020;98:109421.
Kinney AL, Besier TF, D'Lima DD, Fregly BJ. Update on grand challenge competition to predict in vivo knee loads. J Biomech Eng. 2013;135:021012.
Grassi L, Schileo E, Taddei F, et al. Accuracy of finite element predictions in sideways load configurations for the proximal human femur. J Biomech. 2012;45:394-399.
Henninger HB, Reese SP, Anderson AE, Weiss JA. Validation of computational models in biomechanics. Proc Inst Mech Eng Part H. 2010;224:801-812.
Erdemir A, Mulugeta L, Ku JP, et al. Credible practice of modeling and simulation in healthcare: ten rules from a multidisciplinary perspective. J Transl Med. 2020;18:369.
Viceconti M, Pappalardo F, Rodriguez B, Horner M, Bischoff J, Tshinanu FM. In silico trials: verification, validation and uncertainty quantification of predictive models used in the regulatory evaluation of biomedical products. Methods. 2021;185:120-127.
ASMEV&V 40, Assessing Credibility of Computational Modeling through Verification and Validation: Application to Medical Devices. The American Society of Mechanical Engineers; 2018.
Erdemir A, Besier TF, Halloran JP, et al. Deciphering the “art” in modeling and simulation of the knee joint: overall strategy. J Biomech Eng. 2019;141:0710021-0710210.
Halloran JP, Abdollahi N, Hafez MA, et al. Assessment of reporting practices and reproducibility potential of a cohort of published studies in computational knee biomechanics. J Orthop Res. 2022;41:325-334.
Maas SA, Ateshian GA, Weiss JA. FEBio: history and advances. Annu Rev Biomed Eng. 2017;19:279-299.
Seth A, Hicks JL, Uchida TK, et al. OpenSim: simulating musculoskeletal dynamics and neuromuscular control to study human and animal movement. PLoS Comput Biol. 2018;14:e1006223.
Taylor M, Prendergast PJ. Four decades of finite element analysis of orthopaedic devices: where are we now and what are the opportunities? J Biomech. 2015;48:767-778.
Galbusera F, Freutel M, Dürselen L, et al. Material models and properties in the finite element analysis of knee ligaments: a literature review. Front Bioeng Biotechnol. 2014;2:54.
Naghibi Beidokhti H, Janssen D, van de Groes S, Hazrati J, Van den Boogaard T, Verdonschot N. The influence of ligament modelling strategies on the predictive capability of finite element models of the human knee joint. J Biomech. 2017;65:1-11.
Harner CD, Xerogeanes JW, Livesay GA, et al. The human posterior cruciate ligament complex: an interdisciplinary study. Ligament morphology and biomechanical evaluation. Am J Sports Med. 1995;23:736-745.
Woo SLY, Hollis JM, Adams DJ, Lyon RM, Takai S. Tensile properties of the human femur-anterior cruciate ligament-tibia complex. The effects of specimen age and orientation. Am J Sports Med. 1991;19:217-225.
Butler DL, Guan Y, Kay MD, Cummings JF, Feder SM, Levy MS. Location-dependent variations in the material properties of the anterior cruciate ligament. J Biomech. 1992;25:511-518.
Imhauser CW, Kent, 3rd RN, Boorman-Padgett J, Thein R, Wickiewicz TL, Pearle AD. New parameters describing how knee ligaments carry force in situ predict interspecimen variations in laxity during simulated clinical exams. J Biomech. 2017;64:212-218.
Zaylor W, Stulberg BN, Halloran JP. Use of distraction loading to estimate subject-specific knee ligament slack lengths. J Biomech. 2019;92:1-5.
Kumar VD, Sontakke YA, Murugharaj S. Truly existing or hyped up? Unravelling the current knowledge regarding the anatomy, radiology, histology and biomechanics of the enigmatic anterolateral ligament of the knee joint. Arch Bone Jt Surg. 2020;8:332-342.
LaPrade RF, Ly TV, Wentorf FA, Engebretsen AH, Johansen S, Engebretsen L. The anatomy of the medial part of the knee. J Bone Joint Surg Am Vol. 2007;89:2000-2010.
Sturnick DR, Vacek PM, DeSarno MJ, et al. Combined anatomic factors predicting risk of anterior cruciate ligament injury for males and females. Am J Sports Med. 2015;43:839-847.
Erdemir A, Hunter PJ, Holzapfel GA, et al. Perspectives on sharing models and related resources in computational biomechanics research. J Biomech Eng. 2018;140:0247011-02470111.
Rooks NB, Schneider MTY, Erdemir A, et al. Deciphering the “art” in modeling and simulation of the knee joint: variations in model development. J Biomech Eng. 2021;143:061002.
Rooks NB, Schneider MTY, Erdemir A, et al. A method to compare heterogeneous types of bone and cartilage meshes. J Biomech Eng. 2021;143:111002.
Erdemir A. Reproducibility in Simulation-Based Prediction of Natural Knee Mechanics. Interagency Modeling and Analysis Group; 2023.
ISO. ISO Standard 14879-1, Implants for surgery - Total knee-joint prostheses, Part 1: Determination of endurance properties of knee tibial trays. Annual Meeting 2003, Geneva Switzerland; 2000.
ISO. ISO Standard 14243-1, Implants for Surgery - Wear of Total Knee-Joint Prostheses - Part 1: Loading and Displacement Parameters for Wear-Testing Machines with Load Control and Corresponding Environmental Conditions for Test. International Organization for Standardization; 2009.
ASTM. ASTM Standard F1800. Cyclic Fatigue Testing of Metal Tibial Tray Components of Total Knee Joint Replacements. ASTM International; 2012.
ASTM. ASTM Standard F1223. Standard Test Method for Determination of Total Knee Replacement Constraint. ASTM International; 2014.
ASTM. ASTM Standard F1814. Standard Guide for Evaluating Modular Hip and Knee Joint Components. ASTM International; 2015.
ASTM. ASTM Standard F3140. Standard Test Method for Cyclic Fatigue Testing of Metal Tibial Tray Components of Unicondylar Knee Joint Replacements. ASTM International; 2017.
Guidance for Industry and FDA. Class II Special Controls Guidance Document: Knee Joint Patellofemorotibial and Femorotibial Metal/Polymer Porous-Coated Uncemented Prostheses. US Food and Drug Administration; 2003.
Guidance for Industry and FDA. Reporting of Computational Modeling Studies in Medical Device Submissions. Food and Drug Administration; 2016.
ASTM. ASTM Standard F3161. Standard Test Method for Finite Element Analysis (FEA) of Metallic Orthopaedic Total Knee Femoral Components under Closing Conditions. ASTM International; 2017.
ASTM. ASTM Standard F3334-19. Standard Practice For Finite Element Analysis (FEA) Of Metallic Orthopaedic Total Knee Tibial Components. ASTM International; 2019.
Baumann AP, Graf T, Peck JH, Dmitriev AE, Coughlan D, Lotz JC. Assessing the use of finite element analysis for mechanical performance evaluation of intervertebral body fusion devices. JOR Spine. 2021;4:e1137.
Fregly BJ, Besier TF, Lloyd DG, et al. Grand challenge competition to predict in vivo knee loads. J Orthop Res. 2012;30:503-513.
Navacchia A, Myers CA, Rullkoetter PJ, Shelburne KB. Prediction of in vivo knee joint loads using a global probabilistic analysis. J Biomech Eng. 2016;138:4032379.
Guo H, Santner TJ, Lerner AL, Maher SA. Reducing uncertainty when using knee-specific finite element models by assessing the effect of input parameters. J Orthop Res. 2017;35:2233-2242.
Delp SL, Anderson FC, Arnold AS, et al. OpenSim: open-source software to create and analyze dynamic simulations of movement. IEEE Trans Biomed Eng. 2007;54:1940-1950.
Baker M. 1,500 scientists lift the lid on reproducibility. Nature. 2016;533:452-454.
Erdemir A, Guess TM, Halloran JP, et al. Commentary on the integration of model sharing and reproducibility analysis to scholarly publishing workflow in computational biomechanics. IEEE Trans Biomed Eng. 2016;63:2080-2085.
Johnston H, Abdelgaied A, Pandit H, Fisher J, Jennings LM. The effect of surgical alignment and soft tissue conditions on the kinematics and wear of a fixed bearing total knee replacement. J Mech Behav Biomed Mater. 2019;100:103386.