The Statistical Fragility of Single-Bundle vs Double-Bundle Autografts for ACL Reconstruction: A Systematic Review of Comparative Studies.

P value anterior cruciate ligament reconstruction autograft fragility index fragility quotient statistical significance

Journal

Orthopaedic journal of sports medicine
ISSN: 2325-9671
Titre abrégé: Orthop J Sports Med
Pays: United States
ID NLM: 101620522

Informations de publication

Date de publication:
Dec 2021
Historique:
received: 23 07 2021
accepted: 10 09 2021
entrez: 6 1 2022
pubmed: 7 1 2022
medline: 7 1 2022
Statut: epublish

Résumé

The statistical significance of a given study outcome can be liable to small changes in findings. The purpose was to examine the statistical stability of studies comparing primary single-bundle to double-bundle anterior cruciate ligament reconstruction (ACLR) utilizing autograft and independent tunnel drilling. It was hypothesized that the study findings would be vulnerable to a small number of outcome event reversals, often less than the number of patients lost to follow-up. Systematic review; Level of evidence, 2. Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, the authors searched PubMed for comparative studies and randomized controlled trials (RCTs) published in select journals, based on impact factor, between 2005 and 2020. Risk-of-bias assessment and methodology scoring were conducted for the included studies. A total of 48 dichotomous outcome measures were examined for possible event reversals. The FI for each outcome was determined by the number of event reversals necessary to alter significance. The FQ was calculated by dividing the FI by the respective sample size. Of the 1794 studies screened, 15 comparative studies were included for analysis; 13 studies were RCTs. Overall, the mean FI and FQ were 3.14 (IQR, 2-4) and 0.050 (IQR, 0.032-0.062), respectively. For 72.9% of outcomes, the FI was less than the number of patients lost to follow-up. Studies comparing single-bundle versus double-bundle ACLR may not be as statistically stable as previously thought. Comparative studies and RCTs are at substantial risk for statistical fragility, with few event reversals required to alter significance. The reversal of fewer than 4 outcome events in a treatment group can alter the statistical significance of a given result; this is commonly less than the number of patients lost to follow-up. Future comparative study analyses might consider including FI and FQ with

Sections du résumé

BACKGROUND BACKGROUND
The statistical significance of a given study outcome can be liable to small changes in findings.
PURPOSE/HYPOTHESIS OBJECTIVE
The purpose was to examine the statistical stability of studies comparing primary single-bundle to double-bundle anterior cruciate ligament reconstruction (ACLR) utilizing autograft and independent tunnel drilling. It was hypothesized that the study findings would be vulnerable to a small number of outcome event reversals, often less than the number of patients lost to follow-up.
STUDY DESIGN METHODS
Systematic review; Level of evidence, 2.
METHODS METHODS
Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, the authors searched PubMed for comparative studies and randomized controlled trials (RCTs) published in select journals, based on impact factor, between 2005 and 2020. Risk-of-bias assessment and methodology scoring were conducted for the included studies. A total of 48 dichotomous outcome measures were examined for possible event reversals. The FI for each outcome was determined by the number of event reversals necessary to alter significance. The FQ was calculated by dividing the FI by the respective sample size.
RESULTS RESULTS
Of the 1794 studies screened, 15 comparative studies were included for analysis; 13 studies were RCTs. Overall, the mean FI and FQ were 3.14 (IQR, 2-4) and 0.050 (IQR, 0.032-0.062), respectively. For 72.9% of outcomes, the FI was less than the number of patients lost to follow-up.
CONCLUSION CONCLUSIONS
Studies comparing single-bundle versus double-bundle ACLR may not be as statistically stable as previously thought. Comparative studies and RCTs are at substantial risk for statistical fragility, with few event reversals required to alter significance. The reversal of fewer than 4 outcome events in a treatment group can alter the statistical significance of a given result; this is commonly less than the number of patients lost to follow-up. Future comparative study analyses might consider including FI and FQ with

Identifiants

pubmed: 34988239
doi: 10.1177/23259671211064626
pii: 10.1177_23259671211064626
pmc: PMC8721389
doi:

Types de publication

Journal Article Review

Langues

eng

Pagination

23259671211064626

Informations de copyright

© The Author(s) 2021.

Déclaration de conflit d'intérêts

One or more of the authors has declared the following potential conflict of interest or source of funding: A.J.C. has received education payments from Supreme Orthopedic Systems. E.S.C. has received education payments from Arthrex. AOSSM checks author disclosures against the Open Payments Database (OPD). AOSSM has not conducted an independent investigation on the OPD and disclaims any liability or responsibility relating thereto.

Références

Am J Sports Med. 2016 Sep;44(9):2314-22
pubmed: 27343215
Arthroscopy. 2016 Jan;32(1):34-42
pubmed: 26321112
Arthroscopy. 2013 Feb;29(2):357-65
pubmed: 23369481
J Bone Joint Surg Am. 2018 Jun 20;100(12):e85
pubmed: 29916938
Clin Orthop Relat Res. 2012 Mar;470(3):824-34
pubmed: 21667181
Knee Surg Sports Traumatol Arthrosc. 2007 May;15(5):500-7
pubmed: 17216271
Knee Surg Sports Traumatol Arthrosc. 2020 Feb;28(2):339-352
pubmed: 31190245
Knee Surg Sports Traumatol Arthrosc. 2017 Apr;25(4):1307-1315
pubmed: 27106922
Crit Care Med. 2016 Nov;44(11):e1142-e1143
pubmed: 27755081
J Bone Joint Surg Am. 2009 Feb;91(2):257-62
pubmed: 19181968
Kidney Int. 2017 Dec;92(6):1469-1475
pubmed: 28754551
Scand J Med Sci Sports. 2013 Feb;23(1):1-14
pubmed: 22288837
Am J Sports Med. 2018 Nov;46(13):3307-3316
pubmed: 29028445
J Pediatr Orthop. 2018 Sep;38(8):e418-e423
pubmed: 29979332
Am J Sports Med. 2013 Nov;41(11):2693-702
pubmed: 24130247
Knee Surg Sports Traumatol Arthrosc. 2014 May;22(5):1009-23
pubmed: 24343279
Acta Orthop. 2005 Jun;76(3):291-5
pubmed: 16156453
Knee Surg Sports Traumatol Arthrosc. 2011 Mar;19(3):390-7
pubmed: 20668835
Knee Surg Sports Traumatol Arthrosc. 2013 May;21(5):1085-96
pubmed: 22673793
Am J Sports Med. 2014 Oct;42(10):2319-28
pubmed: 25201444
Am J Sports Med. 2010 Jan;38(1):25-34
pubmed: 19793927
Spine J. 2015 Oct 1;15(10):2188-97
pubmed: 26072464
Arthroscopy. 2011 Jul;27(7):906-13
pubmed: 21550760
J Orthop Trauma. 2019 Dec;33(12):e466-e470
pubmed: 31356443
Arthroscopy. 2018 Sep;34(9):2647-2653
pubmed: 29937346
JAMA. 2005 Jul 13;294(2):218-28
pubmed: 16014596
Arthroscopy. 2013 Sep;29(9):1525-32
pubmed: 23910003
Br J Sports Med. 2013 Apr;47(6):367-72
pubmed: 22942168
J Clin Epidemiol. 2014 Jun;67(6):622-8
pubmed: 24508144
Am J Sports Med. 2014 Feb;42(2):285-91
pubmed: 24322979
J Bone Joint Surg Am. 2002 Mar;84(3):485-9
pubmed: 11886922
Am J Sports Med. 2017 Jul;45(9):2164-2170
pubmed: 27895038
Crit Care Med. 2019 Mar;47(3):456-462
pubmed: 30394920
Joints. 2018 Sep 27;6(3):177-187
pubmed: 30582107
Knee Surg Sports Traumatol Arthrosc. 2015 Mar;23(3):696-739
pubmed: 24037314
Pediatr Crit Care Med. 2019 Jun;20(6):e258-e262
pubmed: 31013262
Cochrane Database Syst Rev. 2012 Nov 14;11:CD008413
pubmed: 23152258
JAMA Surg. 2019 Jan 1;154(1):74-79
pubmed: 30422256
Knee Surg Sports Traumatol Arthrosc. 2014 Feb;22(2):308-16
pubmed: 23338665
Clin Orthop Relat Res. 2010 Mar;468(3):885-92
pubmed: 19921345
J Clin Epidemiol. 1990;43(2):201-9
pubmed: 2303850
Am J Sports Med. 2016 May;44(5):1225-36
pubmed: 26948548
Am J Sports Med. 2013 Nov;41(11):2484-91
pubmed: 23921339
Am J Sports Med. 2011 Aug;39(8):1615-22
pubmed: 21610263
Knee Surg Relat Res. 2020 Mar 12;32(1):14
pubmed: 32660562
JAMA. 2016 Mar 15;315(11):1141-8
pubmed: 26978209
Am J Sports Med. 2014 Feb;42(2):278-84
pubmed: 24275859
Knee. 2014 Jan;21(1):28-37
pubmed: 23306028
Arthroscopy. 2015 Jun;31(6):1185-96
pubmed: 25595691

Auteurs

Cooper B Ehlers (CB)

Georgetown University School of Medicine, El Segundo, California, USA.

Andrew J Curley (AJ)

MedStar Georgetown University Hospital, Washington, DC, USA.

Nathan P Fackler (NP)

Georgetown University School of Medicine, El Segundo, California, USA.

Arjun Minhas (A)

Georgetown University School of Medicine, El Segundo, California, USA.

Ariel N Rodriguez (AN)

Georgetown University School of Medicine, El Segundo, California, USA.

Kory Pasko (K)

Georgetown University School of Medicine, El Segundo, California, USA.

Edward S Chang (ES)

Inova Medical Group Orthopedics and Sports Medicine, Fairfax, Virginia, USA.

Classifications MeSH