Positive single-center randomized trials and subsequent multicenter randomized trials in critically ill patients: a systematic review.
Critical illness
Guideline
Intensive care units
Mortality
Randomized controlled trial
Systematic review
Journal
Critical care (London, England)
ISSN: 1466-609X
Titre abrégé: Crit Care
Pays: England
ID NLM: 9801902
Informations de publication
Date de publication:
28 11 2023
28 11 2023
Historique:
received:
12
09
2023
accepted:
21
11
2023
medline:
30
11
2023
pubmed:
29
11
2023
entrez:
29
11
2023
Statut:
epublish
Résumé
It is unclear how often survival benefits observed in single-center randomized controlled trials (sRCTs) involving critically ill patients are confirmed by subsequent multicenter randomized controlled trials (mRCTs). We aimed to perform a systemic literature review of sRCTs with a statistically significant mortality reduction and to evaluate whether subsequent mRCTs confirmed such reduction. We searched PubMed for sRCTs published in the New England Journal of Medicine, JAMA, or Lancet, from inception until December 31, 2016. We selected studies reporting a statistically significant mortality decrease using any intervention (drug, technique, or strategy) in adult critically ill patients. We then searched for subsequent mRCTs addressing the same research question tested by the sRCT. We compared the concordance of results between sRCTs and mRCTs when any mRCT was available. We registered this systematic review in the PROSPERO International Prospective Register of Systematic Reviews (CRD42023455362). We identified 19 sRCTs reporting a significant mortality reduction in adult critically ill patients. For 16 sRCTs, we identified at least one subsequent mRCT (24 trials in total), while the interventions from three sRCTs have not yet been addressed in a subsequent mRCT. Only one out of 16 sRCTs (6%) was followed by a mRCT replicating a significant mortality reduction; 14 (88%) were followed by mRCTs with no mortality difference. The positive finding of one sRCT (6%) on intensive glycemic control was contradicted by a subsequent mRCT showing a significant mortality increase. Of the 14 sRCTs referenced at least once in international guidelines, six (43%) have since been either removed or suggested against in the most recent versions of relevant guidelines. Mortality reduction shown by sRCTs is typically not replicated by mRCTs. The findings of sRCTs should be considered hypothesis-generating and should not contribute to guidelines.
Sections du résumé
BACKGROUND
It is unclear how often survival benefits observed in single-center randomized controlled trials (sRCTs) involving critically ill patients are confirmed by subsequent multicenter randomized controlled trials (mRCTs). We aimed to perform a systemic literature review of sRCTs with a statistically significant mortality reduction and to evaluate whether subsequent mRCTs confirmed such reduction.
METHODS
We searched PubMed for sRCTs published in the New England Journal of Medicine, JAMA, or Lancet, from inception until December 31, 2016. We selected studies reporting a statistically significant mortality decrease using any intervention (drug, technique, or strategy) in adult critically ill patients. We then searched for subsequent mRCTs addressing the same research question tested by the sRCT. We compared the concordance of results between sRCTs and mRCTs when any mRCT was available. We registered this systematic review in the PROSPERO International Prospective Register of Systematic Reviews (CRD42023455362).
RESULTS
We identified 19 sRCTs reporting a significant mortality reduction in adult critically ill patients. For 16 sRCTs, we identified at least one subsequent mRCT (24 trials in total), while the interventions from three sRCTs have not yet been addressed in a subsequent mRCT. Only one out of 16 sRCTs (6%) was followed by a mRCT replicating a significant mortality reduction; 14 (88%) were followed by mRCTs with no mortality difference. The positive finding of one sRCT (6%) on intensive glycemic control was contradicted by a subsequent mRCT showing a significant mortality increase. Of the 14 sRCTs referenced at least once in international guidelines, six (43%) have since been either removed or suggested against in the most recent versions of relevant guidelines.
CONCLUSION
Mortality reduction shown by sRCTs is typically not replicated by mRCTs. The findings of sRCTs should be considered hypothesis-generating and should not contribute to guidelines.
Identifiants
pubmed: 38017475
doi: 10.1186/s13054-023-04755-5
pii: 10.1186/s13054-023-04755-5
pmc: PMC10685543
doi:
Types de publication
Multicenter Study
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
465Informations de copyright
© 2023. The Author(s).
Références
N Engl J Med. 2021 Apr 8;384(14):1301-1311
pubmed: 33471452
N Engl J Med. 2016 May 5;374(18):1711-22
pubmed: 27043165
JAMA. 2013 Oct 23;310(16):1683-91
pubmed: 24108526
JAMA. 2016 Oct 18;316(15):1583-1589
pubmed: 27706466
Crit Care Med. 2013 Feb;41(2):580-637
pubmed: 23353941
JAMA. 2016 May 24-31;315(20):2190-9
pubmed: 27209269
JAMA. 1992 Jan 15;267(3):379-85
pubmed: 1727961
N Engl J Med. 2001 Nov 8;345(19):1368-77
pubmed: 11794169
BMJ. 2021 Mar 29;372:n71
pubmed: 33782057
J Hepatol. 2018 Aug;69(2):406-460
pubmed: 29653741
N Engl J Med. 2008 Jul 3;359(1):7-20
pubmed: 18492867
Intensive Care Med. 2022 Jan;48(1):45-55
pubmed: 34757439
Am J Respir Crit Care Med. 2020 Feb 15;201(4):423-429
pubmed: 31574228
N Engl J Med. 2001 Nov 8;345(19):1359-67
pubmed: 11794168
Lancet. 2015 Jul 11;386(9989):137-44
pubmed: 25956718
N Engl J Med. 2002 Jan 31;346(5):305-10
pubmed: 11821506
N Engl J Med. 2018 Aug 23;379(8):711-721
pubmed: 30021076
Br Med J. 1948 Oct 30;2(4582):769-82
pubmed: 18890300
JAMA. 2022 Nov 15;328(19):1911-1921
pubmed: 36286097
N Engl J Med. 2002 Mar 21;346(12):884-90
pubmed: 11907287
N Engl J Med. 2009 Oct 22;361(17):1627-38
pubmed: 19846848
N Engl J Med. 2018 Oct 11;379(15):1431-1442
pubmed: 30304656
Resuscitation. 2019 Dec;145:95-150
pubmed: 31734223
Gastroenterology. 1996 Nov;111(5):1291-9
pubmed: 8898643
Int Urol Nephrol. 2013 Jun;45(3):869-78
pubmed: 23065432
Intensive Care Med. 2020 Apr;46(4):697-713
pubmed: 32157356
JAMA. 2000 Jan 12;283(2):235-41
pubmed: 10634340
N Engl J Med. 2014 Oct 16;371(16):1496-506
pubmed: 25272316
Crit Care Med. 2016 Jul;44(7):1278-84
pubmed: 26963326
N Engl J Med. 2020 Jul 16;383(3):240-251
pubmed: 32668114
Lancet. 2008 Feb 16;371(9612):579-87
pubmed: 18280328
JAMA. 2021 Sep 14;326(10):940-948
pubmed: 34463696
N Engl J Med. 2016 Jul 14;375(2):122-33
pubmed: 27181456
Intensive Care Med. 2021 Nov;47(11):1181-1247
pubmed: 34599691
BMJ. 2019 Aug 28;366:l4898
pubmed: 31462531
Lancet. 2000 Jul 1;356(9223):26-30
pubmed: 10892761
Respirology. 2015 Nov;20(8):1182-91
pubmed: 26486092
N Engl J Med. 2009 Jan 1;360(1):20-31
pubmed: 19118302
N Engl J Med. 2009 Mar 26;360(13):1283-97
pubmed: 19318384
Ann Intern Med. 2011 Jul 5;155(1):39-51
pubmed: 21727292
Intensive Care Med. 2016 Jun;42(6):1048-50
pubmed: 26951428
Hepatology. 2000 Sep;32(3):471-6
pubmed: 10960437
Lancet. 2003 Jun 7;361(9373):1935-8
pubmed: 12801736
Crit Care Med. 2009 Dec;37(12):3114-9
pubmed: 19789447
JAMA. 2015 Oct 27;314(16):1711-9
pubmed: 26444879
Circulation. 2006 Sep 5;114(10):e385-484
pubmed: 16935995
Crit Care Med. 2004 Mar;32(3):858-73
pubmed: 15090974
Intensive Care Med. 2008 Jan;34(1):17-60
pubmed: 18058085
Resuscitation. 2021 Apr;161:115-151
pubmed: 33773825
Resuscitation. 2010 Oct;81(10):1305-52
pubmed: 20956049
Intensive Care Med. 2017 Mar;43(3):304-377
pubmed: 28101605
Resuscitation. 2018 Dec;133:194-206
pubmed: 30409433
Minerva Anestesiol. 2019 Feb;85(2):194-200
pubmed: 30394068
N Engl J Med. 2002 Sep 19;347(12):895-902
pubmed: 12239258
JAMA. 1991 Aug 28;266(8):1097-102
pubmed: 1865542
Lancet Respir Med. 2020 Sep;8(9):863-872
pubmed: 32243865
Crit Care. 2016 Apr 12;20:100
pubmed: 27072503
Resuscitation. 2005 Dec;67 Suppl 1:S39-86
pubmed: 16321716
Lancet. 1995 Sep 30;346(8979):865-8
pubmed: 7564670
Resuscitation. 2015 Oct;95:1-80
pubmed: 26477410
Lancet. 1984 May 5;1(8384):981-3
pubmed: 6143965
J Clin Epidemiol. 2013 Nov;66(11):1271-80
pubmed: 23972520
JAMA. 1993 Dec 8;270(22):2699-707
pubmed: 7907668
N Engl J Med. 2001 Feb 15;344(7):481-7
pubmed: 11172189
N Engl J Med. 2014 May 1;370(18):1683-93
pubmed: 24635773
Intensive Care Med. 2021 Dec;47(12):1368-1392
pubmed: 34677620
JAMA. 2009 Nov 25;302(20):2222-9
pubmed: 19934423
Lancet. 2003 Sep 27;362(9389):1011-6
pubmed: 14522530
JAMA. 2000 Apr 5;283(13):1723-30
pubmed: 10755499
Eur Respir J. 2023 Apr 3;61(4):
pubmed: 37012080
N Engl J Med. 2013 Jan 3;368(1):11-21
pubmed: 23281973
N Engl J Med. 2015 Apr 2;372(14):1301-11
pubmed: 25776532