Development and validation of the ISARIC 4C Deterioration model for adults hospitalised with COVID-19: a prospective cohort study.
Aged
Aged, 80 and over
COVID-19
/ diagnosis
Clinical Decision Rules
Clinical Decision-Making
/ methods
Clinical Deterioration
Critical Care
/ statistics & numerical data
Female
Hospital Mortality
Humans
Intensive Care Units
/ statistics & numerical data
Logistic Models
Male
Middle Aged
Patient Admission
/ statistics & numerical data
Prognosis
Prospective Studies
Reproducibility of Results
Respiration, Artificial
/ statistics & numerical data
SARS-CoV-2
/ isolation & purification
Severity of Illness Index
United Kingdom
/ epidemiology
Journal
The Lancet. Respiratory medicine
ISSN: 2213-2619
Titre abrégé: Lancet Respir Med
Pays: England
ID NLM: 101605555
Informations de publication
Date de publication:
04 2021
04 2021
Historique:
received:
28
10
2020
revised:
25
11
2020
accepted:
25
11
2020
pubmed:
15
1
2021
medline:
14
4
2021
entrez:
14
1
2021
Statut:
ppublish
Résumé
Prognostic models to predict the risk of clinical deterioration in acute COVID-19 cases are urgently required to inform clinical management decisions. We developed and validated a multivariable logistic regression model for in-hospital clinical deterioration (defined as any requirement of ventilatory support or critical care, or death) among consecutively hospitalised adults with highly suspected or confirmed COVID-19 who were prospectively recruited to the International Severe Acute Respiratory and Emerging Infections Consortium Coronavirus Clinical Characterisation Consortium (ISARIC4C) study across 260 hospitals in England, Scotland, and Wales. Candidate predictors that were specified a priori were considered for inclusion in the model on the basis of previous prognostic scores and emerging literature describing routinely measured biomarkers associated with COVID-19 prognosis. We used internal-external cross-validation to evaluate discrimination, calibration, and clinical utility across eight National Health Service (NHS) regions in the development cohort. We further validated the final model in held-out data from an additional NHS region (London). 74 944 participants (recruited between Feb 6 and Aug 26, 2020) were included, of whom 31 924 (43·2%) of 73 948 with available outcomes met the composite clinical deterioration outcome. In internal-external cross-validation in the development cohort of 66 705 participants, the selected model (comprising 11 predictors routinely measured at the point of hospital admission) showed consistent discrimination, calibration, and clinical utility across all eight NHS regions. In held-out data from London (n=8239), the model showed a similarly consistent performance (C-statistic 0·77 [95% CI 0·76 to 0·78]; calibration-in-the-large 0·00 [-0·05 to 0·05]); calibration slope 0·96 [0·91 to 1·01]), and greater net benefit than any other reproducible prognostic model. The 4C Deterioration model has strong potential for clinical utility and generalisability to predict clinical deterioration and inform decision making among adults hospitalised with COVID-19. National Institute for Health Research (NIHR), UK Medical Research Council, Wellcome Trust, Department for International Development, Bill & Melinda Gates Foundation, EU Platform for European Preparedness Against (Re-)emerging Epidemics, NIHR Health Protection Research Unit (HPRU) in Emerging and Zoonotic Infections at University of Liverpool, NIHR HPRU in Respiratory Infections at Imperial College London.
Sections du résumé
BACKGROUND
Prognostic models to predict the risk of clinical deterioration in acute COVID-19 cases are urgently required to inform clinical management decisions.
METHODS
We developed and validated a multivariable logistic regression model for in-hospital clinical deterioration (defined as any requirement of ventilatory support or critical care, or death) among consecutively hospitalised adults with highly suspected or confirmed COVID-19 who were prospectively recruited to the International Severe Acute Respiratory and Emerging Infections Consortium Coronavirus Clinical Characterisation Consortium (ISARIC4C) study across 260 hospitals in England, Scotland, and Wales. Candidate predictors that were specified a priori were considered for inclusion in the model on the basis of previous prognostic scores and emerging literature describing routinely measured biomarkers associated with COVID-19 prognosis. We used internal-external cross-validation to evaluate discrimination, calibration, and clinical utility across eight National Health Service (NHS) regions in the development cohort. We further validated the final model in held-out data from an additional NHS region (London).
FINDINGS
74 944 participants (recruited between Feb 6 and Aug 26, 2020) were included, of whom 31 924 (43·2%) of 73 948 with available outcomes met the composite clinical deterioration outcome. In internal-external cross-validation in the development cohort of 66 705 participants, the selected model (comprising 11 predictors routinely measured at the point of hospital admission) showed consistent discrimination, calibration, and clinical utility across all eight NHS regions. In held-out data from London (n=8239), the model showed a similarly consistent performance (C-statistic 0·77 [95% CI 0·76 to 0·78]; calibration-in-the-large 0·00 [-0·05 to 0·05]); calibration slope 0·96 [0·91 to 1·01]), and greater net benefit than any other reproducible prognostic model.
INTERPRETATION
The 4C Deterioration model has strong potential for clinical utility and generalisability to predict clinical deterioration and inform decision making among adults hospitalised with COVID-19.
FUNDING
National Institute for Health Research (NIHR), UK Medical Research Council, Wellcome Trust, Department for International Development, Bill & Melinda Gates Foundation, EU Platform for European Preparedness Against (Re-)emerging Epidemics, NIHR Health Protection Research Unit (HPRU) in Emerging and Zoonotic Infections at University of Liverpool, NIHR HPRU in Respiratory Infections at Imperial College London.
Identifiants
pubmed: 33444539
pii: S2213-2600(20)30559-2
doi: 10.1016/S2213-2600(20)30559-2
pmc: PMC7832571
pii:
doi:
Types de publication
Journal Article
Multicenter Study
Research Support, Non-U.S. Gov't
Validation Study
Langues
eng
Sous-ensembles de citation
IM
Pagination
349-359Subventions
Organisme : Medical Research Council
ID : G0701652
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_PC_19059
Pays : United Kingdom
Organisme : Department of Health
ID : IS-HPU-1112-10117
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_UU_12014/9
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_PC_19025
Pays : United Kingdom
Organisme : Wellcome Trust
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_PC_15001
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 109965/Z/15/Z
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_PC_19026
Pays : United Kingdom
Organisme : Department of Health
ID : DRF-2018-11-ST2-004
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_UU_00004/07
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/V033441/1
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/S032304/1
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_UU_12023/21
Pays : United Kingdom
Investigateurs
J Kenneth Baillie
(JK)
Malcolm G Semple
(MG)
Peter Jm Openshaw
(PJ)
Gail Carson
(G)
Beatrice Alex
(B)
Benjamin Bach
(B)
Wendy S Barclay
(WS)
Debby Bogaert
(D)
Meera Chand
(M)
Graham S Cooke
(GS)
Annemarie B Docherty
(AB)
Jake Dunning
(J)
Ana da Silva Filipe
(ADS)
Tom Fletcher
(T)
Christopher A Green
(CA)
Ewen M Harrison
(EM)
Julian A Hiscox
(JA)
Antonia Ying Wai Ho
(AYW)
Peter W Horby
(PW)
Samreen Ijaz
(S)
Saye Khoo
(S)
Paul Klenerman
(P)
Andrew Law
(A)
Wei Shen Lim
(WS)
Alexander J Mentzer
(AJ)
Laura Merson
(L)
Alison M Meynert
(AM)
Mahdad Noursadeghi
(M)
Shona C Moore
(SC)
Massimo Palmarini
(M)
William A Paxton
(WA)
Georgios Pollakis
(G)
Nicholas Price
(N)
Andrew Rambaut
(A)
David L Robertson
(DL)
Clark D Russell
(CD)
Vanessa Sancho-Shimizu
(V)
Janet T Scott
(JT)
Thushan de Silva
(T)
Louise Sigfrid
(L)
Tom Solomon
(T)
Shiranee Sriskandan
(S)
David Stuart
(D)
Charlotte Summers
(C)
Richard S Tedder
(RS)
Emma C Thomson
(EC)
Aa Roger Thompson
(AR)
Ryan S Thwaites
(RS)
Lance Cw Turtle
(LC)
Maria Zambon
(M)
Hayley Hardwick
(H)
Chloe Donohue
(C)
Ruth Lyons
(R)
Fiona Griffiths
(F)
Wilna Oosthuyzen
(W)
Lisa Norman
(L)
Riinu Pius
(R)
Tom M Drake
(TM)
Cameron J Fairfield
(CJ)
Stephen Knight
(S)
Kenneth A Mclean
(KA)
Derek Murphy
(D)
Catherine A Shaw
(CA)
Jo Dalton
(J)
James Lee
(J)
Daniel Plotkin
(D)
Michelle Girvan
(M)
Scott Mullaney
(S)
Claire Petersen
(C)
Egle Saviciute
(E)
Stephanie Roberts
(S)
Janet Harrison
(J)
Laura Marsh
(L)
Marie Connor
(M)
Sophie Halpin
(S)
Clare Jackson
(C)
Carrol Gamble
(C)
Gary Leeming
(G)
Andrew Law
(A)
Murray Wham
(M)
Sara Clohisey
(S)
Ross Hendry
(R)
James Scott-Brown
(J)
William Greenhalf
(W)
Victoria Shaw
(V)
Sarah McDonald
(S)
Seán Keating
(S)
Katie A Ahmed
(KA)
Jane A Armstrong
(JA)
Milton Ashworth
(M)
Innocent G Asiimwe
(IG)
Siddharth Bakshi
(S)
Samantha L Barlow
(SL)
Laura Booth
(L)
Benjamin Brennan
(B)
Katie Bullock
(K)
Benjamin Wa Catterall
(BW)
Jordan J Clark
(JJ)
Emily A Clarke
(EA)
Sarah Cole
(S)
Louise Cooper
(L)
Helen Cox
(H)
Christopher Davis
(C)
Oslem Dincarslan
(O)
Chris Dunn
(C)
Philip Dyer
(P)
Angela Elliott
(A)
Anthony Evans
(A)
Lorna Finch
(L)
Lewis Ws Fisher
(LW)
Terry Foster
(T)
Isabel Garcia-Dorival
(I)
Willliam Greenhalf
(W)
Philip Gunning
(P)
Catherine Hartley
(C)
Antonia Ho
(A)
Rebecca L Jensen
(RL)
Christopher B Jones
(CB)
Trevor R Jones
(TR)
Shadia Khandaker
(S)
Katharine King
(K)
Robyn T Kiy
(RT)
Chrysa Koukorava
(C)
Annette Lake
(A)
Suzannah Lant
(S)
Diane Latawiec
(D)
L Lavelle-Langham
(L)
Daniella Lefteri
(D)
Lauren Lett
(L)
Lucia A Livoti
(LA)
Maria Mancini
(M)
Sarah McDonald
(S)
Laurence McEvoy
(L)
John McLauchlan
(J)
Soeren Metelmann
(S)
Nahida S Miah
(NS)
Joanna Middleton
(J)
Joyce Mitchell
(J)
Shona C Moore
(SC)
Ellen G Murphy
(EG)
Rebekah Penrice-Randal
(R)
Jack Pilgrim
(J)
Tessa Prince
(T)
Will Reynolds
(W)
P Matthew Ridley
(PM)
Debby Sales
(D)
Victoria E Shaw
(VE)
Rebecca K Shears
(RK)
Benjamin Small
(B)
Krishanthi S Subramaniam
(KS)
Agnieska Szemiel
(A)
Aislynn Taggart
(A)
Jolanta Tanianis-Hughes
(J)
Jordan Thomas
(J)
Erwan Trochu
(E)
Libby van Tonder
(L)
Eve Wilcock
(E)
J Eunice Zhang
(JE)
Kayode Adeniji
(K)
Daniel Agranoff
(D)
Ken Agwuh
(K)
Dhiraj Ail
(D)
Ana Alegria
(A)
Brian Angus
(B)
Abdul Ashish
(A)
Dougal Atkinson
(D)
Shahedal Bari
(S)
Gavin Barlow
(G)
Stella Barnass
(S)
Nicholas Barrett
(N)
Christopher Bassford
(C)
David Baxter
(D)
Michael Beadsworth
(M)
Jolanta Bernatoniene
(J)
John Berridge
(J)
Nicola Best
(N)
Pieter Bothma
(P)
David Brealey
(D)
Robin Brittain-Long
(R)
Naomi Bulteel
(N)
Tom Burden
(T)
Andrew Burtenshaw
(A)
Vikki Caruth
(V)
David Chadwick
(D)
Duncan Chambler
(D)
Nigel Chee
(N)
Jenny Child
(J)
Srikanth Chukkambotla
(S)
Tom Clark
(T)
Paul Collini
(P)
Catherine Cosgrove
(C)
Jason Cupitt
(J)
Maria-Teresa Cutino-Moguel
(MT)
Paul Dark
(P)
Chris Dawson
(C)
Samir Dervisevic
(S)
Phil Donnison
(P)
Sam Douthwaite
(S)
Ingrid DuRand
(I)
Ahilanadan Dushianthan
(A)
Tristan Dyer
(T)
Cariad Evans
(C)
Chi Eziefula
(C)
Chrisopher Fegan
(C)
Adam Finn
(A)
Duncan Fullerton
(D)
Sanjeev Garg
(S)
Sanjeev Garg
(S)
Atul Garg
(A)
Effrossyni Gkrania-Klotsas
(E)
Jo Godden
(J)
Arthur Goldsmith
(A)
Clive Graham
(C)
Elaine Hardy
(E)
Stuart Hartshorn
(S)
Daniel Harvey
(D)
Peter Havalda
(P)
Daniel B Hawcutt
(DB)
Maria Hobrok
(M)
Luke Hodgson
(L)
Anil Hormis
(A)
Michael Jacobs
(M)
Susan Jain
(S)
Paul Jennings
(P)
Agilan Kaliappan
(A)
Vidya Kasipandian
(V)
Stephen Kegg
(S)
Michael Kelsey
(M)
Jason Kendall
(J)
Caroline Kerrison
(C)
Ian Kerslake
(I)
Oliver Koch
(O)
Gouri Koduri
(G)
George Koshy
(G)
Shondipon Laha
(S)
Steven Laird
(S)
Susan Larkin
(S)
Tamas Leiner
(T)
Patrick Lillie
(P)
James Limb
(J)
Vanessa Linnett
(V)
Jeff Little
(J)
Michael MacMahon
(M)
Emily MacNaughton
(E)
Ravish Mankregod
(R)
Huw Masson
(H)
Elijah Matovu
(E)
Katherine McCullough
(K)
Ruth McEwen
(R)
Manjula Meda
(M)
Gary Mills
(G)
Jane Minton
(J)
Mariyam Mirfenderesky
(M)
Kavya Mohandas
(K)
Quen Mok
(Q)
James Moon
(J)
Elinoor Moore
(E)
Patrick Morgan
(P)
Craig Morris
(C)
Katherine Mortimore
(K)
Samuel Moses
(S)
Mbiye Mpenge
(M)
Rohinton Mulla
(R)
Michael Murphy
(M)
Megan Nagel
(M)
Thapas Nagarajan
(T)
Mark Nelson
(M)
Igor Otahal
(I)
Mark Pais
(M)
Selva Panchatsharam
(S)
Hassan Paraiso
(H)
Brij Patel
(B)
Natalie Pattison
(N)
Justin Pepperell
(J)
Mark Peters
(M)
Mandeep Phull
(M)
Stefania Pintus
(S)
Jagtur Singh Pooni
(JS)
Frank Post
(F)
David Price
(D)
Rachel Prout
(R)
Nikolas Rae
(N)
Henrik Reschreiter
(H)
Tim Reynolds
(T)
Neil Richardson
(N)
Mark Roberts
(M)
Devender Roberts
(D)
Alistair Rose
(A)
Guy Rousseau
(G)
Brendan Ryan
(B)
Taranprit Saluja
(T)
Aarti Shah
(A)
Prad Shanmuga
(P)
Anil Sharma
(A)
Anna Shawcross
(A)
Jeremy Sizer
(J)
Manu Shankar-Hari
(M)
Richard Smith
(R)
Catherine Snelson
(C)
Nick Spittle
(N)
Nikki Staines
(N)
Tom Stambach
(T)
Richard Stewart
(R)
Pradeep Subudhi
(P)
Tamas Szakmany
(T)
Kate Tatham
(K)
Jo Thomas
(J)
Chris Thompson
(C)
Robert Thompson
(R)
Ascanio Tridente
(A)
Darell Tupper-Carey
(D)
Mary Twagira
(M)
Andrew Ustianowski
(A)
Nick Vallotton
(N)
Lisa Vincent-Smith
(L)
Shico Visuvanathan
(S)
Alan Vuylsteke
(A)
Sam Waddy
(S)
Rachel Wake
(R)
Andrew Walden
(A)
Ingeborg Welters
(I)
Tony Whitehouse
(T)
Paul Whittaker
(P)
Ashley Whittington
(A)
Meme Wijesinghe
(M)
Martin Williams
(M)
Lawrence Wilson
(L)
Sarah Wilson
(S)
Stephen Winchester
(S)
Martin Wiselka
(M)
Adam Wolverson
(A)
Daniel G Wooton
(DG)
Andrew Workman
(A)
Bryan Yates
(B)
Peter Young
(P)
Commentaires et corrections
Type : CommentIn
Informations de copyright
Copyright © 2021 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 license. Published by Elsevier Ltd.. All rights reserved.