Development and validation of the ISARIC 4C Deterioration model for adults hospitalised with COVID-19: a prospective cohort study.


Journal

The Lancet. Respiratory medicine
ISSN: 2213-2619
Titre abrégé: Lancet Respir Med
Pays: England
ID NLM: 101605555

Informations de publication

Date de publication:
04 2021
Historique:
received: 28 10 2020
revised: 25 11 2020
accepted: 25 11 2020
pubmed: 15 1 2021
medline: 14 4 2021
entrez: 14 1 2021
Statut: ppublish

Résumé

Prognostic models to predict the risk of clinical deterioration in acute COVID-19 cases are urgently required to inform clinical management decisions. We developed and validated a multivariable logistic regression model for in-hospital clinical deterioration (defined as any requirement of ventilatory support or critical care, or death) among consecutively hospitalised adults with highly suspected or confirmed COVID-19 who were prospectively recruited to the International Severe Acute Respiratory and Emerging Infections Consortium Coronavirus Clinical Characterisation Consortium (ISARIC4C) study across 260 hospitals in England, Scotland, and Wales. Candidate predictors that were specified a priori were considered for inclusion in the model on the basis of previous prognostic scores and emerging literature describing routinely measured biomarkers associated with COVID-19 prognosis. We used internal-external cross-validation to evaluate discrimination, calibration, and clinical utility across eight National Health Service (NHS) regions in the development cohort. We further validated the final model in held-out data from an additional NHS region (London). 74 944 participants (recruited between Feb 6 and Aug 26, 2020) were included, of whom 31 924 (43·2%) of 73 948 with available outcomes met the composite clinical deterioration outcome. In internal-external cross-validation in the development cohort of 66 705 participants, the selected model (comprising 11 predictors routinely measured at the point of hospital admission) showed consistent discrimination, calibration, and clinical utility across all eight NHS regions. In held-out data from London (n=8239), the model showed a similarly consistent performance (C-statistic 0·77 [95% CI 0·76 to 0·78]; calibration-in-the-large 0·00 [-0·05 to 0·05]); calibration slope 0·96 [0·91 to 1·01]), and greater net benefit than any other reproducible prognostic model. The 4C Deterioration model has strong potential for clinical utility and generalisability to predict clinical deterioration and inform decision making among adults hospitalised with COVID-19. National Institute for Health Research (NIHR), UK Medical Research Council, Wellcome Trust, Department for International Development, Bill & Melinda Gates Foundation, EU Platform for European Preparedness Against (Re-)emerging Epidemics, NIHR Health Protection Research Unit (HPRU) in Emerging and Zoonotic Infections at University of Liverpool, NIHR HPRU in Respiratory Infections at Imperial College London.

Sections du résumé

BACKGROUND
Prognostic models to predict the risk of clinical deterioration in acute COVID-19 cases are urgently required to inform clinical management decisions.
METHODS
We developed and validated a multivariable logistic regression model for in-hospital clinical deterioration (defined as any requirement of ventilatory support or critical care, or death) among consecutively hospitalised adults with highly suspected or confirmed COVID-19 who were prospectively recruited to the International Severe Acute Respiratory and Emerging Infections Consortium Coronavirus Clinical Characterisation Consortium (ISARIC4C) study across 260 hospitals in England, Scotland, and Wales. Candidate predictors that were specified a priori were considered for inclusion in the model on the basis of previous prognostic scores and emerging literature describing routinely measured biomarkers associated with COVID-19 prognosis. We used internal-external cross-validation to evaluate discrimination, calibration, and clinical utility across eight National Health Service (NHS) regions in the development cohort. We further validated the final model in held-out data from an additional NHS region (London).
FINDINGS
74 944 participants (recruited between Feb 6 and Aug 26, 2020) were included, of whom 31 924 (43·2%) of 73 948 with available outcomes met the composite clinical deterioration outcome. In internal-external cross-validation in the development cohort of 66 705 participants, the selected model (comprising 11 predictors routinely measured at the point of hospital admission) showed consistent discrimination, calibration, and clinical utility across all eight NHS regions. In held-out data from London (n=8239), the model showed a similarly consistent performance (C-statistic 0·77 [95% CI 0·76 to 0·78]; calibration-in-the-large 0·00 [-0·05 to 0·05]); calibration slope 0·96 [0·91 to 1·01]), and greater net benefit than any other reproducible prognostic model.
INTERPRETATION
The 4C Deterioration model has strong potential for clinical utility and generalisability to predict clinical deterioration and inform decision making among adults hospitalised with COVID-19.
FUNDING
National Institute for Health Research (NIHR), UK Medical Research Council, Wellcome Trust, Department for International Development, Bill & Melinda Gates Foundation, EU Platform for European Preparedness Against (Re-)emerging Epidemics, NIHR Health Protection Research Unit (HPRU) in Emerging and Zoonotic Infections at University of Liverpool, NIHR HPRU in Respiratory Infections at Imperial College London.

Identifiants

pubmed: 33444539
pii: S2213-2600(20)30559-2
doi: 10.1016/S2213-2600(20)30559-2
pmc: PMC7832571
pii:
doi:

Types de publication

Journal Article Multicenter Study Research Support, Non-U.S. Gov't Validation Study

Langues

eng

Sous-ensembles de citation

IM

Pagination

349-359

Subventions

Organisme : Medical Research Council
ID : G0701652
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_PC_19059
Pays : United Kingdom
Organisme : Department of Health
ID : IS-HPU-1112-10117
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_UU_12014/9
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_PC_19025
Pays : United Kingdom
Organisme : Wellcome Trust
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_PC_15001
Pays : United Kingdom
Organisme : Wellcome Trust
ID : 109965/Z/15/Z
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_PC_19026
Pays : United Kingdom
Organisme : Department of Health
ID : DRF-2018-11-ST2-004
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_UU_00004/07
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/V033441/1
Pays : United Kingdom
Organisme : Medical Research Council
ID : MR/S032304/1
Pays : United Kingdom
Organisme : Medical Research Council
ID : MC_UU_12023/21
Pays : United Kingdom

Investigateurs

J Kenneth Baillie (JK)
Malcolm G Semple (MG)
Peter Jm Openshaw (PJ)
Gail Carson (G)
Beatrice Alex (B)
Benjamin Bach (B)
Wendy S Barclay (WS)
Debby Bogaert (D)
Meera Chand (M)
Graham S Cooke (GS)
Annemarie B Docherty (AB)
Jake Dunning (J)
Ana da Silva Filipe (ADS)
Tom Fletcher (T)
Christopher A Green (CA)
Ewen M Harrison (EM)
Julian A Hiscox (JA)
Antonia Ying Wai Ho (AYW)
Peter W Horby (PW)
Samreen Ijaz (S)
Saye Khoo (S)
Paul Klenerman (P)
Andrew Law (A)
Wei Shen Lim (WS)
Alexander J Mentzer (AJ)
Laura Merson (L)
Alison M Meynert (AM)
Mahdad Noursadeghi (M)
Shona C Moore (SC)
Massimo Palmarini (M)
William A Paxton (WA)
Georgios Pollakis (G)
Nicholas Price (N)
Andrew Rambaut (A)
David L Robertson (DL)
Clark D Russell (CD)
Vanessa Sancho-Shimizu (V)
Janet T Scott (JT)
Thushan de Silva (T)
Louise Sigfrid (L)
Tom Solomon (T)
Shiranee Sriskandan (S)
David Stuart (D)
Charlotte Summers (C)
Richard S Tedder (RS)
Emma C Thomson (EC)
Aa Roger Thompson (AR)
Ryan S Thwaites (RS)
Lance Cw Turtle (LC)
Maria Zambon (M)
Hayley Hardwick (H)
Chloe Donohue (C)
Ruth Lyons (R)
Fiona Griffiths (F)
Wilna Oosthuyzen (W)
Lisa Norman (L)
Riinu Pius (R)
Tom M Drake (TM)
Cameron J Fairfield (CJ)
Stephen Knight (S)
Kenneth A Mclean (KA)
Derek Murphy (D)
Catherine A Shaw (CA)
Jo Dalton (J)
James Lee (J)
Daniel Plotkin (D)
Michelle Girvan (M)
Scott Mullaney (S)
Claire Petersen (C)
Egle Saviciute (E)
Stephanie Roberts (S)
Janet Harrison (J)
Laura Marsh (L)
Marie Connor (M)
Sophie Halpin (S)
Clare Jackson (C)
Carrol Gamble (C)
Gary Leeming (G)
Andrew Law (A)
Murray Wham (M)
Sara Clohisey (S)
Ross Hendry (R)
James Scott-Brown (J)
William Greenhalf (W)
Victoria Shaw (V)
Sarah McDonald (S)
Seán Keating (S)
Katie A Ahmed (KA)
Jane A Armstrong (JA)
Milton Ashworth (M)
Innocent G Asiimwe (IG)
Siddharth Bakshi (S)
Samantha L Barlow (SL)
Laura Booth (L)
Benjamin Brennan (B)
Katie Bullock (K)
Benjamin Wa Catterall (BW)
Jordan J Clark (JJ)
Emily A Clarke (EA)
Sarah Cole (S)
Louise Cooper (L)
Helen Cox (H)
Christopher Davis (C)
Oslem Dincarslan (O)
Chris Dunn (C)
Philip Dyer (P)
Angela Elliott (A)
Anthony Evans (A)
Lorna Finch (L)
Lewis Ws Fisher (LW)
Terry Foster (T)
Isabel Garcia-Dorival (I)
Willliam Greenhalf (W)
Philip Gunning (P)
Catherine Hartley (C)
Antonia Ho (A)
Rebecca L Jensen (RL)
Christopher B Jones (CB)
Trevor R Jones (TR)
Shadia Khandaker (S)
Katharine King (K)
Robyn T Kiy (RT)
Chrysa Koukorava (C)
Annette Lake (A)
Suzannah Lant (S)
Diane Latawiec (D)
L Lavelle-Langham (L)
Daniella Lefteri (D)
Lauren Lett (L)
Lucia A Livoti (LA)
Maria Mancini (M)
Sarah McDonald (S)
Laurence McEvoy (L)
John McLauchlan (J)
Soeren Metelmann (S)
Nahida S Miah (NS)
Joanna Middleton (J)
Joyce Mitchell (J)
Shona C Moore (SC)
Ellen G Murphy (EG)
Rebekah Penrice-Randal (R)
Jack Pilgrim (J)
Tessa Prince (T)
Will Reynolds (W)
P Matthew Ridley (PM)
Debby Sales (D)
Victoria E Shaw (VE)
Rebecca K Shears (RK)
Benjamin Small (B)
Krishanthi S Subramaniam (KS)
Agnieska Szemiel (A)
Aislynn Taggart (A)
Jolanta Tanianis-Hughes (J)
Jordan Thomas (J)
Erwan Trochu (E)
Libby van Tonder (L)
Eve Wilcock (E)
J Eunice Zhang (JE)
Kayode Adeniji (K)
Daniel Agranoff (D)
Ken Agwuh (K)
Dhiraj Ail (D)
Ana Alegria (A)
Brian Angus (B)
Abdul Ashish (A)
Dougal Atkinson (D)
Shahedal Bari (S)
Gavin Barlow (G)
Stella Barnass (S)
Nicholas Barrett (N)
Christopher Bassford (C)
David Baxter (D)
Michael Beadsworth (M)
Jolanta Bernatoniene (J)
John Berridge (J)
Nicola Best (N)
Pieter Bothma (P)
David Brealey (D)
Robin Brittain-Long (R)
Naomi Bulteel (N)
Tom Burden (T)
Andrew Burtenshaw (A)
Vikki Caruth (V)
David Chadwick (D)
Duncan Chambler (D)
Nigel Chee (N)
Jenny Child (J)
Srikanth Chukkambotla (S)
Tom Clark (T)
Paul Collini (P)
Catherine Cosgrove (C)
Jason Cupitt (J)
Maria-Teresa Cutino-Moguel (MT)
Paul Dark (P)
Chris Dawson (C)
Samir Dervisevic (S)
Phil Donnison (P)
Sam Douthwaite (S)
Ingrid DuRand (I)
Ahilanadan Dushianthan (A)
Tristan Dyer (T)
Cariad Evans (C)
Chi Eziefula (C)
Chrisopher Fegan (C)
Adam Finn (A)
Duncan Fullerton (D)
Sanjeev Garg (S)
Sanjeev Garg (S)
Atul Garg (A)
Effrossyni Gkrania-Klotsas (E)
Jo Godden (J)
Arthur Goldsmith (A)
Clive Graham (C)
Elaine Hardy (E)
Stuart Hartshorn (S)
Daniel Harvey (D)
Peter Havalda (P)
Daniel B Hawcutt (DB)
Maria Hobrok (M)
Luke Hodgson (L)
Anil Hormis (A)
Michael Jacobs (M)
Susan Jain (S)
Paul Jennings (P)
Agilan Kaliappan (A)
Vidya Kasipandian (V)
Stephen Kegg (S)
Michael Kelsey (M)
Jason Kendall (J)
Caroline Kerrison (C)
Ian Kerslake (I)
Oliver Koch (O)
Gouri Koduri (G)
George Koshy (G)
Shondipon Laha (S)
Steven Laird (S)
Susan Larkin (S)
Tamas Leiner (T)
Patrick Lillie (P)
James Limb (J)
Vanessa Linnett (V)
Jeff Little (J)
Michael MacMahon (M)
Emily MacNaughton (E)
Ravish Mankregod (R)
Huw Masson (H)
Elijah Matovu (E)
Katherine McCullough (K)
Ruth McEwen (R)
Manjula Meda (M)
Gary Mills (G)
Jane Minton (J)
Mariyam Mirfenderesky (M)
Kavya Mohandas (K)
Quen Mok (Q)
James Moon (J)
Elinoor Moore (E)
Patrick Morgan (P)
Craig Morris (C)
Katherine Mortimore (K)
Samuel Moses (S)
Mbiye Mpenge (M)
Rohinton Mulla (R)
Michael Murphy (M)
Megan Nagel (M)
Thapas Nagarajan (T)
Mark Nelson (M)
Igor Otahal (I)
Mark Pais (M)
Selva Panchatsharam (S)
Hassan Paraiso (H)
Brij Patel (B)
Natalie Pattison (N)
Justin Pepperell (J)
Mark Peters (M)
Mandeep Phull (M)
Stefania Pintus (S)
Jagtur Singh Pooni (JS)
Frank Post (F)
David Price (D)
Rachel Prout (R)
Nikolas Rae (N)
Henrik Reschreiter (H)
Tim Reynolds (T)
Neil Richardson (N)
Mark Roberts (M)
Devender Roberts (D)
Alistair Rose (A)
Guy Rousseau (G)
Brendan Ryan (B)
Taranprit Saluja (T)
Aarti Shah (A)
Prad Shanmuga (P)
Anil Sharma (A)
Anna Shawcross (A)
Jeremy Sizer (J)
Manu Shankar-Hari (M)
Richard Smith (R)
Catherine Snelson (C)
Nick Spittle (N)
Nikki Staines (N)
Tom Stambach (T)
Richard Stewart (R)
Pradeep Subudhi (P)
Tamas Szakmany (T)
Kate Tatham (K)
Jo Thomas (J)
Chris Thompson (C)
Robert Thompson (R)
Ascanio Tridente (A)
Darell Tupper-Carey (D)
Mary Twagira (M)
Andrew Ustianowski (A)
Nick Vallotton (N)
Lisa Vincent-Smith (L)
Shico Visuvanathan (S)
Alan Vuylsteke (A)
Sam Waddy (S)
Rachel Wake (R)
Andrew Walden (A)
Ingeborg Welters (I)
Tony Whitehouse (T)
Paul Whittaker (P)
Ashley Whittington (A)
Meme Wijesinghe (M)
Martin Williams (M)
Lawrence Wilson (L)
Sarah Wilson (S)
Stephen Winchester (S)
Martin Wiselka (M)
Adam Wolverson (A)
Daniel G Wooton (DG)
Andrew Workman (A)
Bryan Yates (B)
Peter Young (P)

Commentaires et corrections

Type : CommentIn

Informations de copyright

Copyright © 2021 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 license. Published by Elsevier Ltd.. All rights reserved.

Auteurs

Rishi K Gupta (RK)

Institute for Global Health, University College London, London, UK.

Ewen M Harrison (EM)

Centre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK; Department of Clinical Surgery, University of Edinburgh, Edinburgh, UK.

Antonia Ho (A)

Medical Research Council, University of Glasgow Centre for Virus Research, Glasgow, UK; Department of Infectious Diseases, Queen Elizabeth University Hospital, Glasgow, UK.

Annemarie B Docherty (AB)

Centre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK; Intensive Care Unit, Royal Infirmary Edinburgh, Edinburgh, UK.

Stephen R Knight (SR)

Centre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.

Maarten van Smeden (M)

Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, Netherlands.

Ibrahim Abubakar (I)

Institute for Global Health, University College London, London, UK.

Marc Lipman (M)

UCL Respiratory, Division of Medicine, University College London, London, UK; Royal Free Hospitals NHS Trust, London, UK.

Matteo Quartagno (M)

MRC Clinical Trials Unit, Institute of Clinical Trials and Methodology, University College London, London, UK.

Riinu Pius (R)

Centre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.

Iain Buchan (I)

Institute of Population Health Sciences, University of Liverpool, Liverpool, UK.

Gail Carson (G)

ISARIC Global Support Centre, Nuffield Department of Medicine, University of Oxford, Oxford, UK.

Thomas M Drake (TM)

Centre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.

Jake Dunning (J)

National Infection Service, Public Health England, London, UK; National Heart and Lung Institute, Imperial College London, London, UK.

Cameron J Fairfield (CJ)

Centre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.

Carrol Gamble (C)

Liverpool Clinical Trials Centre, University of Liverpool, Liverpool, UK.

Christopher A Green (CA)

Institute of Microbiology and Infection, University of Birmingham, Birmingham, UK.

Sophie Halpin (S)

Liverpool Clinical Trials Centre, University of Liverpool, Liverpool, UK.

Hayley E Hardwick (HE)

NIHR Health Protection Research Unit, Institute of Infection, Veterinary, and Ecological Sciences, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK.

Karl A Holden (KA)

NIHR Health Protection Research Unit, Institute of Infection, Veterinary, and Ecological Sciences, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK.

Peter W Horby (PW)

ISARIC Global Support Centre, Nuffield Department of Medicine, University of Oxford, Oxford, UK.

Clare Jackson (C)

Liverpool Clinical Trials Centre, University of Liverpool, Liverpool, UK.

Kenneth A Mclean (KA)

Centre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.

Laura Merson (L)

ISARIC Global Support Centre, Nuffield Department of Medicine, University of Oxford, Oxford, UK.

Jonathan S Nguyen-Van-Tam (JS)

Division of Epidemiology and Public Health, University of Nottingham School of Medicine, Nottingham, UK.

Lisa Norman (L)

Centre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.

Piero L Olliaro (PL)

ISARIC Global Support Centre, Nuffield Department of Medicine, University of Oxford, Oxford, UK.

Mark G Pritchard (MG)

Centre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, UK.

Clark D Russell (CD)

Queen's Medical Research Institute, University of Edinburgh, Edinburgh, UK.

James Scott-Brown (J)

School of Informatics, University of Edinburgh, Edinburgh, UK.

Catherine A Shaw (CA)

Centre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.

Aziz Sheikh (A)

Centre for Medical Informatics, The Usher Institute, University of Edinburgh, Edinburgh, UK.

Tom Solomon (T)

NIHR Health Protection Research Unit, Institute of Infection, Veterinary, and Ecological Sciences, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK; Walton Centre NHS Foundation Trust, Liverpool, UK.

Cathie Sudlow (C)

Health Data Research UK, London, UK.

Olivia V Swann (OV)

Department of Child Life and Health, University of Edinburgh, Edinburgh, UK.

Lance Turtle (L)

NIHR Health Protection Research Unit, Institute of Infection, Veterinary, and Ecological Sciences, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK; Tropical and Infectious Disease Unit, Royal Liverpool University Hospital, Liverpool, UK.

Peter J M Openshaw (PJM)

National Heart and Lung Institute, Imperial College London, London, UK.

J Kenneth Baillie (JK)

Roslin Institute, University of Edinburgh, Edinburgh, UK; Intensive Care Unit, Royal Infirmary Edinburgh, Edinburgh, UK.

Malcolm G Semple (MG)

NIHR Health Protection Research Unit, Institute of Infection, Veterinary, and Ecological Sciences, Faculty of Health and Life Sciences, University of Liverpool, Liverpool, UK; Respiratory Medicine, Alder Hey Children's Hospital, Institute in The Park, University of Liverpool, Liverpool, UK. Electronic address: m.g.semple@liverpool.ac.uk.

Mahdad Noursadeghi (M)

Division of Infection and Immunity, University College London, London, UK. Electronic address: m.noursadeghi@ucl.ac.uk.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH