GRADE Guidelines 30: the GRADE approach to assessing the certainty of modeled evidence-An overview in the context of health decision-making.


Journal

Journal of clinical epidemiology
ISSN: 1878-5921
Titre abrégé: J Clin Epidemiol
Pays: United States
ID NLM: 8801383

Informations de publication

Date de publication:
01 2021
Historique:
received: 21 02 2020
revised: 08 09 2020
accepted: 17 09 2020
pubmed: 28 9 2020
medline: 7 9 2021
entrez: 27 9 2020
Statut: ppublish

Résumé

The objective of the study is to present the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) conceptual approach to the assessment of certainty of evidence from modeling studies (i.e., certainty associated with model outputs). Expert consultations and an international multidisciplinary workshop informed development of a conceptual approach to assessing the certainty of evidence from models within the context of systematic reviews, health technology assessments, and health care decisions. The discussions also clarified selected concepts and terminology used in the GRADE approach and by the modeling community. Feedback from experts in a broad range of modeling and health care disciplines addressed the content validity of the approach. Workshop participants agreed that the domains determining the certainty of evidence previously identified in the GRADE approach (risk of bias, indirectness, inconsistency, imprecision, reporting bias, magnitude of an effect, dose-response relation, and the direction of residual confounding) also apply when assessing the certainty of evidence from models. The assessment depends on the nature of model inputs and the model itself and on whether one is evaluating evidence from a single model or multiple models. We propose a framework for selecting the best available evidence from models: 1) developing de novo, a model specific to the situation of interest, 2) identifying an existing model, the outputs of which provide the highest certainty evidence for the situation of interest, either "off-the-shelf" or after adaptation, and 3) using outputs from multiple models. We also present a summary of preferred terminology to facilitate communication among modeling and health care disciplines. This conceptual GRADE approach provides a framework for using evidence from models in health decision-making and the assessment of certainty of evidence from a model or models. The GRADE Working Group and the modeling community are currently developing the detailed methods and related guidance for assessing specific domains determining the certainty of evidence from models across health care-related disciplines (e.g., therapeutic decision-making, toxicology, environmental health, and health economics).

Identifiants

pubmed: 32980429
pii: S0895-4356(20)31103-3
doi: 10.1016/j.jclinepi.2020.09.018
pmc: PMC8514123
mid: NIHMS1679871
pii:
doi:

Types de publication

Journal Article Research Support, N.I.H., Extramural

Langues

eng

Sous-ensembles de citation

IM

Pagination

138-150

Subventions

Organisme : World Health Organization
ID : 001
Pays : International
Organisme : Medical Research Council
ID : MR/K02325X/1
Pays : United Kingdom
Organisme : Intramural NIH HHS
ID : Z99 ES999999
Pays : United States

Informations de copyright

Copyright © 2020. Published by Elsevier Inc.

Références

Value Health. 2012 Sep-Oct;15(6):835-42
pubmed: 22999133
Res Synth Methods. 2019 Mar;10(1):125-133
pubmed: 30508309
J Clin Epidemiol. 2019 Jul;111:94-104
pubmed: 29452223
Med Decis Making. 2012 Sep-Oct;32(5):667-77
pubmed: 22990082
Environ Health Perspect. 1998 Dec;106 Suppl 6:1453-60
pubmed: 9860904
BMC Med Res Methodol. 2012 Nov 07;12:168
pubmed: 23134698
J Clin Epidemiol. 2011 Apr;64(4):407-15
pubmed: 21247734
Med Decis Making. 2011 Jul-Aug;31(4):675-92
pubmed: 21653805
J Clin Epidemiol. 2011 Apr;64(4):401-6
pubmed: 21208779
J Clin Epidemiol. 2017 Jul;87:4-13
pubmed: 28529184
J Clin Epidemiol. 2019 Jul;111:83-93
pubmed: 29800687
J Clin Epidemiol. 2013 Feb;66(2):151-7
pubmed: 22542023
Value Health. 2014 Mar;17(2):174-82
pubmed: 24636375
CMAJ. 2003 Sep 30;169(7):677-80
pubmed: 14517128
PLoS One. 2018 Jan 11;13(1):e0187271
pubmed: 29324741
Med Decis Making. 2012 Sep-Oct;32(5):690-700
pubmed: 22990084
Ann Intern Med. 2020 Jan 7;172(1):46-56
pubmed: 31766052
Value Health. 2015 Mar;18(2):147-60
pubmed: 25773550
J Expo Sci Environ Epidemiol. 2012 Sep;22(5):522-32
pubmed: 22781436
J Clin Epidemiol. 2011 Dec;64(12):1294-302
pubmed: 21803546
PLoS Med. 2012;9(7):e1001245
pubmed: 22802730
PLoS Med. 2012;9(12):e1001353
pubmed: 23239943
Med Decis Making. 2012 Sep-Oct;32(5):712-21
pubmed: 22990086
Ann Intern Med. 2016 Feb 16;164(4):215-25
pubmed: 26756606
J Clin Epidemiol. 2011 Dec;64(12):1311-6
pubmed: 21802902
Regul Toxicol Pharmacol. 2019 Aug;106:90-104
pubmed: 31026540
Pharmacoeconomics. 2016 Jun;34(6):597-608
pubmed: 26861793
BMJ. 2008 May 17;336(7653):1106-10
pubmed: 18483053
BMJ. 2015 Mar 16;350:h870
pubmed: 25775931
J Clin Epidemiol. 2011 Dec;64(12):1283-93
pubmed: 21839614
Environ Res. 2019 Apr;171:302-312
pubmed: 30708234
Med Decis Making. 2012 Sep-Oct;32(5):701-11
pubmed: 22990085
J Occup Environ Hyg. 2014;11(1):19-31
pubmed: 24283333
Lancet Public Health. 2020 Jul;5(7):e375-e385
pubmed: 32502389
Int J Evid Based Healthc. 2015 Sep;13(3):170-8
pubmed: 26288063
Value Health. 2015 Jun;18(4):512-29
pubmed: 26091606
Value Health. 2003 Jan-Feb;6(1):9-17
pubmed: 12535234
Value Health. 2013 Sep-Oct;16(6):1106-7
pubmed: 24041364
BMJ. 2013 Mar 25;346:f1049
pubmed: 23529982
Environ Int. 2016 Jul-Aug;92-93:585-9
pubmed: 27126781
J Clin Epidemiol. 2016 Aug;76:89-98
pubmed: 26931285
BMJ. 2009 Nov 19;339:b4571
pubmed: 19926697
Value Health. 2015 Jan;18(1):5-16
pubmed: 25595229
J Clin Epidemiol. 2013 Feb;66(2):140-50
pubmed: 22863410
Value Health. 2019 Mar;22(3):267-275
pubmed: 30832964
Med Decis Making. 2012 Sep-Oct;32(5):678-89
pubmed: 22990083
Pharmacoeconomics. 2006;24(4):355-71
pubmed: 16605282
J Clin Epidemiol. 2011 Dec;64(12):1277-82
pubmed: 21802904
BMJ. 2008 May 3;336(7651):995-8
pubmed: 18456631
J Clin Epidemiol. 2011 Dec;64(12):1303-10
pubmed: 21802903
Med Decis Making. 2012 Sep-Oct;32(5):733-43
pubmed: 22990088

Auteurs

Jan L Brozek (JL)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Medicine, McMaster University, Hamilton, Ontario, Canada; McMaster GRADE Centre & Michael DeGroote Cochrane Canada Centre, McMaster University, Hamilton, Ontario, Canada.

Carlos Canelo-Aybar (C)

Department of Paediatrics, Obstetrics and Gynaecology, Preventive Medicine, and Public Health. PhD Programme in Methodology of Biomedical Research and Public Health. Universitat Autònoma de Barcelona, Bellaterra, Spain; Iberoamerican Cochrane Center, Biomedical Research Institute (IIB Sant Pau-CIBERESP), Barcelona, Spain.

Elie A Akl (EA)

Department of Internal Medicine, American University of Beirut, Beirut, Lebanon.

James M Bowen (JM)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Toronto Health Economics and Technology Assessment (THETA) Collaborative, Toronto, Ontario, Canada.

John Bucher (J)

National Toxicology Program, National Institute of Environmental Health Sciences, Durham, NC, USA.

Weihsueh A Chiu (WA)

Department of Veterinary Integrative Biosciences, Texas A&M University, College Station, TX, USA.

Mark Cronin (M)

School of Pharmacy and Chemistry, Liverpool John Moores University, Liverpool, UK.

Benjamin Djulbegovic (B)

Center for Evidence-Based Medicine and Health Outcome Research, Morsani College of Medicine, University of South Florida, Tampa, Florida, USA.

Maicon Falavigna (M)

Institute for Education and Research, Hospital Moinhos de Vento, Porto Alegre, Rio Grande do Sul, Brazil.

Gordon H Guyatt (GH)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Medicine, McMaster University, Hamilton, Ontario, Canada; McMaster GRADE Centre & Michael DeGroote Cochrane Canada Centre, McMaster University, Hamilton, Ontario, Canada.

Ami A Gordon (AA)

ICF International, Durham, NC, USA.

Michele Hilton Boon (M)

Institute of Health & Wellbeing, University of Glasgow, Glasgow, UK.

Raymond C W Hutubessy (RCW)

Department of Immunization, Vaccines and Biologicals, World Health Organization, Geneva, Switzerland.

Manuela A Joore (MA)

Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Centre+, Maastricht, the Netherlands.

Vittal Katikireddi (V)

Institute of Health & Wellbeing, University of Glasgow, Glasgow, UK.

Judy LaKind (J)

LaKind Associates, LLC, Catonsville, MD, USA; Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore, MD, USA.

Miranda Langendam (M)

Department of Clinical Epidemiology, Biostatistics, and Bioinformatics, Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands.

Veena Manja (V)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Surgery, University of California Davis, Sacramento, CA, USA; Department of Medicine, Department of Veterans Affairs, Northern California Health Care System, Mather, CA, USA.

Kristen Magnuson (K)

ICF International, Durham, NC, USA.

Alexander G Mathioudakis (AG)

Division of Infection, Immunity and Respiratory Medicine, University Hospital of South Manchester, University of Manchester, Manchester, UK.

Joerg Meerpohl (J)

Institute for Evidence in Medicine, Medical Center, University of Freiburg, Freiburg-am-Breisgau, Germany; Cochrane Germany, Freiburg-am-Breisgau, Germany.

Dominik Mertz (D)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada.

Roman Mezencev (R)

National Center for Environmental Assessment, U.S. Environmental Protection Agency, Washington, DC, USA.

Rebecca Morgan (R)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada.

Gian Paolo Morgano (GP)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; McMaster GRADE Centre & Michael DeGroote Cochrane Canada Centre, McMaster University, Hamilton, Ontario, Canada.

Reem Mustafa (R)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Medicine, University of Kansas Medical Center, Kansas City, KS, USA.

Martin O'Flaherty (M)

Institute of Population Health Sciences, University of Liverpool, Liverpool, UK.

Grace Patlewicz (G)

National Center for Computational Toxicology, U.S. Environmental Protection Agency, Durham, NC, USA.

John J Riva (JJ)

McMaster GRADE Centre & Michael DeGroote Cochrane Canada Centre, McMaster University, Hamilton, Ontario, Canada; Department of Family Medicine, McMaster University, Hamilton, Ontario, Canada.

Margarita Posso (M)

Iberoamerican Cochrane Center, Biomedical Research Institute (IIB Sant Pau-CIBERESP), Barcelona, Spain.

Andrew Rooney (A)

National Toxicology Program, National Institute of Environmental Health Sciences, Durham, NC, USA.

Paul M Schlosser (PM)

National Center for Environmental Assessment, U.S. Environmental Protection Agency, Washington, DC, USA.

Lisa Schwartz (L)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada.

Ian Shemilt (I)

EPPI-Centre, Institute of Education, University College London, London, UK.

Jean-Eric Tarride (JE)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Programs for Assessment of Technology in Health, McMaster University, Hamilton, Ontario, Canada.

Kristina A Thayer (KA)

Department of Medicine, Department of Veterans Affairs, Northern California Health Care System, Mather, CA, USA.

Katya Tsaioun (K)

Evidence-Based Toxicology Collaboration, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.

Luke Vale (L)

Health Economics Group, Institute of Health and Society, Newcastle University, Newcastle upon Tyne, UK.

John Wambaugh (J)

National Center for Computational Toxicology, U.S. Environmental Protection Agency, Durham, NC, USA.

Jessica Wignall (J)

ICF International, Durham, NC, USA.

Ashley Williams (A)

ICF International, Durham, NC, USA.

Feng Xie (F)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada.

Yuan Zhang (Y)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Health Quality Ontario, Toronto, Ontario, Canada.

Holger J Schünemann (HJ)

Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Medicine, McMaster University, Hamilton, Ontario, Canada; McMaster GRADE Centre & Michael DeGroote Cochrane Canada Centre, McMaster University, Hamilton, Ontario, Canada.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH