GRADE Guidelines 30: the GRADE approach to assessing the certainty of modeled evidence-An overview in the context of health decision-making.
Certainty of evidence
GRADE
Guidelines
Health care Decision making
Mathematical models
Modelling studies
Journal
Journal of clinical epidemiology
ISSN: 1878-5921
Titre abrégé: J Clin Epidemiol
Pays: United States
ID NLM: 8801383
Informations de publication
Date de publication:
01 2021
01 2021
Historique:
received:
21
02
2020
revised:
08
09
2020
accepted:
17
09
2020
pubmed:
28
9
2020
medline:
7
9
2021
entrez:
27
9
2020
Statut:
ppublish
Résumé
The objective of the study is to present the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) conceptual approach to the assessment of certainty of evidence from modeling studies (i.e., certainty associated with model outputs). Expert consultations and an international multidisciplinary workshop informed development of a conceptual approach to assessing the certainty of evidence from models within the context of systematic reviews, health technology assessments, and health care decisions. The discussions also clarified selected concepts and terminology used in the GRADE approach and by the modeling community. Feedback from experts in a broad range of modeling and health care disciplines addressed the content validity of the approach. Workshop participants agreed that the domains determining the certainty of evidence previously identified in the GRADE approach (risk of bias, indirectness, inconsistency, imprecision, reporting bias, magnitude of an effect, dose-response relation, and the direction of residual confounding) also apply when assessing the certainty of evidence from models. The assessment depends on the nature of model inputs and the model itself and on whether one is evaluating evidence from a single model or multiple models. We propose a framework for selecting the best available evidence from models: 1) developing de novo, a model specific to the situation of interest, 2) identifying an existing model, the outputs of which provide the highest certainty evidence for the situation of interest, either "off-the-shelf" or after adaptation, and 3) using outputs from multiple models. We also present a summary of preferred terminology to facilitate communication among modeling and health care disciplines. This conceptual GRADE approach provides a framework for using evidence from models in health decision-making and the assessment of certainty of evidence from a model or models. The GRADE Working Group and the modeling community are currently developing the detailed methods and related guidance for assessing specific domains determining the certainty of evidence from models across health care-related disciplines (e.g., therapeutic decision-making, toxicology, environmental health, and health economics).
Identifiants
pubmed: 32980429
pii: S0895-4356(20)31103-3
doi: 10.1016/j.jclinepi.2020.09.018
pmc: PMC8514123
mid: NIHMS1679871
pii:
doi:
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Langues
eng
Sous-ensembles de citation
IM
Pagination
138-150Subventions
Organisme : World Health Organization
ID : 001
Pays : International
Organisme : Medical Research Council
ID : MR/K02325X/1
Pays : United Kingdom
Organisme : Intramural NIH HHS
ID : Z99 ES999999
Pays : United States
Informations de copyright
Copyright © 2020. Published by Elsevier Inc.
Références
Value Health. 2012 Sep-Oct;15(6):835-42
pubmed: 22999133
Res Synth Methods. 2019 Mar;10(1):125-133
pubmed: 30508309
J Clin Epidemiol. 2019 Jul;111:94-104
pubmed: 29452223
Med Decis Making. 2012 Sep-Oct;32(5):667-77
pubmed: 22990082
Environ Health Perspect. 1998 Dec;106 Suppl 6:1453-60
pubmed: 9860904
BMC Med Res Methodol. 2012 Nov 07;12:168
pubmed: 23134698
J Clin Epidemiol. 2011 Apr;64(4):407-15
pubmed: 21247734
Med Decis Making. 2011 Jul-Aug;31(4):675-92
pubmed: 21653805
J Clin Epidemiol. 2011 Apr;64(4):401-6
pubmed: 21208779
J Clin Epidemiol. 2017 Jul;87:4-13
pubmed: 28529184
J Clin Epidemiol. 2019 Jul;111:83-93
pubmed: 29800687
J Clin Epidemiol. 2013 Feb;66(2):151-7
pubmed: 22542023
Value Health. 2014 Mar;17(2):174-82
pubmed: 24636375
CMAJ. 2003 Sep 30;169(7):677-80
pubmed: 14517128
PLoS One. 2018 Jan 11;13(1):e0187271
pubmed: 29324741
Med Decis Making. 2012 Sep-Oct;32(5):690-700
pubmed: 22990084
Ann Intern Med. 2020 Jan 7;172(1):46-56
pubmed: 31766052
Value Health. 2015 Mar;18(2):147-60
pubmed: 25773550
J Expo Sci Environ Epidemiol. 2012 Sep;22(5):522-32
pubmed: 22781436
J Clin Epidemiol. 2011 Dec;64(12):1294-302
pubmed: 21803546
PLoS Med. 2012;9(7):e1001245
pubmed: 22802730
PLoS Med. 2012;9(12):e1001353
pubmed: 23239943
Med Decis Making. 2012 Sep-Oct;32(5):712-21
pubmed: 22990086
Ann Intern Med. 2016 Feb 16;164(4):215-25
pubmed: 26756606
J Clin Epidemiol. 2011 Dec;64(12):1311-6
pubmed: 21802902
Regul Toxicol Pharmacol. 2019 Aug;106:90-104
pubmed: 31026540
Pharmacoeconomics. 2016 Jun;34(6):597-608
pubmed: 26861793
BMJ. 2008 May 17;336(7653):1106-10
pubmed: 18483053
BMJ. 2015 Mar 16;350:h870
pubmed: 25775931
J Clin Epidemiol. 2011 Dec;64(12):1283-93
pubmed: 21839614
Environ Res. 2019 Apr;171:302-312
pubmed: 30708234
Med Decis Making. 2012 Sep-Oct;32(5):701-11
pubmed: 22990085
J Occup Environ Hyg. 2014;11(1):19-31
pubmed: 24283333
Lancet Public Health. 2020 Jul;5(7):e375-e385
pubmed: 32502389
Int J Evid Based Healthc. 2015 Sep;13(3):170-8
pubmed: 26288063
Value Health. 2015 Jun;18(4):512-29
pubmed: 26091606
Value Health. 2003 Jan-Feb;6(1):9-17
pubmed: 12535234
Value Health. 2013 Sep-Oct;16(6):1106-7
pubmed: 24041364
BMJ. 2013 Mar 25;346:f1049
pubmed: 23529982
Environ Int. 2016 Jul-Aug;92-93:585-9
pubmed: 27126781
J Clin Epidemiol. 2016 Aug;76:89-98
pubmed: 26931285
BMJ. 2009 Nov 19;339:b4571
pubmed: 19926697
Value Health. 2015 Jan;18(1):5-16
pubmed: 25595229
J Clin Epidemiol. 2013 Feb;66(2):140-50
pubmed: 22863410
Value Health. 2019 Mar;22(3):267-275
pubmed: 30832964
Med Decis Making. 2012 Sep-Oct;32(5):678-89
pubmed: 22990083
Pharmacoeconomics. 2006;24(4):355-71
pubmed: 16605282
J Clin Epidemiol. 2011 Dec;64(12):1277-82
pubmed: 21802904
BMJ. 2008 May 3;336(7651):995-8
pubmed: 18456631
J Clin Epidemiol. 2011 Dec;64(12):1303-10
pubmed: 21802903
Med Decis Making. 2012 Sep-Oct;32(5):733-43
pubmed: 22990088