Psychometric properties of measures of substance use: a systematic review and meta-analysis of reliability, validity and diagnostic test accuracy.
Alcohol
Drugs
Meta-analysis
Psychometric properties
Substance use
Journal
BMC medical research methodology
ISSN: 1471-2288
Titre abrégé: BMC Med Res Methodol
Pays: England
ID NLM: 100968545
Informations de publication
Date de publication:
07 05 2020
07 05 2020
Historique:
received:
22
07
2019
accepted:
30
03
2020
entrez:
9
5
2020
pubmed:
10
5
2020
medline:
25
6
2021
Statut:
epublish
Résumé
Synthesis of psychometric properties of substance use measures to identify patterns of use and substance use disorders remains limited. To address this gap, we sought to systematically evaluate the psychometric properties of measures to detect substance use and misuse. We conducted a systematic review and meta-analysis of literature on measures of substance classes associated with HIV risk (heroin, methamphetamine, cocaine, ecstasy, alcohol) that were published in English before June 2016 that reported at least one of the following psychometric outcomes of interest: internal consistency (alpha), test-retest/inter-rater reliability (kappa), sensitivity, specificity, positive predictive value, and negative predictive value. We used meta-analytic techniques to generate pooled summary estimates for these outcomes using random effects and hierarchical logistic regression models. Findings across 387 paper revealed that overall, 65% of pooled estimates for alpha were in the range of fair-to-excellent; 44% of estimates for kappa were in the range of fair-to-excellent. In addition, 69, 97, 37 and 96% of pooled estimates for sensitivity, specificity, positive predictive value, and negative predictive value, respectively, were in the range of moderate-to-excellent. We conclude that many substance use measures had pooled summary estimates that were at the fair/moderate-to-excellent range across different psychometric outcomes. Most scales were conducted in English, within the United States, highlighting the need to test and validate these measures in more diverse settings. Additionally, the majority of studies had high risk of bias, indicating a need for more studies with higher methodological quality.
Sections du résumé
BACKGROUND
Synthesis of psychometric properties of substance use measures to identify patterns of use and substance use disorders remains limited. To address this gap, we sought to systematically evaluate the psychometric properties of measures to detect substance use and misuse.
METHODS
We conducted a systematic review and meta-analysis of literature on measures of substance classes associated with HIV risk (heroin, methamphetamine, cocaine, ecstasy, alcohol) that were published in English before June 2016 that reported at least one of the following psychometric outcomes of interest: internal consistency (alpha), test-retest/inter-rater reliability (kappa), sensitivity, specificity, positive predictive value, and negative predictive value. We used meta-analytic techniques to generate pooled summary estimates for these outcomes using random effects and hierarchical logistic regression models.
RESULTS
Findings across 387 paper revealed that overall, 65% of pooled estimates for alpha were in the range of fair-to-excellent; 44% of estimates for kappa were in the range of fair-to-excellent. In addition, 69, 97, 37 and 96% of pooled estimates for sensitivity, specificity, positive predictive value, and negative predictive value, respectively, were in the range of moderate-to-excellent.
CONCLUSION
We conclude that many substance use measures had pooled summary estimates that were at the fair/moderate-to-excellent range across different psychometric outcomes. Most scales were conducted in English, within the United States, highlighting the need to test and validate these measures in more diverse settings. Additionally, the majority of studies had high risk of bias, indicating a need for more studies with higher methodological quality.
Identifiants
pubmed: 32380951
doi: 10.1186/s12874-020-00963-7
pii: 10.1186/s12874-020-00963-7
pmc: PMC7203822
doi:
Types de publication
Journal Article
Meta-Analysis
Research Support, N.I.H., Extramural
Systematic Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
106Subventions
Organisme : NIDA NIH HHS
ID : R25 DA028567
Pays : United States
Organisme : NIAID NIH HHS
ID : UM1 AI069424
Pays : United States
Organisme : NIAID NIH HHS
ID : UM1 AI068619
Pays : United States
Références
J Clin Epidemiol. 2005 Sep;58(9):882-93
pubmed: 16085191
Biostatistics. 2007 Apr;8(2):239-51
pubmed: 16698768
Gen Hosp Psychiatry. 2015 Jan-Feb;37(1):67-75
pubmed: 25439733
Curr Opin HIV AIDS. 2012 Jul;7(4):320-5
pubmed: 22498479
AIDS Behav. 2007 Mar;11(2):185-94
pubmed: 16897351
BMC Res Notes. 2012 Oct 10;5:563
pubmed: 23050607
J Affect Disord. 2015 Mar 15;174:447-63
pubmed: 25553406
Br J Gen Pract. 2014 Jul;64(624):e408-18
pubmed: 24982493
Eur Addict Res. 2005;11(1):22-31
pubmed: 15608468
J Acquir Immune Defic Syndr. 2009 Jul 1;51(3):349-55
pubmed: 19387357
J Acquir Immune Defic Syndr. 2013 Aug 1;63(4):540-4
pubmed: 23572012
Pediatrics. 2011 Jul;128(1):e180-92
pubmed: 21646259
Drug Alcohol Depend. 2015 Mar 1;148:27-33
pubmed: 25595052
Percept Mot Skills. 2007 Dec;105(3 Pt 1):997-1014
pubmed: 18229554
Lancet. 2010 Aug 7;376(9739):458-74
pubmed: 20650520
J Stud Alcohol Drugs. 2007 May;68(3):461-73
pubmed: 17446987
AIDS. 2006 Mar 21;20(5):731-9
pubmed: 16514304
Ann Intern Med. 2011 Oct 18;155(8):529-36
pubmed: 22007046
Lancet. 2017 Sep 16;390(10100):1211-1259
pubmed: 28919117
Psychol Rep. 1993 Dec;73(3 Pt 1):1019-46
pubmed: 8302975
J Acquir Immune Defic Syndr. 2013 Jul;63 Suppl 2:S174-8
pubmed: 23764632
Arch Pathol Lab Med. 2013 Apr;137(4):558-65
pubmed: 23544945
Br J Gen Pract. 2007 Feb;57(535):144-51
pubmed: 17263931
Clin Invest Med. 2007;30(1):33-41
pubmed: 17716538
Prev Med. 2001 Nov;33(5):428-33
pubmed: 11676584
Lancet. 2016 Oct 8;388(10053):1659-1724
pubmed: 27733284
Alcohol Clin Exp Res. 2011 Feb;35(2):203-10
pubmed: 21058961
Am J Epidemiol. 1966 May;83(3):586-92
pubmed: 5932702
AIDS Behav. 2011 Apr;15 Suppl 1:S51-6
pubmed: 21404011
AIDS. 2016 Feb 20;30(4):627-34
pubmed: 26558725
Curr Drug Abuse Rev. 2011 Mar;4(1):57-64
pubmed: 21466499
Drug Alcohol Depend. 2015 Feb 1;147:160-6
pubmed: 25548025
Lancet. 2013 Nov 9;382(9904):1564-74
pubmed: 23993281
Front Public Health. 2018 Jun 11;6:149
pubmed: 29942800
BMJ Open. 2017 Jul 2;7(6):e014581
pubmed: 28674134
Drugs. 2006;66(6):769-89
pubmed: 16706551
Arch Gen Psychiatry. 1981 Apr;38(4):381-9
pubmed: 6260053
J Anxiety Disord. 2012 Jan;26(1):182-8
pubmed: 22154123
Acad Emerg Med. 2017 May;24(5):552-568
pubmed: 28145070
Arch Intern Med. 2001 May 28;161(10):1281-8
pubmed: 11371255
BMJ. 2003 Sep 6;327(7414):557-60
pubmed: 12958120