Reliability (or lack thereof) of smartphone ecological momentary assessment of visual dot probe attention bias toward threat indices.
Attention bias
Ecological momentary assessment
Generalized anxiety disorder
Reliability
Social anxiety disorder
Visual dot probe
Journal
Journal of behavior therapy and experimental psychiatry
ISSN: 1873-7943
Titre abrégé: J Behav Ther Exp Psychiatry
Pays: Netherlands
ID NLM: 0245075
Informations de publication
Date de publication:
Mar 2024
Mar 2024
Historique:
received:
30
03
2022
revised:
05
07
2023
accepted:
09
10
2023
medline:
4
12
2023
pubmed:
1
11
2023
entrez:
31
10
2023
Statut:
ppublish
Résumé
Cognitive bias theories posit that generalized anxiety disorder (GAD) and social anxiety disorder (SAD) are entwined with attention bias toward threats, commonly indexed by faster response time (RT) on threat-congruent (vs. threat-incongruent) trials on the visual dot probe. Moreover, although smartphone ecological momentary assessment (EMA) of the visual dot probe has been developed, their psychometric properties are understudied. This study thus aimed to assess the reliability of 8 smartphone-delivered visual dot probe attention bias and related indices in persons with and without GAD and SAD. Community-dwelling adults (n = 819; GAD: 64%; SAD: 49%; Mixed GAD and SAD: 37%; Non-GAD/SAD Controls: 24%) completed a five-trial smartphone-delivered visual dot probe for a median of 60 trials (12 sessions x 5 trials/session) and an average of 100 trials (20 sessions x 5 trials/session). As hypothesized, Global Attention Bias Index, Disengagement Effect, and Facilitation Bias had low-reliability estimates. However, retest-reliability and internal reliability were good for Trial-Level Bias Scores (TLBS) (Bias Toward Treat: intra-class correlation coefficients (ICCs) = 0.626-0.644; split-half r = 0.640-0.670; Attention Bias Variability: ICCs = 0.507-0.567; split-half r = 0.520-0.580) and (In)congruent RTs. Poor retest-reliability and internal reliability estimates were consistently observed for all traditional attention bias and related indices but not TLBS. Our visual dot probe EMA should have administered ≥320 trials to match best-practice guidelines based on similar laboratory studies. Future research should strive to examine attention bias paradigms beyond the dot-probe task that evidenced meaningful test-retest reliability properties in laboratory and real-world naturalistic settings.
Sections du résumé
BACKGROUND AND OBJECTIVES
OBJECTIVE
Cognitive bias theories posit that generalized anxiety disorder (GAD) and social anxiety disorder (SAD) are entwined with attention bias toward threats, commonly indexed by faster response time (RT) on threat-congruent (vs. threat-incongruent) trials on the visual dot probe. Moreover, although smartphone ecological momentary assessment (EMA) of the visual dot probe has been developed, their psychometric properties are understudied. This study thus aimed to assess the reliability of 8 smartphone-delivered visual dot probe attention bias and related indices in persons with and without GAD and SAD.
METHODS
METHODS
Community-dwelling adults (n = 819; GAD: 64%; SAD: 49%; Mixed GAD and SAD: 37%; Non-GAD/SAD Controls: 24%) completed a five-trial smartphone-delivered visual dot probe for a median of 60 trials (12 sessions x 5 trials/session) and an average of 100 trials (20 sessions x 5 trials/session).
RESULTS
RESULTS
As hypothesized, Global Attention Bias Index, Disengagement Effect, and Facilitation Bias had low-reliability estimates. However, retest-reliability and internal reliability were good for Trial-Level Bias Scores (TLBS) (Bias Toward Treat: intra-class correlation coefficients (ICCs) = 0.626-0.644; split-half r = 0.640-0.670; Attention Bias Variability: ICCs = 0.507-0.567; split-half r = 0.520-0.580) and (In)congruent RTs. Poor retest-reliability and internal reliability estimates were consistently observed for all traditional attention bias and related indices but not TLBS.
LIMITATIONS
CONCLUSIONS
Our visual dot probe EMA should have administered ≥320 trials to match best-practice guidelines based on similar laboratory studies.
CONCLUSIONS
CONCLUSIONS
Future research should strive to examine attention bias paradigms beyond the dot-probe task that evidenced meaningful test-retest reliability properties in laboratory and real-world naturalistic settings.
Identifiants
pubmed: 37907019
pii: S0005-7916(23)00085-X
doi: 10.1016/j.jbtep.2023.101918
pii:
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
101918Informations de copyright
Copyright © 2023 Elsevier Ltd. All rights reserved.
Déclaration de conflit d'intérêts
Declaration of competing interest The authors declare that they have no conflict of interest.