Measuring self-regulation in everyday life: Reliability and validity of smartphone-based experiments in alcohol use disorder.
Behavioral tasks
Information sampling
Reliability
Risk-taking
Smartphone
Stop signal task
Validity
Working memory
Journal
Behavior research methods
ISSN: 1554-3528
Titre abrégé: Behav Res Methods
Pays: United States
ID NLM: 101244316
Informations de publication
Date de publication:
Dec 2023
Dec 2023
Historique:
accepted:
03
11
2022
medline:
7
12
2023
pubmed:
13
12
2022
entrez:
12
12
2022
Statut:
ppublish
Résumé
Self-regulation, the ability to guide behavior according to one's goals, plays an integral role in understanding loss of control over unwanted behaviors, for example in alcohol use disorder (AUD). Yet, experimental tasks that measure processes underlying self-regulation are not easy to deploy in contexts where such behaviors usually occur, namely outside the laboratory, and in clinical populations such as people with AUD. Moreover, lab-based tasks have been criticized for poor test-retest reliability and lack of construct validity. Smartphones can be used to deploy tasks in the field, but often require shorter versions of tasks, which may further decrease reliability. Here, we show that combining smartphone-based tasks with joint hierarchical modeling of longitudinal data can overcome at least some of these shortcomings. We test four short smartphone-based tasks outside the laboratory in a large sample (N = 488) of participants with AUD. Although task measures indeed have low reliability when data are analyzed traditionally by modeling each session separately, joint modeling of longitudinal data increases reliability to good and oftentimes excellent levels. We next test the measures' construct validity and show that extracted latent factors are indeed in line with theoretical accounts of cognitive control and decision-making. Finally, we demonstrate that a resulting cognitive control factor relates to a real-life measure of drinking behavior and yields stronger correlations than single measures based on traditional analyses. Our findings demonstrate how short, smartphone-based task measures, when analyzed with joint hierarchical modeling and latent factor analysis, can overcome frequently reported shortcomings of experimental tasks.
Identifiants
pubmed: 36508108
doi: 10.3758/s13428-022-02019-8
pii: 10.3758/s13428-022-02019-8
pmc: PMC10700450
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
4329-4342Informations de copyright
© 2022. The Author(s).
Références
Psychol Sci. 2020 Mar;31(3):268-279
pubmed: 32024421
Psychon Bull Rev. 2013 Oct;20(5):819-58
pubmed: 23955122
Psychon Bull Rev. 2019 Apr;26(2):452-467
pubmed: 30911907
Behav Res Methods. 2018 Jun;50(3):1166-1186
pubmed: 28726177
Behav Res Methods. 2020 Oct;52(5):2085-2097
pubmed: 32180179
PLoS One. 2014 Jul 15;9(7):e100662
pubmed: 25025865
Sci Rep. 2023 Apr 4;13(1):5534
pubmed: 37015952
Neuropsychobiology. 2022;81(5):438-450
pubmed: 35350031
Psychol Methods. 2021 Feb;26(1):74-89
pubmed: 32437184
Elife. 2019 Apr 29;8:
pubmed: 31033438
Proc Natl Acad Sci U S A. 2019 Mar 19;116(12):5472-5477
pubmed: 30842284
Proc Natl Acad Sci U S A. 2015 May 19;112(20):6515-8
pubmed: 25941369
Curr Biol. 2016 Jun 20;26(12):1634-1639
pubmed: 27265392
Proc Natl Acad Sci U S A. 2014 Aug 19;111(33):12252-7
pubmed: 25092308
Cogn Affect Behav Neurosci. 2018 Jun;18(3):536-549
pubmed: 29616472
PLoS One. 2019 Jul 22;14(7):e0219854
pubmed: 31329615
Healthcare (Basel). 2022 Aug 31;10(9):
pubmed: 36141271
Biol Psychiatry Cogn Neurosci Neuroimaging. 2020 Jun;5(6):601-609
pubmed: 32249207
Curr Biol. 2018 May 7;28(9):1433-1439.e7
pubmed: 29706512
J Exp Psychol Gen. 2021 Feb;150(2):242-275
pubmed: 32700925
J Chiropr Med. 2016 Jun;15(2):155-63
pubmed: 27330520
Sci Rep. 2019 Apr 4;9(1):5652
pubmed: 30948756
Proc Natl Acad Sci U S A. 2011 Feb 15;108(7):2693-8
pubmed: 21262822
Exp Neurol. 2021 Nov;345:113807
pubmed: 34228998
PLoS Biol. 2016 Nov 10;14(11):e2000638
pubmed: 27832071
Cogn Affect Behav Neurosci. 2018 Aug;18(4):622-637
pubmed: 29654477
Annu Rev Psychol. 2015 Jan 3;66:83-113
pubmed: 25251491
PLoS One. 2015 Oct 21;10(10):e0140383
pubmed: 26488166
Neurosci Biobehav Rev. 2021 Sep;128:1-11
pubmed: 34097979
J Neuropsychol. 2012 Sep;6(2):212-31
pubmed: 22257421
Cogn Affect Behav Neurosci. 2021 Oct;21(5):936-947
pubmed: 34075542
Perspect Psychol Sci. 2012 May;7(3):221-37
pubmed: 26168460
Addict Biol. 2013 Mar;18(2):203-13
pubmed: 22264351
JAMA Psychiatry. 2020 Apr 1;77(4):368-377
pubmed: 31812982
Addict Biol. 2020 Mar;25(2):e12866
pubmed: 31859437
J Child Psychol Psychiatry. 2017 Apr;58(4):361-383
pubmed: 28035675
Psychol Sci. 2014 Jul;25(7):1337-44
pubmed: 24789842
Psychol Sci. 2011 Apr;22(4):498-506
pubmed: 21378368
Int J Methods Psychiatr Res. 2014 Jan;23 Suppl 1:41-57
pubmed: 24375535
Front Hum Neurosci. 2021 Jan 27;14:614979
pubmed: 33584226
CBE Life Sci Educ. 2019 Mar;18(1):rm1
pubmed: 30821600
Behav Res Methods. 2022 Dec;54(6):2993-3014
pubmed: 35167111
Int J Epidemiol. 2010 Oct;39(5):1137-50
pubmed: 21051364
PLoS Comput Biol. 2019 Feb 13;15(2):e1006803
pubmed: 30759077
Cortex. 2017 Jan;86:186-204
pubmed: 27251123
Science. 2009 Oct 23;326(5952):535-8
pubmed: 19900889
Neuropsychologia. 2020 Dec;149:107667
pubmed: 33130158
Nat Commun. 2019 May 24;10(1):2319
pubmed: 31127115
Science. 1981 Jan 30;211(4481):453-8
pubmed: 7455683