Attention and impulsivity assessment using virtual reality games.
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
22 08 2023
22 08 2023
Historique:
received:
10
01
2023
accepted:
10
08
2023
medline:
24
8
2023
pubmed:
23
8
2023
entrez:
22
8
2023
Statut:
epublish
Résumé
The assessment of cognitive functions is mainly based on standardized neuropsychological tests, widely used in various fields such as personnel recruitment, education, or health. This paper presents a virtual reality game that allows collecting continuous measurements of both the performance and behaviour of the subject in an immersive, controllable, and naturalistic experience. The application registers variables related to the user's eye movements through the use of virtual reality goggles, as well as variables of the game performance. We study how virtual reality can provide data to help predict scores on the Attention Control Scale Test and the Barratt Impulsiveness Scale. We design the application and test it with a pilot group. We build a random forest regressor model to predict the attention and impulsivity scales' total score. When evaluating the performance of the model, we obtain a positive correlation with attention (0.434) and with impulsivity (0.382). In addition, our model identified that the most significant variables are the time spent looking at the target or at distractors, the eye movements variability, the number of blinks and the pupil dilation in both attention and impulsivity. Our results are consistent with previous results in the literature showing that it is possible to use data collected in virtual reality to predict the degree of attention and impulsivity.
Identifiants
pubmed: 37608015
doi: 10.1038/s41598-023-40455-4
pii: 10.1038/s41598-023-40455-4
pmc: PMC10444747
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
13689Informations de copyright
© 2023. Springer Nature Limited.
Références
Bruchmüller, K., Margraf, J. & Schneider, S. Is ADHD diagnosed in accord with diagnostic criteria? Overdiagnosis and influence of client gender on diagnosis. J. Consult. Clin. Psychol. 80, 128. https://doi.org/10.1037/a0026582 (2012).
doi: 10.1037/a0026582
pubmed: 22201328
Kooij, J. et al. Updated European consensus statement on diagnosis and treatment of adult ADHD. Eur. Psychiatry 56, 14–34. https://doi.org/10.1016/j.eurpsy.2018.11.001 (2019).
doi: 10.1016/j.eurpsy.2018.11.001
pubmed: 30453134
Klonsky, E. D. & May, A. Rethinking impulsivity in suicide. Suicide Life-Threat. Behav. 40, 612–619. https://doi.org/10.1521/suli.2010.40.6.612 (2010).
doi: 10.1521/suli.2010.40.6.612
pubmed: 21198330
Dawe, S. L. N. The role of impulsivity in the development of substance use and eating disorder. Neurosci. Biobehav. Rev. 28, 343–351. https://doi.org/10.1016/j.neubiorev.2004.03.007 (2004) (Festschrift in Honour of Jeffrey Gray - Issue 1: Anxiety and Neuroticism).
doi: 10.1016/j.neubiorev.2004.03.007
pubmed: 15225976
Nasiri, E. et al. A comprehensive review of attention tests: Can we assess what we exactly do not understand?. Egypti. J. Neurol. Psychiatry Neurosurg. 59, 26. https://doi.org/10.1186/s41983-023-00628-4 (2023).
doi: 10.1186/s41983-023-00628-4
Merrell, C. & Tymms, P. B. Inattention, hyperactivity and impulsiveness: Their impact on academic achievement and progress. Br. J. Educ. Psychol. 71, 43–56. https://doi.org/10.1348/000709901158389 (2001).
doi: 10.1348/000709901158389
pubmed: 11307708
McClelland, M. M., Acock, A. C., Piccinin, A., Rhea, S. A. & Stallings, M. C. Relations between preschool attention Span-Persistence and age 25 educational outcomes. Early Child. Res. Q 28, 314–324 (2012).
doi: 10.1016/j.ecresq.2012.07.008
pubmed: 23543916
pmcid: 3610761
Ćosić, K. et al. New tools and methods in selection of air traffic controllers based on multimodal psychophysiological measurements. IEEE Access 7, 174873–174888. https://doi.org/10.1109/ACCESS.2019.2957357 (2019).
doi: 10.1109/ACCESS.2019.2957357
Próchniak, P. Traits of personality and preferred values among fearless and courageous policemen. Int. J. Psychol. Stud. 4, 113 (2012).
doi: 10.5539/ijps.v4n4p113
Flynn, R. M., Colón-Acosta, N., Zhou, J. & Bower, J. A game-based repeated assessment for cognitive monitoring: Initial usability and adherence study in a summer camp setting. J. Autism Dev. Disord. 49, 2003–2014. https://doi.org/10.1007/s10803-019-03881-w (2019).
doi: 10.1007/s10803-019-03881-w
pubmed: 30656527
Hirsch, O. & Christiansen, H. Faking ADHD? Symptom validity testing and its relation to self-reported, observer-reported symptoms, and neuropsychological measures of attention in adults with ADHD. J. Atten. Disord. 22, 269–280. https://doi.org/10.1177/1087054715596577 (2018).
doi: 10.1177/1087054715596577
pubmed: 26246589
Rosvold, H. E., Mirsky, A. F., Sarason, I., Bransome, E. D. Jr. & Beck, L. H. A continuous performance test of brain damage. J. Consult. Psychol. 20, 343. https://doi.org/10.1037/h0043220 (1956).
doi: 10.1037/h0043220
pubmed: 13367264
Trommer, B. L., Hoeppner, J.-A.B., Lorber, R. & Armstrong, K. J. The go-no-go paradigm in attention deficit disorder. Ann. Neurol. 24, 610–614. https://doi.org/10.1002/ana.410240504 (1988).
doi: 10.1002/ana.410240504
pubmed: 3202613
Lumsden, J., Edwards, E. A., Lawrence, N. S., Coyle, D. & Munafò, M. R. Gamification of cognitive assessment and cognitive training: A systematic review of applications and efficacy. JMIR Serious Games 4, e11. https://doi.org/10.2196/games.5888 (2016).
doi: 10.2196/games.5888
pubmed: 27421244
pmcid: 4967181
Tong, T., Chignell, M., Tierney, M. C. & Lee, J. A serious game for clinical assessment of cognitive status: Validation study. JMIR Serious Games 4, e7. https://doi.org/10.2196/games.5006 (2016).
doi: 10.2196/games.5006
pubmed: 27234145
pmcid: 4902858
Ijaz, K., Ahmadpour, N., Naismith, S. L. & Calvo, R. A. An immersive virtual reality platform for assessing spatial navigation memory in predementia screening: Feasibility and usability study. JMIR Ment. Health 6, e13887. https://doi.org/10.2196/13887 (2019).
doi: 10.2196/13887
pubmed: 31482851
pmcid: 6751096
Bioulac, S. et al. Virtual remediation versus methylphenidate to improve distractibility in children with ADHD: A controlled randomized clinical trial study. J. Atten. Disord. 24, 326–335. https://doi.org/10.1177/1087054718759751 (2020).
doi: 10.1177/1087054718759751
pubmed: 29562853
Sújar, A. et al. Developing serious video games to treat attention deficit hyperactivity disorder: Tutorial guide. JMIR Serious Games 10, e33884. https://doi.org/10.2196/33884 (2022).
doi: 10.2196/33884
pubmed: 35916694
pmcid: 9379781
Berger, I., Slobodin, O. & Cassuto, H. Usefulness and validity of continuous performance tests in the diagnosis of attention-deficit hyperactivity disorder children. Arch. Clin. Neuropsychol. 32, 81–93. https://doi.org/10.1093/arclin/acw101 (2017).
doi: 10.1093/arclin/acw101
pubmed: 28122767
Pollak, Y. et al. The utility of a continuous performance test embedded in virtual reality in measuring ADHD-related deficits. J. Dev. Behav. Pediatr. 30, 1–10. https://doi.org/10.1097/DBP.0b013e3181969b22 (2009).
doi: 10.1097/DBP.0b013e3181969b22
Crepaldi, M. et al. The use of a serious game to assess inhibition mechanisms in children. Front. Comput. Sci. https://doi.org/10.3389/fcomp.2020.00034 (2020).
doi: 10.3389/fcomp.2020.00034
Waltz, E. First video game to treat disease gains fda okay. Nat. Biotechnol. 38, 1224. https://doi.org/10.1038/s41587-020-0726-6 (2020).
doi: 10.1038/s41587-020-0726-6
pubmed: 33144726
Delgado-Gómez, D. et al. Objective assessment of attention-deficit hyperactivity disorder (ADHD) using an infinite runner-based computer game: A pilot study. Brain Sci. https://doi.org/10.3390/brainsci10100716 (2020).
doi: 10.3390/brainsci10100716
pubmed: 33050130
pmcid: 7599622
Sujar, A. et al. Attention deficit hyperactivity disorder assessment based on patient behavior exhibited in a car video game: A pilot study. Brain Sci. https://doi.org/10.3390/brainsci12070877 (2022).
doi: 10.3390/brainsci12070877
pubmed: 35884684
pmcid: 9313446
Clarke, P. J. & Todd, J. Lessons unlearned: A conceptual review and meta-analysis of the relationship between the attention control scale and objective attention control. Cogn. Emot. 35, 1447–1459. https://doi.org/10.1080/02699931.2021.1987861 (2021).
doi: 10.1080/02699931.2021.1987861
pubmed: 34672869
Derryberry, D. & Reed, M. A. Anxiety-related attentional biases and their regulation by attentional control. J. Abnorm. Psychol. 111, 225–236. https://doi.org/10.1037/0021-843X.111.2.225 (2002).
doi: 10.1037/0021-843X.111.2.225
pubmed: 12003445
Stanford, M. S. et al. Fifty years of the Barratt impulsiveness scale: An update and review. Pers. Individ. Diff. 47, 385–395. https://doi.org/10.1016/j.paid.2009.04.008 (2009).
doi: 10.1016/j.paid.2009.04.008
Bates, M. E. & Lemay, E. P. The d2 test of attention: Construct validity and extensions in scoring techniques. J. Int. Neuropsychol. Soc. 10, 392–400. https://doi.org/10.1017/S135561770410307X (2004).
doi: 10.1017/S135561770410307X
pubmed: 15147597
de-la Peña, M. T. C., Otero, J. M. & Romero, E. Comparison among various methods of assessment of impulsiveness. Percept. Motor Skills 77, 567–575. https://doi.org/10.2466/pms.1993.77.2.567 (1993).
doi: 10.2466/pms.1993.77.2.567
Mackworth, J. F. & Taylor, M. M. The d’measure of signal detectability in vigilancelike situations. Can. J. Psychol. 17, 302. https://doi.org/10.1037/h0092885 (1963).
doi: 10.1037/h0092885
pubmed: 14048841
Homack, S. & Riccio, C. A. Conners’ continuous performance test (2nd ed.; ccpt-ii). J. Atten. Disord. 9, 556–558. https://doi.org/10.1177/1087054705283578 (2006).
doi: 10.1177/1087054705283578
pubmed: 16481673
Greenberg, L. M. & Waldmant, I. D. Developmental normative data on the test of variables of attention (t.o.v.a.™). J. Child Psychol. Psychiatry 34, 1019–1030. https://doi.org/10.1111/j.1469-7610.1993.tb01105.x (1993).
doi: 10.1111/j.1469-7610.1993.tb01105.x
pubmed: 8408366
Edwards, M. C. et al. Estimates of the validity and utility of the Conners’ continuous performance test in the assessment of inattentive and/or hyperactive-impulsive behaviors in children. J. Abnorm. Child Psychol. 35, 393–404. https://doi.org/10.1007/s10802-007-9098-3 (2007).
doi: 10.1007/s10802-007-9098-3
pubmed: 17295064
O’Mahony, N., Florentino-Liano, B., Carballo, J. J., Baca-García, E. & Rodríguez, A. A. Objective diagnosis of ADHD using IMUs. Med. Eng. Phys. 36, 922–926. https://doi.org/10.1016/j.medengphy.2014.02.023 (2014).
doi: 10.1016/j.medengphy.2014.02.023
pubmed: 24657100
Delgado-Gomez, D. et al. Microsoft kinect-based continuous performance test: An objective attention deficit hyperactivity disorder assessment. J. Med. Internet Res. 19, e79. https://doi.org/10.2196/jmir.6985 (2017).
doi: 10.2196/jmir.6985
pubmed: 28320691
pmcid: 5379015
Varela Casal, P. et al. Clinical validation of eye vergence as an objective marker for diagnosis of ADHD in children. J. Atten. Disord. 23, 599–614. https://doi.org/10.1177/1087054717749931 (2019).
doi: 10.1177/1087054717749931
pubmed: 29357741
Snyder, S. M., Rugino, T. A., Hornig, M. & Stein, M. A. Integration of an EEG biomarker with a clinician’s ADHD evaluation. Brain Behav. 5, e00330. https://doi.org/10.1002/brb3.330 (2015).
doi: 10.1002/brb3.330
pubmed: 25798338
pmcid: 4356845
Rodríguez, C., Areces, D., García, T., Cueli, M. & González-Castro, P. Comparison between two continuous performance tests for identifying ADHD: Traditional vs. virtual reality. Int. J. Clin. Health Psychol. 18, 254–263. https://doi.org/10.1016/j.ijchp.2018.06.003 (2018).
doi: 10.1016/j.ijchp.2018.06.003
pubmed: 30487931
pmcid: 6225036
Peñuelas-Calvo, I. et al. Video games for the assessment and treatment of attention-deficit/hyperactivity disorder: A systematic review. Eur. Child Adolesc. Psychiatry 31, 5–20. https://doi.org/10.1007/s00787-020-01557-w (2022).
doi: 10.1007/s00787-020-01557-w
pubmed: 32424511
Peijnenborgh, J. C. et al. A study on the validity of a computer-based game to assess cognitive processes, reward mechanisms, and time perception in children aged 4–8 years. JMIR Serious Games 4, e15. https://doi.org/10.2196/games.5997 (2016).
doi: 10.2196/games.5997
pubmed: 27658428
pmcid: 5054232
Hay, D. A., Bennett, K. S., Levy, F., Sergeant, J. & Swanson, J. A twin study of attention-deficit/hyperactivity disorder dimensions rated by the strengths and weaknesses of ADHD-symptoms and normal-behavior (swan) scale. Biol. Psychiatry 61, 700–705. https://doi.org/10.1016/j.biopsych.2006.04.040 (2007).
doi: 10.1016/j.biopsych.2006.04.040
pubmed: 16962074
Cutler, A., Cutler, D. R. & Stevens, J. R. Random Forests (Springer, 2012).
Parsons, T. D., Duffield, T. & Asbee, J. A comparison of virtual reality classroom continuous performance tests to traditional continuous performance tests in delineating ADHD: a meta-analysis. Neuropsychol. Rev. 29, 338–356. https://doi.org/10.1007/s11065-019-09407-6 (2019).
doi: 10.1007/s11065-019-09407-6
pubmed: 31161465
Faraone, S. V. et al. The groundskeeper gaming platform as a diagnostic tool for attention-deficit/hyperactivity disorder: Sensitivity, specificity, and relation to other measures. J. Child Adolesc. Psychopharmacol. 26, 672–685. https://doi.org/10.1089/cap.2015.0174 (2016).
doi: 10.1089/cap.2015.0174
pubmed: 27105181
pmcid: 5069710
Parsons, T. D., Bowerly, T., Buckwalter, J. G. & Rizzo, A. A. A controlled clinical comparison of attention performance in children with ADHD in a virtual reality classroom compared to standard neuropsychological methods. Child Neuropsychol. 13, 363–381. https://doi.org/10.1080/13825580600943473 (2007).
doi: 10.1080/13825580600943473
pubmed: 17564852
Ray Li, C., Chen, S.-H., Lin, W. & Yang, Y. Attentional blink in adolescents with varying levels of impulsivity. J. Psychiatr. Res. 39, 197–205. https://doi.org/10.1016/j.jpsychires.2004.06.003 (2005).
doi: 10.1016/j.jpsychires.2004.06.003
pubmed: 15589569
Lev, A., Braw, Y., Elbaum, T., Wagner, M. & Rassovsky, Y. Eye tracking during a continuous performance test: Utility for assessing ADHD patients. J. Atten. Disord. 26, 245–255. https://doi.org/10.1177/1087054720972786 (2022).
doi: 10.1177/1087054720972786
pubmed: 33238787
Das, W. & Khanna, S. A novel pupillometric-based application for the automated detection of ADHD using machine learning. In Proceedings of the 11th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics, BCB ’20. Association for Computing Machinery. https://doi.org/10.1145/3388440.3412427 (2020).
Wainstein, G. et al. Pupil size tracks attentional performance in attention-deficit/hyperactivity disorder. Sci. Rep. https://doi.org/10.1038/s41598-017-08246-w (2017).
doi: 10.1038/s41598-017-08246-w
pubmed: 29213082
pmcid: 5719026