Inter-rater reliability of the Conversational Assessment of Neurocognitive Dysfunction.
assessment
clinical psychologist
communication
dementia
interaction
Journal
Psychogeriatrics : the official journal of the Japanese Psychogeriatric Society
ISSN: 1479-8301
Titre abrégé: Psychogeriatrics
Pays: England
ID NLM: 101230058
Informations de publication
Date de publication:
Jul 2023
Jul 2023
Historique:
received:
25
01
2023
accepted:
25
04
2023
medline:
4
7
2023
pubmed:
11
5
2023
entrez:
10
5
2023
Statut:
ppublish
Résumé
Cognitive assessment through communication has been the focus of recent studies because the conventional cognitive tests are often considered invasive for older people. Although the Conversational Assessment of Neurocognitive Dysfunction is designed to assess cognitive function non-invasively, inter-rater reliability remains unclear. The current study investigated the Conversational Assessment of Neurocognitive Dysfunction's reliability. The Conversational Assessment of Neurocognitive Dysfunction was used by four clinical psychologists, who evaluated 38 older people with and without cognitive dysfunction. One clinical psychologist evaluated the assessment based on face-to-face communication with participants, while the other clinical psychologists evaluated it according to the audio data in the digital voice recorder. All clinical psychologists were blind to the results of other conventional cognitive tests and details surrounding participants' daily living activities. The univariate correlation scores of the Conversational Assessment of Neurocognitive Dysfunction among evaluators ranged from 0.61 to 0.79, all of which were significant (P < 0.001). The intraclass correlation coefficient was 0.64 (P < 0.001, 95% CI: 0.53-0.79 for agreement) and 0.67 (P < 0.001, 95% CI: 0.45-0.77 for consistency). The Conversational Assessment of Neurocognitive Dysfunction score of all evaluators was significantly associated with conventional cognitive tests like the Mini-Mental State Examination (P < 0.001). The findings suggested that the Conversational Assessment of Neurocognitive Dysfunction has moderate to good inter-rater reliability and high concurrent validity as a cognitive assessment tool, and it would be useful in clinical practice.
Sections du résumé
BACKGROUND
BACKGROUND
Cognitive assessment through communication has been the focus of recent studies because the conventional cognitive tests are often considered invasive for older people. Although the Conversational Assessment of Neurocognitive Dysfunction is designed to assess cognitive function non-invasively, inter-rater reliability remains unclear. The current study investigated the Conversational Assessment of Neurocognitive Dysfunction's reliability.
METHODS
METHODS
The Conversational Assessment of Neurocognitive Dysfunction was used by four clinical psychologists, who evaluated 38 older people with and without cognitive dysfunction. One clinical psychologist evaluated the assessment based on face-to-face communication with participants, while the other clinical psychologists evaluated it according to the audio data in the digital voice recorder. All clinical psychologists were blind to the results of other conventional cognitive tests and details surrounding participants' daily living activities.
RESULTS
RESULTS
The univariate correlation scores of the Conversational Assessment of Neurocognitive Dysfunction among evaluators ranged from 0.61 to 0.79, all of which were significant (P < 0.001). The intraclass correlation coefficient was 0.64 (P < 0.001, 95% CI: 0.53-0.79 for agreement) and 0.67 (P < 0.001, 95% CI: 0.45-0.77 for consistency). The Conversational Assessment of Neurocognitive Dysfunction score of all evaluators was significantly associated with conventional cognitive tests like the Mini-Mental State Examination (P < 0.001).
CONCLUSIONS
CONCLUSIONS
The findings suggested that the Conversational Assessment of Neurocognitive Dysfunction has moderate to good inter-rater reliability and high concurrent validity as a cognitive assessment tool, and it would be useful in clinical practice.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
667-674Subventions
Organisme : Japan Society for the Promotion of Science
ID : 20K14220
Informations de copyright
© 2023 Japanese Psychogeriatric Society.
Références
Watson R, Bryant J, Sanson-Fisher R, Mansfield E, Evans TJ. What is a ‘timely’ diagnosis? Exploring the preferences of Australian health service consumers regarding when a diagnosis of dementia should be disclosed. BMC Health Serv Res 2018; 18: 612.
Dubois B, Padovani A, Scheltens P, Rossi A, Dell'Agnello G. Timely diagnosis for Alzheimer's disease: a literature review on benefits and challenges. J Alzheimers Dis 2016; 49: 617-631.
Adachi H, Shinagawa S, Komori K et al. Comparison of the utility of everyday memory test and the Alzheimer's disease assessment scale-cognitive part for evaluation of mild cognitive impairment and very mild Alzheimer's disease. Psychiatry Clin Neurosci 2013; 67: 148-153.
Kazui H, Matsuda A, Hirono N et al. Everyday memory impairment of patients with mild cognitive impairment. Dement Geriatr Cogn Disord 2005; 19: 331-337.
Mavioglu H, Gedizlioglu M, Akyel S, Aslaner T, Eser E. The validity and reliability of the Turkish version of Alzheimer's disease assessment scale-cognitive subscale (ADAS-cog) in patients with mild and moderate Alzheimer's disease and normal subjects. Int J Geriatr Psychiatry 2006; 21: 259-265.
Homma A, Fukuzawa K, Tsukada Y et al. Development of a Japanse version of Alzheimer's disease assessment scale (ADAS). Jpn J Geriatr Psychiatry 1992; 3: 647-655.
Lai JM, Hawkins KA, Gross CP, Karlawish JH. Self-reported distress after cognitive testing in patients with Alzheimer's disease. J Gerontol A Biol Sci Med Sci 2008; 63: 855-859.
Boustani M, Perkins AJ, Fox C et al. Who refuses the diagnostic assessment for dementia in primary care? Int J Geriatr Psychiatry 2006; 21: 556-563.
Cahill S, Clark M, O'Connell H, Lawlor B, Coen RF, Walsh C. The attitudes and practices of general practitioners regarding dementia diagnosis in Ireland. Int J Geriatr Psychiatry 2008; 23: 663-669.
Cockrell JR, Folstein MF. Mini-Mental State Examination. In: Copeland JRM, Abou-Saleh MT, Blazer DG, eds. Principles and Practice of Geriatric Psychiatry. UK: John Wiley & Sons Ltd, 2002; 140-141.
Shibata M, Ohara T, Hosoi M et al. Emotional loneliness is associated with a risk of dementia in a general Japanese older population: the Hisayama study. J Gerontol B Psychol Sci Soc Sci 2021; 76: 1756-1766.
Gardiner C, Laud P, Heaton T, Gott M. What is the prevalence of loneliness amongst older people living in residential and nursing care homes? A systematic review and meta-analysis. Age Ageing 2020; 49: 748-757.
Sun W, Matsuoka T, Oba H, Narumoto J. Importance of loneliness in behavioral and psychological symptoms of dementia. Int J Geriatr Psychiatry 2021; 36: 540-546.
Rousseaux M, Sève A, Vallet M, Pasquier F, Mackowiak-Cordoliani MA. An analysis of communication in conversation in patients with dementia. Neuropsychologia 2010; 48: 3884-3890.
Elsey C, Drew P, Jones D et al. Towards diagnostic conversational profiles of patients presenting with dementia or functional memory disorders to memory clinics. Patient Educ Couns 2015; 98: 1071-1077.
Jones D, Drew P, Elsey C et al. Conversational assessment in memory clinic encounters: interactional profiling for differentiating dementia from functional memory disorders. Aging Ment Health 2016; 20: 500-509.
Yamada Y, Shinkawa K, Shimmei K. Atypical repetition in daily conversation on different days for detecting Alzheimer disease: evaluation of phone-call data from a regular monitoring service. JMIR Ment Health 2020; 7: e16790.
Forbes-McKay K, Shanks MF, Venneri A. Profiling spontaneous speech decline in Alzheimer's disease: a longitudinal study. Acta Neuropsychiatr 2013; 25: 320-327.
Oba H, Sato S, Kazui H, Nitta Y, Nashitani T, Kamiyama A. Conversational assessment of cognitive dysfunction among residents living in long-term care facilities. Int Psychogeriatr 2018; 30: 87-94.
Oba H, Sato S, Kazui H et al. Development of conversational assessment of neurocognitive dysfunction (CANDy): evaluation of reliability and validity. Jpn J Geriatr Psychiatry 2017; 28: 379-388.
Petersen RC, Smith GE, Ivnik RJ et al. Apolipoprotein E status as a predictor of the development of Alzheimer's disease in memory-impaired individuals. JAMA 1995; 273: 1274-1278.
McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM. Clinical diagnosis of Alzheimer's disease: report of the NINCDS-ADRDA work group under the auspices of Department of Health and Human Services Task Force on Alzheimer's disease. Neurology 1984; 34: 939-944.
Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”: a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 1975; 12: 189-198.
Wilson B, Cockburn J, Baddeley A, Hiorns R. The development and validation of a test battery for detecting and monitoring everyday memory problems. J Clin Exp Neuropsychol 1989; 11: 855-870.
Mohs RC, Rosen WG, Davis KL. The Alzheimer's disease assessment scale: an instrument for assessing treatment efficacy. Psychopharmacol Bull 1983; 19: 448-450.
Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 2016; 15: 155-163.
R Core Team. A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing, 2020.
Crum RM, Anthony JC, Bassett SS, Folstein MF. Population-based norms for the mini-mental state examination by age and educational level. JAMA 1993; 269: 2386-2391.
Oba H, Matsuoka T, Kato Y et al. Attitude toward dementia and preferences for diagnosis in Japanese health service consumers. BMC Health Serv Res 2021; 21: 411.
Stanyon MR, Griffiths A, Thomas SA, Gordon AL. The facilitators of communication with people with dementia in a care setting: an interview study with healthcare workers. Age Ageing 2016; 45: 164-170.
Mallidou AA, Cummings GG, Schalm C, Estabrooks CA. Health care aides use of time in a residential long-term care unit: a time and motion study. Int J Nurs Stud 2013; 50: 1229-1239.
Vasse E, Vernooij-Dassen M, Spijker A, Rikkert MO, Koopmans R. A systematic review of communication strategies for people with dementia in residential and nursing homes. Int Psychogeriatr 2010; 22: 189-200.