The interrater reliability of a routine outcome measure for infants and pre-schoolers aged under 48 months: Health of the Nation Outcome Scales for Infants.

HoNOSI infants interrater reliability mental health outcome measure

Journal

BJPsych open
ISSN: 2056-4724
Titre abrégé: BJPsych Open
Pays: England
ID NLM: 101667931

Informations de publication

Date de publication:
22 Apr 2021
Historique:
entrez: 22 4 2021
pubmed: 23 4 2021
medline: 23 4 2021
Statut: epublish

Résumé

A review of Australian mental health services identified a gap in routine outcome measures addressing social, emotional and behavioural domains for pre-schoolers and infants. The Child and Adolescent Mental Health Information Development Expert Advisory Panel Working Group developed the Health of the Nation Outcome Scales for Infants (HoNOSI), a clinician-reported routine outcome measure for use with those aged under 4 years. Prior psychometric testing showed that the HoNOSI was considered to show face validity, and that it met the standards for concurrent validity and internal consistency. We aimed to investigate the interrater reliability of the HoNOSI. Forty-five infant mental health clinicians completed HoNOSI ratings on a set of five case vignettes. Quadratic weighted kappa interrater reliability estimates showed the HoNOSI to have Almost Perfect interrater reliability for the HoNOSI total score. Of the 15 scales, one had Moderate, seven had Substantial and seven had Almost Perfect interrater reliability. Ten of the fifteen scales and the total score exceeded the COnsensus-based Standards for the Selection of Health Measurement INstruments criteria for interrater reliability (κw ≥ 0.7). There has been a clear need for a routine outcome measure for use with infants and pre-schoolers. This study provides evidence of interrater reliability. The current findings, combined with the face and concurrent validity studies, support further examination of HoNOSI in real-world settings.

Sections du résumé

BACKGROUND BACKGROUND
A review of Australian mental health services identified a gap in routine outcome measures addressing social, emotional and behavioural domains for pre-schoolers and infants. The Child and Adolescent Mental Health Information Development Expert Advisory Panel Working Group developed the Health of the Nation Outcome Scales for Infants (HoNOSI), a clinician-reported routine outcome measure for use with those aged under 4 years. Prior psychometric testing showed that the HoNOSI was considered to show face validity, and that it met the standards for concurrent validity and internal consistency.
AIMS OBJECTIVE
We aimed to investigate the interrater reliability of the HoNOSI.
METHOD METHODS
Forty-five infant mental health clinicians completed HoNOSI ratings on a set of five case vignettes.
RESULTS RESULTS
Quadratic weighted kappa interrater reliability estimates showed the HoNOSI to have Almost Perfect interrater reliability for the HoNOSI total score. Of the 15 scales, one had Moderate, seven had Substantial and seven had Almost Perfect interrater reliability. Ten of the fifteen scales and the total score exceeded the COnsensus-based Standards for the Selection of Health Measurement INstruments criteria for interrater reliability (κw ≥ 0.7).
CONCLUSIONS CONCLUSIONS
There has been a clear need for a routine outcome measure for use with infants and pre-schoolers. This study provides evidence of interrater reliability. The current findings, combined with the face and concurrent validity studies, support further examination of HoNOSI in real-world settings.

Identifiants

DOI: 10.1192/bjo.2021.39 PMID: 33883058 PMC: PMC8086387
pubmed: 33883058
doi: 10.1192/bjo.2021.39
pii: S2056472421000399
pmc: PMC8086387
doi:

Types de publication

Journal Article

Langues

eng

Pagination

e85

Références

Health Qual Life Outcomes. 2005 Nov 28;3:76
pubmed: 16313678
J Clin Epidemiol. 2010 Jul;63(7):737-45
pubmed: 20494804
Clin Child Psychol Psychiatry. 2014 Jan;19(1):90-9
pubmed: 23236097
Soc Psychiatry Psychiatr Epidemiol. 1999 May;34(5):243-9
pubmed: 10396165
Eur Child Adolesc Psychiatry. 2003 Dec;12(6):298-302
pubmed: 14689262
J Psychiatr Ment Health Nurs. 2007 Dec;14(8):727-33
pubmed: 18039295
Int J Ment Health Syst. 2011 Sep 06;5:20
pubmed: 21896181
BJPsych Open. 2018 May;4(3):91-94
pubmed: 29606183
Australas Psychiatry. 2009 Apr;17(2):141-8
pubmed: 19016362
Psychiatry Res. 2012 Dec 30;200(2-3):884-9
pubmed: 22884311
Br J Psychiatry. 1990 Oct;157:500-14
pubmed: 2131131
Ann Intern Med. 2004 Nov 16;141(10):771-80
pubmed: 15545677
Biometrics. 1977 Mar;33(1):159-74
pubmed: 843571
Br J Psychiatry. 1999 May;174:413-6
pubmed: 10616607
Aging Ment Health. 2013;17(2):258-64
pubmed: 23082951
BJPsych Bull. 2018 Apr;42(2):63-68
pubmed: 29502543
Aust N Z J Psychiatry. 2001 Jun;35(3):370-6
pubmed: 11437812
Adm Policy Ment Health. 2007 Nov;34(6):513-8
pubmed: 17710527
Qual Life Res. 2018 May;27(5):1171-1179
pubmed: 29260445
Can J Psychiatry. 2010 Jul;55(7):431-9
pubmed: 20704770
Qual Life Res. 2018 May;27(5):1147-1157
pubmed: 29435801
Br J Psychiatry. 1998 Jan;172:11-8
pubmed: 9534825
Aust N Z J Psychiatry. 2010 Dec;44(12):1097-104
pubmed: 21070105

Auteurs

Peter Brann (P)

Eastern Health Child and Youth Mental Health Service, Australia; and Monash University, Australia.

Gordana Culjak (G)

Australian Mental Health Outcomes and Classification Network, Health Education and Training Institute, Australia; and Sydney Medical School, University of Sydney, Australia.
ORCID: 0000-0002-2653-7661

Nick Kowalenko (N)

Department of Psychological Medicine, Sydney Children's Hospital Randwick, Sydney Children's Hospital Network, Australia.

Rosemary Dickson (R)

Child and Adolescent Mental Health Information Development Expert Advisory Panel, Australian Mental Health Outcomes and Classification Network, Health Education and Training Institute, Australia.

Tim Coombs (T)

Australian Mental Health Outcomes and Classification Network, Australia; and Illawarra Institute for Mental Health, Australia.

Anne Sved Williams (A)

University of Adelaide, Australia; and Women's and Children's Health Network, Australia.

Elisabeth Hoehn (E)

Queensland Centre for Perinatal and Infant Mental Health, Child and Youth Mental Health Service, Children's Health Queensland Hospital and Health Service, Australia.

Simon Davies (S)

Child and Adolescent Mental Health Service, Western Australia Child and Adolescent Health Service, Australia.

Margaret Hoyland (M)

Child and Youth Mental Health Service, Children's Health Queensland Hospital and Health Service, Australia.

Philip Burgess (P)

Australian Mental Health Outcomes and Classification Network Analysis and Reporting, School of Public Health, Faculty of Medicine, The University of Queensland, Australia.
ORCID: 0000-0001-7184-0363

Classifications MeSH