Development, preliminary validation and reliability of the colourful 'My Feelings Form' self-report for young children.
Outcome
mental health
questionnaires
reliability
validity
Journal
Child and adolescent mental health
ISSN: 1475-357X
Titre abrégé: Child Adolesc Ment Health
Pays: England
ID NLM: 101142157
Informations de publication
Date de publication:
05 2023
05 2023
Historique:
accepted:
05
04
2022
medline:
17
4
2023
pubmed:
26
5
2022
entrez:
25
5
2022
Statut:
ppublish
Résumé
Patient-reported outcome measures place the patient at the centre of his/her care. There are calls to introduce child-reported outcome measures to mental health services. We aimed to (a) develop an age-appropriate patient-reported outcome measure for children's mental health, and (b) validate this in a primary school and Child and Adolescent Mental Health Service (CAMHS). A list of items to measure children's mental health was proposed (Draft 1) and revised to 14 items following focus group and user consultation (Draft 2). A colourful, cartoon and emoji version was created in consultation with children (Draft 3); a professional cartoon artist created the final 'My Feelings Form' (MFF), with usability feedback (Draft 4). The MFF was tested by 317 children aged 4-13 years from one mixed-gender primary school at two time points in 1 day, and 25 children aged 4-13 years from CAMHS. Results were analysed using test-retest reliability and exploratory factor analysis; a receiver operator characteristic curve was constructed. The CAMHS group scored significantly higher than the school group for the mean total score (23.5 ± 11.3 vs. 16.1 ± 6.2) and for 10 items. Test-retest reliability was acceptable (correlation = 0.74, p < .001). Exploratory factor analysis using 10 informative items identified two factors - emotional factor (Cronbach's alpha = 0.74) and function factor (Cronbach's alpha = 0.59). The revised 10-item form has a Cronbach's alpha of 0.77; a cut-off of 12 has a sensitivity of 80% and specificity of 60%, indicating that it correctly identified 80% of those who were attending CAMHS and gave 60% of the schoolchildren a negative result. The colourful MFF was co-produced with children, and preliminary data suggest that it is a useful patient-reported outcome measure for children's mental health.
Sections du résumé
BACKGROUND
Patient-reported outcome measures place the patient at the centre of his/her care. There are calls to introduce child-reported outcome measures to mental health services. We aimed to (a) develop an age-appropriate patient-reported outcome measure for children's mental health, and (b) validate this in a primary school and Child and Adolescent Mental Health Service (CAMHS).
METHODS
A list of items to measure children's mental health was proposed (Draft 1) and revised to 14 items following focus group and user consultation (Draft 2). A colourful, cartoon and emoji version was created in consultation with children (Draft 3); a professional cartoon artist created the final 'My Feelings Form' (MFF), with usability feedback (Draft 4). The MFF was tested by 317 children aged 4-13 years from one mixed-gender primary school at two time points in 1 day, and 25 children aged 4-13 years from CAMHS. Results were analysed using test-retest reliability and exploratory factor analysis; a receiver operator characteristic curve was constructed.
RESULTS
The CAMHS group scored significantly higher than the school group for the mean total score (23.5 ± 11.3 vs. 16.1 ± 6.2) and for 10 items. Test-retest reliability was acceptable (correlation = 0.74, p < .001). Exploratory factor analysis using 10 informative items identified two factors - emotional factor (Cronbach's alpha = 0.74) and function factor (Cronbach's alpha = 0.59). The revised 10-item form has a Cronbach's alpha of 0.77; a cut-off of 12 has a sensitivity of 80% and specificity of 60%, indicating that it correctly identified 80% of those who were attending CAMHS and gave 60% of the schoolchildren a negative result.
CONCLUSIONS
The colourful MFF was co-produced with children, and preliminary data suggest that it is a useful patient-reported outcome measure for children's mental health.
Substances chimiques
Excipients
0
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
299-306Informations de copyright
© 2022 The Authors. Child and Adolescent Mental Health published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.
Références
Angold, A., Costello, E.J., Messer, S.C., Pickles, A., Winder, F., & Silver, D. (1995). The development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. International Journal of Methods in Psychiatric Research, 5, 237-249.
Barton, P., Brooks, M., Davies, S., Flynn, T., & Wood, V. (2008). From CORE-OM to CORE-LD through participatory research. Clinical Psychology and People with Learning Disabilities, 6, 27-28.
Bordin, I.A., Rocha, M.M., Paula, C.S., Teixeira, M.C., Achenbach, T.M., Rescorla, L.A., & Silvares, E.F. (2013). Child Behavior Checklist (CBCL), Youth Self-Report (YSR) and Teacher's Report Form (TRF): An overview of the development of the original and Brazilian versions. Cadernos De Saude Publica, 29, 13-28.
Campbell, A., & Hemsley, S. (2009). Outcome Rating Scale and Session Rating Scale in psychological practice: Clinical utility of ultra-brief measures. Clinical Psychologist, 13, 1-9.
Casey, P., Patalay, P., Deighton, J., Miller, S.D., & Wolpert, M. (2020). The Child Outcome Rating Scale: Validating a four-item measure of psychosocial functioning in community and clinic samples of children aged 10-15. European Child & Adolescent Psychiatry, 29, 1089-1102.
Chorpita, B.F., Yim, L., Moffitt, C., Umemoto, L.A., & Francis, S.E. (2000). Assessment of symptoms of DSM-IV anxiety and depression in children: A revised child anxiety and depression scale. Behaviour Research and Therapy, 38, 835-855.
Dawson, J., Doll, H., Fitzpatrick, R., Jenkinson, C., & Carr, A.J. (2010). The routine use of patient reported outcome measures in healthcare settings. British Medical Journal, 340, c186.
Deighton, J., Croudace, T., Fonagy, P., Brown, J., Patalay, P., & Wolpert, M. (2014). Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: A review of child self-report measures. Child and Adolescent Psychiatry and Mental Health, 8, 14.
Deighton, J., Tymms, P., Vostanis, P., Belsky, J., Fonagy, P., Brown, A., … & Wolpert, M. (2013). The development of a school-based measure of child mental health. Journal of Psychoeducational Assessment, 31, 247-257.
Dooley, B., Fitzgerald, A., & Giollabhui, N.M. (2015). The risk and protective factors associated with depression and anxiety in a national sample of Irish adolescents. Irish Journal of Psychological Medicine, 32, 93-105.
Evans, C., Mellor-Clark, J., Margison, F., Barkham, M., Audin, K., Connell, J., & McGrath, G. (2000). CORE: Clinical Outcomes in Routine Evaluation. Journal of Mental Health, 9, 247-255.
Ford, T., Tingay, K., Wolpert, M., & CORC Steering Group. (2006). CORC's survey of routine outcome monitoring and national CAMHS dataset developments: A response to Johnston and Gower. Child and Adolescent Mental Health, 11, 50-52.
Gilligan, C., Sresthaporn, N., & Mulligan, A. (2022). COVID-19 and mental health of primary school children: Comparison of 2019 and 2020. Child: Care, Health and Development. https://doi.org/10.1111/cch.13001 Epub ahead of print.
Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1337-1345.
Goodman, R., Ford, T., Simmons, H., Gatward, R., & Meltzer, H. (2000). Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. The British Journal of Psychiatry, 177, 534-539.
Harley, M.E., Connor, D., Clarke, M.C., Kelleher, I., Coughlan, H., Lynch, F., … & Cannon, M. (2015). Prevalence of mental disorder among young adults in Ireland: a population based study. Irish Journal of Psychological Medicine, 32, 79-91.
Loranger, H., & Nielsen, J. (2006). Prioritizing web usability. Indianapolis, IN: New Riders Publishing.
McMahon, E.M., O'Regan, G., Corcoran, P., Arensman, E., Cannon, M., Williamson, E., & Keeley, H. (2017). Young lives in Ireland: A school-based study of mental health and suicide prevention. Cork, Ireland: National Suicide Research Foundation Available from: https://nsrf.ie/wp-content/uploads/reports/NSRF%20SEYLE%20Report.pdf [last accessed 24 June 2021]
Meltzer, H., Gatward, R., Goodman, R., & Ford, T. (2003). Mental health of children and adolescents in Great Britain. International Review of Psychiatry, 15, 185-187.
Morris, A.C., Macdonald, A., Moghraby, O., Stringaris, A., Hayes, R.D., Simonoff, E., … & Downs, J.M. (2021). Sociodemographic factors associated with routine outcome monitoring: a historical cohort study of 28,382 young people accessing child and adolescent mental health services. Child and Adolescent Mental Health, 26, 56-64.
Steer, R.A., Kumar, G., Beck, J.S., & Beck, A.T. (2001). Evidence for the construct validities of the Beck Youth Inventories with child psychiatric outpatients. Psychological Reports, 89, 559-565.
Stewart, D.W., Shamdasani, P.N., & Rook, D.W. (2007). Applied social research methods: Focus groups. Thousand Oaks, CA: SAGE Publications, Ltd.
Theunissen, M.H.C., de Wolff, M.S., & Reijneveld, S.A. (2019). The Strengths and Difficulties Questionnaire Self-Report: A Valid Instrument for the Identification of Emotional and Behavioral Problems. Academic Pediatrics, 19, 471-476.
Twigg, E., Barkham, M., Bewick, B.M., Mulhern, B., Connell, J., & Cooper, M. (2009). The Young Person's CORE: Development of a brief outcome measure for young people. Counselling and Psychotherapy Research, 9, 160-168.
Wasserman, D. (2016). Review of health and risk-behaviours, mental health problems and suicidal behaviours in young Europeans on the basis of the results from the EU-funded Saving and Empowering Young Lives in Europe (SEYLE) study. Psychiatria Polska, 50, 1093-1107.
Wolpert, M., Ford, T., Trustam, E., Law, D., Deighton, J., Flannery, H., & Fugard, A. (2012). Patient reported outcomes in child and adolescent mental health services (CAMHS): Use of idiographic and standardized measures. Journal of Mental Health, 21(2), 165-173. https://doi.org/10.3109/09638237.2012.664304
Wolpert, M., Fugard, A., Deighton, J., & Görzig, A. (2012). Routine outcomes monitoring as part of children and young people's Improving Access to Psychological Therapies (CYP IAPT) - improving care or unhelpful burden? Child and Adolescent Mental Health, 17, 129-130.
Zisook, S., Lesser, I., Stewart, J.W., Wisniewski, S.R., Balasubramani, G.K., Fava, M., … & Rush, A.J. (2007). Effect of age at onset on the course of major depressive disorder. The American Journal of Psychiatry, 164, 1539-1546.