The challenges of assessing sample representativeness within community-based evaluations of parenting programmes delivered in England and Ireland.
England
Ireland
external validity
generalisability
parenting
representativeness
trials
Journal
Health & social care in the community
ISSN: 1365-2524
Titre abrégé: Health Soc Care Community
Pays: England
ID NLM: 9306359
Informations de publication
Date de publication:
07 2022
07 2022
Historique:
revised:
02
06
2021
received:
19
11
2020
accepted:
27
07
2021
pubmed:
26
8
2021
medline:
9
6
2022
entrez:
25
8
2021
Statut:
ppublish
Résumé
The findings from evaluations of parenting programmes can help inform policy and practice decisions, including how best to allocate scarce resources designed to support families. However, studies often fail to consider the extent to which the findings can be generalised to other settings or populations. One, yet unexplored solution, is to compare study findings and large-scale data sets including publicly available population data. The aims of this study were to assess the feasibility of assessing sample representativeness using publicly available data and to identify the challenges involved in considering the generalisability of study findings. Sociodemographic data from two community-based evaluations of parenting programmes conducted in England and Ireland between 2015 and 2018 were used in the study (N = 395 parent-infant dyads). The results indicated some differences between the trial samples and the wider population. However, it is difficult to reach definitive conclusions about these findings due to the limitations associated with using the comparative data sets. Our study revealed three key challenges, including: (1) how best to define and conceptualise representativeness; (2) the availability of comparative data sets; and (3) the quality of the available data. Our study suggests that there is a need for up-to-date, good-quality comparative data sets to allow for the assessment of representativeness. Further work is required to identify parameters for making claims about representativeness, specifically regarding the acceptable level of difference between the target population and the study sample. This is the first study to explore the feasibility of using publicly available population data in two jurisdictions, for the purpose of making judgements about the representativeness of the findings from parent programmes. It is hoped that our results will encourage further investigation around the reporting of trial external validity to enable effective decision-making at policy and practice level.
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
e1278-e1289Informations de copyright
© 2021 John Wiley & Sons Ltd.
Références
Atkins, D., Eccles, M., Flottorp, S., Guyatt, G. H., Henry, D., Hill, S., Liberati, A., O'Connell, D., Oxman, A. D., Phillips, B., Schünemann, H., Edejer, T.-T., Vist, G. E., & Williams, J. W.; The GRADE Working Group (2004). Systems for grading the quality of evidence and the strength of recommendations I: Critical appraisal of existing approaches The GRADE Working Group. BMC Health Services Research, 4, 38-45. https://doi.org/10.1186/1472-6963-4-38
Blower, S., Gridley, N., Dunn, A., Bywater, T., Hindson, Z., & Bryant, M. (2019). Psychometric properties of parent outcome measures used in RCTs of antenatal and early years parent programs: A systematic review. Clinical Child and Family Psychology Review, 22(3), 367-387. https://doi.org/10.1007/s10567-019-00276-2
Bundy, D. A. P., de Silva, N., Horton, S., Patton, G. C., Schultz, L., Jamison, D. T., Abubakara, A., Ahuja, A., Alderman, H., Allen, N., Appleby, L., Aurino, E., Azzopardi, P., Baird, S., Banham, L., Behrman, J., Benzian, H., Bhalotra, S., Bhutta, Z., Black, M., … Sawyer, S. M. (2018). Investment in child and adolescent health and development: Key messages from Disease Control Priorities. The Lancet, 391(10121), 687-699. https://doi.org/10.1016/S0140-6736(17)32417-0
Bywater, T., Berry, V., Blower, S. L., Cohen, J., Gridley, N., Kiernan, K., Mandefield, L., Mason-Jones, A., McGilloway, S., McKendrick, K., Pickett, K., Richardson, G., Dawn Teare, M., Tracey, L., Walker, S., Whittaker, K., Wright, J. (2018). Enhancing Social-Emotional Health and Wellbeing in the Early Years (E-SEE): A study protocol of a community-based randomised controlled trial with process and economic evaluations of the incredible years infant and toddler parenting programmes, delivered in a proportionate universal model. British Medical Journal Open, 8(12), e026906.
Candy, B., Vickerstaff, V., Jones, L., & King, M. (2018). Description of complex interventions: Analysis of changes in reporting in randomised trials since 2002. Trials, 19(1), 110. https://doi.org/10.1186/s13063-018-2503-0
Central Statistics Office. (2014). Census data. Retrieved from https://www.cso.ie/en/census/
Central Statistics Office. (2016). Census data. Retrieved from https://www.cso.ie/en/census/
Central Statistics Office. (2016). Small area population statistics. Retrieved from https://www.cso.ie/en/census/census2016reports/census2016smallareapopulationstatistics/
Connelly, R., & Platt, L. (2014). Cohort profile: UK millennium Cohort study (MCS). International Journal of Epidemiology, 43(6), 1719-1725. https://doi.org/10.1093/ije/dyu001
Des Jarlais, D. C., Lyles, C., & Crepaz, N. (2004). Improving the reporting quality of nonrandomised evaluations of behavioural and public health interventions. The TREND Statement. American Journal of Public Health, 94, 361-366.
Eldridge, S., Ashby, D., Bennett, C., Wakelin, M., & Feder, G. (2008). Internal and external validity of cluster randomised trials: Systematic review of recent trials. British Medical Journal, https://doi.org/10.1136/bmj.39517.495764.25
Elliott, J., & Shepherd, P. (2006). Cohort profile: 1970 British birth cohort (BCS70). International Journal of Epidemiology, 35(4), 836-843. https://doi.org/10.1093/ije/dyl174
Feinberg, M. E., Jones, D. E., Kan, M. L., & Goslin, M. C. (2010). Effects of family foundations on parents and children: 3.5 years after baseline. Journal of Family Psychology, 24, 532-542. https://doi.org/10.1037/a0020837
Fixsen, D. L., Blasé, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work in Practice, 19, 531-540. https://doi.org/10.1177/1049731509335549
Hickey, G., McGilloway, S., Furlong, M., Leckey, Y., Bywater, T., & Donnelly, M. (2016). Understanding the implementation and effectiveness of a group-based early parenting intervention: A process evaluation protocol. BMC Health Services Research, 16, https://doi.org/10.1186/s12913-016-1737-3
Hickey, G., McGilloway, S., Leckey, Y., Furlong, M., Leavy, S., Stokes, A., O’Connor, S., Bywater, T., & Donnelly, M. (2019). Mothers’ wellbeing, parenting attitudes and home environment: Cumulative risk and parity in early motherhood. Child: Care, Health and Development, 45(4), 523-530. https://doi.org/10.1111/cch.12677
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., Lamb, S. E., Dixon-Woods, M., McCulloch, P., Wyatt, J. C., Chan, A.-W., & Michie, S. (2014). Better reporting of interventions: Template for intervention description and replication (TIDieR) checklist and guide. British Medical Journal, 348, g1687. https://doi.org/10.1136/bmj.g1687
Hurt, L., Paranjothy, S., Lucas, P. J., Watson, D., Mann, M., Griffiths, L. J., Ginja, S., Paljarvi, T., Williams, J. O., Bellis, M. A., & Lingam, R. (2018). Interventions that enhance health services for parents and infants to improve child development and social and emotional well-being in high income countries: A systematic review. British Medical Journal Open, 8, e014899. https://doi.org/10.1136/bmjopen-2016-014899
Kennedy-Martin, T., Curtis, S., Faries, D., Robinson, S., & Johnston, J. (2015). A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results. Trials, 16, 495-509. https://doi.org/10.1186/s13063-015-1023-4
Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606-613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x
Leviton, L. C. (2017). Generalizing about public health interventions: A mixed-methods approach to external validity. Annual Review of Public Health, 38, 371-391. https://doi.org/10.1146/annurev-publhealth-031816-044509
Lindsay, G., & Totsika, V. (2017). The effectiveness of universal parenting programmemes: The CANparent trial. BMC Psychology, 5, 35.
Marmot, M., Allen, J., Goldblatt, P., Boyce, T., McNeish, D., Grady, M., & Geddes, I. (2010). Fair Society, Healthy Lives. The Marmot Report. Retrieved from https://www.instituteofhealthequity.org/resources-reports/fairsociety-healthy-lives-the-marmot-review/fair-society-healthy-lives-full-report-pdf.pdf
Millard, J. D., Muhangi, L., Sewankambo, M., Ndibazza, J., Elliott, A. M., & Webb, E. L. (2014). Assessing the external validity of a randomized controlled trial of anthelminthics in mothers and their children in Entebbe, Uganda. Trials, 15(1), 310. https://doi.org/10.1186/1745-6215-15-310
Murad, M. H., Katabi, A., Benkhadra, R., & Montori, V. M. (2018). External validity, generalisability, applicability and directness: A brief primer. BMJ Evidence-Based Medicine, 23(1), 17. https://doi.org/10.1136/ebmed-2017-110800
Najafzadeh, M., & Schneeweiss, S. (2017). From trial to target populations-calibrating real-world data. New England Journal of Medicine, 376(13), 1203-1205. https://doi.org/10.1056/NEJMp1614720
Nixon, E., Swords, L., & Murray, A. (2013). Parenting and infant development. Stationery Office.
Office for National Statistics. (2011). 2011 Census. Retrieved from https://www.ons.gov.uk/census/2011census
Office for National Statistics. (2016). Births by usual area of residence in the UK. Retrieved from https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/livebirths/datasets/birthsbyareaofusualresidenceofmotheruk
Office for National Statistics. (2016). Families and household in the UK. Retrieved from https://www.ons.gov.uk/releases/familiesandhouseholdsintheuk2016
Office for National Statistics. (2016). Annual survey of hours and earnings. Retrieved from https://www.ons.gov.uk/employmentandlabourmarket/peopleinwork/earningsandworkinghours/bulletins/annualsurveyofhoursandearnings/2017provisionaland2016revisedresults
Olsen, R. B., Orr, L. L., Bell, S. H., & Stuart, E. A. (2013). External validity in policy evaluations that choose sites purposively. Journal of Policy Analysis and Management, 32, 107-121. https://doi.org/10.1002/pam.21660
Public Health England. (2019). Public Health Profiles. [13th December 2019]. https://fingertips.phe.org.uk
Rothwell, P. M. (2006). Factors that can affect the external validity of randomised controlled trials. PLOS Clinical Trials, 1, https://doi.org/10.1371/journal.pctr.0010009
Schulz, K. F., Altman, D. G., & Moher, D. (2010). CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised controlled trials. British Medical Journal, 340, https://doi.org/10.1136/bmj.c332
Stuart, E. A., Ackerman, B., & Westreich, D. (2018). Generalizability of randomized trial results to target populations: Design and analysis possibilities. Research on Social Work Practice, 28(5), 532-537. https://doi.org/10.1177/1049731517720730
Stuart, E. A., Bradshaw, C. P., & Leaf, P. J. (2015). Assessing the generalizability of randomized trial results to target populations. Prevention Science, 16(3), 475-485. https://doi.org/10.1007/s11121-014-0513-z
Tomlinson, M., Ward, C. L., & Marlow, M. (2015). Improving the efficiency of evidence-based interventions: The strengths and limitations of randomised controlled trials. South African Crime Quarterly, 51, 43-53. https://doi.org/10.4314/sacq.v51i1.5
Travers, J., Marsh, S., Williams, M., Weatherall, M., Caldwell, B., Shirtcliffe, P., Aldington, S., & Beasley, R. (2007). External validity of randomised controlled trials in asthma: To whom do the results of the trials apply? Thorax, 62, 219-223. https://doi.org/10.1136/thx.2006.066837
Webster-Stratton, C. (2010). The Incredible Years parenting programme’s user manual. Unpublished manuscript.