Intervention fidelity assessment: A sub-study of the Norfolk Diabetes Prevention Study (NDPS).
NDPS
behaviour change
intervention fidelity
lifestyle intervention
type 2 diabetes
Journal
British journal of health psychology
ISSN: 2044-8287
Titre abrégé: Br J Health Psychol
Pays: England
ID NLM: 9605409
Informations de publication
Date de publication:
09 2023
09 2023
Historique:
received:
10
05
2022
accepted:
20
01
2023
medline:
10
8
2023
pubmed:
13
2
2023
entrez:
12
2
2023
Statut:
ppublish
Résumé
Previous research has shown that lifestyle modification can delay or prevent the onset of type 2 diabetes in high-risk individuals. The Norfolk Diabetes Prevention Study (NDPS) was a parallel, three-arm, randomized controlled trial with up to 46 months follow-up that tested a group-delivered, theory-based lifestyle intervention to reduce the incidence of type 2 diabetes in high-risk groups. The current study aimed to evaluate if the NDPS intervention was delivered to an acceptable standard and if any part(s) of the delivery required improvement. A sub-sample of 30, 25 for inter-rater reliability and audio-recordings of the NDPS intervention education sessions were assessed independently by two reviewers (CT, TW) using a 12-item checklist. Each item was scored on a 0-5 scale, with a score of 3 being defined as 'adequate delivery'. Inter-rater reliability was assessed. Analysis of covariance (ANCOVA) was used to assess changes in intervention fidelity as the facilitators gained experience. Inter-rater agreement was acceptable (86%). A mean score of 3.47 (SD = .38) was achieved across all items of the fidelity checklist and across all intervention facilitators (n = 6). There was an apparent trend for intervention fidelity scores to decrease with experience; however, this trend was non-significant (p > .05) across all domains in this small sample. The NDPS was delivered to an acceptable standard by all Diabetes Prevention Facilitators. Further research is needed to better understand how the intervention's delivery characteristics can be optimized and how they might vary over time.
Sections du résumé
BACKGROUND
Previous research has shown that lifestyle modification can delay or prevent the onset of type 2 diabetes in high-risk individuals. The Norfolk Diabetes Prevention Study (NDPS) was a parallel, three-arm, randomized controlled trial with up to 46 months follow-up that tested a group-delivered, theory-based lifestyle intervention to reduce the incidence of type 2 diabetes in high-risk groups. The current study aimed to evaluate if the NDPS intervention was delivered to an acceptable standard and if any part(s) of the delivery required improvement.
METHODS
A sub-sample of 30, 25 for inter-rater reliability and audio-recordings of the NDPS intervention education sessions were assessed independently by two reviewers (CT, TW) using a 12-item checklist. Each item was scored on a 0-5 scale, with a score of 3 being defined as 'adequate delivery'. Inter-rater reliability was assessed. Analysis of covariance (ANCOVA) was used to assess changes in intervention fidelity as the facilitators gained experience.
RESULTS
Inter-rater agreement was acceptable (86%). A mean score of 3.47 (SD = .38) was achieved across all items of the fidelity checklist and across all intervention facilitators (n = 6). There was an apparent trend for intervention fidelity scores to decrease with experience; however, this trend was non-significant (p > .05) across all domains in this small sample.
CONCLUSION
The NDPS was delivered to an acceptable standard by all Diabetes Prevention Facilitators. Further research is needed to better understand how the intervention's delivery characteristics can be optimized and how they might vary over time.
Substances chimiques
N,N-di-n-propylserotonin
36288-75-2
Types de publication
Randomized Controlled Trial
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
740-752Informations de copyright
© 2023 The Authors. British Journal of Health Psychology published by John Wiley & Sons Ltd on behalf of British Psychological Society.
Références
Artinian, N. T., Fletcher, G. F., Mozaffarian, D., Kris-Etherton, P., Van Horn, L., Lichtenstein, A. H., Kumanyika, S., Kraus, W. E., Fleg, J. L., Redeker, N. S., Meininger, J. C., Banks, J., Stuart-Shor, E. M., Fletcher, B. J., Miller, T. D., Hughes, S., Braun, L. T., Kopin, L. A., Berra, K., … American Heart Association Prevention Committee of the Council on Cardiovascular Nursing. (2010). Interventions to promote physical activity and dietary lifestyle changes for cardiovascular risk factor reduction in adults: A scientific statement from the American Heart Association. Circulation, 122(4), 406-441.
Bellg, A. J., Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., Czajkowski, S., & Treatment Fidelity Workgroup of the NIH Behavior Change Consortium. (2004). Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH behavior change consortium. Health Psychology, 23(5), 443-451.
Borek, A. J., Abraham, C., Greaves, C. J., Gillison, F., Tarrant, M., Morgan-Trimmer, S., McCabe, R., & Smith, J. R. (2019). Identifying change processes in group-based health behaviour-change interventions: Development of the mechanisms of action in group-based interventions (MAGI) framework. Health Psychology Review, 13(3), 227-247.
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008). Developing and evaluating complex interventions: The new Medical Research Council guidance. British Medical Journal (Clinical Research Ed.), 337, a1655.
Cross, R., Greaves, C. J., Withall, J., Rejeski, W. J., & Stathi, A. (2022). Delivery fidelity of the REACT (REtirement in ACTion) physical activity and behaviour maintenance intervention for community dwelling older people with mobility limitations. BMC Public Health, 22, 1112. https://doi.org/10.1186/s12889-022-13496-z
Davies, M. J., Tringham, J. R., Troughton, J., & Khunti, K. K. (2004). Prevention of type 2 diabetes mellitus. A review of the evidence and its application in a UK setting. Diabetic Medicine: A Journal of the British Diabetic Association, 21(5), 403-414.
Daw, P., van Beurden, S. B., Greaves, C., van Zanten, J. J. V., Harrison, A., Dalal, H., McDonagh, S. T. J., Doherty, P. J., & Taylor, R. S. (2020). Getting evidence into clinical practice: Protocol for evaluation of the implementation of a home-based cardiac rehabilitation programme for patients with heart failure. BMJ Open, 10(6), e036137.
Diabetes UK. (2014). The cost of diabettes report V2.
Diabetes UK. (2019). Number of People with Diabetes Reaches 4.8 million 2020. https://www.diabetes.org.uk/about_us/news/diabetes-prevalence-2019
Dreyfus, S. E. (2004). The five-stage model of adult skill acquisition. Bulletin of Science Technology Society, 24(3), 177-181.
Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237-256.
French, D. P., Hawkes, R. E., Bower, P., & Cameron, E. (2021). Is the NHS Diabetes prevention Programme intervention delivered as planned? An observational study of Fidelity of intervention delivery. Annals of Behavioral Medicine, 55(11), 1104-1115.
Frost, J., Wingham, J., Britten, N., Greaves, C., Abraham, C., Warren, F. C., Jolly, K., Doherty, P. J., Miles, J., Singh, S. J., Paul, K., Taylor, R., & Dalal, H. (2019). Home-based rehabilitation for heart failure with reduced ejection fraction: Mixed methods process evaluation of the REACH-HF multicentre randomised controlled trial. BMJ Open, 9(8), e026039.
Garner, N. J., Pond, M., Auckland, S., & Sampson, M. (2022). Trained volunteers with type 2 Diabetes experience significant health benefits when providing peer support. Health Education & Behavior, 49(4), 667-679. https://doi.org/10.1177/10901981211048823
Gillies, C. L., Abrams, K. R., Lambert, P. C., Cooper, N. J., Sutton, A. J., Hsu, R. T., & Khunti, K. (2007). Pharmacological and lifestyle interventions to prevent or delay type 2 diabetes in people with impaired glucose tolerance: Systematic review and meta-analysis. British Medical Journal (Clinical Research Ed.), 334(7588), 299.
Greaves, C. (2012). Practical Psychology in Diabetes Care.
Greaves, C., Reddy, P., & Sheppard, K. (2010). Diabetes prevention in practice.
Hawkes, R. E., Cameron, E., Miles, L. M., & French, D. P. (2021). The Fidelity of training in behaviour change techniques to intervention Design in a National Diabetes Prevention Programme. International Journal of Behavioral Medicine, 28, 671-682.
Knäuper, B., Shireen, H., Carrière, K., Frayn, M., Ivanova, E., Xu, Z., Lowensteyn, I., Sadikaj, G., Luszczynska, A., Grover, S., & McGill CHIP Healthy Weight Program Investigators. (2020). The effects of if-then plans on weight loss: Results of the 24-month follow-up of the McGill CHIP healthy weight program randomized controlled trial. Trials, 21(1), 40.
Knowler, W. C., Barrett-Connor, E., Fowler, S. E., Hamman, R. F., Lachin, J. M., Walker, E. A., Nathan, D. M., & Diabetes Prevention Program Research Group. (2002). Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. The New England Journal of Medicine, 346(6), 393-403.
Kwasnicka, D., Dombrowski, S. U., White, M., & Sniehotta, F. (2016). Theoretical explanations for maintenance of behaviour change: A systematic review of behaviour theories. Health Psychology Review, 10(3), 277-296.
Lambert, J. D., Greaves, C. J., Farrand, P., Cross, R., Haase, A. M., & Taylor, A. H. (2017). Assessment of fidelity in individual level behaviour change interventions promoting physical activity among adults: A systematic review. BMC Public Health, 17(1), 765.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159-174.
Lindström, J., Ilanne-Parikka, P., Peltonen, M., Aunola, S., Eriksson, J. G., Hemiö, K., Hämäläinen, H., Härkönen, P., Keinänen-Kiukaanniemi, S., Laakso, M., Louheranta, A., Mannelin, M., Paturi, M., Sundvall, J., Valle, T. T., Uusitupa, M., Tuomilehto, J., & Finnish Diabetes Prevention Study Group. (2006). Sustained reduction in the incidence of type 2 diabetes by lifestyle intervention: Follow-up of the Finnish Diabetes prevention study. Lancet (London, England), 368(9548), 1673-1679.
Lindström, J., Louheranta, A., Mannelin, M., Rastas, M., Salminen, V., Eriksson, J., Uusitupa, M., Tuomilehto, J., & Finnish Diabetes Prevention Study Group. (2003). The Finnish Diabetes prevention study (DPS): Lifestyle intervention and 3-year results on diet and physical activity. Diabetes Care, 26(12), 3230-3236.
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., & Baird, J. (2015). Process evaluation of complex interventions: Medical Research Council guidance. British Medical Journal (Clinical Research Ed.), 350, 350.
Pascale, M., Murray, N., Bachmann, M., Barton, G., Clark, A., Howe, A., Greaves, C., & Sampson, M. (2017). Study protocol: The Norfolk Diabetes prevention study [NDPS]: A 46 month multi - Centre, randomised, controlled parallel group trial of a lifestyle intervention [with or without additional support from lay lifestyle mentors with type 2 diabetes] to prevent transition to type 2 diabetes in high risk groups with non - diabetic hyperglycaemia, or impaired fasting glucose. BMC Public Health, 17(1), 31.
Royal College of General Practitioners. (n.d.). Professional Topic Guides [cited 2022 28/04/2022]. https://www.rcgp.org.uk/training-exams/training/gp-curriculum-overview/professional-topic-guides.aspx#consulting
Sampson, M., Clark, A., Bachmann, M., Garner, N., Irvine, L., Howe, A., Greaves, C., Auckland, S., Smith, J., Turner, J., Rea, D., Rayman, G., Dhatariya, K., John, W. G., Barton, G., Usher, R., Ferns, C., Pascale, M., & Norfolk Diabetes Prevention Study (NDPS) Group. (2021). Lifestyle intervention with or without lay volunteers to prevent type 2 Diabetes in people with impaired fasting glucose and/or nondiabetic hyperglycemia: A randomized clinical trial. JAMA Internal Medicine, 181(2), 168-178.
Sampson, M., Elwell-Sutton, T., Bachmann, M. O., Clark, A., Dhatariya, K. K., Ferns, C., Howe, A., John, W. G., Rayman, G., Swafe, L., Turner, J., & Pascale, M. (2018). Discordance in glycemic categories and regression to normality at baseline in 10,000 people in a type 2 diabetes prevention trial. Scientific Reports, 8(1), 6240.
Sánchez, A., Rogers, H. L., Pablo, S., García, E., Rodríguez, I., Flores, M. A., Galarza, O., Gaztañaga, A. B., Martínez, P. A., Alberdi, E., Resines, E., Llarena, A. I., Grandes, G., & PREDIAPS Group. (2021). Fidelity evaluation of the compared procedures for conducting the PVS-PREDIAPS implementation strategy to optimize diabetes prevention in primary care. BMC Family Practice, 22(1), 34.
Schinckus, L., Van den Broucke, S., & Housiaux, M. (2014). Assessment of implementation fidelity in diabetes self-management education programs: A systematic review. Patient Education and Counseling, 96(1), 13-21.
Schwarzer, R. (2014). Self-efficacy: Thought control of action. Taylor & Francis.
Song, M.-K., Happ, M. B., & Sandelowski, M. (2010). Development of a tool to assess fidelity to a psycho-educational intervention. Journal of Advanced Nursing, 66(3), 673-682.
Thompson, T. P., Lambert, J. D., Greaves, C. J., & Taylor, A. H. (2018). Intervention delivery fidelity assessment of a counseling-based intervention for promoting smoking reduction and increasing physical activity. Health Psychology, 37(7), 627-637.
Timm, L., Karlsson, I., Sidney Annerstedt, K., Absetz, P., Forsberg, B. C., Daivadanam, M., & Mølsted Alvesson, H. (2021). Intervention Fidelity focusing on interaction between participants and facilitators in a telephone-delivered health coaching intervention for the prevention and Management of Type 2 Diabetes. Nutrients, 13(11), 3862.
Toomey, E., Hardeman, W., Hankonen, N., Byrne, M., McSharry, J., Matvienko-Sikar, K., & Lorencatto, F. (2020). Focusing on fidelity: Narrative review and recommendations for improving intervention fidelity within trials of health behaviour change interventions. Health Psychology and Behavioral Medicine, 8(1), 132-151.
Tuomilehto, J., Lindstrom, J., Eriksson, J. G., Valle, T. T., Hamalainen, H., Ilanne-Parikka, P., Keinänen-Kiukaanniemi, S., Laakso, M., Louheranta, A., Rastas, M., Salminen, V., Uusitupa, M., & Finnish Diabetes Prevention Study Group. (2001). Prevention of type 2 diabetes mellitus by changes in lifestyle among subjects with impaired glucose tolerance. The New England Journal of Medicine, 344(18), 1343-1350.
Walton, H., Spector, A., Williamson, M., Tombor, I., & Michie, S. (2020). Developing quality fidelity and engagement measures for complex health interventions. British Journal of Health Psychology, 25(1), 39-60.
Yates, T., Haffner, S. M., Schulte, P. J., Thomas, L., Huffman, K. M., Bales, C. W., Califf, R. M., Holman, R. R., McMurray, J. J. V., Bethel, M. A., Tuomilehto, J., Davies, M. J., & Kraus, W. E. (2014). Association between change in daily ambulatory activity and cardiovascular events in people with impaired glucose tolerance (NAVIGATOR trial): A cohort analysis. The Lancet, 383(9922), 1059-1066.