Assessing Competence With a Task Trainer: Validity Evidence for Novel Tracheostomy Care Skills Assessment Tool.
Journal
Simulation in healthcare : journal of the Society for Simulation in Healthcare
ISSN: 1559-713X
Titre abrégé: Simul Healthc
Pays: United States
ID NLM: 101264408
Informations de publication
Date de publication:
01 Aug 2022
01 Aug 2022
Historique:
pubmed:
29
7
2021
medline:
6
8
2022
entrez:
28
7
2021
Statut:
ppublish
Résumé
The purpose of this study was to develop a caregiver and healthcare provider assessment tool to evaluate essential tracheostomy skills using a simulated task trainer. Three tracheostomy skill checklists were developed: closed suctioning, open suctioning, and tracheostomy change. Checklist items were developed based on institutional guidelines and a literature review. Items were revised based on iterative expert review and pilot testing. A total of 64 intensive care staff and 24 caregivers were evaluated using the checklists, of which 29 staff members and 4 caregivers were rated simultaneously by 2 raters to estimate interrater reliability. The relationships between checklist performance and staff demographics (experience and discipline) were calculated. A survey examining the selection of automatic fail items and minimum passing score was sent to 660 multidisciplinary staff members. Intraclass correlations were 0.93 for closed suctioning, 0.93 for open suctioning, and 0.76 for tracheostomy change. Staff performance only correlated with experience for the tracheostomy change checklist and was inconsistently associated with discipline (respiratory therapy vs nursing). A large, multidisciplinary survey with 132 of 660 respondents confirmed the selection of automatic fail items and minimum passing score. A total of 92.9% of the survey respondents agreed with a minimum passing score of 80%. We developed 3 essential tracheostomy skill checklists with multiple sources of validity evidence to support their use in a simulation-based assessment of tracheostomy skills.
Identifiants
pubmed: 34319269
doi: 10.1097/SIH.0000000000000597
pii: 01266021-202208000-00002
doi:
Types de publication
Journal Article
Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
220-225Informations de copyright
Copyright © 2021 Society for Simulation in Healthcare.
Déclaration de conflit d'intérêts
The authors declare no conflict of interest.
Références
Edwards JD, Kun SS, Keens TG. Outcomes and causes of death in children on home mechanical ventilation via tracheostomy: an institutional and literature review. J Pediatr 2010;157(6):955–959.e2. doi:10.1016/j.jpeds.2010.06.012.
doi: 10.1016/j.jpeds.2010.06.012
Kun SS, Edwards JD, Ward SL, Keens TG. Hospital readmissions for newly discharged pediatric home mechanical ventilation patients. Pediatr Pulmonol 2012;47(4):409–414. doi:10.1002/ppul.21536.
doi: 10.1002/ppul.21536
Day T, Farnell S, Haynes S, Wainwright S, Wilson-Barnett J. Tracheal suctioning: an exploration of nurses' knowledge and competence in acute and high dependency ward areas. J Adv Nurs 2002;39(1):35–45. doi:10.1046/j.1365-2648.2002.02240.x.
doi: 10.1046/j.1365-2648.2002.02240.x
Imaiso J, Yamauchi T. Caregiver suctioning education for Japanese patients with an invasive home ventilator. Nurs Health Sci 2009;11(4):422–429. doi:10.1111/j.1442-2018.2009.00469.x.
doi: 10.1111/j.1442-2018.2009.00469.x
Mitchell RB, Hussey HM, Setzen G, et al. Clinical consensus statement: tracheostomy care. Otolaryngol Head Neck Surg 2013;148(1):6–20. doi:10.1177/0194599812460376.
doi: 10.1177/0194599812460376
Boroughs DS. An evaluation of a continuing education program for family caregivers of ventilator-dependent children with spinal muscular atrophy (SMA). Children 2017;4(5):33. doi:10.3390/children4050033.
doi: 10.3390/children4050033
Szondy MV, Morton DE, Parrott HM, Bazzy-Asaad A, Tolomeo CT. Standardizing family education in a pediatric respiratory care unit. J Pediatr Nurs Nurs Care Child Fam 2014;29(3):272–278. doi:10.1016/j.pedn.2013.12.010.
doi: 10.1016/j.pedn.2013.12.010
Whalen M, Aebersold ML, Nelson K, Rooney DM. The feasibility and use of simulation to assess parent learning. Clin Simul Nurs 2020;38:23–26. doi:10.1016/j.ecns.2019.10.003.
doi: 10.1016/j.ecns.2019.10.003
Loerzel VW, Crosby WW, Reising E, Sole ML. Developing the tracheostomy care anxiety relief through education and support (T-CARES) program. Clin J Oncol Nurs 2014;18(5):522–527. doi:10.1188/14.CJON.522-527.
doi: 10.1188/14.CJON.522-527
Thrasher J, Baker J, Ventre KM, et al. Hospital to home: a quality improvement initiative to implement high-fidelity simulation training for caregivers of children requiring long-term mechanical ventilation. J Pediatr Nurs 2018;38:114–121. doi:10.1016/j.pedn.2017.08.028.
doi: 10.1016/j.pedn.2017.08.028
Tofil NM, Schier S, Benningfield B, et al. Tracheostomy education for parents utilizing simulation: a new paradigm in parental education. Pediatr Nurs 44(3):5.
Agarwal A, Marks N, Wessel V, et al. Improving knowledge, technical skills, and confidence among pediatric health care providers in the management of chronic tracheostomy using a simulation model. Pediatr Pulmonol 2016;51(7):696–704. doi:10.1002/ppul.23355.
doi: 10.1002/ppul.23355
Sterni LM, Collaco JM, Baker CD, et al. An official American Thoracic Society clinical practice guideline: pediatric chronic home invasive ventilation. Am J Respir Crit Care Med 2016;193(8):e16–e35. doi:10.1164/rccm.201602-0276ST.
doi: 10.1164/rccm.201602-0276ST
Rose L, McKim DA, Katz SL, et al. Home mechanical ventilation in Canada: a national survey. Respir Care 2015;60(5):695–704. doi:10.4187/respcare.03609.
doi: 10.4187/respcare.03609
Pritchett CV, Foster Rietz M, Ray A, Brenner MJ, Brown D. Inpatient nursing and parental comfort in managing pediatric tracheostomy care and emergencies. JAMA Otolaryngol Head Neck Surg 2016;142(2):132–137. doi:10.1001/jamaoto.2015.3050.
doi: 10.1001/jamaoto.2015.3050
Tofil NM, Rutledge C, Zinkan JL, et al. Ventilator caregiver education through the use of high-fidelity pediatric simulators: a pilot study. Clin Pediatr (Phila) 2013;52(11):1038–1043. doi:10.1177/0009922813505901.
doi: 10.1177/0009922813505901
Tolomeo CT, Major NE, Szondy MV, Bazzy-Asaad A. Standardizing care and parental training to improve training duration, referral frequency, and length of stay: our quality improvement project experience. J Pediatr Nurs 2017;32:72–79. doi:10.1016/j.pedn.2016.10.004.
doi: 10.1016/j.pedn.2016.10.004
Amin R, Parshuram C, Kelso J, et al. Caregiver knowledge and skills to safely care for pediatric tracheostomy ventilation at home. Pediatr Pulmonol 2017;52(12):1610–1615. doi:10.1002/ppul.23842.
doi: 10.1002/ppul.23842
Cook DA, Brydges R, Ginsburg S, Hatala R. A contemporary approach to validity arguments: a practical guide to Kane's framework. Med Educ 2015;49(6):560–575. doi:10.1111/medu.12678.
doi: 10.1111/medu.12678
Messick S. Validity. In: Linn R, ed. Educational Measurement . 3rd ed. New York, NY: American Council on Education and Macmillan; 1989:13–104.
Yudkowsky R. Performance tests. In: Downing S, Yudkowsky R, eds. Assessment in Health Professions Education . Routledge; 2009:217–243.
Myers E, Johnson J. Tracheotomy: Airway Management, Communication, and Swallowing . 2nd ed. San Diego, CA: Plural Publishing; 2008.
White GC. Basic Clinical Lab Competencies for Respiratory Care: Clifton Park, NY: An Integrated Approach . 4th ed. Delmar Learning; 2003.
Joseph RA. Tracheostomy in infants: parent education for home care. Neonatal Netw 2011;30(4):231–242. doi:10.1891/0730-0832.30.4.231.
doi: 10.1891/0730-0832.30.4.231
Nagi M, Kapoor S, Kaur S, Gupta SK. Effect of an intervention on performance regarding change of tracheostomy tube among the caregivers of the patient. Indian J Neurosurg 2014;3(1):31–35. doi:10.4103/2277-9167.132001.
doi: 10.4103/2277-9167.132001
Rn JC, Thompson DR, Chan D, et al. An evaluation of the implementation of a best practice guideline on tracheal suctioning in intensive care units. Int J Evid Based Healthc 2007;5(3):354–359. doi:10.1111/j.1479-6988.2007.00073.x.
doi: 10.1111/j.1479-6988.2007.00073.x
Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 1990;43(6):543–549.
Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess 1994;6(4):284–290. doi:10.1037/1040-3590.6.4.284.
doi: 10.1037/1040-3590.6.4.284
Smith KK, Gilcreast D, Pierce K. Evaluation of staff's retention of ACLS and BLS skills. Resuscitation 2008;78(1):59–65. doi:10.1016/j.resuscitation.2008.02.007.
doi: 10.1016/j.resuscitation.2008.02.007
The American Association for Public Opinion Research. Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys . 9th ed. 2016.