Developing and Gathering Validity Evidence for a Simulation-Based Test of Competencies in Lung Ultrasound.
Acute respiratory failure
Education
Respiratory symptoms
Training
Ultrasound
Virtual reality
Journal
Respiration; international review of thoracic diseases
ISSN: 1423-0356
Titre abrégé: Respiration
Pays: Switzerland
ID NLM: 0137356
Informations de publication
Date de publication:
Historique:
received:
14
08
2018
accepted:
11
09
2018
pubmed:
8
11
2018
medline:
22
8
2020
entrez:
8
11
2018
Statut:
ppublish
Résumé
Clinical lung ultrasound (LUS) is a fast bedside diagnostic tool which can assist clinicians in decisions regarding the treatment and monitoring of patients with respiratory symptoms. LUS training and education differ widely, and is often done in a clinical setting, with potential risks for patients if decisions are made based on the wrong interpretations. No clear guidelines or recommendations for objective and standardized assessment of LUS skills exist, and those that do are often based on a fixed time-frame or an arbitrary number of examinations performed; this does not ensure adequate competencies. The study aimed to develop and gather validity evidence for a practical, simulation-based test in LUS. Nine cases were developed in collaboration with 3D Systems Healthcare, Littleton, CO, USA, representing the most common diagnosis and sonographic findings in patients with respiratory symptoms. Thirty-six participants with different levels of competence in LUS, completed the test. The participants were divided into groups, i.e., novices, intermediates, and experienced, according to their experience with LUS, the number of examinations they had performed, and any research they had conducted. Their answers were used for item analyses. The intraclass correlation coefficient, Cronbachs' α, was 0.69 summarized, and there was a statistically significant difference (p < 0.001) between the novices and the trained participants (intermediates and experienced). A pass/fail score of 16 points was calculated according to the contrasting-groups method. We developed a test for the assessment of clinical competencies in LUS. The test proved solid validity evidence, and a pass/fail standard without any false-negatives, and only 2 explained false-positives.
Sections du résumé
BACKGROUND
BACKGROUND
Clinical lung ultrasound (LUS) is a fast bedside diagnostic tool which can assist clinicians in decisions regarding the treatment and monitoring of patients with respiratory symptoms. LUS training and education differ widely, and is often done in a clinical setting, with potential risks for patients if decisions are made based on the wrong interpretations. No clear guidelines or recommendations for objective and standardized assessment of LUS skills exist, and those that do are often based on a fixed time-frame or an arbitrary number of examinations performed; this does not ensure adequate competencies.
OBJECTIVES
OBJECTIVE
The study aimed to develop and gather validity evidence for a practical, simulation-based test in LUS.
METHODS
METHODS
Nine cases were developed in collaboration with 3D Systems Healthcare, Littleton, CO, USA, representing the most common diagnosis and sonographic findings in patients with respiratory symptoms. Thirty-six participants with different levels of competence in LUS, completed the test. The participants were divided into groups, i.e., novices, intermediates, and experienced, according to their experience with LUS, the number of examinations they had performed, and any research they had conducted. Their answers were used for item analyses.
RESULTS
RESULTS
The intraclass correlation coefficient, Cronbachs' α, was 0.69 summarized, and there was a statistically significant difference (p < 0.001) between the novices and the trained participants (intermediates and experienced). A pass/fail score of 16 points was calculated according to the contrasting-groups method.
CONCLUSION
CONCLUSIONS
We developed a test for the assessment of clinical competencies in LUS. The test proved solid validity evidence, and a pass/fail standard without any false-negatives, and only 2 explained false-positives.
Identifiants
pubmed: 30404101
pii: 000493758
doi: 10.1159/000493758
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
329-336Informations de copyright
© 2018 S. Karger AG, Basel.