[Reliability and validity of a workbook for assessment of professional competencies of internal medicine residents].
Évaluation multicentrique de la reproductibilité et de la validité d’un carnet d’évaluation des compétences professionnelles des internes de médecine interne.
Assessment tools
Competency
Compétence
Internes
Lieu d’exercice
Outils d’évaluation
Psychometric study
Residents
Workplace
Étude psychométrique
Journal
La Revue de medecine interne
ISSN: 1768-3122
Titre abrégé: Rev Med Interne
Pays: France
ID NLM: 8101383
Informations de publication
Date de publication:
Jul 2019
Jul 2019
Historique:
received:
30
07
2018
revised:
25
01
2019
accepted:
10
02
2019
pubmed:
16
3
2019
medline:
1
5
2020
entrez:
16
3
2019
Statut:
ppublish
Résumé
Though several assessment tools for resident professional skills based on workplace direct observation have been validated, they remain scarcely used in France. The objective of this study was to evaluate the reliability and the validity of a workbook including several assessment forms for different components of the professional competency. Three assessment forms have been tested over a period of 6 months in a multicentric study including 12 French internal medicine departments: the French version of the mini-CEX, an interpersonal skills assessment form (OD_CR) and the multisource feedback form (E_360). Reliability has been assess using the intra-class correlation coefficient (ICC) and the Cronbach alpha coefficient. Arguments for validity have been provided looking at the ability of the forms to detect an increase in the scores over time and according to the level of experience of the resident. Twenty-five residents have been included. The Cronbach alpha was of 0.90 (n=70) with the mini-CEX, 0.89 with the OD_CR (n=62) and 0.77 with the E_360 (n=86). ICC showed a wide variation according to the items of the mini-CEX and the OD-CR probably due to the poor number of observations performed by residents. The scores of most of the items of these two forms increased between M1 and M6. The scores of the E_360 were high: 7.3±0.8 to 8.3±2.4 (maximum 9) and did not vary according to the level of experience. This study suggest that it would be difficult to ensure a sufficient reliability for professional skills assessment using these tools given our available current human and material resources. However, these assessment forms could be added to the resident portfolio as supports for the debriefing in order to document their progression during their formation.
Identifiants
pubmed: 30871866
pii: S0248-8663(19)30051-7
doi: 10.1016/j.revmed.2019.02.003
pii:
doi:
Types de publication
Evaluation Study
Journal Article
Multicenter Study
Langues
fre
Sous-ensembles de citation
IM
Pagination
419-426Informations de copyright
Copyright © 2019 Société Nationale Française de Médecine Interne (SNFMI). Published by Elsevier Masson SAS. All rights reserved.