[Reliability and validity of a workbook for assessment of professional competencies of internal medicine residents]. / Évaluation multicentrique de la reproductibilité et de la validité d'un carnet d'évaluation des compétences professionnelles des internes de médecine interne.
Rev Med Interne
; 40(7): 419-426, 2019 Jul.
Article
en Fr
| MEDLINE
| ID: mdl-30871866
INTRODUCTION: Though several assessment tools for resident professional skills based on workplace direct observation have been validated, they remain scarcely used in France. The objective of this study was to evaluate the reliability and the validity of a workbook including several assessment forms for different components of the professional competency. METHODS: Three assessment forms have been tested over a period of 6 months in a multicentric study including 12 French internal medicine departments: the French version of the mini-CEX, an interpersonal skills assessment form (OD_CR) and the multisource feedback form (E_360). Reliability has been assess using the intra-class correlation coefficient (ICC) and the Cronbach alpha coefficient. Arguments for validity have been provided looking at the ability of the forms to detect an increase in the scores over time and according to the level of experience of the resident. RESULTS: Twenty-five residents have been included. The Cronbach alpha was of 0.90 (n=70) with the mini-CEX, 0.89 with the OD_CR (n=62) and 0.77 with the E_360 (n=86). ICC showed a wide variation according to the items of the mini-CEX and the OD-CR probably due to the poor number of observations performed by residents. The scores of most of the items of these two forms increased between M1 and M6. The scores of the E_360 were high: 7.3±0.8 to 8.3±2.4 (maximum 9) and did not vary according to the level of experience. CONCLUSION: This study suggest that it would be difficult to ensure a sufficient reliability for professional skills assessment using these tools given our available current human and material resources. However, these assessment forms could be added to the resident portfolio as supports for the debriefing in order to document their progression during their formation.
Palabras clave
Texto completo:
1
Colección:
01-internacional
Base de datos:
MEDLINE
Asunto principal:
Evaluación Educacional
/
Medicina Interna
/
Internado y Residencia
Tipo de estudio:
Clinical_trials
/
Evaluation_studies
/
Observational_studies
Límite:
Humans
País/Región como asunto:
Europa
Idioma:
Fr
Revista:
Rev Med Interne
Año:
2019
Tipo del documento:
Article
País de afiliación:
Francia
Pais de publicación:
Francia