RESUMO

BACKGROUND: Systematic reviews on simulation training effectiveness have pointed to the need to adhere to evidence-based instructional design (ID) guidelines. ID guidelines derive from sound cognitive theories and aim to optimize complex learning (integration of knowledge, skills, and attitudes) and learning transfer (application of acquired knowledge and skills in the workplace). The purpose of this study was to explore adherence to ID guidelines in simulation training programs for dealing with postpartum hemorrhage (PPH), a high-risk situation and the leading cause of maternal mortality worldwide. METHODS: A total of 40 raters analyzed simulation training programs as described in 32 articles. The articles were divided into four subsets of seven articles and one subset of four articles. Each subset was judged by seven to ten raters on adherence to ID guidelines. The 5-point Likert score rating scale was based on Merrill's First Principles of Instruction and included items relating to key ID features categorized into five subscales: authenticity, activation of prior knowledge, demonstration, application, and integration/transfer. The authors searched for articles published in English between January 2007 and March 2017 in PubMed, Eric, and Google Scholar and calculated the mean Likert-scale score, per subscale, and interrater reliability (IRR). RESULTS: The mean Likert-scale scores calculated for all subscales were < 3.00. For the number of raters used to judge the papers in this study (varying between 7 and 10), the IRR was found to be excellent for the authenticity and integration/transfer subscales, good-to-excellent for the activation of prior knowledge and application subscales, and fair-to-good for the demonstration subscale. CONCLUSION: The results demonstrate a paucity of the description of adherence to evidence-based ID guidelines in current simulation trainings for a high-risk situation such as PPH.

RESUMO

Objective: To compare postpartum hemorrhage (PPH) patient outcomes before and after an in situ instructional design based PPH simulation attended by obstetrics and gynecology (OBGYN) residents.Methods: This uncontrolled before-and-after study was conducted in Recife, Brazil including all 1388 women delivering from June to August 2012 and all 1357 delivering from June to August 2013. The 36 OBGYN residents were divided into13 teams of two or three participants and were trained through ID based PPH simulation training with the following eight steps: (1) prior knowledge activation, (2) video demonstration, (3) dual-coding PPH protocol discussion-an image association during the training, (4) training scenario # 1, (5) debriefing, (6) training scenario # 2 with immediate feedback, (7) training scenario # 3, and (8) debriefing with self-assessment. The training scenarios had an increasing level of complexity. The main goal of the training was the adequate management of PPH and situational awareness improvement-the ability to anticipate, recognize, and intercept unfolding error chains. The primary patient outcomes rates used for the before and after comparison were therapeutic uterotonics use within 24 h of birth and blood transfusion. Secondary outcomes were therapeutic oxytocin mean dosage IU within 24 h of birth, postpartum Hb < 6 g/dL, among others. Chi-square test was used for categorical variables comparison and independent t-test for continuous variables.Results: PPH rates were 100 (7.2% of 2012 deliveries) and 80 cases (5.9% of 2013 deliveries), respectively. Comparison of primary post- and pre-simulation outcomes revealed no significant differences. However, in the comparison for therapeutic oxytocin mean dosage IU within 24 h of birth, there was an increase found after the simulation (15.98 ± 7.4 versus 25.1 ± 12.3; p < .001). For all other outcome measures, there were no statistical differences.Conclusions: In situ ID based PPH simulation leads to an increase in the mean dosage of oxytocin after training, in selected cases. This may indicate better situational awareness when managing women with PPH.

Assuntos

RESUMO

OBJECTIVE: To explore long-term transfer (application of acquired knowledge and skills on the job) after postpartum hemorrhage simulation training based on either instructional design (ID) principles or conventional best practice. METHODS: In this qualitative study, semi-structured interviews with obstetrics and gynecology healthcare practitioners were conducted between August 7 and September 26, 2015, in Recife, Brazil. The participants were randomly selected from each of two postpartum hemorrhage simulations attended 2 years earlier (one ID and one conventional best practice). Thematic analysis was used to explore (1) residents' perceptions of long-term transfer of learning, (2) ID elements influencing the perceived long-term transfer, and (3) differences in the participants' perceptions according to the type of simulation attended. RESULTS: There were 12 interview participants. After either simulation format, residents perceived long-term transfer effects. Training design factors influencing transfer were, in their opinion, related to trainees' characteristics, simulation design, and workplace environment. Trainees who participated in the ID-based simulation perceived better communication skills and better overall situational awareness: "I didn't do that before." CONCLUSION: All residents perceived long-term transfer after simulation training for postpartum hemorrhage. Those who attended the ID format additionally perceived improvements in communication skills and situational awareness, which are fundamental factors in the management of postpartum hemorrhage.

Assuntos

RESUMO

OBJECTIVE: To compare learning outcomes of postpartum hemorrhage simulation training based on either instructional design guidelines or best practice. METHODS: A pretest-post-test non-equivalent groups study was conducted among obstetrics and gynecology residents in Recife, Brazil, from June 8 to August 30, 2013. The instructional design group included 13 teams, whereas the best practice group included seven teams. A standardized task checklist was used for scenario analysis and the proportion of correctly executed tasks compared (post-test minus pretest). RESULTS: The instructional design group scored higher than the best practice group for total number of tasks completed (median difference 0.46 vs 0.17; P<0.001; effect size [r]=0.72). Similar results were observed for communication (median difference 0.56 vs 0.22; P=0.004; r=0.58), laboratory evaluation (median difference 0.83 vs 0.00; P<0.001; r=0.76), and mechanical management (median difference 0.25 vs -0.15; P=0.048; r=0.39). Speed of learning was also increased. The median differences were 0.20 for the instructional design group compared with 0.05 for the best practice group at 60 seconds (P=0.015; r=0.49), and 0.49 versus 0.26 (P=0.001; r=0.65) at 360 seconds. CONCLUSION: The use of simulation training for postpartum hemorrhage that was based on instructional design guidelines yielded better learning outcomes than did training based on best practice.

Assuntos

Assuntos

Assuntos

Assuntos

RESUMO

Reliability estimations of workplace-based assessments with the mini-CEX are typically based on real-life data. Estimations are based on the assumption of local independence: the object of the measurement should not be influenced by the measurement itself and samples should be completely independent. This is difficult to achieve. Furthermore, the variance caused by the case/patient or by assessor is completely confounded. We have no idea how much each of these factors contribute to the noise in the measurement. The aim of this study was to use a controlled setup that overcomes these difficulties and to estimate the reproducibility of the mini-CEX. Three encounters were videotaped from 21 residents. The patients were the same for all residents. Each encounter was assessed by 3 assessors who assessed all encounters for all residents. This delivered a fully crossed (all random) two-facet generalizability design. A quarter of the total variance was associated with universe score variance (28%). The largest source of variance was the general error term (34%) followed by the main effect of assessors (18%). Generalizability coefficients indicated that an approximate sample of 9 encounters was needed assuming a single different assessor per encounter and assuming different cases per encounter (the usual situation in real practice), 4 encounters when 2 raters were used and 3 encounters when 3 raters are used. Unexplained general error and the leniency/stringency of assessors are the major causes for unreliability in mini-CEX. To optimize reliability rater training might have an effect.

Assuntos

Assuntos

RESUMO

El mini-CEX (mini clinical evaluation exercise) es un instrumento de evaluación del desempeño profesional a través de la observación directa del residente mientras participa de un encuentro con un paciente, la valoración de una serie de habilidades y destrezas clínicas con posterior provisión de feedback o devolución en su ámbito de trabajo. Se centra en una serie de habilidades que el residente debe demostrar durante el encuentro con un paciente y requiere que el docente documente ese desempeño en seis competencias. Es fácil de aplicar por los docentes porque se integra bien a la rutina del día a día en los diferentes escenarios clínicos. El tiempo estimado de esta interacción no debe superar los 20 minutos y debe repetirse al menos 8 veces al año con cada residente por diferentes docentes. Es de vital importancia que los docentes definan de antemano qué competencias se van a evaluar y cuáles son los estándares de desempeño mínimo que deberán alcanzar los residentes. La confección de una base de datos con la información de los formularios completados nos permitirá monitorizar el proceso de evaluación y efectuar las medidas correctivas pertinentes.

The mini-CEX (mini clinical evaluation exercise) is a tool for the assessment of professional performance of residents through direct observation of resident-patient encounter, evaluating clinical skills and providing subsequent feedback in the work setting. The exam focuses on the evaluation of resident's skills during resident-patient encounter. The evaluator must document resident's performance in six areas of competence. The exam is easy to apply as it fits in real life settings in the different clinical scenarios. The evaluation should not take more than 20 minutes and each resident should have 8 mini-CEX per year of training with different faculties. Faculties should previously define the areas of competence to evaluate and the minimum performance standards residents should reach. All the completed forms should be used to construct a database in order to monitor the evaluation process and make the necessary corrections.

RESUMO

OBJECTIVES: A mandatory remedial programme for students who repeat their first semester at medical school has resulted in large gains in academic performance and greatly reduced attrition. Here, we explore the students' views of this in order to clarify understanding of optimal remediation practice. METHODS: Using a mixed-methods approach, quantitative and qualitative data were gathered from student surveys (n=333) and three in-depth focus groups. Results were analysed for emergent themes. RESULTS: Remedial programmes for at-risk medical students should be mandatory, but should respect students' identity as repeaters. Attitude and motivation are key, and working in stable groups provides essential emotional and cognitive support. The learning environment needs to foster changes in students' ways of thinking and their development as flexible, reflective learners. These endeavours require support from honest teachers with rigorous expectations and good facilitation skills. CONCLUSIONS: Successful remediation needs to challenge students' conceptions of learning, works best in groups with skilled facilitators, and must take into account a blend of cognitive and affective factors and the complex interplay between learner and environment. Given a carefully designed programme, at-risk medical students can learn to make effective and lasting changes to their approach to study, and their views of learning can come to converge with influential ideas in the education literature.

Assuntos

RESUMO

BACKGROUND: Many medical schools provide academic support programmes to aid increasing numbers of students from diverse backgrounds. There have been calls for research into successful intervention programmes, and for detailed descriptions of how they work. AIMS: To explore the efficacy of a mandatory intervention programme for at-risk medical students. METHOD: Students who failed and then repeated first semester were required to participate in a cognitive skills programme, following a syllabus based on principles drawn from both educational experience and multi-disciplinary theory and practice. Performance of programme participants was compared to the performance of students who repeated prior to the mandatory programme. RESULTS: Of the participants (n = 216), 91% passed their repeat semester, compared to 58% (n = 715) for controls (p < 0.0001). This significant effect persisted for progression through the school for the subsequent three semesters (p < 0.0005). CONCLUSION: A mandatory programme that draws on a blend of theories and research-proven techniques can make a positive difference to the outcomes for at-risk medical students.

Assuntos

RESUMO

AIMS: The purpose of the study was to determine the validity, reliability, feasibility and satisfaction of the Mini-CEX. METHODS AND RESULTS: From May 2003 to December 2004, 108 residents from 17 cardiology residency programs in Buenos Aires were monitored by the educational board of the Argentine Society of Cardiology. Validity was evaluated by the instrument's capability to discriminate between pre-existing levels of clinical seniority. For reliability, generalisability theory was used. Feasibility was defined by a minimum number of completed observations: 50% of the residents obtaining at least four Mini-CEX's. Satisfaction was evaluated through a one to nine rating scale from the evaluators, and residents' perspectives. The total number of encounters was 253. Regarding validity, Mini-CEX was able to discriminate significantly between residents of different seniority. Reliability analysis indicated that a minimum of ten evaluations are necessary to produce a minimally reliable inference, but more are preferable. Feasibility was poor: 15% of the residents were evaluated four or more times during the study period. High satisfaction ratings from evaluators' and residents' were achieved. CONCLUSION: Mini-CEX discriminates between pre-existing levels of seniority, requires considerable sampling to achieve sufficient reliability, and was not feasible within the current circumstances, but it was considered a valuable assessment tool as indicated by the evaluators' and residents' satisfaction ratings.

Assuntos