RESUMEN

Background: There is growing need for physician-innovators to address the mounting challenges within the US healthcare system. Despite this, there remains a significant gap in understanding of the efficacy of innovation programs for US MD candidates. We present initial program outcomes of a novel, clinically immersive medical innovation program offered to MD candidates at the David Geffen School of Medicine (DGSOM) at UCLA. Methods: A novel clinically immersive medical innovation curriculum was developed based on existing and reputable medical innovation frameworks and tailored for medical students. Curricular topics broadly included clinical ethnography, interviewing techniques, mind mapping, needs formulation and prioritization, quality improvement, intellectual property, reimbursement pathways, solution landscaping and prioritization, regulatory processes. The program was trialed during an unscheduled summer with voluntary enrollees from DGSOM Class of 2024. The traditional four-level Kirkpatrick model was employed to assess program outcomes. Results: Program outcomes were positive on all four Kirkpatrick levels. Students rated enjoyment at 9.5/10 for lectures and 9.1/10 for clinical immersion. Student-perceived confidence in key skills increased by 43%, and 75% of faculty directly perceived improvement in ethnographic skills. Students were highly engaged in both didactics and clinical immersion, discovering on average 2.6 faculty-verified needs per week. Faculty largely felt their students discovered important unmet clinical needs and added value to their clinical practice. Conclusion: We developed and trialed a novel clinically immersive medical innovation curriculum tailored for medical students. This program achieved positive outcomes on all four levels of the Kirkpatrick model. Our findings have driven the local adoption of this program into our institution's medical school curriculum. We hope that the program efficacy demonstrated herein catalyzes more institutions to trial similar medical innovation programs.

We conducted this investigation after recent literature identified a significant gap in our understanding of the role of innovation and entrepreneurship (I&E) programs in the United States (US) medical education. I&E programs are meant to teach the skills necessary to identify and assess ongoing challenges in health care and subsequently formulate a solution for such challenges. The rate of adoption of I&E programs into US medical education has been unexplainably slow, despite a strong reported interest among medical students in learning the associated topics. We sought to answer the question: how effectively can an I&E curriculum be integrated into the traditional US medical doctorate (M.D). curriculum? We designed a novel medical innovation program tailored for medical students and offered this six-week program to 16 M.D. candidates at UCLA during an unscheduled summer. By describing the curriculum in detail and presenting our holistic assessment of program outcomes including learners' feeling, learnings, transference of knowledge, and the program's real-world impact, we demonstrate methods by which medical innovation can effectively be taught to medical students and the impact this may have on our future physician workforce. Our implementation of a quality improvement conceptual framework examining multiple process measures enabled iterative and real-time improvement of the program throughout its offering. Our surveys were administered at regular intervals through the course, thereby allowing iterative feedback from enrolled students to drive course improvement, similar to how quality improvement frameworks incrementally improve outcomes through closed-loop feedback in health care settings. We posit that analogous medical innovation curricula should be increasingly integrated into MD curricula more broadly.

RESUMEN

The present study aims at ideating a quantitative protocol to evaluate effectiveness of training programmes especially meant for farmers, farm women, and rural youth. The specific objective was to develop a robust framework for measuring the effectiveness of rural training programmes organized by the Farmers Training Centres (FTCs) of India. Kirkpatrick's training evaluation model provides us the foundation to design a four-dimensional composite framework based on range-based indicator normalization, principal component analysis based indicator weight estimation, and rank correlation based framework sensitivity testing. We used cross-sectional primary data generated through household survey and personal interviews with randomly selected one thousand trainees to test and validate our proposed protocol. Applying it on our evaluation target we find that the degree of effectiveness of the training programmes varies; one in every four training programmes may not be effective. Trainees' reactions on various aspects of the training programmes may have positive and significant influence on learning. Training outcomes may be linked with the trainees' post-training changes in behaviour. A sensitivity test confirms that the proposed framework is not susceptible to changes in weighting schemes, implying robustness of indicator selection. The findings offer dissection of individual training programmes guiding policy decisions for a training organization. The proposed framework enriches the Kirkpatrick's training evaluation model by offering standardized indicators for training effectiveness evaluation.

Asunto(s)

RESUMEN

Introduction: The patient experience (PX) is central to improving the quality of healthcare services. We launched a PX capacity- and capability-building program at the Armed Forces Hospitals Taif Region, which is integral to our regional healthcare cluster transformation plans and is an initial step toward developing a culture of improvement in human experience in healthcare. Methods: A multidisciplinary PX committee recruited five frontline interprofessional PX heads, one from each of our regional healthcare hospitals. The Kirkpatrick model for program evaluation was used to assess the impact on four key levels: reaction, learning, behavior, and results. A pre-program competency assessment was conducted to evaluate the level of expertise across various PX competencies, and a program curriculum was developed accordingly. Participants underwent an intensive workshop-based PX capacity-building training program. A post-program competency assessment was performed along with a post-program survey. The PX-related activities led by interprofessional frontline PX heads at their respective hospitals' post-programs were tracked. The impact on the regional PX mean score across various settings, including inpatient, outpatient, and emergency settings, was measured using Press Ganey PX surveys. Our work is reported in accordance with the SQUIRE-EDU guidelines of the EQUATOR network. Results: The PX capacity-building program led to a significant improvement in participants' expertise across various PX competencies. Significant improvements beyond the strategic targets were observed in the PX mean score in inpatient departments pre-program (83.31) vs. post-program (86.34), with a p-value of < 0.001 across the regional healthcare system. Conclusion: The PX capacity-building program is a first step toward major cultural change amid the healthcare cluster transformation in our regional healthcare system. The Kirkpatrick model helps evaluate the impact of PX capacity- and capability-building training programs comprehensively through an organizational approach. Sustainable improvements in PX over a long period through a capacity-building program alone remain challenging.

RESUMEN

OBJECTIVE: To deliver and evaluate an educational intervention to equip health and social care professionals (professionals) on how best to support parents at end of life with cancer concerning their dependent children (<18). METHODS: An evidence-based and theory-driven face-to-face educational intervention was developed and evaluated using three levels of Kirkpatrick's Model of Evaluation. Pre-test, post-test surveys were completed immediately before-and-after the intervention using a validated self-efficacy scale and single-item questions evaluating perceived usefulness and relevance (levels one/two). Qualitative interviews ≥ 3-months post-intervention explored if, and how the intervention impacted professionals' practice (level three). Fourteen sessions were delivered at oncology settings to 347 professionals between 2021 and 2023. Two hundred seventy four professionals completed the pre-test survey, with 239 completing the post-test survey. Fourteen professionals were interviewed between three-and 19-months post-intervention. RESULTS: Quantitative findings demonstrated a statistically significant improvement in self-efficacy post-educational intervention (p < 0.001). Qualitative data highlighted professionals gained new approaches to progress end of life conversations with parents, despite some familial resistance to sharing the reality of the situation with children. Positive intervention content shaping clinical practice included the bereaved parent's lived experience, communication framework and roleplay videos. Some professionals considered a booster session and opportunities to practice conversations necessary to further consolidate learning into practice. CONCLUSIONS: Evidence and theory-driven education can positively impact professionals' provision of family-centred cancer care. Future studies should explore the impact of this educational intervention on familial outcomes. Alongside a sustainable delivery of this intervention, advanced communication skills programmes should incorporate parent-child end of life conversations.

Asunto(s)

RESUMEN

BACKGROUND: Mental disorders pose a major public health problem in most western countries. The demand for services for common mental health disorders has been on the rise despite the widespread accessibility of medication. Especially, the supply and demand for evidence-based psychotherapy do not align. Large-scale increase of modern psychotherapy is difficult with current methods of training which are often expensive, time consuming, and dependent on a small number of top-level professionals as trainers. E-learning has been proposed to enhance psychotherapy training accessibility, quality, and scalability. OBJECTIVE: This systematic review aims to provide an overview of the current evidence regarding e-learning in psychotherapy training. In particular, the review examines the usability, acceptability, and learning outcomes associated with e-learning. Learning outcomes are assessed in different modalities including trainee experiences, knowledge acquisition, skill acquisition, and application of trained content in daily practice. Furthermore, the equivalence of web-based training and conventional training methods is evaluated. METHODS: Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, a search from Ovid, MEDLINE, PsycINFO, and Scopus databases between 2008 and June 2022 was conducted. Inclusion criteria required studies to describe e-learning systems for psychotherapy training and assess acceptability, feasibility, or learning outcomes. The risk of bias was evaluated for both randomized and nonrandomized studies. Learning outcomes were categorized using the Kirkpatrick model. Effect sizes comparing e-learning and traditional methods were calculated. RESULTS: The search yielded 3380 publications, of which 34 fulfilled the inclusion criteria. Positive learning outcomes are generally associated with various e-learning programs in psychotherapy training including trainee satisfaction, knowledge, and skill acquisition, and in application of trained content in clinical practice. Learning outcomes generally show equivalence between e-learning and conventional training methods. The overall effect size, indicating this disparity, was 0.01, suggesting no significant difference. This literature displays a high level of heterogeneity in e-learning solutions and assessment methods. CONCLUSIONS: e-Learning seems to have good potential to enhance psychotherapy training by increasing access, scalability, and cost-effectiveness while maintaining quality in terms of learning outcomes. Results are congruent with findings related to e-learning in health education in general where e-learning as a pedagogy is linked to an opportunity to carry out learner-centric practices. Recommendations for conducting psychotherapy training programs in blended settings supported by activating learning methods are presented. However, due to the heterogeneity and limitations in the existing literature, further research is necessary to replicate these findings and to establish global standards for e-learning, as well as for the assessment of training outcomes in psychotherapy education. Research is especially needed on the effects of training on patient outcomes and optimal ways to combine e-learning and conventional training methods in blended learning settings.

Asunto(s)

RESUMEN

BACKGROUND: Faculty development programs are crucial for promoting continuous learning, enhancing teaching effectiveness, and encouraging professional growth among medical educators. Problem-based learning was introduced as a teaching strategy in our Faculty of Medicine in 2007. Thereafter, several rounds of a faculty development program were conducted to help teachers recognize their role as facilitators and assess areas for improvement. METHODS: We conducted a mixed-methods study with a sample of 284 third-year medical students answering a questionnaire and 21 faculty members participating in focus groups. A validated 13-item questionnaire was used to investigate the students' evaluation of their tutors' performance in problem-based learning. Three sessions were then conducted with faculty members involved in problem-based learning to gain in-depth insights into their experiences and perspectives. RESULTS: The mean performance ranking for tutors awarded by the students was above halfway. There was a significant positive correlation between tutors' performance ranking and all five of the learning approaches examined herein: constructive/active learning, self-directed learning, contextual learning, collaborative learning, and intra-personal behavior (p < 0.05). The data from the focus groups were analyzed under five broad themes: tutors' insights into their strengths and weaknesses, challenges in conducting problem-based learning, tutors' ways of preparing for problem-based learning, feedback, and suggestions for improving problem-based learning workshops. CONCLUSIONS: This study recommends improvements and future directions for advanced program evaluation. Faculty development programs can be tailored to effectively address students and faculty members' goals and needs, which can benefit the teaching and learning process and foster a culture of continuous improvement and professional growth.

Asunto(s)

RESUMEN

Purpose The portfolio can be used as a crucial tool for self-reflection, which allows us not only to showcase achievements but also course correct on our personal and professional journey. However, there is a significant lack of awareness among medical professionals about portfolios. Arranging a workshop to impart this knowledge could be a potential mitigation approach. This study aims to assess the impact of workshops on portfolios on students' and faculty's knowledge. In addition, the study also analyzes the effect of using rubrics on reflective writing skills. Method A portfolio workshop was organized for the medical faculty and students in the Bundelkhand Government Medical College, Sagar, M.P. The Kirkpatrick model of training evaluation along with a rubric for the evaluation of reflective writing skills were used to measure the effectiveness of the workshop. Pre and post-tests for the workshop, pre and post-reflective writing skills, and workshop feedback were collected using questionnaires. The Shapiro-Wilk test and the Wilcoxon signed rank test were applied to the data collected. Results Out of 89 registrations for the workshop, only 81 people consented to the workshop and participated in the study. The total number of faculty was only 17 and the rest were students from all the phases. Both the Shapiro-Wilk test and the Wilcoxon signed rank test showed a significantly small p-value, stating that there was a significant positive impact on the knowledge, perception, and effectiveness of the workshop. Conclusion This study clearly outlines the positive impact of conducting a workshop on portfolios. A significant increase in participants' knowledge of portfolios is identified. Similarly, employing rubrics has a significant increase in the quality of reflective writing skills.

RESUMEN

BACKGROUND: In this era of evidence-based medicine, only systematic research can help in providing judicious and precise healthcare to individual patients based on updated knowledge and skills. However, many medical professionals do not feel competent and confident enough to conduct research. One of the reasons could be the lack of a research-based curriculum in undergraduate courses. The National Medical Council has also stressed the need for formal training in research methodology for healthcare professionals. The research methodology workshops help to familiarize the participants with basic, clinical, and translational research required to impart optimum patient care. The objective of our study was to evaluate a research methodology workshop conducted for postgraduate students by assessing the participant's knowledge, feedback, and expected impact using Kirkpatrick's evaluation model. MATERIALS AND METHODS: A quasi-experimental, single-group study was conducted among 132 first-year postgraduate students. The four levels of Kirkpatrick's model were applied for evaluation. Feedback forms, scores of the pretest and posttest, quality of the research proposal drafted by the postgraduates for their thesis, and finally successful submission of the research proposal were the components used to evaluate the four levels of outcome of Kirkpatrick's model. STATISTICAL ANALYSIS: Data collected were compiled and tabulated into MS Excel. Proportions were calculated for categorical variables and mean and standard deviation (SD) for scores. A comparison of means between pre- and postworkshop scores was made with paired t-test. A value of P < 0.05 was considered statistically significant. Statistical analysis was done using IBM SPSS Statistics version 20.0 software. RESULTS: Out of 132 participants, 29% (38) were males and 71% (94) were females. The mean ± SD pretest and posttest scores at a 95% confidence interval were 10.55 ± 2.537 and 12.43 ± 2.484, respectively. The difference was found to be statistically significant by paired sample t-test (P < 0.001). CONCLUSION: Participant feedback is vital for improving research methodology workshops. The workshop met the overall requirements of the participants. There was a significant improvement in the knowledge of participants after the workshop completion.

RESUMEN

OBJECTIVE: The aim of this study was to determine whether a flipped classroom curriculum coupled with case-based learning would improve residents' perceptions of the learning environment, improve education outcomes, and increase faculty engagement. Research suggests that active learning yields better educational results compared with passive learning. However, faculty are more comfortable providing lectures that require only passive participation from learners. METHODS: A council was created to identify issues with the current format of the resident didactic curriculum and to redesign the neurosurgical curriculum and conference per Accreditation Council for Graduate Medical Education (ACGME) requirements. Trends from the authors' 2022 and 2023 ACGME Resident Surveys were tracked to assess changes in the organizational learning environment. Surveys of resident participants were conducted to assess learner satisfaction. RESULTS: Between July 2022 and June 2023, the authors gathered 127 survey responses from neurosurgical residents. The majority of respondents, comprising 50.4% (n = 64), were postgraduate year (PGY)-4 and PGY-5 residents. Sixty-six percent (n = 84) reported that the new format ranked within the top third of sessions they had experienced. On analysis of trends from these 2022 and 2023 ACGME Resident Surveys, the authors observed a positive trajectory in various key components. Notably, there was an upward trend in achieving an appropriate balance between service and education, in the availability of protected time for structured learning, faculty engagement and interest in education, and amount of clinical and didactic teaching. CONCLUSIONS: The results of this study suggest that this innovative educational model can have a positive impact on residents' perceptions of the learning environment, their educational outcomes, and faculty engagement. As residency education continues to evolve, the flipped classroom model offers an exciting avenue for enhancing the quality of residency education.

Asunto(s)

RESUMEN

BACKGROUND: Since June 2021, patients with hemophilia A with antifactor VIII inhibitors and those with severe hemophilia A without antifactor VIII inhibitors treated with Hemlibra have had to choose between a community or hospital pharmacy. The French reference center for hemophilia developed the HEMOPHAR e-learning program for community pharmacists for dispensing emicizumab. OBJECTIVE: This study aims to evaluate the efficiency and safety of this new care pathway by assessing the HEMOPHAR e-learning program. METHODS: The methodology is based on Kirkpatrick's model for evaluating the immediate reaction of trained community pharmacists (level 1), their level of acquired knowledge (level 2), and their professional practice after 3 months of dispensation (level 3). RESULTS: The HEMOPHAR e-learning program reached a large audience, with 67% (337/502) of the eligible community pharmacists following it. The immediate reaction was overall satisfying. High rates of engagement were reported with 63.5% (214/337) to 73.3% (247/337) of completed training modules, along with high rates of success with quizzes of 61.5% (174/337) to 95.7% (244/337). We observed that 83.9% (193/230) of the community pharmacists needed less than 2 attempts to pass the quiz of the module related to professional practice, while the other quizzes required more attempts. Advice on compliance and drug interactions were most frequently provided to patients by the community pharmacists. CONCLUSIONS: This study suggests ways to improve the training of community pharmacists and to optimize coordination with treatment centers. This study also reports on the feasibility of switching to a community pharmacy in a secure pharmaceutical circuit, including in the context of a rare bleeding disease. TRIAL REGISTRATION: ClinicalTrials.gov NCT05449197; https://clinicaltrials.gov/study/NCT05449197. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/43091.

RESUMEN

INTRODUCTION: The Educational Scholar Program (ESP) is designed and implemented as a longitudinal and institution-based faculty development program. The present study aimed to assess the effect of the ESP on educators' capabilities to undertake SoTL activities associated with their scholar role. METHODS: This study was conducted from 2017 to 2022. The participants (n = 64) were educators in six schools of Shahid Sadoughi University of Medical Sciences. The ESP was a faculty development program that consisted of training and project-based stages. The educators experienced small-group learning, self-directed learning, and reflective assignments in the training stage. In the second stage, the educators completed a SoTL (Scholarship of Teaching and Learning) project. Learner-related outcomes based on Kirkpatrick model was assessed. The reaction of educators (satisfaction, active participation in the ESP, and the perception of mentoring sessions) was assessed by three questionnaires (Reaction level). The educators' learning was evaluated by modified essay questions and their project reports (Learning and Behavior levels). Outputs of the ESP including journal publications, abstracts presented at meetings or congresses, grant funding, awards in educational festivals, promotions, projects with ongoing implementation following the ESP, and conducting further SoTL projects after ESP were assessed quantitatively over two years after participating in the ESP (Results level). Data were summarized by descriptive statistics (mean, percentage, SD, 95% Confidence Interval (CI)). Cut-off scores of the instruments was calculated with a standard setting method which introduced by Cohen-Schotanus and Van DerVleuten. Data analyzed by One-sample t-test. RESULTS: Sixty-four of 72 (89%) educators completed the ESP. The mean (CI) satisfaction score of educators was 42 (CI: 26.92-58.28), the active participation was 92 (CI: 80.24-103.76). The scores of the mentoring assessment from the perspective of the educators were reported at 90 (CI: 78.24- 101.76). The mean (95%CI) learning scores in the essay examination were 88 (CI: 70.36- 105.64), and project assessment were 90 (CI: 78.24- 101.76). The results showed the educators' scores in reaction and learning significantly higher than the cut-off scores. (P < 0.05). Most projects were conducted in curriculum development and assessment/evaluation domains. The number of projects with ongoing implementation over the two years following the ESP and the acquisition of grants was higher than other outputs in the results level. CONCLUSION: The ESP, as an institute-based longitudinal program, enhanced the learner-related outcomes (in four levels of reaction, learning, behavior, and results). The creation of practical learning and supportive mechanisms influenced on the results. The outcomes of ESP indicated that the educators prepared to conduct SoTL activities in their educational community.

Asunto(s)

RESUMEN

OBJECTIVES: Simulation is used across surgical specialties for skill enhancement. The choice and assessment method of a simulator varies across literature. In the age of endovascular approach, trainees have limited exposure to open lower limb bypass procedures which needs attention. This review aims to assess the utility of simulation training in lower limb bypass surgery using Kirkpatrick's model. METHODS: Using PRISMA statement, we included all the studies done on simulators in lower limb bypass surgical procedures for this systematic review. The primary outcome was to assess the effectiveness of different types of simulation used for lower limb bypass surgery using the Kirkpatrick's model for training evaluation. RESULTS: An initial search identified 295 articles out of which 7 articles were found to be eligible for this systematic review. A variety of simulators were used including cadavers and synthetic models. Most studies (n=5) found the use of simulation as an effective tool in achieving technical competence. All the five studies we found at level 2 on Kirpatrick's model evaluation. CONCLUSION: Most of the existing studies are at level 2 of Kirkpatrick's model which reflects learning changes in trainees after simulation. Feedback mechanism needs to be evolved where the improvement after simulation training can be gauged by its replication in clinical practice and improved patient care practices corresponding to the highest level of Kirkpatrick's model.

RESUMEN

AIM: This study evaluated an advanced care planning (ACP) training program incorporating online skills in shared decision making (SDM). METHOD: The New World Kirkpatrick Model was employed to assess the efficacy of the training program at four levels: reaction, learning, behavior, and results. Reaction measured the participants' satisfaction and difficulty with the training program alongside the status of support received from workplaces engaging in ACP. Learning evaluated the changes in SDM skills. Behavior assessed the changes in the relationship between patients and healthcare professionals when the latter were involved in the SDM process. Results evaluated whether the participants were willing to participate in ACP educational programs as a facilitator and whether their motivation for continuous learning changed through throughout the training program. The relationships among patients, healthcare providers, and third-party roles were analyzed in SDM role-playing via structural equation modeling (SEM). RESULTS: Between September 2020 and June 2022, 145 multidisciplinary participants completed the entirety of the training program. The most common responses to the training were "satisfied", "slightly difficult", and "I received some support from my workplace". The SDM skills significantly improved from the first to the third workshop, evaluated using the Wilcoxon rank-sum test. In the first workshop, SDM was primarily performed by healthcare providers; however, in the third workshop, patient-centered SDM was adopted. Of the participants who completed the program, 63% intended to participate in future ACP educational programs as ACP education facilitators. CONCLUSION: This study ascertained the validity of this training.

RESUMEN

PROBLEM: Little is known about the educational impact of providing routine, online feedback from women on midwifery student learning and clinical practice. BACKGROUND: Feedback on students' clinical performance has historically been provided by lecturers and clinical supervisors. Women's feedback is not routinely collected or evaluated for impact on student learning. AIM: To evaluate the impact of women's feedback about continuity of care experiences with a midwifery student on learning and practice. DESIGN: Descriptive, exploratory qualitative study. METHODS: All second-and third-year Bachelor of Midwifery students undertaking clinical placement between February and June 2022 at one Australian university, submitted formative, guided written reflections on de-identified women's feedback they received through their ePortfolio. Data were analysed using reflexive thematic analysis. FINDINGS: Forty-four of the 69 eligible students (64%) submitted reflections on feedback received. Three themes emerged: 1) Confidence boosting, 2) Deeply integrating Midwifery Metavalues, and 3) Enhancing commitment to continuity. Three subthemes: connection, future practice and advocacy were identified. Women's feedback positively impacts student learning and places the woman in the educational feedback loop. CONCLUSION: This study is an international first evaluating the impact of feedback from women on midwifery students' learning. Students reported greater confidence in their clinical practice, a deeper understanding of their midwifery philosophy, and an intention to advocate for, and work in, midwifery continuity models after graduation. Routine feedback about women's experiences should be embedded into midwifery education programs.

RESUMEN

Trainers often use information from previous learning sessions to design or redesign a course. Although universities conducted numerous research integrity training in the past decades, information on what works and what does not work in research integrity training are still scattered. The latest meta-reviews offer trainers some information about effective teaching and learning activities. Yet they lack information to determine which activities are plausible for specific target groups and learning outcomes and thus do not support course design decisions in the best possible manner. This article wants to change this status quo and outlines an easy-to-use taxonomy for research integrity training based on Kirkpatrick's four levels of evaluation to foster mutual exchange and improve research integrity course design. By describing the taxonomy for research integrity training (TRIT) in detail and outlining three European projects, their intended training effects before the project started, their learning outcomes, teaching and learning activities, and their assessment instruments, this article introduces a unified approach. This article gives practitioners references to identify didactical interrelations and impacts and (knowledge) gaps in how to (re-)design an RI course. The suggested taxonomy is easy to use and enables an increase in tailored and evidence-based (re-)designs of research integrity training.

Asunto(s)

RESUMEN

OBJECTIVE: The aim of this retrospective study was to evaluate a Dental Sleep Medicine Mini-Residency (DSMMR) continuing education (CE) program using the Kirkpatrick model. METHODS: After receiving ethical approval, data from participants in the 2019-2020 DSMMR CE course were included for the Kirkpatrick evaluation. The analysis was stratified and all the Kirkpatrick levels were integrated: level 1 (satisfaction) was assessed via Likert scale and open-ended questions; level 2 (learning) was evaluated using pretest and posttest knowledge data following Module 1 (M1) and an assessment of multiple-choice questions (MCQs) developed by participants; level 3 (behavior) was evaluated using Likert scale questions; and level 4 (results) was assessed via the percentage of participants who passed the American Board of Dental Sleep Medicine (ABDSM) examination on their first attempt. RESULTS: A total of 90 participants were included in the study. At least 83.1% of participants agreed/strongly agreed with positively worded statements about satisfaction. Knowledge scores significantly increased from pre-M1 to post-M1 (p < 0.001); however, only 15.2% of MCQs were evaluated as well-formulated. At least 88.6% of participants agreed/strongly agreed with positively worded statements about transfer of knowledge/skills to their practice. 91.1% passed the ABDSM examination on their first attempt. CONCLUSION: The evaluation of the 2019-2020 DSMMR using the Kirkpatrick model suggests its overall positive impact as a training program. The Kirkpatrick model provided information that can be used to improve the quality of a program. Future studies should assess other dental CE programs using the Kirkpatrick model or another evaluation model.

Asunto(s)

RESUMEN

BACKGROUND: Commercialized since 2019, emicizumab (Hemlibra) was available only in French hospital pharmacies for prophylaxis of hemophilia A with or without inhibitors. Since June 15, 2021, patients can choose between a hospital and community pharmacy. These changes in the care pathway have important organizational consequences for patients, their relatives, and health professionals. Two training programs are available for community pharmacists: the "HEMOPHAR" training program proposed by the national reference center for hemophilia and the Roche training program proposed by the laboratory that markets the product. OBJECTIVE: The PASODOBLEDEMI study aims to evaluate the direct impact of the training programs provided to community pharmacists in the context of the dispensing of emicizumab, and to evaluate patients' satisfaction with their treatment whether they choose dispensation from a community pharmacy or retained dispensation from the hospital pharmacy. METHODS: We designed a cross-sectional study based on the 4-level Kirkpatrick evaluation model: the immediate reaction of community pharmacists following training (Reaction), the knowledge acquired during the training (Learning), the professional practice of community pharmacists during dispensing of the product (Behavior), and patients' satisfaction related to the treatment whether it is dispensed from a hospital or from a community pharmacy (Results). RESULTS: Considering that single outcome measures cannot adequately reflect the complexity of this new organization, the Kirkpatrick evaluation model provides 4 distinct outcomes: the immediate reaction after the HEMOPHAR training program, the level of knowledge acquired after the HEMOPHAR training program, the impact of training on professional practice, and patient satisfaction with access to emicizumab. We developed specialized questionnaires for each of the 4 levels of the Kirkpatrick evaluation model. All community pharmacists involved in dispensing emicizumab, whether they have followed the HEMOPHAR or the Roche training program or neither, were eligible for inclusion. All patients with severe hemophilia A were eligible, irrespective of inhibitor use, age, treatment with emicizumab, and whether they chose dispensation from a community pharmacy or retained dispensation from a hospital pharmacy. CONCLUSIONS: The new organization for dispensing emicizumab to patients with hemophilia A in French community pharmacies must be accompanied by optimal safety and quality conditions due to the risk of serious and urgent bleeding situations in the management of rare bleeding diseases. The elaboration of the PASODOBLEDEMI protocol has already a positive impact with the commitment of all health professionals, physicians, hospital and community pharmacists, and the patient community. The results will be disseminated among the French authorities and will enable, if necessary, proposing this access model to other rare diseases. TRIAL REGISTRATION: ClinicalTrials.gov NCT05449197, https://clinicaltrials.gov/ct2/show/NCT05449197?term=NCT05449197; ClinicalTrials.gov NCT05450640, https://clinicaltrials.gov/ct2/show/NCT05450640?term=NCT05450640. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/43091.

RESUMEN

BACKGROUND@#This study aims to evaluate the effectiveness of the “Effective Written Communication Training” provided among 16 UP Manila administrative employees following Kirkpatrick's training evaluation model.@*OBJECTIVES@#This study specifically examines the reaction of the employees to the training program (Level 1), changes in the level of learning (Level 2), and transfer of training in the workplace or behavioral changes (Level 3).@*METHODOLOGY@#The study used a cross-sectional design, and the primary data was collected through survey questionnaires, a pretest, and a posttest. For the Level 1 evaluation, a training assessment survey was given to the participants. For the Level 2 evaluation, tests were given to the participants before and after the conduct of the training program. For the Level 3 evaluation, a survey questionnaire was given to the participants and their immediate supervisor five months after the end of the training.@*RESULTS@#The Level 1 results showed that the participants' overall reaction to the training was Excellent in terms of training design, facilitation, resource speaker/facilitator, and overall experience. For the Level 2 evaluation, results showed that there is a significant change (t(15)=11.32, ρ<0.05) in the participants' learning about written communication, as shown in the difference between the pretest (M=16.56, SD=3.01) and posttest scores (M=20.25, SD=2.49). Results of the Level 3 evaluation showed that written communication competencies have been applied to the workplace. Employees confidently compose written correspondences, construct formal and official letters, and relay queries using a more appropriate choice of words, which the participants' supervisors also observed.@*CONCLUSION@#Overall, the training program was found to be effective in improving the participants' written communication skills, following Kirkpatrick's training evaluation model.

RESUMEN

Background@#Sarcomas, a heterogenous group of malignancies consisting of tumors, are rarely encountered in most general oncology clinics. As a result, most general oncologists have very little experience in dealing with these tumors and resulting in poorer treatment and survival outcomes. Having successful collaborative efforts in research, the Asian Sarcoma Consortium (ASC) pioneered a Sarcoma Preceptorship Program with its main goal of increasing awareness of the multidisciplinary approach in the management of sarcomas.@*Objective@#The objective of this study is to evaluate the ASC Sarcoma Preceptorship Program using the first 2 levels of the Kirkpatrick Evaluation Model: Level 1) Reaction – through using satisfaction surveys; and Level 2) Knowledge – focusing on the amount of information gained from the activity evaluated by test-retest method.@*Methods@#The 2-day preceptorship program held in Singapore utilized educational activities such as didactic lectures, multidisciplinary case discussions, and case presentations. The program was evaluated using: 1) pre-test and posttest; 2) satisfaction survey from ASC; and 3) satisfaction survey made by the sponsor, Novartis Pharma.@*Results@#The preceptorship program enrolled 30 participants, most from the Asia-Pacific region. The overall results from the satisfaction surveys were generally optimistic, with results showing high levels of satisfaction with regard to the time allotment, scope of topics, and how helpful each session was. Test results showed that participants scored lower in post-test as compared to the pre-test. Computation of the Coefficient of Test reliability showed that although the pre-test was highly reliable, this was not true of the post-test.@*Conclusions@#Based on the Level 1 evaluation, the program was successful in terms of both participant and faculty satisfaction. However, certain areas for improvement were identified and recommendations were made in order to effect improvements for future iterations of this preceptorship.

Asunto(s)

RESUMEN

Objective To construct the evaluation index system for pharmacist training effectiveness in China. Methods The initial framework of index system based on Kirkpatrick evaluation model was constructed through literature research and expert interview method. Delphi method was used to analyze the index system. Results The evaluation index system for pharmacist training effectiveness in China included 4 first-level indicators, reaction evaluation, learning evaluation, behavior evaluation and result evaluation, 9 second-level indicators, training scheme, teaching staff, training conditions, theoretical knowledge, practical skills, the change of work ability, the change of professional attitude, personal income and organizational income, as well as 32 third-level indexes such as pharmaceutical professional knowledge. Conclusion This evaluation index system for pharmacist training result is highly scientific and systematic. It covers the whole-process and follow-up evaluation of the training activities. It can optimize the pharmacist training schedule and improve the program design for the effective pharmacist training evaluation.