RESUMEN

Introduction: Literature demonstrates the detrimental impact of discrimination and microaggressions at personal and institutional levels in the health care workplace. Residents in our program requested curricula to help with addressing manifestations of bias. In response, we designed and implemented an adaptable and reproducible 4-hour virtual simulation session aimed at helping residents identify and constructively respond to microaggressions. Methods: This curriculum, influenced by a preceding needs assessment, was delivered to 68 senior internal medicine residents. It began with a didactic overview to establish foundational knowledge of bias. This was followed by a workshop focused on strategies to address microaggressions. The session culminated with skills practice in a virtual simulation activity where learners addressed microaggressions as bystanders in realistic case scenarios employing simulated participants. We administered pre- and postevaluation individual key-linked surveys assessing learner confidence in responding to microaggressions. Results: A total of 68 residents participated in the curriculum over two academic years, 27 of whom provided complete data for analysis. Overall, there was a statistically significant increase in learner confidence identifying microaggressions. As both a bystander and target/recipient of microaggressions, there were statistically significant increases in learner confidence addressing gender-based microaggressions, race-based microaggressions, and microaggressions reflecting other types of bias. Furthermore, there were statistically significant increases in learner confidence addressing microaggressions in low-acuity contexts, high-acuity contexts, across interprofessional disciplines, with a supervisor, and with a supervisee. Discussion: Our virtual experiential curriculum on responding to microaggressions can help increase learner confidence in addressing microaggressions.

Asunto(s)

RESUMEN

INTRODUCTION: The cochlear implant (CI) is crucial in developing hearing, speech, language, and communication skills in children with profound hearing loss (HL). The study aimed to assess how the age at which children receive a CI affects the development of pragmatic abilities between the ages of 5 and 8 for those who received a CI before or after the age of 3. METHODS: Forty children with CI were evaluated. The children between the ages of 5 and 8 were divided into two groups who received CIs before or after age 3. The Persian version of the Children's Communication Checklist (CCC) was used to assess pragmatic abilities with a parent rating scale. RESULTS: Children implanted under 3 got higher scores in social relationships, using context, conversational rapport, syntax, and speech. Also, their performance in inappropriate and stereotyped conversations was better than those over 3 years. They have a significant difference in the pragmatic composite than those who received CI over 3 except for coherence and interest (p < 0.05). CONCLUSION: According to the results, children with CI under 3 performed better in pragmatic composites, which means they have better pragmatic abilities. These findings suggest that early CI is important. Of course, other individual and environmental factors must also be considered.

RESUMEN

Introduction: Medical misinformation, which contributes to vaccine hesitancy, poses challenges to health professionals. Health professions students, while capable of addressing and advocating for vaccination, may lack the confidence to engage with vaccine-hesitant individuals influenced by medical misinformation. Methods: An interprofessional in-person simulation activity (90 minutes) using standardized patients was developed and instituted for students in medicine, nursing, pharmacy, and public health programs. Student volunteers were recruited from classes approximately halfway through their respective degree programs (i.e., second or third year of a 4-year program). Online simulation was used as a method to prepare for in-person simulation. Impact on students was assessed primarily through a postprogram student self-assessment. Results: A total of 220 students participated in the program; 206 (94%) had paired data available to analyze. Following program participation, self-assessed abilities increased from pre to post, from 2.8 out of 5 (good) to 3.9 out of 5 (very good; p < .001). Ninety-eight percent of students felt that their ability to address medical misinformation was somewhat/much better after the activity, compared to before, and that their ability to address vaccine hesitancy was somewhat/much better. The overall program was rated highly, with mean scores for each program evaluation item >4 out of 5 (very good). Discussion: An interprofessional cohort of students demonstrated improvement in self-assessed skills to participate in a conversation with an individual with hesitancy to receive vaccines and/or beliefs informed by misinformation. Students felt that this program was relevant and important to their professional development.

Asunto(s)

RESUMEN

AIM/OBJECTIVE: This review aims to examine and synthesize the existing literature on various teaching strategies for preparing nursing students to initiate conversations with patients with mental health concerns. BACKGROUND: The increase in adults experiencing mental illnesses each year in the United States emphasizes the need for proficient communication between healthcare workers and patients with mental health concerns. Nursing students have reported feeling anxious and uncomfortable initiating difficult conversations with patients who have mental illnesses or concerns thus, effective teaching strategies are essential to enhance their communication skills, confidence, and interactions. This scoping review aims to identify and evaluate educational interventions that can better prepare nursing students for these critical conversations. DESIGN: This scoping review follows PRISMA guidelines and the JBI Manual for Evidence Synthesis. METHOD: Scopus, Academic Search Elite, and CINAHL identified 96 potentially relevant articles published between 2013 and 2023. A total of 11 articles met the criteria for inclusion in this review. RESULTS: Three themes were identified: (1) peer learning, (2) blended learning, and (3) simulation learning. The findings of these articles indicate that simulation is the most widely used teaching strategy for preparing nursing students for mental health nursing. CONCLUSION: This review revealed important insight into how implementing various teaching strategies can affect nursing students' knowledge, skills, and attitudes when communicating with a patient with mental health concerns. Gaps in literature were identified for future research.

RESUMEN

OBJECTIVE: To explore the value of anonymous patient feedback for audiology students, examining alignment between student and patient judgments on communication skills and assessing how students utilise the feedback. DESIGN: This study utilised a mixed methods design, employing a Likert survey to collect patient and student ratings on professionalism, compassion, and listening and talking skills in clinical encounters. Semi-structured interviews investigated the student perspective of receiving patient feedback. STUDY SAMPLE: 13 Audiology students and 31 patients who were placed at, or received care at an Audiology teaching clinic. RESULTS: Patients' ratings across all measures were higher on average when compared to students' self-ratings, only correlating significantly for the measure concerning students' talking skills. Five themes and one subtheme were identified: Emotional impacts, A worthwhile experience, Contrasting priorities, Patients retake centre stage, and Self-reflective learners (subtheme Self-doubt). CONCLUSIONS: This study reveals that patient feedback led student Audiologists to report heightened seriousness in their interactions and increased attention on skills vital for patient-centred care. The process boosted students' confidence and reinforced awareness of the patient's perspective. Further research is needed to gauge the extent of these effects and explore the feasibility of implementing a large-scale patient feedback program in audiology training settings.

RESUMEN

In healthcare, effective communication in complex situations such as end of life conversations is critical for delivering high quality care. Whether residents learn from communication training with actors depends on whether they are able to select appropriate information or 'predictive cues' from that learning situation that accurately reflect their or their peers' performance and whether they use those cues for ensuing judgement. This study aimed to explore whether prompts can help medical residents improving use of predictive cues and judgement of communication skills. First and third year Kenyan residents (N = 41) from 8 different specialties were randomly assigned to one of two experimental groups during a mock OSCE assessing advanced communication skills. Residents in the intervention arm received paper predictive cue prompts while residents in the control arm received paper regular prompts for self-judgement. In a pre- and post- test, residents' use of predictive cues and the appropriateness of peer-judgements were evaluated against a pre-rated video of another resident. The intervention improved both the use of predictive cues in self-judgement and peer-judgement. Ensuing accuracy of peer-judgements in the pre- to post-test only partly improved: no effect from the intervention was found on overall appropriateness of judgements. However, when analyzing participants' completeness of judgements over the various themes within the consultation, a reduction in inappropriate judgments scores was seen in the intervention group. In conclusion, predictive cue prompts can help learners to concentrate on relevant cues when evaluating communication skills and partly improve monitoring accuracy. Future research should focus on offering prompts more frequently to evaluate whether this increases the effect on monitoring accuracy in communication skills.

RESUMEN

BACKGROUND AND PURPOSE: A Medication Therapy Management (MTM) encounter allows pharmacists to gather information to make appropriate assessments and recommendations regardless of the patient's language needs and the encounter environment utilized. With the goal of improving comfort and confidence in providing MTM services, working with an interpreter, and providing care in a virtual environment, students participated in a virtual MTM activity with English and non-English speaking patients. EDUCATIONAL ACTIVITY AND SETTING: In groups, students completed two MTM encounters during a virtual skills laboratory. Students were asked to complete a pre- and post-lab survey to gauge their confidence before and after completing these encounters. One encounter was with an English-speaking patient, and one was with a non-English speaking patient which utilized an interpreter for communication. Both encounters were completed using a virtual platform. FINDINGS: As a result of these activities, students reported improved confidence in providing MTM services to a patient who speaks a language different than themselves and managing patients using a virtual platform. Students self-identified that teamwork and pre-encounter preparation were essential for effective MTM services. SUMMARY: Students found completing virtual MTM was a beneficial way to improve comfort and confidence with navigating virtual platforms, gathering medication information, and working with interpreters.

RESUMEN

Introduction: Although the ACGME and other accrediting organizations are increasingly emphasizing the importance of clinical learning environments that value diversity, equity, and inclusion, faculty development surrounding behavioral skills that promote inclusivity in the learning environment still needs cultivation. We designed a virtual longitudinal faculty development curriculum focused on direct observation, feedback, and practice of behavioral skills to acknowledge and address microaggressions in the learning environment. Methods: We used Kern's six steps of curriculum development to create four voluntary virtual workshops offered twice throughout the academic year, with topics including: (1) recognizing and naming microaggressions, (2) apologizing when harm has been experienced, (3) setting expectations surrounding microaggressions, and (4) debriefing microaggressions. Participant learners included residency program directors, associate program directors, and other leaders across all medical and surgical departments from one institution. Results: Thirty-one faculty from 10 departments participated in this yearlong curriculum. Pre- and postworkshop surveys analyzed participants' self-assessments of confidence and comfort in applying learned skills. Participants were more confident in openly naming bias, delivering expectations surrounding microaggressions, and debriefing microaggressions with learners. Participants also reported greater comfort in apologizing to learners when harm has occurred in public, in person, and electronically. Discussion: To create an inclusive learning environment, faculty can increase their comfort and confidence with addressing bias and microaggressions through practice and feedback. Our curriculum demonstrates how experiential learning allows for continual practice to solidify a new skill.

Asunto(s)

RESUMEN

Introduction: Medical mis- and disinformation are on the rise and impact patient health outcomes. The complexity of modern medicine and health care delivery necessitates that care be delivered by an interprofessional team of providers well versed in addressing this increased prevalence of medical misinformation. Health professions educational curricula often lack opportunities for students to learn how to address medical misinformation, employ advanced communication techniques, and work collaboratively. Methods: Based on literature and our previous qualitative research, we created a module offering prework learning on COVID-19 and addressing misinformation through advanced communication techniques and interprofessional collaboration. After completing prework, students participated in a standardized patient encounter addressing COVID misinformation. Health professions student dyads completed a preencounter planning huddle and together interviewed a standardized patient. Students received global and checklist-based feedback from standardized patients and completed pre- and postsession self-assessments. Results: Twenty students participated (10 third-year medical, nine third-year pharmacy, one fourth-year pharmacy). Key findings included the following: Nine of 15 survey questions demonstrated statistically significant improvement, including all three questions assessing readiness to have difficult conversations and six of 10 questions assessing interprofessional collaboration and team function. Discussion: Students participating in this novel curriculum advanced their readiness to address medical misinformation, including COVID-19 vaccine disinformation, with patients and coworkers to improve health decision-making and patient care. These curricular methods can be customized for use with a range of health professions learners.

Asunto(s)

RESUMEN

Background: Effective communication skill of physicians is an important component of high-quality healthcare delivery and safe patient care. Communication is embedded in the social and cultural contexts where it takes place. An understanding of medical students' attitudes and learning communication skills would help to design and deliver culturally appropriate medical education. The Communication Skills Attitude Scale (CSAS) is a widely used and validated tool to measure the attitude of medical students toward learning communication skills in different populations, settings, and countries. However, there is no culturally adapted and validated scale in Bangla in the Bangladesh context. This study aims to culturally adapt the CSAS into Bangla, and validate it in a cohort of medical students in Bangladesh. Methods: This study used a cross-sectional survey design to collect data from purposively selected 566 undergraduate medical students from the Rajshahi division. The survey was conducted from January to December 2023. Descriptive statistics like frequency distribution and measures of central tendency were used to measure perception regarding communication skills. The sample adequacy was measured through the Kaiser-Meyer-Olkin test. The internal consistency of the items was identified using Cronbach's alpha (α) coefficients. Result: The results of the study show that the Bangla version of the scale is feasible, valid, and internally consistent in the context of a developing country, Bangladesh. The overall internal consistency of the Bangla version is good since the value of Cronbach's alpha (α) is 0.882. For PAS, the internal consistency is 0.933. While, for NAS, the value is 0.719. The item-wise average scores in the PAS indicate that female medical students are more willing to learn communication skills compared with male students (α = 0.933). While, the scores in the NAS indicate that the male students tend to have more negative attitude toward learning communication skills compared with female students (α = 0.719). Conclusion: The CSAS-Bangla is a valid and reliable tool for assessing communication skill attitudes among Bangla speaking medical students. This scale can be used in future studies to measure the attitude of students, designing and evaluating communication skills training programs in medical colleges.

RESUMEN

Introduction: Resident physicians frequently experience bias at work, with patients and families often being the source. Women and other trainees underrepresented in medicine are disproportionately impacted by these negative experiences, and experiencing bias contributes to resident physician burnout. Unfortunately, many resident physicians feel inadequately prepared to respond to bias. Methods: We developed a 45-minute, peer-led, case-based workshop that equipped trainees with tools to respond to patient-expressed bias. Our toolkit centered on resident physicians by including an assessment of the trainee's emotional well-being, a team-based response, and an embedded debrief. The toolkit provided resident physicians with possible responses to bias directed towards themselves (bias-towards-self) or bias directed towards others (bias-towards-others). Surveys were administered pre- and postworkshop to assess change in participants' comfort in responding to patient-expressed bias. Results: Thirty-seven residents completed both surveys. The workshop significantly increased comfort in responding to bias-towards-self (p < .001; 95% CI, 1.00-1.50) and bias-towards-others (p < .001; 95% CI, 1.00-1.50). Discussion: We improved resident physicians' comfort responding to patient bias-towards-self and bias-towards-others through a toolkit and workshop designed specifically for trainees. The toolkit centers the resident physician perspective, incorporates clinical context, and embeds a debrief. Our novel approach situates the toolkit's teaching in a highly scalable, case-based workshop.

Asunto(s)

RESUMEN

Objectives: Only 5-8% of adults with cancer participate in cancer clinical trials (CCTs), with even lower rates among underrepresented groups. Improving oncologists' communication skills may enhance the frequency and quality of their discussions with patients about CCTs, consequently increasing participation. However, little is known about interest in or presence of CCT-related communication training during Hematology-Oncology (Hem-Onc) fellowships. This study aimed to describe, from the perspective of Hem-Onc fellowship program directors (PDs): (1) the current landscape of CCT education for Hem-Onc fellows; (2) the acceptability and feasibility of implementing a CCT communication skills workshop for Hem-Onc fellows. Methods: We used an explanatory sequential mixed-methods approach. PDs were surveyed and interviewed about their graduate medical education (GME) programs' current CCT curriculum, training challenges, fellows' CCT knowledge and CCT communication skills, and preferences for a CCT communication workshop. Results: PDs were surveyed (n = 40) and interviewed (n = 12). PDs reported that their institutions prioritize CCT accrual (M = 4.58, SD = .78; 1-5 scale, 5 = "Strongly Agree") and clinical research training (M = 4.20, SD = .85). CCT skills that programs least often addressed were how to (1) discuss CCTs with newly diagnosed patients, (2) talk to patients about CCTs when none are available, and (3) help patients find CCTs at other institutions. PDs were interested in a CCT communication workshop for fellows ("yes" = 67.5%, "maybe" = 32.5%) and said training would be feasible (M = 4.28, SD = .78) and useful (M = 4.47, SD = .78). Qualitative results described programs' current approaches to CCT education and insights about developing and implementing CCT communication training. Conclusions: There is a clear need to improve CCT communication skills training in Hem-Onc fellowship programs and to implement and scale such training to increase CCT participation, especially among diverse patient populations. Furthermore, Hem-Onc GME PDs view such training as feasible and useful.

RESUMEN

Introduction: The COVID pandemic and affiliated infodemic led to widespread health misinformation, generating confusion and distrust. Physicians must identify and address misinformation, with attention to cultural/health literacy, equity, and autonomy. Most medical students receive training in core communication techniques but are rarely taught how to combat misinformation with patients and lack opportunities for practice in diverse settings. Methods: We used mixed methods to evaluate the impact of a role-play-based training curriculum on 44 third- and fourth-year medical students' comfort and confidence applying ask-respond-tell-seek solutions (ARTS) and motivational interviewing (MI) to discuss vaccine hesitancy, using COVID-19 as an example. There were three training iterations: prior to volunteering at a community health fair, during a medicine clinical rotation, and during a pediatrics rotation. Pre- and postsession questionnaires were administered. Likert-scale questions assessed comfort and confidence using ARTS and MI. Narrative responses focused on previous experiences with vaccine hesitancy, challenges faced, and session takeaways. Results: Students' comfort, confidence with ARTS/MI, and self-reported ability to discuss COVID-19 vaccinations improved as measured by pre- and postsession surveys (p < .05). Qualitatively, students reported increased confidence delivering recommendations in plain language and exploring patients' thought processes behind choices. Discussion: Reinforcement of core communications strategies in medical school can positively impact trainees' ability and ease addressing misinformation. We recommend this 45-minute training session to effectively increase medical students' comfort and confidence in discussing COVID-19 vaccines with patients. It can be adapted to any health professions school with an existing communications thread.

Asunto(s)

RESUMEN

BACKGROUND: Educating patients regarding surgery is an important aspect of the preoperative process. It helps individuals answer their queries, reduce anxiety, and improve overall satisfaction with the surgical experience. OBJECTIVE: To compare patients' expectations with their real-perioperative surgical experiences. Also, to evaluate the effectiveness of preoperative education and, thus, improve the doctor-patient relationship. METHODOLOGY: Through consecutive sampling, 65 adult patients were selected from the ENT department of Khyber Teaching Hospital. Preoperative education was provided to all the subjects using a 25-point pro-forma, and their queries were addressed. Postoperatively, all participants were interviewed regarding their expectations and real perioperative surgical experiences. The gaps were noted, and participants were asked about their preferences for addressing such gaps in future interactions. Postoperatively, patients were asked to give comments on how a certain part of preoperative education could have been better delivered. RESULTS: Among the 65 patients, 28 (43.1%) were male, and 37 (56.9%) were female. The majority (38.5%) had a primary/secondary school education. Eight (12.3%) patients had ear surgery, 19 (29.2%) had nose surgery, and 38 (58.5%) had throat surgery. Almost 39 (60%) patients had preoperative fear/anxiety. After preoperative education, 17 (26.2%) patients experienced perioperative fear/anxiety, which was a significant reduction (p = 0.001). Preoperative anxiety was greater in females (M: F = 8:13, p = 0.00), while perioperative anxiety was comparable among both genders after patient education (M: F = 5:12, p = 0.18). The greatest dissatisfaction was noted regarding the surgical schedule (33.8%), range of motion (16.9%), deep breathing exercises (13.8%), and preoperative fasting (12.3%). Most importantly, patients' comments were noted, when they were asked to suggest a better way to educate preoperatively in their respective area of dissatisfaction. Patients appreciated detailed explanations with practical demonstrations for range of motion exercises. One patient complained about no clear instructions on postoperative resumption of snuff. CONCLUSION: Preoperative patient education should be a two-way process involving active participation and continuous feedback. By educating patients properly through a multidisciplinary approach, healthcare providers can further enhance patient satisfaction, alleviate anxiety, and improve the overall quality of care.

Asunto(s)

RESUMEN

BACKGROUND: Patients perceive effective patient-doctor communication as an important metric when evaluating their satisfaction with health systems. Hence, optimal patient-physician communication is fundamental for quality healthcare. High-income countries (HICs) have extensively studied patient-resident communication. However, there is a dearth of similar studies in low- and middle-income countries (LMICs). Therefore, we aimed to explore the current state of and barriers to practicing good patient-resident communication and explore possible solutions to mitigate these challenges at one of the largest Academic Medical Centers in an LMIC. METHODS: This study employed an exploratory qualitative study design and was conducted at the Aga Khan University Hospital in Pakistan. Through purposive maximum variation sampling, 60 healthcare workers from diverse cohorts, including attendings, fellows, residents, and medical students, participated in eight focus group discussions. RESULTS: We identified three key themes from the data: Status-quo of residents' communication skills and learning (Poor verbal and non-verbal communication, inadequate training programs, and variable sources of learning), Barriers to effective communication (Institutional barriers such as lack of designated counselling spaces, lack of resident insight regarding effective communication and deficits in intra-team communication), and the need for developing a communication skills curriculum (Design, implementation and scaling to other cohorts of healthcare workers). CONCLUSIONS: Findings from this study show that multifaceted factors are responsible for inadequate patient resident-physician communication, highlighting the need for and importance of developing a formal communication skills training curriculum for residents. These insights can be used to create standardized training for equipping residents with adequate skills for effectively communicating with patients which can improve healthcare service delivery and patient outcomes.

Asunto(s)

RESUMEN

The humanization of medical education is targeted at integration of humanitarian values and approaches into system of education of medical personnel to improve their professional and personal training. This process includes education in medical ethics, development of communication skills, stress management and implementation of humanitarian disciplines into the curriculum. The humanization contributes into formation of empathy, responsibility and professionalism in future physicians that helps to better understand and consider psychological, social and emotional needs of patients. The problems of including humanitarian sciences into medical education are associated with lack of systematic approach, adequate curricula and qualified lecturers. To optimize process, it is necessary to focus on education of ideals and beliefs, development of integrated curricula and enhancement of humanitarian component of education.

Asunto(s)

RESUMEN

BACKGROUND: A conceptual model of effective symptom management was previously developed from interviews with multidisciplinary healthcare professionals (HCP) working in English hospices. Here we aimed to answer the question; does a HCP data-derived model represent the experience of patients and carers of people with advanced cancer? METHODS: Semi-structured interviews were undertaken with six patients with advanced cancer and six carers to gain an in-depth understanding of their experience of symptom management. Analysis was based on the framework method; transcription, familiarisation, coding, applying analytical framework (conceptual model), charting, interpretation. Inductive framework analysis was used to align data with themes in the existing model. A deductive approach was also used to identify new themes. RESULTS: The experience of patients and carers aligned with key steps of engagement, decision making, partnership and delivery in the HCP-based model. The data aligned with 18 of 23 themes. These were; Role definition and boundaries, Multidisciplinary team decision making, Availability of services/staff, Clinician-Patient relationship/rapport, Patient preferences, Patient characteristics, Quality of life versus treatment need, Staff time/burden, Psychological support -informal, Appropriate understanding, expectations, acceptance and goals- patients, Appropriate understanding, expectations, acceptance and goals-HCPs, Appropriate understanding, expectations, acceptance and goals- family friends, carers, Professional, service and referral factors, Continuity of care, Multidisciplinary team working, Palliative care philosophy and culture, Physical environment and facilities, Referral process and delays. Four additional patient and carer-derived themes were identified: Carer Burden, Communication, Medicines management and COVID-19. Constructs that did not align were Experience (of staff), Training (of staff), Guidelines and evidence, Psychological support (for staff) and Formal psychological support (for patients). CONCLUSIONS: A healthcare professional-based conceptual model of effective symptom management aligned well with the experience of patients with advanced cancer and their carers. Additional domains were identified. We make four recommendations for change arising from this research. Routine appraisal and acknowledgement of carer burden, medicine management tasks and previous experience in healthcare roles; improved access to communication skills training for staff and review of patient communication needs. Further research should explore the symptom management experience of those living alone and how these people can be better supported.

Asunto(s)

RESUMEN

Objective: To investigate residents' experiences recording and receiving feedback on a challenging video of a patient encounter. Methods: We used a qualitative design with first year residents who took part in a mandatory communication skills course in which all participants were asked to bring a challenging video of a patient encounter. The methods consisted of brief reflection texts and focus groups related to their perspectives on the use of challenging videos. Results: 106 residents wrote brief reflection texts, and 13 residents participated in four focus groups. Residents mainly expressed positive experiences with the challenging video exercise. Residents reported that the pressure to perform was felt to be less than on previous teaching sessions because the focus was on choosing an encounter which was less than perfect. They also reported that they appreciated the opportunity to see that other doctors were not performing optimally. Conclusion: The use of challenging videos as a teaching method for communication skills was experienced as encouraging by residents and facilitated enhanced learning. Innovation: We recommend adding more focus on challenging situations in video review. This could support learning by providing what our participants found to be a less daunting learning environment.

RESUMEN

INTRODUCTION: Sharing mental models is essential for high-performance teams, and speaking up is key for exchanging critical insights, especially during medical errors. Understanding how health providers and trainees voice their concerns is crucial for improving speaking-up behavior. This study aims to fill a gap in the literature by examining how medical students speak up when they encounter medical errors and assessing the impact of training on their speaking-up patterns. METHOD: A quasi-experimental study involving 146 students, who were divided into two groups, was conducted in Northern Taiwan. One group of students encountered life-threatening scenario before intervention, followed by a faculty-led personalized debriefing session, then a non-life-threatening scenario after the intervention. Another group of students underwent these sessions in the reverse order. Students' Speaking-up patterns, including expression style, form and attitude, and their speaking-up confidence were assessed at pre- and post-intervention scenarios. RESULTS: During pre-intervention scenario, in expression style, 50 students (34.5%) addressed their concerns to medical errors with direct expression and 14 students (9.7%) utilized indirect hint to express their concerns. In expression form, 31 students (21.4%) addressed their concerns to medical errors with affirmative sentences and 33 students (22.8%) asked questions to express their concerns. In speaking-up attitude, 47 students (32.4%) used unoffensive words, while 17 students (11.7%) used offensive words. After intervention, significantly change of speaking-up styles, forms, and attitude were observed along with their speaking-up confidence (p < 0.001). DISCUSSION: Medical students are inclined to speak up in the event of medical errors using more direct expression and affirmative sentences, along with increased speaking-up confidence after simulation scenario learning and faculty-led personalized debriefing. Healthcare educators can focus more on discussing with students the advantages and disadvantages of various approaches of speaking-up in medical errors, helping them to develop effective speaking-up behaviors in a variety of medical contexts.

RESUMEN

BACKGROUND: Although history taking is fundamental for diagnosing medical conditions, teaching and providing feedback on the skill can be challenging due to resource constraints. Virtual simulated patients and web-based chatbots have thus emerged as educational tools, with recent advancements in artificial intelligence (AI) such as large language models (LLMs) enhancing their realism and potential to provide feedback. OBJECTIVE: In our study, we aimed to evaluate the effectiveness of a Generative Pretrained Transformer (GPT) 4 model to provide structured feedback on medical students' performance in history taking with a simulated patient. METHODS: We conducted a prospective study involving medical students performing history taking with a GPT-powered chatbot. To that end, we designed a chatbot to simulate patients' responses and provide immediate feedback on the comprehensiveness of the students' history taking. Students' interactions with the chatbot were analyzed, and feedback from the chatbot was compared with feedback from a human rater. We measured interrater reliability and performed a descriptive analysis to assess the quality of feedback. RESULTS: Most of the study's participants were in their third year of medical school. A total of 1894 question-answer pairs from 106 conversations were included in our analysis. GPT-4's role-play and responses were medically plausible in more than 99% of cases. Interrater reliability between GPT-4 and the human rater showed "almost perfect" agreement (Cohen κ=0.832). Less agreement (κ<0.6) detected for 8 out of 45 feedback categories highlighted topics about which the model's assessments were overly specific or diverged from human judgement. CONCLUSIONS: The GPT model was effective in providing structured feedback on history-taking dialogs provided by medical students. Although we unraveled some limitations regarding the specificity of feedback for certain feedback categories, the overall high agreement with human raters suggests that LLMs can be a valuable tool for medical education. Our findings, thus, advocate the careful integration of AI-driven feedback mechanisms in medical training and highlight important aspects when LLMs are used in that context.

Asunto(s)