RESUMEN

In March 2020, the University of Hawaii John A. Burns School of Medicine suspended in person clinical teaching due to the SARS-CoV-2 (COVID) pandemic. During this period, virtual cases, telehealth participation, and online cases were incorporated into medical education. We have examined the effects of educational outcomes of third and fourth year students throughout clerkship performance, national standardized test scores, and our local fourth year OSCE examination. We found that USMLE step 2 scores were higher in the COVID-affected group. Patient logs in the COVID-affected group were lower for internal medicine, family medicine, OBGYN, and psychiatry clerkships. Clerkship performance grades in the COVID-affected group were lower for OBGYN and higher for surgery and psychiatry, but not different in other clerkships. USNBME subject specific examination scores in the COVID-affected group were higher for internal medicine, surgery, family medicine and psychiatry, but not different in all other specialties. For the fourth year OSCE, students in the COVID-affected group performed better on note taking and worse on physical examination. Future investigations will be needed to explore how our COVID-affected medical students perform in residency and beyond.

RESUMEN

INTRODUCTION: To secure a residency in the United States, medical students must pass the United States Medical Licensing Examination (USMLE) Step 1 and Step 2 CK exams. This study examines the correlation between international medical graduates' (IMGs) self-study habits and their USMLE scores. MATERIALS AND METHODS: A retrospective study was conducted with 51 anonymous third- and fourth-year IMGs from Saint James Medical School, IL, United States. Participants completed an online survey about their study habits and USMLE Step 1 and Step 2 CK scores. All participants were undergoing clinical clerkships at South Texas Health Hospitals in McAllen, TX. RESULTS: The highest mean Step 1 scores were 211.3 for completing ≥7,000 questions, 222.2 for 91-120 days of study, 209.2 for 76-100% time on practice questions, 229.7 for 16-19 hours/day of study, and 228.0 for 51-75% group study. The highest mean Step 2 CK scores were 241.0 for completing ≥6,000 questions, 239.8 for <30 days of study, 238.8 for 76-100% time on practice questions, 239.0 for 16-19 hours/day of study, and 237.5 for 26-50% group study. No significant relationship was found between study habits and passing Step 1 scores (p>0.05), but moderate correlations were found for completing ≥4,000 questions and 61-90 days of study. No significant relationship was found between study habits and the national average Step 2 CK score, but a strong correlation was found for 25-50% time on practice questions. CONCLUSION: While some study habits correlate with higher scores, no significant relationship was found between specific study habits and passing Step 1 or achieving the national average Step 2 CK score.

RESUMEN

Objectives In February 2020, the National Board of Medical Examiners (NBME) announced that the United States Medical Licensing Examination (USMLE) Step 1 licensing examination would change from a numerical score to Pass/Fail (P/F). After implementation, many believe that USMLE-Step 2-Clinical Knowledge (CK) will become an important metric for students applying to otolaryngology (ENT). The purpose of this study is to determine factors important to resident selection after these changes. Methods A survey containing 15 questions related to resident selection practices and how changing USMLE Step 1 to P/F would impact future resident selection was designed. It was distributed to all ENT residency programs accredited by the Accreditation Council for Graduate Medical Education (ACGME). Results Forty percent of programs responded; 66% (95% confidence interval (CI): 51.1%-78.4%) felt that changing Step 1 scoring would not lead to students being more prepared for clinical rotations; 55% believe class rank will increase in significance (95% CI: 35.7%-64.3%). There was also an increase in the importance of Step 2 CK, which had a mean ranking of 10.67 prior to changes in Step 1 scoring and increased to 7.80 after P/F. Conclusions The changes in Step 1 scoring will likely lead to increasing importance of other objective measures like class rank or Step 2 CK. This may defeat the intended purpose put forth by the NBME. Therefore, further guidance on measures correlated with student performance as a resident will be integral to the selection process.

RESUMEN

OBJECTIVES: Medical students are increasingly using a spaced repetition software called Anki to study. There are limited studies evaluating the relationship between Anki and learner outcomes. In this study, we describe the history of Anki use in medical school and assess the potential relationships between use of Anki and medical student academic, extracurricular, and wellness outcomes. METHODS: We used cross-sectional data from a 50-item online survey and retrospective academic performance data from our institution's outcomes database. Participants were medical students. The survey assessed the frequency and timing of Anki use, student perceived stress, sleep quality, burnout risk, and involvement in extracurricular activities. Academic success was measured by USMLE Step 1 and Step 2 scores. RESULTS: 165 students responded survey. 92 (56%) identified as daily Anki users. Daily Anki use was correlated with increased Step 1 score (P = .039), but not Step 2 scores. There was an association between Anki use and increased sleep quality (P = .01), but no difference for other measurements of wellness or extracurricular involvement. CONCLUSION: The study demonstrates potential benefits of daily use of Anki but also confirms that a variety of study methods can be used to achieve similar medical school outcomes.

RESUMEN

Issue: The United States Medical Licensing Exam (USMLE) Step 2 Clinical Skills Examination (Step 2 CS), the only clinical skills competency testing required for licensure in the United States, has been discontinued. Evidence: This exam, though controversial, propelled a movement emphasizing the value of clinical skills instruction and assessment in undergraduate medical education. While disappointed by the loss of this national driver that facilitated standardization of clinical skills education, the Directors of Clinical Skills Education (DOCS) see prospects for educational innovation and growth. DOCS is a national organization and inclusive community of clinical skills education leaders. This statement from DOCS regarding the discontinuation of USMLE Step 2 CS has been informed by DOCS meetings, listserv discussions, an internal survey, and a review of recent literature. Implications: Rigorous clinical skills assessment remains central to effective and patient-centered healthcare. DOCS shares specific concerns as well as potential solutions. Now free from the external pressure to prepare students for success on Step 2 CS, clinical skills educators can reprioritize content and restructure clinical skills programs to best meet the needs of learners and the ever-evolving healthcare landscape. DOCS, as an organization of clinical skills leaders, makes the following recommendations: 1) Collaboration amongst institutions must be prioritized; clinical skills assessment consortia should be expanded. 2) Governing, accrediting, and licensing organizations should leverage their influence to support and require high quality clinical skills assessments. 3) UME clinical skills leaders should develop ways to identify students who perform with exceptional, borderline, and poor clinical skills at their local institutions. 4) UME leadership should fully commit resources and curricular time to graduate students with excellent clinical skills.

Asunto(s)

RESUMEN

Purpose: The University of South Carolina School of Medicine Greenville has incorporated Emergency Medical Technician (EMT) training into the first semester curriculum with students becoming state-certified EMTs and completing one ambulance shift per month throughout their pre-clerkship years. Although there have been programs that have reported EMT experiences in the pre-clinical years of medical education, student perceptions of how the EMT experiences help prepare them for board exams and clerkships is limited. Therefore, the aim of this study was to measure student perceptions regarding the impact of an EMT course and training in the pre-clerkship curriculum in medical school on helping prepare them for national board exams (ie USMLE® Step 1, 2 Clinical Knowledge (CK), 2 Clinical Skills (CS)) and clerkship rotations. Methods: Second-, third-, and fourth-year medical students at the University of South Carolina School of Medicine Greenville completed an anonymous voluntary survey with response rates of 66.3%, 55.2%, and 56.9%, respectively. The study was reviewed and exempted by the University of South Carolina Institutional Review Board. Results: Seventeen percent, 14%, and 41% of students agreed/strongly agreed an EMT course helped prepare them for the USMLE Step 1, Step 2 CK, and Step 2 CS exam, respectively. Sixty-four percent of students agreed/strongly agreed that an EMT course and experience helped prepare them for clerkship rotations. Conclusion: The findings in this study support EMT training and experience as an EMT as one method to help prepare students for clerkship rotations.

RESUMEN

In February 2020, the governing bodies of the United States Medical Licensing Examination (USMLE) announced the decision to change Step 1 score reporting from a three-digit system to pass/fail designation. Previous studies theorized that Step 2 Clinical Knowledge (CK) will become the numerical standard by which residency directors can quickly sort through program applicants. The goal of this study is to review prior research and identify significant factors associated with Step 2 CK outcomes. A systematic literature search on PubMed, Web of Science, Scopus, and ERIC that included articles published between 2005 and 2015 was conducted using the keywords "USMLE," "Step 2 CK," "score," "success," and "predictors." After screening the initial search yield of 3,239 articles, 52 articles were included for this review. Positively correlated factors included Step 1 score, clinical block grades, Comprehensive Clinical Science Self-Assessment (CCSSA), Comprehensive Clinical Science Examination (CCSE), and volunteerism. Factors such as clerkship sequence and pass/fail grading failed to correlate with Step 2 CK. Medical College Admission Test (MCAT) score (p < 0.01) and undergraduate grade point average (GPA) (p = 0.01) positively correlated, while age displayed a negative correlation. Additionally, females typically scored higher on Step 2 CK than their male peers. The study findings suggest that continuous learning and academic success throughout medical school positively influence eventual Step 2 CK scoring. Performance on USMLE practice examinations, Step 1, and clinical evaluations serve as positive predictors for Step 2 CK scores. Interestingly, changing answers and spending more time on each question during the examination were associated with higher scores.

RESUMEN

Background To improve their standing in residency selection, many osteopathic medical students choose to take the United States Medical Licensing Examination (USMLE). Although scores on USMLE Step 1 and Level 1 of the Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA) are known to be highly correlated, scarce data exist on the association between COMLEX-USA Level 2-Cognitive Evaluation (CE) and USMLE Step 2 Clinical Knowledge (CK) scores. In this study, we aimed to determine the association between COMLEX-USA Level 2-CE and USMLE Step 2 CK scores and derive an equation to predict performance on USMLE Step 2 CK for applicants who have only taken COMLEX-USA. Methodology We reviewed COMLEX-USA Level 2-CE and USMLE Step 2 CK scores for all students at the Lake Erie College of Osteopathic Medicine from May 2020 to April 2021. Linear regression was used to evaluate the relationship between COMLEX-USA Level 2-CE and USMLE Step 2 CK scores. Results A total of 340 students took both COMLEX-USA Level 2-CE and USMLE Step 2 CK. There was a linear association between COMLEX-USA Level 2-CE and USMLE Step 2 CK scores such that every one-point increase in COMLEX-USA was associated with a 0.13-point increase in USMLE Step 2 CK score (standard error = 9.1; model R2 = 0.64). Conclusions Students or programs interested in predicting performance on USMLE Step 2 CK from performance on COMLEX-USA Level 2-CE can do so using the following equation: USMLE Step 2 CK = 0.13(COMLEX-USA Level 2-CE) + 163.5.

RESUMEN

Background United States Medical Licensing Examination (USMLE) Step 1 is a common metric looked at by residency programs to determine invitations for candidates to interview. However, USMLE Step 2 Clinical Knowledge (CK) has also been an important factor for selecting applicants to interview and plays a significant role during applicant selection. This study aims to identify academic performance measures that correlate with USMLE Step 2 CK scores and to develop a model to predict USMLE Step 2 CK scores using previous academic measures from the first two cohorts in the longitudinal interleaved clerkship (LInC) at the Kirk Kerkorian School of Medicine at the University of Nevada, Las Vegas (KSOM). Setting The KSOM is a newly accredited US allopathic medical school that accepted its first class in 2017. At KSOM, a LInC model is used in the primary clinical year. In this model, rotations are two weeks in duration before moving on to the next specialty. Students complete the National Board of Medical Examiners (NBME) subject examinations in all six specialties in one week at the midpoint and the end of the LInC. Students who passed an exam at the midpoint can opt out of that exam at the end as the higher of the two exam scores is recorded. However, most students choose to take all the exams again to improve their scores and prepare for USMLE Step 2 CK. Methodology Academic performance measures were gathered from the class of 2021 and 2022 (n = 101) including undergraduate grade point average (GPA), undergraduate science GPA, medical college admission test score, USMLE Step 1 score, NBME clinical subject exam scores, and USMLE Step 2 CK scores. Pearson correlations were run between the performance variables and USMLE Step 2 CK scores to measure influence variables individually, then a regression model measured impacts of variables together. Results All variables except undergraduate science GPA significantly correlated with USMLE Step 2 CK score. USMLE Step 1 had the strongest correlation (r = 0.752, p < 0.001). The regression model had an R of 0.859 with the internal medicine subject exam showing the highest beta coefficient (0.327, p < 0.001). Conclusions This study determined that USMLE Step 2 CK scores can be effectively predicted using available performance measures. With USMLE Step 1 becoming pass/fail in January 2022, the importance of USMLE Step 2 CK as a screening tool in the residency application process will likely increase. This study was conducted within a LInC curriculum and may have limited value in the prediction of scores within other clinical year curricula.

RESUMEN

BACKGROUND: To evaluate if United States Medical Licensing Examination (USMLE) Step 1, USMLE Step 2 CK, USMLE Step 3, and residency third-year in-service training exam (ITE) scores predict the results of American Board of Internal Medicine Certifying Exam (ABIM-CE). METHODS: We performed a retrospective review of USMLE Step 1, USMLE Step 2 CK, USMLE Step 3, third-year residency ITE scores and ABIM-CE results of IM residents at our residency program from 2004 through 2017. Statistical analysis was perfrormed using Pearson correlation coefficient, and logistic regression to assess the relationship between USMLE Step 1, USMLE Step 2CK, USMLE Step 3, 3rd year ITE scores and ABIM-CE results. We used Multivariate logistic regression to predict pass or fail results in ABIM-CE based on USMLE and third-year ITE test scores controlling for other covariates. RESULTS: Among 114 Internal Medicine MD residents included in the study, 92% (n = 105) passed the ABIM-CE. The OR of passing ABIM-CE was 2.70 (95% CI = 1.38-5.29), 2.31 (95% CI = 1.33-4.01), and 1.63 (95% CI = 0.81-3.29) with a ten-point increase in USMLE Step 1, USMLE Step 2 CK and USMLE Step 3 scores respectively. The OR of ABIM-CE passing chance was 2.96 (95% CI = 0.95-9.20), with a ten-point increase in the average score of the above three exams. A 5 % increase in ITE percentage raised the likelihood of passing ABIM-CE (OR 2.92, 95% CI 1.15-7.38). All residents who failed ABIM-CE had Step 1 scores < 220. Among 31 residents with Step 2 CK score < 220, 20% (n = 6) failed ABIM. Similarly, 9% of residents with USMLE Step 3 score < 220 failed ABIM-CE; all residents who failed had scored < 220. The probability curve predicted that the chance of passing ABIM- CE was around 80% with USMLE scores greater than 200 and increased to almost 100% with USMLE scores of 250 or more. CONCLUSION: USMLE Step 1, USMLE Step 2 CK, and third-year ITE scores can predict the chances of passing ABIM-CE. The third-year ITE score has a higher preditive value compared to USMLE Step 1 and USMLE Step 2 scores. USMLE Step 1 scores more predictive of ABIM-CE results compared to USMLE Step 2CK scores. Thus, residency programs can identify internal medicine residents at risk of failing ABIM-CE and formulate interventions at an early stage during residency training. Measures such as enrolling them in question banks or board review courses can be helpful in improving their chances of passing ABIM-CE.

Asunto(s)

RESUMEN

OBJECTIVES: The neurosurgery residency match is becoming increasingly competitive, with numerous factors being considered as part of the application. We aim to determine whether USMLE Step 2 scores were a significant predictor of neurosurgery board performance. PATIENTS AND METHODS: Residents who entered a neurological surgery residency program at a single academic institution during 2000-2017 provided scores for all ABNS attempts, USMLE Step 1 and Step 2 scores. Data were deidentified and analyzed for correlation and regression. Pearson's correlation coefficients were determined. RESULTS: USMLE Step 1, Step 2, and maximum ABNS scores were all normally distributed. Step 1 and Step 2 scores were less variable than ABNS scores. USMLE Step 2 and residents' best ABNS written examination scores were not correlated (Pearson Correlation of 0.228 with a 2-tailed significance of 0.272). No outliers were present. When comparing USMLE Step 2 scores with year in residency at which residents scored over 300 on the ABNS written examination, Pearson correlation was -0.500 (p = .015). A simple linear regression was calculated using Step 2 scores to predict the passing year of ABNS written examination (F(1,14) = 6.984, p = .015, R2 = 0.25). CONCLUSION: Although other studies have found correlations between USMLE Step 2 scores and performance before graduating medical school and during residency for other specialties, this is the first study comparing USMLE Step 2 scores with the ABNS written examination scores of neurosurgical residents. Our data showed that USMLE Step 2 was not a reliable predictor of ABNS written examination scores.

Asunto(s)

RESUMEN

Phenomenon: In high-stakes evaluations of communicative competency, data-gathering skills are commonly assessed through the use of standardized patient encounters. This article seeks to document inquiry practices in 2 such encounters in a setting designed to emulate a consequential, clinical skills examination. Approach: Drawing on the methods and findings of Conversation Analysis, we examine selected fragments seeking to understand how, in the ways in which they are organized, they produce quite different outcomes. Findings: In the first encounter, the topic of the patient's history of depression arises naturally in the course of the interview. It happens to be a checklist item for the case and the examinee receives credit for having elicited it. In the second encounter, though the examinee was the more clinically experienced, the topic does not come up and the examinee fails to receive credit. Insights: When we examine how the two inquiry sequences develop on a turn-by-turn basis, it becomes clear that the differences between inquiry practices that carefully constrain patient responses and those that leave space for patient elaboration are subtle but evident. Both types of practice, however, are presumably a part of competent clinical performance. We argue that looking carefully at how specific interactional practices operate within clinical interviews can enable us to become more articulate as to what might count as communicative competence in the clinic.

Asunto(s)

RESUMEN

PURPOSE: To investigate whether starting the clerkship year in family medicine (FM), internal medicine (IM), pediatrics, or surgery influences NBME shelf and USMLE Step 2 CK examination performance. METHODS: USMLE Step 1, Step 2 CK, and shelf examination scores for FM, IM, pediatrics, and surgery were collected. Sequences were selected on the following assignment criteria: rotation 1 (either FM or IM), rotation 5 (pediatrics), rotation 8 (surgery), rotation 1 (either pediatrics or surgery), and rotation 8 (IM). Multivariate analysis of covariance, with Step 1 as the covariate, was used to investigate rotation sequence on examination performance. RESULTS: Wilks's statistic found no statistically significant effect of rotation sequence (starting the clerkship year in FM or IM) on the pediatrics, surgery, and Step 2 CK examinations (Λ = .95, F[3,51] = .93, p ≤ .432). Wilk's statistic for the covariate (Step 1) was statistically significant (Λ = .488, F[3,51] = 17.827, p ≤ .001), indicating the two groups differ on Step 1 performance. Wilk's statistic found no statistically significant effect of rotation sequence (starting the clerkship year in pediatrics or surgery) on the IM and Step 2 CK results (Λ = .925, F[2,75] = 3.036, p ≤ .054). Wilk's statistic for the covariate (Step 1) was statistically significant (Λ = .309, F[2,75] = 83.915, p ≤ .001) indicating that the two groups differ on Step 1 performance. CONCLUSION: Starting the clerkship year in FM, IM, pediatrics, or surgery does not influence subsequent performance on shelf examinations or on Step 2 CK.

RESUMEN

BACKGROUND: Finding early specific indicators of failure in the United States Medical Licensing Examination (USMLE) Step 1 and Step 2 Clinical Knowledge (CK) could be used to develop early interventions that could solve deficiencies and help at-risk students to ultimately attain a passing score. This study was aimed at determining if the National Board of Medical Examiners (NBME) Comprehensive Basic Science Examination (CBSE) could predict a passing score during the USMLE Step 1. We also assessed if the NBME Medicine Clinical Science Subject Examination (CSSE) or the USMLE Step 1 could predict passing scores during the USMLE Step 2 CK. METHODS: Gender and scores from 724 students who took the USMLE Step 1 were linked and analyzed with the scores of the NBME CBSE, the NBME Medicine CSSE, and the USMLE Step 2 CK using IBM-SPSS. RESULTS: There were significant correlations between the scores from NBME CBSE and USMLE Step 1 (r=0.73, P≤0.001), between the scores from the NBME Medicine CSSE and the USMLE Step 2 CK (r=0.572, P≤0.001), and between the scores from the USMLE Step 1 and Step 2 CK (r=0.698, P≤0.001). Students with scores <66 in the NBME CBSE were less likely to approve the USMLE Step 1 on their first attempt (P≤0.00001). There was a significant correlation (r=0.684, P≤0.0001) between a score of ≥208 in the USMLE Step 1 and passing the Step 2 CK on the first attempt. CONCLUSION: A score <66 in the NBME CBSE might indicate failure during the USMLE Step 1 first take. Similarly, a score <208 in the USMLE Step 1 might predict failure in the USMLE Step 2 CK.

RESUMEN

Recent changes to the patient note (PN) format of the United States Medical Licensing Examination have challenged medical schools to improve the instruction and assessment of students taking the Step-2 clinical skills examination. The purpose of this study was to gather validity evidence regarding response process and internal structure, focusing on inter-rater reliability and generalizability, to determine whether a locally-developed PN scoring rubric and scoring guidelines could yield reproducible PN scores. A randomly selected subsample of historical data (post-encounter PN from 55 of 177 medical students) was rescored by six trained faculty raters in November-December 2014. Inter-rater reliability (% exact agreement and kappa) was calculated for five standardized patient cases administered in a local graduation competency examination. Generalizability studies were conducted to examine the overall reliability. Qualitative data were collected through surveys and a rater-debriefing meeting. The overall inter-rater reliability (weighted kappa) was .79 (Documentation = .63, Differential Diagnosis = .90, Justification = .48, and Workup = .54). The majority of score variance was due to case specificity (13 %) and case-task specificity (31 %), indicating differences in student performance by case and by case-task interactions. Variance associated with raters and its interactions were modest (<5 %). Raters felt that justification was the most difficult task to score and that having case and level-specific scoring guidelines during training was most helpful for calibration. The overall inter-rater reliability indicates high level of confidence in the consistency of note scores. Designs for scoring notes may optimize reliability by balancing the number of raters and cases.

Asunto(s)