RESUMEN

BACKGROUND: Brazilian medical schools equitably divide their medical education assessments into five content areas: internal medicine, surgery, pediatrics, obstetrics and gynecology, and public health. However, this division does not follow international patterns and may threaten the examinations' reliability and validity. OBJECTIVE: To assess the reliability indices of the content areas of serial, cross-institutional progress test examinations. DESIGN AND SETTINGS: This was an analytical, observational, and cross-sectional study conducted at nine public medical schools (mainly from the state of São Paulo) with progress test examinations conducted between 2017 and 2023. METHODS: The examinations covered the areas of basic sciences, internal medicine, surgery, pediatrics, obstetrics and gynecology, and public health. We calculated reliability indices using Cronbach's α, which indicates the internal consistency of a test. We used simple linear regressions to analyze temporal trends. RESULTS: The results showed that the Cronbach's α for basic sciences and internal medicine presented lower values, whereas gynecology, obstetrics, and public health presented higher values. After changes in the number of items and the exclusion of basic sciences as a separate content area, internal medicine ranked highest in 2023. Individually, all content areas except pediatrics remained stable over time. CONCLUSIONS: Maintaining an equitable division in assessment content may lead to suboptimal results in terms of assessment reliability, especially for internal medicine. Therefore, content sampling of medical knowledge for general assessments should be reappraised.

Asunto(s)

RESUMEN

OBJECTIVE: Define and develop a set of entrustable professional activities (EPAs) to link clinical training and assessment of the hospital components of neonatal care in neonatology medical residency programs. METHODS: An exploratory study was conducted in two phases using a modified Delphi approach. In the first phase, a committee of five neonatology residency program coordinators drafted an initial set of EPAs based on the national matrix of competencies and on EPAs defined by international organizations. In the second phase, a group of neonatal care physicians and medical residents rated the indispensability and clarity of the EPAs and provided comments and suggestions. RESULTS: Seven EPAs were drafted by the coordinators´ committee (n = 5) and used in the content validation process with a group (n = 37) of neonatal care physicians and medical residents. In the first Delphi round, all EPAs reached a content validity index (CVI) above 0.8. The coordinators´ committee analyzed comments and suggestions and revised the EPAs. A second Delphi round with the revised EPAs was conducted to validate and all items maintained a CVI above 0.8 for indispensability and clarity. CONCLUSION: Seven entrustable professional activities were developed to assess residents in the hospital components of neonatal care medicine. These EPAs might contribute to implementing competency-based neonatology medical residency programs grounded in core professional activities.

Asunto(s)

RESUMEN

INTRODUCTION: Evaluating the professional competencies of Peruvian doctors is crucial for proposing necessary improvements. However, there is a lack of knowledge regarding the specific characteristics and competencies that are assessed in these studies. OBJECTIVE: The objective of this study is to characterize published studies focusing on the assessment of professional competencies among physicians in Peru. METHODS: A comprehensive scoping review was conducted, encompassing scientific journal publications that evaluated the professional competencies of physicians in Peru. The search was performed in PubMed, Google Scholar, Scopus, and SciELO, with the review period extending until 2022. The identified competencies were classified using the Accreditation Council for Graduate Medical Education (ACGME) and the Ministry of Health of Peru (MINSA) frameworks. The findings were presented using absolute and relative frequency measures. RESULTS: A total of forty-nine studies focused on the assessment of professional competencies among physicians were identified, indicating an upward trend over the years. The primary focus of these studies was on evaluating competencies related to medical knowledge (79.6% according to ACGME classification) and the treatment of health problems (57.1% according to MINSA classification). However, there was a noticeable lack of emphasis on assessing behavioral competencies such as ethics, professionalism, and communication. Most of the included studies (65.3%) were exclusively conducted in Lima. Among the studies that disclosed their funding sources, 61% were self-funded. CONCLUSION: Most studies primarily concentrated on evaluating knowledge-based competencies, specifically in the areas of diagnosis and treatment. There is a scarcity of studies assessing other important competencies. Additionally, centralization and limited funding appear to be areas that require improvement in the evaluation of professional competencies among Peruvian physicians.

Asunto(s)

RESUMEN

Medical societies must maintain high standards of competence and quality when awarding specialist titles, defining the certification criteria, taking into account the needs and realities of the health system and medical practice.

Asunto(s)

Asunto(s)

RESUMEN

Background: The deployment of OpenAI's ChatGPT-3.5 and its subsequent versions, ChatGPT-4 and ChatGPT-4 With Vision (4V; also known as "GPT-4 Turbo With Vision"), has notably influenced the medical field. Having demonstrated remarkable performance in medical examinations globally, these models show potential for educational applications. However, their effectiveness in non-English contexts, particularly in Chile's medical licensing examinations-a critical step for medical practitioners in Chile-is less explored. This gap highlights the need to evaluate ChatGPT's adaptability to diverse linguistic and cultural contexts. Objective: This study aims to evaluate the performance of ChatGPT versions 3.5, 4, and 4V in the EUNACOM (Examen Único Nacional de Conocimientos de Medicina), a major medical examination in Chile. Methods: Three official practice drills (540 questions) from the University of Chile, mirroring the EUNACOM's structure and difficulty, were used to test ChatGPT versions 3.5, 4, and 4V. The 3 ChatGPT versions were provided 3 attempts for each drill. Responses to questions during each attempt were systematically categorized and analyzed to assess their accuracy rate. Results: All versions of ChatGPT passed the EUNACOM drills. Specifically, versions 4 and 4V outperformed version 3.5, achieving average accuracy rates of 79.32% and 78.83%, respectively, compared to 57.53% for version 3.5 (P<.001). Version 4V, however, did not outperform version 4 (P=.73), despite the additional visual capabilities. We also evaluated ChatGPT's performance in different medical areas of the EUNACOM and found that versions 4 and 4V consistently outperformed version 3.5. Across the different medical areas, version 3.5 displayed the highest accuracy in psychiatry (69.84%), while versions 4 and 4V achieved the highest accuracy in surgery (90.00% and 86.11%, respectively). Versions 3.5 and 4 had the lowest performance in internal medicine (52.74% and 75.62%, respectively), while version 4V had the lowest performance in public health (74.07%). Conclusions: This study reveals ChatGPT's ability to pass the EUNACOM, with distinct proficiencies across versions 3.5, 4, and 4V. Notably, advancements in artificial intelligence (AI) have not significantly led to enhancements in performance on image-based questions. The variations in proficiency across medical fields suggest the need for more nuanced AI training. Additionally, the study underscores the importance of exploring innovative approaches to using AI to augment human cognition and enhance the learning process. Such advancements have the potential to significantly influence medical education, fostering not only knowledge acquisition but also the development of critical thinking and problem-solving skills among health care professionals.

Asunto(s)

RESUMEN

INTRODUCCIÓN: La diversidad cultural en Chile y las inequidades en el acceso y calidad de la atención requiere del desarrollo de competencias culturales en los profesionales de la salud debido a las inequidades en el acceso y calidad de la atención. A nivel internacional, se ha integrado la competencia cultural en los planes de estudio de las carreras de salud, pero en Chile está en sus etapas iniciales. MÉTODOS: Se utilizó una metodología mixta que incluyó: revisión documental (búsquedas y análisis en bases de datos y documentos oficiales), entrevistas a informantes clave y consenso de expertos. Las entrevistas se transcribieron textuales y se realizó un análisis temático utilizando el software ATLAS.ti. RESULTADOS: La revisión documental identificó dominios, objetivos e instrumentos utilizados para medir la competencia cultural en odontología. Las entrevistas revelaron cuatro categorías principales: concepciones de salud, facilitadores y barreras, y características de los profesionales de la salud. Se elaboró un listado de contenidos y resultados de aprendizaje, evaluados y consensuados por expertos. Conclusiones: La inclusión de la competencia cultural en los planes de estudio de odontología es esencial para una atención de salud más inclusiva y culturalmente segura. Se recomienda su integración longitudinal en diversos cursos, empleando metodologías efectivas de enseñanza y evaluación. Los resultados de este estudio ofrecen una guía para identificar los conocimientos, habilidades y actitudes necesarios para formar a los profesionales de salud que finalmente deben entregar una apropiada atención de salud con pertinencia intercultural.

INTRODUCTION: Cultural diversity in Chile and inequities in access and quality of care require the development of cultural competencies in health professionals. Internationally, cultural competence has been integrated into the curricula of health professional programs; however, in Chile it is still in its early stages. METHODS: A mixed methodology included documentary review (searches and analysis in databases and official documents), key informant interviews and expert consensus. The interviews were transcribed verbatim, and thematic analysis was carried out using ATLAS.ti software. RESULTS: The documentary review identified domains, objectives and instruments used to measure cultural competence in dentistry. The interviews revealed four main categories: conceptions of health, facilitators and barriers, and characteristics of health professionals. Experts developed, evaluated and agreed upon content and learning outcomes. Conclusion: Including cultural competence in dental curricula is essential for more inclusive and culturally safe health care. Its longitudinal integration into various courses, employing effective teaching and assessment methodologies, is recommended. The results of this study provide a guide to identifying the knowledge, skills, and attitudes needed to train health professionals who ultimately deliver appropriate health care with cultural pertinence.

Asunto(s)

RESUMEN

INTRODUCTION: Cultural diversity in Chile and inequities in access and quality of care require the development of cultural competencies in health professionals. Internationally, cultural competence has been integrated into the curricula of health professional programs; however, in Chile it is still in its early stages. METHODS: A mixed methodology included documentary review (searches and analysis in databases and official documents), key informant interviews and expert consensus. The interviews were transcribed verbatim, and thematic analysis was carried out using ATLAS.ti software. RESULTS: The documentary review identified domains, objectives and instruments used to measure cultural competence in dentistry. The interviews revealed four main categories: conceptions of health, facilitators and barriers, and characteristics of health professionals. Experts developed, evaluated and agreed upon content and learning outcomes. CONCLUSION: Including cultural competence in dental curricula is essential for more inclusive and culturally safe health care. Its longitudinal integration into various courses, employing effective teaching and assessment methodologies, is recommended. The results of this study provide a guide to identifying the knowledge, skills, and attitudes needed to train health professionals who ultimately deliver appropriate health care with cultural pertinence.

Asunto(s)

RESUMEN

INTRODUCTION: Exchange transfusion is the treatment of choice for patients with severe hyperbilirubinemia who do not respond to phototherapy. This procedure is highly complex and requires substantial expertise to perform, however it´s not done frequently enough to guarantee adequate training. Traditional learning scenarios do not have a space reserved for teaching this procedure or an instrument that fully and objectively evaluates the skills that a professional must acquire.  OBJECTIVES: The purpose was to construct and evaluate the INEXTUS instrument´s validity evidence relevant to internal structure, in a simulated scenario through the performance of an objective structured clinical exam (OSCE).  MATERIALS AND METHODS: The Delphi consensus methodology was utilized to design the instrument; six experts participated through three rounds using the Google Forms platform. The categories and items previously obtained were subjected to validation by nine experts through a dichotomous survey. Prior to data collection, the evaluators were trained through a pilot test with 10 medical students. Subsequently, all residents of a paediatric programme were evaluated through the OSCE methodology in a simulated scenario, with 6 stations, of a clinical case of a new-born with an explicit need for exchange transfusion. During their participation in the scenario, the residents were first evaluated with the instrument developed. Additionally, audio and video filming of all students who participated was performed with the aim of conducting a second evaluation two weeks after the first four evaluators participated. RESULTS: The final INEXTUS instrument consists of 46 subitems grouped into 23 items divided into 6 categories, demonstrating an inter-rater intraclass correlation coefficient of 0.96 (95% CI 0.94, 0.98 p-value < 0.001). For the Fleiss Kappa of the 23 items evaluated, concordance was evaluated for 14 items but could not be determined for the 9 remaining items because all the ratings were equal, either because the items were not performed or they were all performed adequately. Of the 14 items, 9 good scores were obtained (95% CI 0.61 to 0.8; p value < 0.001), and 5 very good scores were obtained (95% CI 0.81 to 1; p value < 0.001). CONCLUSIONS: The INEXTUS instrument evaluates exchange transfusion skills in medical personnel in training in simulated scenarios using the OSCE methodology; it has high validity and reliability and is a high-impact educational tool.

Asunto(s)

Asunto(s)

RESUMEN

Abstract Pharmaceutical education should enable the development of competences for community pharmacy practice, which is an important field for the pharmacist workforce. The aim of this study was to evaluate the competences perceived by pharmacy interns from a Brazilian pharmacy school for community pharmacy practice. This study adopted a combined quantitative and qualitative approach. The study cohort included undergraduate students who undertook internships in community pharmacy in the final year of the pharmacy course. Students responded to an 11-item structured questionnaire according to a five-point Likert scale that included perceptions of their competences for community pharmacy practice. Among the 693 possible answers, 605 (87.3%) agreed that the course promoted the development of competences for professional practice in community pharmacy. Less than 70% of students perceived themselves as prepared to respond to symptoms and provide non-prescription medicines. Qualitative analysis of the comments revealed three themes: the need to improve patient information skills, improve practice as a member of a health care team, and improve dispensing according to legal requirements. These findings may support improvements in undergraduate pharmacy programs, such as the inclusion of experiential learning, active learning methods, interprofessional education, and development of clinical skills.

Asunto(s)

Asunto(s)

RESUMEN

Tanto la formación en Competencia Intercultural como la Educación Interprofesional mejoran los resultados en salud. No se encontraron revisiones sistemáticas, en la literatura especializada, que analicen ambos factores juntos en los últimos diez años. Caracterizar aspectos metodológicos de investigaciones empíricas de Competencia Intercultural con Educación Interprofesional en estudiantes de Ciencias de la Salud, describir aspectos curriculares de la formación en Competencia Intercultural con Educación Interprofesional, y analizar la efectividad de dichas experiencias educativas. Se desarrolló una revisión sistemática de las bases de datos Web of Science, Scopus, SciELO, PubMed y ProQuest desde el 2010 a 2020. Existe un predominio de artículos realizados en Estados Unidos y Australia, con enfoque mixto, no experimentales, tamaño muestral acotado y uso de encuestas de percepción. Los contenidos abordaron el conocimiento intercultural general y la atención de salud, con experiencias de tipo extracurricular, presenciales, de corta duración y para un acotado número de carreras. Destacaron las estrategias de aprendizaje en equipo y Service Learning Experience. La efectividad de las experiencias educativas resultó poco concluyente; no obstante, se sugieren ciertas pautas en base a lo analizado. Resulta imprescindible desarrollar mayor investigación a nivel latinoamericano y que se incluyan las mejoras metodológicas señaladas. La formación debería focalizarse en desarrollar la autoconciencia cultural como base para la comprensión mutua, esto requiere de un equipo docente con competencias pedagógicas y culturales, además de sanitarias. Finalmente, es fundamental investigar sobre los factores que permiten un mayor desarrollo de estas competencias en el estudiantado.

There is a direct impact on health service outcomes when professionals are trained in intercultural competence and interprofessional education. No systematic reviews were found in the specialized literature that examined both factors together over the last ten years. To characterize the methodological aspects of empirical research regarding Intercultural Competence with Interprofessional Education in Health Sciences students, To describe the curricular aspects of training in Intercultural Competence with Interprofessional Education, and To analyze the effectiveness of said educational experiences. A systematic review of the Web of Science, Scopus, SciELO, PubMed, and ProQuest databases was carried out from 2010 to 2020. There is a predominance of articles composed in the United States and Australia, with a mixed approach, not experimental, limited sample size, and use of survey perception. The contents dealt with general intercultural knowledge and health care, with extracurricular, faceto-face, short-term experiences, and for a limited number of majors. Team learning strategies and stood out Service Learning Experience. The effectiveness of the educational experiences was inconclusive; however, certain guidelines are recommended based on what has been analyzed. It is crucial to develop more research at a Latin American level including the methodological improvements. Training should focus on developing cultural self-awareness as a basis for mutual understanding, this requires a teaching team with pedagogical and cultural skills, as well as health knowledge. Finally, it is fundamental to investigate the factors that allow more comprehensive development of these competencies in the student body.

Asunto(s)

RESUMEN

INTRODUCTION: Objective: to describe an evaluation of interobserver agreement in the use of a checklist related to the use of nasoenteral tube (NSS) as a presupposition for quality in obtaining data. Method: a methodological study conducted in 2018 in a Brazilian hospital, preceding the data collection of an open-label clinical trial. Independent observers, blinded to the evaluation of their peers, evaluated patients with NSS through a 25-item checklist. The data collected by eight previously trained research assistants (RA) were compared to those obtained by an experienced nurse (reference standard). Agreement was measured using the kappa coefficient and PABAK. Results: a total of 451 observations were made in pairs. Considering the total items on the checklist there was almost perfect agreement (k > 0.80) in all observation pairs (nurse vs. each RA): RA 1 (k = 0.91; 95 % CI = 0.89-0.93); RA 2 (k = 0.83; 95 % CI = 0.80-0.85); RA 3 (k = 0.92; 95 % CI = 0.90-0.94); RA 4 (k = 0.83; 95 % CI = 0.80-0.86); RA 5 (k = 0.94; 95 % CI = 0.92-0.96); RA 6 (k = 0.94; 95 % CI = 0.92-0.96); RA 7 (k = 0.96; 95 % CI = 0.95-0.98); RA 8 (k = 0.73; 95 % CI = 0.70-0.77). However, for isolated items, and in specific RAs, there were fair agreements, unacceptable to effectively collect data from a clinical trial. Retraining and supervision of RAs were able to improve agreement between observers. Conclusion: an evaluation of interobserver agreement proved to be fundamental to ensure the reliability of data collection and, therefore, to avoid measurement biases.

INTRODUCCIÓN: Objetivo: describir una evaluación de la concordancia entre observadores en el uso de una lista de verificación en la atención a pacientes con sonda nasoenteral (SNE) como premisa de la recogida de datos. Método: este estudio de fiabilidad se realizó en 2018 en un hospital brasileño, antes de la recogida de datos para un ensayo clínico abierto. Ocho observadores independientes, previamente capacitados y "cegados" con respecto a las evaluaciones de los demás, evaluaron a pacientes con SNE por medio de una lista de comprobación de 25 elementos. Los datos obtenidos por estos asistentes de investigación (AI) se compararon con los obtenidos por una enfermera experimentada. Se midió la concordancia mediante los coeficientes kappa y PABAK. Resultados: se realizaron 451 observaciones por pares. Considerando la totalidad de los elementos, hubo una concordancia casi perfecta (k > 0,80) en todos los pares de observación (enfermera vs. cada AI): AI 1 (k = 0,91; IC95 % = 0,89-0,93); AI 2 (k = 0,83; IC95 % = 0,80-0,85); AI 3 (k = 0,92; IC95 %= 0,90-0,94 ); AI 4 (k = 0,83; IC95 % = 0,80-0,86); AI 5 (k = 0,94; IC95 % = 0,92-0,96); AI 6 (k = 0,94; IC95 % = 0,92-0,96); AI 7 (k = 0,96; IC95 % = 0,95-0,98); AI 8 (k = 0,73; IC95 % = 0,70-0,77). Se identificó un menor número de concordancia en los elementos individuales y en determinados AI. La recapacitación y supervisión de los AI mejoró su desempeño y la concordancia entre observadores. Conclusión: la evaluación de la concordancia entre observadores resultó fundamental para asegurar la fiabilidad de la recogida de datos y, por consiguiente, evitar sesgos de medición en los estudios clínicos de enfermería.

Asunto(s)

Asunto(s)

RESUMEN

BACKGROUND: Central venous access (CVA) is a frequent procedure taught in medical residencies. However, since CVA is a high-risk procedure requiring a detailed teaching and learning process to ensure trainee proficiency, it is necessary to determine objective differences between the expert's and the novice's performance to guide novice practitioners during their training process. This study compares experts' and novices' biomechanical variables during a simulated CVA performance. METHODS: Seven experts and seven novices were part of this study. The participants' motion data during a CVA simulation procedure was collected using the Vicon Motion System. The procedure was divided into four stages for analysis, and each hand's speed, acceleration, and jerk were obtained. Also, the procedural time was analyzed. Descriptive analysis and multilevel linear models with random intercept and interaction were used to analyze group, hand, and stage differences. RESULTS: There were statistically significant differences between experts and novices regarding time, speed, acceleration, and jerk during a simulated CVA performance. These differences vary significantly by the procedure stage for right-hand acceleration and left-hand jerk. CONCLUSIONS: Experts take less time to perform the CVA procedure, which is reflected in higher speed, acceleration, and jerk values. This difference varies according to the procedure's stage, depending on the hand and variable studied, demonstrating that these variables could play an essential role in differentiating between experts and novices, and could be used when designing training strategies.

Asunto(s)

RESUMEN

OBJECTIVES: To describe the development and initial results of an examination and certification process assessing competence in critical care echocardiography. DESIGN: A test writing committee of content experts from eight professional societies invested in critical care echocardiography was convened, with the Executive Director representing the National Board of Echocardiography. Using an examination content outline, the writing committee was assigned topics relevant to their areas of expertise. The examination items underwent extensive review, editing, and discussion in several face-to-face meetings supervised by National Board of Medical Examiners editors and psychometricians. A separate certification committee was tasked with establishing criteria required to achieve National Board of Echocardiography certification in critical care echocardiography through detailed review of required supporting material submitted by candidates seeking to fulfill these criteria. SETTING: The writing committee met twice a year in person at the National Board of Medical Examiner office in Philadelphia, PA. SUBJECTS: Physicians enrolled in the examination of Special Competence in Critical Care Electrocardiography (CCEeXAM). MEASUREMENTS AND MAIN RESULTS: A total of 524 physicians sat for the examination, and 426 (81.3%) achieved a passing score. Of the examinees, 41% were anesthesiology trained, 33.2% had pulmonary/critical care background, and the majority had graduated training within the 10 years (91.6%). Most candidates work full-time at an academic hospital (46.9%). CONCLUSIONS: The CCEeXAM is designed to assess a knowledge base that is shared with echocardiologists in addition to that which is unique to critical care. The National Board of Echocardiography certification establishes that the physician has achieved the ability to independently perform and interpret critical care echocardiography at a standard recognized by critical care professional societies encompassing a wide spectrum of backgrounds. The interest shown and the success achieved on the CCEeXAM by practitioners of critical care echocardiography support the standards set by the National Board of Echocardiography for testamur status and certification in this imaging specialty area.

Asunto(s)

Asunto(s)

RESUMEN

AIMS: No evidence-informed educational curriculum is available for designing urodynamics (UDS) courses. We evaluated the learning outcomes of a short-lasting urodynamic course for urology residents. METHODS: Urology residents of postgraduate years 4 and 5 (n = 13 and n = 1316, respectively) attended a 1-day urodynamic course. Learning objectives included patient preparation, indication and technique, terminology, trace interpretation, and impact on patient management. Instructional methods consisted of short lectures (3 h) and case-based discussions (7.5 h). Learners' reactions, modifications of perceptions and attitudes, and acquisition of knowledge and skills were assessed by three written tests with a single group, pretest, posttest 1, and posttest 2 design. Tests were conducted precourse, 1 week after, and 4 months after the course. RESULTS: All participants felt more confident in several urodynamic competencies after the course, including patient preparation, urodynamic indication and technique, terminology, trace interpretation, and impact for patient management. These perceptions remained unchanged after 4 months. Most became stricter in the indication of UDS, including 20 (87.0%) at posttest 1 and 8 (66.7%) at posttest 2. The mean number of correct answers in the knowledge evaluation was 52.2% versus 61.4% versus 56.7%, respectively at pretest, posttest 1, and posttest 2; p = 0.535). All participants rated the course as very useful or useful in both posttest evaluations. CONCLUSIONS: Our study demonstrates that a 1-day urodynamic course can promote lasting improvements in self-reported perceptions, attitudes, and urodynamic-related competencies of urology residents. Further studies using evidence-informed educational principles are needed to determine the effect of specific educational interventions on urodynamic competencies in different contexts.

Asunto(s)

Asunto(s)