RESUMO

Assessment is an essential component for all educational programs and must check competence acquirement while foster and promote learning. Progress Test (PT) is well recognized to assess cognitive knowledge, clinical reasoning and decision making in the clinical context, offering important information about the individual performance and program quality. It is widely used in Brazilian and international medical schools; however, it still has little role in assessing medical residents in Brazil. We present the experience of a PT pilot implementation in an Infectious Diseases residency program over two years. The first, second and third-year residents did four serial exams with 40 multiple choice questions (item)/each. Preceptors were trained on best practices on item writing. All the items were reviewed by a panel of experts and, after approval, included in the item bank. All participants answered a survey on their perceptions about the experience. The final score was higher for the third-year residents in all exam applications. The level of satisfaction was high among the participants, who mentioned the learning opportunity with the exam and the feedback. PT can improve residents' assessment along the training period and residents' performance should guide review and improvement of the programs.

Assuntos

RESUMO

La evaluación ha dejado de ser una instancia que sólo certifica el logro alcanzado a través de una calificación, sino actualmente se entiende como un elemento fundamental para favorecer los procesos de enseñanza-aprendizaje. El objetivo del presente estudio fue "Conocer las concepciones y prácticas evaluativas del alumnado y profesorado de la FIPEF (Formación Inicial del Profesorado en Educación Física) de dos campus universitarios de la zona sur austral de Chile". Para ello, se contó con una muestra de 219 alumnos y alumnas (edad M = 21.6 y dt. = 2.8) de dos campus universitarios que cursaban Formación Inicial del Profesorado en Educación Física (FIPEF) y 21 profesores y profesoras (edad M = 50.3 y dt. = 13.2). Se aplicó el "Cuestionario para el estudio del sistema de evaluación en la formación inicial del profesorado de educación física" de forma virtual, sometiendo los resultados a pruebas estadísticas como la media, desviación típica y pruebas inferenciales. Los principales resultados dejan ver la presencia de metodologías e instrumentos tradicionales de evaluación, así como, una apreciación diferenciada entre alumnado vs. profesorado. Sin embargo, se puede constatar la presencia de intencionalidad formativa en las acciones implementadas por el profesorado.

The evaluation has ceased to be a mere instance that only certifies the achievement through a grade; rather, it is currently understood as a fundamental element to promote teaching and learning processes. The objective of the present study was to "Understand the conceptions and evaluative practices of students and faculty in the FIPEF (Initial Teacher Education in Physical Education) of two university campuses in the southernmost region of Chile." For this purpose, a sample of 219 students (age M = 21.6 and SD = 2.8) from two university campuses undergoing Initial Teacher Education in Physical Education (FIPEF) and 21 teachers (age M = 50.3 and SD = 13.2) was used. The "Questionnaire for the study of the evaluation system in the initial teacher education of physical education" was administered in a virtual manner, subjecting the results to statistical tests such as mean, standard deviation, and inferential tests. The main results reveal the presence of traditional evaluation methodologies and instruments, as well as a differentiated perception between students and faculty. However, there is evidence of formative intent in the actions implemented by the faculty.

A avaliação deixou de ser apenas uma instância que certifica a conquista por meio de uma nota; atualmente, é compreendida como um elemento fundamental para promover os processos de ensino e aprendizagem. O objetivo do presente estudo foi "Compreender as concepções e práticas avaliativas dos estudantes e professores da FIPEF (Formação Inicial de Professores de Educação Física) de dois campi universitários na região sul-austral do Chile." Para isso, contamos com uma amostra de 219 alunos (idade M = 21,6 e dp. = 2,8) de dois campi universitários que cursavam a Formação Inicial de Professores de Educação Física (FIPEF) e 21 professores (idade M = 50,3 e dp. = 13,2). Foi aplicado o "Questionário para o estudo do sistema de avaliação na formação inicial de professores de educação física" de forma virtual, sujeitando os resultados a testes estatísticos como média, desvio padrão e testes inferenciais. Os principais resultados revelam a presença de metodologias e instrumentos tradicionais de avaliação, bem como uma percepção diferenciada entre alunos e professores. No entanto, há evidências de intencionalidade formativa nas ações implementadas pelos professores.

RESUMO

BACKGROUND: The prevalence of overweight and obesity in schoolchildren is increasing in Peru. Given the increased use of digital media, there is potential to develop effective digital health interventions to promote healthy eating practices at schools. This study investigates the needs of schoolchildren in relation to healthy eating and the potential role of digital media to inform the design of game-based nutritional interventions. OBJECTIVE: This study aims to explore schoolchildren's knowledge about healthy eating and use of and preferences for digital media to inform the future development of a serious game to promote healthy eating. METHODS: A survey was conducted in 17 schools in metropolitan Lima, Peru. The information was collected virtually with specific questions for the schoolchild and their caregiver during October 2021 and November 2021 and following the COVID-19 public health restrictions. Questions on nutritional knowledge and preferences for and use of digital media were included. In the descriptive analysis, the percentages of the variables of interest were calculated. RESULTS: We received 3937 validated responses from caregivers and schoolchildren. The schoolchildren were aged between 8 years and 15 years (2030/3937, 55.8% girls). Of the caregivers, 83% (3267/3937) were mothers, and 56.5% (2223/3937) had a secondary education. Only 5.2% (203/3937) of schoolchildren's homes did not have internet access; such access was through WiFi (2151/3937, 54.6%) and mobile internet (1314/3937, 33.4%). In addition, 95.3% (3753/3937) of schoolchildren's homes had a mobile phone; 31.3% (1233/3937) had computers. In relation to children's knowledge on healthy eating, 42.2% (1663/3937) of schoolchildren did not know the recommendation to consume at least 5 servings of fruits and vegetables daily, 46.7% (1837/3937) of schoolchildren did not identify front-of-package warning labels (FOPWLs), and 63.9% (2514/3937) did not relate the presence of an FOPWL with dietary risk. Most schoolchildren (3100/3937, 78.7%) preferred to use a mobile phone. Only 38.3% (1509/3937) indicated they preferred a computer. In addition, 47.9% (1885/3937) of caregivers considered that the internet helps in the education of schoolchildren, 82.7% (3254/3937) of caregivers gave permission for schoolchildren to play games with digital devices, and 38% (1495/3937) of caregivers considered that traditional digital games for children are inadequate. CONCLUSIONS: The results suggest that knowledge about nutrition in Peruvian schoolchildren has limitations. Most schoolchildren have access to the internet, with mobile phones being the device type with the greatest availability and preference for use. Caregivers' perspectives on games and schoolchildren, including a greater interest in using digital games, provide opportunities for the design and development of serious games to improve schoolchildren's nutritional knowledge in Peru. Future research is needed to explore the potential of serious games that are tailored to the needs and preferences of both schoolchildren and their caregivers in Peru in order to promote healthy eating.

RESUMO

BACKGROUND: Feedback processes are crucial for learning, guiding improvement, and enhancing performance. In workplace-based learning settings, diverse teaching and assessment activities are advocated to be designed and implemented, generating feedback that students use, with proper guidance, to close the gap between current and desired performance levels. Since productive feedback processes rely on observed information regarding a student's performance, it is imperative to establish structured feedback activities within undergraduate workplace-based learning settings. However, these settings are characterized by their unpredictable nature, which can either promote learning or present challenges in offering structured learning opportunities for students. This scoping review maps literature on how feedback processes are organised in undergraduate clinical workplace-based learning settings, providing insight into the design and use of feedback. METHODS: A scoping review was conducted. Studies were identified from seven databases and ten relevant journals in medical education. The screening process was performed independently in duplicate with the support of the StArt program. Data were organized in a data chart and analyzed using thematic analysis. The feedback loop with a sociocultural perspective was used as a theoretical framework. RESULTS: The search yielded 4,877 papers, and 61 were included in the review. Two themes were identified in the qualitative analysis: (1) The organization of the feedback processes in workplace-based learning settings, and (2) Sociocultural factors influencing the organization of feedback processes. The literature describes multiple teaching and assessment activities that generate feedback information. Most papers described experiences and perceptions of diverse teaching and assessment feedback activities. Few studies described how feedback processes improve performance. Sociocultural factors such as establishing a feedback culture, enabling stable and trustworthy relationships, and enhancing student feedback agency are crucial for productive feedback processes. CONCLUSIONS: This review identified concrete ideas regarding how feedback could be organized within the clinical workplace to promote feedback processes. The feedback encounter should be organized to allow follow-up of the feedback, i.e., working on required learning and performance goals at the next occasion. The educational programs should design feedback processes by appropriately planning subsequent tasks and activities. More insight is needed in designing a full-loop feedback process, in which specific attention is needed in effective feedforward practices.

Assuntos

RESUMO

Introducción. El uso de la inteligencia artificial (IA) en la educación ha sido objeto de una creciente atención en los últimos años. La IA se ha utilizado para mejorar la personalización del aprendizaje, la retroalimentación y la evaluación de los estudiantes. Sin embargo, también hay desafíos y limitaciones asociados. El objetivo de este trabajo fue identificar las principales tendencias y áreas de aplicación de la inteligencia artificial en la educación, así como analizar los beneficios y limitaciones de su uso en este ámbito. Métodos. Se llevó a cabo una revisión sistemática que exploró el empleo de la inteligencia artificial en el ámbito educativo. Esta revisión siguió una metodología de investigación basada en la búsqueda de literatura, compuesta por cinco etapas. La investigación se realizó utilizando Scopus como fuente de consulta primaria y se empleó la herramienta VOSviewer para analizar los resultados obtenidos. Resultados. Se encontraron numerosos estudios que investigan el uso de la IA en la educación. Los resultados sugieren que la IA puede mejorar significativamente la personalización del aprendizaje, proporcionando recomendaciones de actividades y retroalimentación adaptadas a las necesidades individuales de cada estudiante. Conclusiones. A pesar de las ventajas del uso de la IA en la educación, también hay desafíos y limitaciones que deben abordarse, como la calidad de los datos utilizados por la IA, la necesidad de capacitación para educadores y estudiantes, y las preocupaciones sobre la privacidad y la seguridad de los datos de los estudiantes. Es importante seguir evaluando los efectos del uso de la IA en la educación para garantizar su uso efectivo y responsable.

Introduction. The use of artificial intelligence (AI) in education has been the subject of increasing attention in recent years. AI has been used to improve personalized learning, feedback, and student assessment. However, there are also challenges and limitations. The aim of this study was to identify the main trends and areas of application of artificial intelligence in education, as well as to analyze the benefits and limitations of its use in this field. Methods. A systematic review was carried out on the use of artificial intelligence in education, using a literature search research methodology with five stages, based on the Scopus query and the tool for analyzing results with VOSviewer. Results. Numerous studies investigating the use of AI in education were found. The results suggest that AI can significantly improve personalized learning by providing activity recommendations and feedback tailored to the individual needs of each student. Conclusions. Despite the advantages of using AI in education, there are also challenges and limitations that need to be addressed, such as the quality of data used by AI, the need for training for educators and students, and concerns about the privacy and security of student data. It is important to continue evaluating the effects of AI use in education to ensure its effective and responsible use.

Assuntos

RESUMO

ABSTRACT Assessment is an essential component for all educational programs and must check competence acquirement while foster and promote learning. Progress Test (PT) is well recognized to assess cognitive knowledge, clinical reasoning and decision making in the clinical context, offering important information about the individual performance and program quality. It is widely used in Brazilian and international medical schools; however, it still has little role in assessing medical residents in Brazil. We present the experience of a PT pilot implementation in an Infectious Diseases residency program over two years. The first, second and third-year residents did four serial exams with 40 multiple choice questions (item)/each. Preceptors were trained on best practices on item writing. All the items were reviewed by a panel of experts and, after approval, included in the item bank. All participants answered a survey on their perceptions about the experience. The final score was higher for the third-year residents in all exam applications. The level of satisfaction was high among the participants, who mentioned the learning opportunity with the exam and the feedback. PT can improve residents' assessment along the training period and residents' performance should guide review and improvement of the programs.

RESUMO

ABSTRACT Objective: To understand the pedagogical elements necessary for the debriefing to favor the development of reflective thinking. Method: A single case study developed at the Centro de Simulación en Salud of the Escuela de Enfermería of the Universidad de Costa Rica in October 2018. Data were collected through interviews, observation and document analysis. For data analysis, the strategy of theoretical propositions and the construction of explanation technique were used. Results: The data originated two categories: 1) pedagogy of the organization, addressed elements thought by the professor to facilitate the dialogue; 2) facilitation pedagogy, brought elements from the dialogue itself that enrich the discussion, mobilize the group, provoke reflection and engagement. Final considerations: It is essential to include the following as pedagogical elements in order to favor the development of reflective thinking: prior planning, adequate environment, systematization, pedagogical training in facilitating debriefing, openness to dialogue, pedagogical respect, valorization of positive aspects, patience, and motivation.

RESUMEN Objetivo: Comprender los elementos pedagógicos necesarios para que el debriefing favorezca el desarrollo del pensamiento reflexivo. Método: La información sobre el tipo de estudio, muestra, período, lugar de la investigación, recolección y análisis de datos debe presentarse de manera clara y objetiva, sin excesivos detalles. El método debe alinearse con la sección de métodos del artículo completo, brindando información más detallada sobre el diseño del estudio y los procedimientos utilizados. Resultados: Los datos originaron dos categorías: 1) pedagogía de la organización, en que los elementos abordados pensados por el profesor para facilitar el diálogo; 2) pedagogía de la facilitación, en que el trajo elementos del propio diálogo que enriquecen la discusión, movilizan al grupo, provocan la reflexión y el compromiso. Consideraciones finales: Es imprescindible incluir como elementos pedagógicos que favorezcan el desarrollo del pensamiento reflexivo los siguientes: planeamiento previo, ambiente adecuado, sistematización, formación pedagógica en la facilitación del debriefing, apertura al diálogo, respeto pedagógico, valorización de los aspectos positivos, paciencia y motivación.

RESUMO Objetivo: Compreender os elementos pedagógicos necessários para que o debriefing favoreça o desenvolvimento do pensamento reflexivo. Método: Estudo de caso único desenvolvido no Centro de Simulaciónen Salud da Escuela de Enfermería da Universidad de Costa Rica em outubro de 2018. Os dados foram coletados por meio de entrevistas, observação e análise documental. Utilizaram-se a estratégia de proposições teóricas e a técnica de construção de explanação para a análise dos dados. Resultados: Os dados originaram duas categorias: 1) pedagogia da organização, a qual abordou elementos pensados pelo docente para facilitar o diálogo; 2) pedagogia da facilitação, a qual trouxe elementos do próprio diálogo que enriquecem a discussão, mobilizam o grupo, provocam a reflexão e o engajamento. Considerações finais: Torna-se imprescindível incluir como elementos pedagógicos que favoreçam o desenvolvimento do pensamento reflexivo os seguintes: planejamento prévio, ambiente adequado, sistematização, formação pedagógica em facilitação de debriefing, abertura ao diálogo, respeito pedagógico, valorização do positivo, paciência e motivação.

RESUMO

O processo formativo é considerado a criação contínua de formas somáticas ao longo da existência para fazer presença, para responder aos acontecimentos e para ampliar a função da vida em seu processo evolutivo. Dispõe de uma prática corporal fortemente baseada em imagens, uma vez que se inclui ver e trabalhar em processo e como realidade somática por meio de imagens gráficas e vídeo. Neste texto, discorremos sobre o uso da linguagem das histórias em quadrinhos (HQ) para cartografar o processo formativo de corpos, que emergiu do trabalho realizado pelo Laboratório do Processo Formativo durante a pandemia de Covid-19 em grupos on-line, diante da necessidade urgente de mutação dos corpos devido a confinamento e ameaça à vida e de adaptação a um cotidiano intensamente permeado pelas telas.

The formative process can be defined as the continuous creation of somatic forms throughout existence to establish presence, respond to events and expand the function of life in the evolutionary process. It comprises a heavily image-based bodily practice, since it includes seeing and working on oneself as part of a process and somatic reality using visual image and videos. We discuss the use of comic book language to map the formative process of bodies. This initiative emerged from work developed by the Formative Process Laboratory during the Covid-19 pandemic with on-line groups in response to the urgent need for the mutation of bodies in the face of confinement, the threat to life and the adaption of daily lives intensely permeated by screens.

El proceso formativo se considera la creación continua de formas somáticas a lo largo de la existencia para señalar presencia, para responder a los acontecimientos y para la ampliación de la función de la vida en su proceso evolutivo. Dispone de una práctica corporal fuertemente basada en imágenes, puesto que incluye verse y trabajarse en el proceso y como realidad somática por medio de imágenes gráficas y en video. En este texto trataremos sobre el uso del lenguaje de los cómics, para cartografiar el proceso formativo de cuerpos, que surgió del trabajo realizado por el Laboratorio del Proceso Formativo durante la pandemia de Covid-19 en grupos on-line, ante la necesidad urgente de mutación de los cuerpos frente al confinamiento y a la amenaza a la vida y de adaptación a un cotidiano intensamente ocupado por las pantallas.

Assuntos

RESUMO

BACKGROUND: The use of measurement instruments to assess the use of Evidence-Based Practice by health professionals has been frequently reported in studies. AIMS: This systematic review aimed to summarize, describe, and evaluate the measurement properties of the instruments that evaluate the use of Evidence-Based Practice in health professionals. METHODS: The search was carried out in four databases considering three groups of search terms: evidence-based practice, evaluation, and measurement proprieties. Studies were included that described the use of instruments to assess Evidence-Based Practice in health professionals, with the full-text publication, which analyzed the measurement properties, in English. The methodological quality of the studies was evaluated using COnsensus-based Standards for the selection of health Measurement INstruments. RESULTS: In total, 6,429 were found and only 92 were eligible for data analysis. Forty new instruments were identified most were developed for nursing and physical therapist. The investigators performed at least 1 type of validity test on 73% of the instruments. Reliability was tested at 90%, through internal consistency. Responsiveness was tested on less than half of the instruments (30%). Most of the instruments identified are reliable and valid to measure evidence-based practice in health professionals. CONCLUSION: Although the Fresno Test remains the most complete instrument, and adequate for use. The COnsensus-based Standards for the selection of health Measurement INstruments checklist classified 7 (seven) instruments as suitable for the target audience.

RESUMO

In the present research the typical triangle on formative research was extended to a double triangle for an overall career programme (here expander/ compressor) and funnel proposal was explored in a single course (as a "fractal" method). Array processing and ElectroEncephaloGram (EEG) techniques have been incorporated into a Digital Signal Processing (DSP) course and research projects. The present research question was: is it possible to insert array sensing on formative research in an undergraduate course of DSP? From over eight years, two semesters with different homework loads (homogeneous triangle vs expander-compressor-supplier distributions) were analysed in detail within the DSP evaluations and students chose between experimental applied analysis and a formative research project. Results showed that cognitive load was influenced positively in the expander-compressor-supplier distribution, showing that an increase of the efficiency undertook more undergraduate research on array processing and the decrease of the number of formative applied projects. Over a longer term (48 months) students undertook more undergraduate research works on array processing and DSP techniques. Supplementary Information: The online version contains supplementary material available at 10.1007/s10639-023-11837-y.

RESUMO

El manejo del inglés, como idioma universal, constituye una necesidad para los profesionales ecuatorianos. La educación superior tiene la responsabilidad de facilitar la adquisición y consolidación de habilidades y destrezas en su manejo. La investigación formativa puede contribuir a esto por las características propias de este proceso. El objetivo de este trabajo fue exponer los elementos conceptuales y operacionales que permiten el adecuado desarrollo de la investigación formativa para consolidar destrezas y habilidades en el manejo del idioma inglés. En esta investigación se vierten opiniones de como puede ser utilizada la investigación formativa en el fomento de la preparación bilingüe de los estudiantes, basado en sus conceptos básicos. Con su aplicación se favorecen dos elementos básicos como son la motivación del estudiante y la adquisición de habilidades y destrezas relacionadas con los cuatro componentes fundamentales para el conocimiento de idiomas. Se concluye que la adopción de la investigación formativa como una estrategia metodológica de aprendizaje en el sistema de educación superior en el Ecuador, abre el camino a la formación, directa o indirecta, de habilidades y destrezas en el manejo del idioma inglés; es necesario entonces fortalecer el conocimiento sobre sus elementos metodológicos básicos que pueden favorecer la participación y formación bilingüe de los estudiantes de educación superior en el país.

The use of English, as a universal language, is a necessity for Ecuadorian professionals. Higher education has the responsibility of facilitating the acquisition and consolidation of abilities and skills in its management. Formative research can contribute to this due to the characteristics of this process. The objective of this work was to expose the conceptual and operational elements that allow the adequate development of formative research to consolidate skills and abilities in the management of the English language. In this research, opinions are expressed on how formative research can be used to promote the bilingual preparation of students, based on its basic concepts. With its application, two basic elements are favored, such as student motivation and the acquisition of abilities and skills related to the four fundamental components for language knowledge. It is concluded that the adoption of formative research as a methodological learning strategy in the higher education system in Ecuador, opens the way to the formation, direct or indirect, of abilities and skills in the management of the English language; It is therefore necessary to strengthen the knowledge about its basic methodological elements that can favor the participation and bilingual training of higher education students in the country.

RESUMO

BACKGROUND: During the COVID-19 pandemic, face-to-face teaching and learning of physiotherapy practical skills was limited. Asynchronous, remote training has been effective in development of clinical skills in some health professions. This study aimed to determine the effect of remote, asynchronous training and feedback on development of neurodynamic skills in physiotherapy students. METHODS: Longitudinal repeated measurements study, across four training sessions. Participants engaged in a remote training program for development of upper limb neurodynamic techniques. In this sequential training, participants viewed the online tutorial, practiced independently, and uploaded a video of their performance for formative assessment and feedback from a trained instructor via a checklist and rubric. RESULTS: Intra-subject analyses of 60 third-year physiotherapy students showed that the target standard of performance, with no further significant change in scores, was attained following session 2 for the checklist and session 3 for the rubric. This shows that two sessions are required to learn the procedures, and three sessions yield further improvements in performance quality. CONCLUSION: The remote, asynchronous training and feedback model proved to be an effective strategy for students' development of neurodynamic testing skills and forms a viable alternative to in-person training. This study contributes to the future of acquiring physiotherapy clinical competencies when distance or hybrid practice is required.

Assuntos

RESUMO

RESUMO Intervenções para a capacitação parental de famílias de crianças com deficiência auditiva, incluindo as usuárias de implante coclear, são apontadas como otimizadoras em seus resultados de desenvolvimento. Neste estudo de intervenção de caso único, temos por objetivos descrever o uso do videofeedback em ambiente remoto, bem como identificar a sua efetividade, a partir da análise da interação da mãe e criança, tanto para os comportamentos comunicativos da mãe como para os comportamentos da linguagem receptiva e expressiva da criança. Medidas pré e pós-intervenção foram realizadas, a partir da análise de vídeos de interação da mãe com a criança, por juízes cegos, bem como pela aplicação de instrumentos de avaliação da criança e da mãe. Foram realizadas 13 sessões, sendo 3 de avaliação nos momentos pré e pós-intervenção e 10 sessões de teleconsulta em que se empregou a ferramenta de videofeedback com a mãe. Os dados foram analisados de forma descritiva e inferencial, por meio do método JT, que determinou o Índice de Mudança Confiável (IMC) e a Significância Clínica. Houve mudança positiva confiável na linguagem receptiva e expressiva da criança, bem como mudança positiva confiável e mudança clínica significativa na interação da mãe com a criança após as 10 sessões de intervenção remota com videofeedback. A partir das mudanças confiáveis observadas neste estudo, apresentamos este modelo (Televideofeedback), como potencial para otimizar os recursos e esforços para o sucesso terapêutico na reabilitação auditiva infantil, o qual deve ser estudado em pesquisas com método rigoroso, para a ampla recomendação de seu uso.

ABSTRACT Interventions for parental training for families of hard of hearing children, including cochlear implant users, are identified as optimizing their developmental outcomes. In this single-case intervention study, we aim to describe the use of videofeedback in a remote environment, as well as to identify its effectiveness, based on the analysis of mother-child interaction, both for the mother's communicative behaviors and for the behaviors of the mother, receptive and expressive language of the child. Pre- and post-intervention measurements were performed, based on video analysis of the mother's interaction with the child, by blind judges, as well as through the application of assessment instruments for the child and the mother. There were 13 sessions, 3 of which were for evaluation before and after the intervention and 10 of teleconsultation sessions in which the videofeedback tool was used with the mother. Data were analyzed descriptively and inferentially, using the JT method, which determined the Reliable Change Index (BMI) and Clinical Significance. There was reliable positive change in the child's receptive and expressive language, as well as reliable positive change and clinically significant change in mother-child interaction after the 10 sessions of remote videofeedback intervention. Based on the reliable changes observed in this study, we present this model (televideofeedback) as a potential to optimize resources and efforts for therapeutic success in children's auditory rehabilitation, which should be studied in research with a rigorous method, for the broad recommendation of its use.

RESUMO

Resumo Introdução: A avaliação é primordial no processo de ensino-aprendizagem do médico residente. O Mini-CEX é considerado um instrumento apropriado para realizar uma avaliação formativa, permitindo um feedback educacional estruturado. Nesse contexto, os preceptores de residência precisam estar em contínuo processo de capacitação para melhor direcionar os seus residentes, e uma forma viável de capacitação é por meio do ensino a distância (EaD). Objetivo: Este estudo teve como objetivos desenvolver e validar um curso na modalidade de EaD sobre Mini-CEX para preceptores da residência em mastologia. Método: Trata-se de desenvolvimento e validação de um produto técnico-educacional no formato de curso de capacitação e na modalidade de EaD. No processo de validação de conteúdo do produto, utilizou-se a técnica de grupo de consenso. A validação semântica foi realizada através de questionário de validação aplicado aos preceptores envolvidos na residência em mastologia. Resultado: Foi elaborado e validado um curso autoinstrucional e sem mediação, com carga horária total de duas horas. O curso teve aprovação do público-alvo por apresentar um escore médio global de 98% de satisfação e um alfa de Cronbach igual a 0,8. Conclusão: O curso desenvolvido e validado sobre Mini-CEX apresenta-se como opção relevante para a formação de preceptores de residência médica em mastologia, podendo se estender para qualquer serviço de residência médica. Ressalta-se que o curso na modalidade de EaD favorece a adesão do público-alvo apresentando um formato acessível para fortalecer o conhecimento sobre o tema, além de incentivar os preceptores a utilizar a ferramenta de avaliação educacional.

Abstract Introduction: Assessment is paramount in the resident physician's teaching-learning process. The Mini-CEX is considered an appropriate instrument to carry out formative assessment, allowing structured educational feedback. In this context, residency preceptors need to undergo a continuous training process to better prepare their residents, and a viable form of training is using Distance Education (EaD). Objective: To develop and validate a Distance Education (EaD) course on Mini-CEX for residency preceptors in Mastology. Method: Development and validation of a technical-educational product, in the format of a training course and in the Distance Education modality (EaD). The consensus group technique was used in the product content validation process. Semantic validation was carried out through a validation questionnaire applied to the preceptors involved in the residency program in Mastology. Results: A self-instructional and unmediated course was designed and validated, with a total workload of 02 (two) hours. The course was approved by the target audience, as it had an overall average score of 98% satisfaction and a Cronbach's alpha equal to 0.8. Conclusions: The course developed and validated on Mini-CEX presents itself as a relevant option for the training of medical residency preceptors in Mastology and can be extended to any medical residency service. It should be noted that the Distance Education (EaD) course favors the adherence of the target audience, with an accessible format to strengthen knowledge on the subject, in addition to encouraging preceptors to also use the educational evaluation.

RESUMO

Abstract The choice of statistical data analysis should be guided by a critical analysis that supports the theoretical relationship between the construct and its indicators. This theoretical article reviews the three main existing psychometric paradigms and their proposals for explaining the relationship between indicators and their constructs. The discussion begins with the standard paradigm that guides the construction and analysis of data in psychology, reflective model. Then, a description of the formative models is performed and finally the Network Analysis as an alternative. The definitions, consequences, and limitations of the use of each measurement model are presented such as a reflection on making decisions about which data generation mechanisms are more appropriate.

Resumo A escolha da análise estatística de dados deveria ser guiada por uma análise crítica que fundamenta a relação teórica entre construto e seus indicadores. Este teórico artigo faz uma revisão dos três principais paradigmas psicométricos e suas propostas de explicação da relação entre os indicadores e seus construtos. A discussão é iniciada com o paradigma padrão que guia a construção e análise de dados na psicologia, os modelos reflexivos. Em seguida, é realizada uma descrição dos modelos formativos e, por fim, a proposta da Análise de Redes como alternativa. São apresentadas as definições, consequências e limitações do uso de cada modelo de medida, bem como uma reflexão na tomada de decisão sobre quais mecanismos de geração de dados são mais apropriados.

RESUMO

Introducción: La producción científica latinoamericana aún no es la esperada. Por ello tiene importancia analizar la actividad científica sobre investigación formativa en esta parte del mundo. Objetivo: Evaluar la producción latinoamericana sobre investigación formativa en Scopus en el período 2010-2020. Métodos: Estudio descriptivo retrospectivo. Las unidades de análisis fueron publicaciones sobre investigación formativa en revistas indizadas en la base de datos Scopus durante 2010-2020, y cuya autoría hacía mención a filiaciones de entidades latinoamericanas. Resultados: Se encontró un total de 120 artículos publicados con autoría a afiliaciones de instituciones latinoamericanas. Colombia es el país que contribuye con mayor producción científica sobre este tema, seguido por México, Perú y Brasil, que sobrepasan el 10 por ciento de la producción latinoamericana. En cuanto a la productividad por institución, 83 instituciones internacionales han participado en la producción latinoamericana sobre investigación formativa, entre los que destacan instituciones de México, Perú y Colombia con 4 y más artículos publicados. Conclusiones: La producción latinoamericana sobre investigación formativa entre 2010 y 2020 fue de 120 artículos en revistas indizadas en Scopus, con un porcentaje mayoritario de artículos de investigación, procedentes de Colombia, México y Perú. La institución con más producción resultó el Instituto Nacional de Salud Pública de México, y como las revistas con mayor cantidad de artículos aparecieron Q1 y Q2, con presencia de autores peruanos, brasileros y mexicanos(AU)

Introduction: Latin American scientific production is not yet as expected. Therefore, it is important to analyze the scientific activity on formative research in this part of the world. Objective: To evaluate the Latin American production on formative research in Scopus in the period 2010-2020. Methods: Retrospective descriptive study. The units of analysis were publications on formative research in journals indexed in the Scopus database during 2010-2020, and whose authorship mentioned affiliations with Latin American institutions. Results: A total of 120 published articles were found with authorship to affiliations of Latin American institutions. Colombia is the country that contributes with the highest scientific production on this subject, followed by Mexico, Peru and Brazil, which exceed 10 percent of the Latin American production. In terms of productivity by institution, 83 international institutions have participated in the Latin American production on formative research, among which institutions from Mexico, Peru and Colombia stand out with 4 or more published articles. Conclusions: The Latin American production on formative research between 2010 and 2020 was 120 articles in journals indexed in Scopus, with a majority percentage of research articles, coming from Colombia, Mexico and Peru. The institution with the highest production was the National Institute of Public Health of Mexico, and the journals with the highest number of articles were Q1 and Q2, with the presence of Peruvian, Brazilian and Mexican authors(AU)

Assuntos

RESUMO

Introducción: El uso del portafolio para el aprendizaje y la evaluación ha surgido, en los últimos años, como herramienta en los procesos formativos al adoptarse una nueva y renovada visión sobre la enseñanza, el aprendizaje desarrollador y la evaluación educativa. Objetivo: Describir las regularidades y tendencias del proceso de evaluación por portafolio de las asignaturas de la carrera de Medicina en la Facultad de Ciencias Médicas "Dr. Ernesto Guevara de la Serna", Pinar del Río, Cuba, entre enero de 2021 y julio de 2021. Método: Se realizó un estudio descriptivo y transversal, con la utilización de métodos teóricos, empíricos y estadísticos, en los cuales el universo coincidió con la muestra representada por 60 profesionales docentes de la carrera de Medicina de dicha facultad. Se analizaron documentos normativos relacionados con el proceso de evaluación de las asignaturas médicas, especialmente, la evaluación por portafolio, así como el estado de opinión de profesores sobre la pertinencia de esta modalidad de evaluación. Resultados: Se consideró baja la dimensión cognitiva-procedimental al tenerse en cuenta que la mayoría de los indicadores fueron evaluados de bajo, debido a las dificultades presentadas respecto al dominio de los conocimientos, habilidades y ventajas del objeto de estudio de la investigación. Conclusiones: La concepción de la evaluación por portafolio, como proceso formativo en función del logro del aprendizaje desarrollador en los alumnos y un resultado desde lo instructivo, educativo e interdisciplinario, muestra insuficiencias y por ello es necesario comprender que el uso de esta herramienta constituye para el docente un medio de enseñanza y para los estudiantes un recurso para aprender construyendo.

Introduction: The use of a portfolio for learning and evaluation has emerged in recent years, as a tool for training processes in the new and renewed vision of teaching, developmental learning and educational evaluation. Objective: Describe regularities and tendencies in the portfolio assessment process used in the Medicine career at the Facultad de Ciencias Médicas "Dr. Ernesto Guevara de la Serna", Pinar del Río, Cuba, between January 2021 and July 2021. Method: A descriptive and cross-sectional study was carried out, using theoretical, empirical and statistical methods, in which 60 professor from the over mentioned Faculty of Medicine were selected as universe and sample. Normative documents related to the evaluation process of medical subjects were analyzed, especially, the portfolio assessment, as well as the opinion expressed by professors concerning this evaluation modality. Results: The cognitive-procedural dimension was considered low taking into account that most of the indicators were evaluated as low, due to the difficulties presented with respect to the mastery of knowledge, skills and advantages of the aim proposed in the research. Conclusions: In this case, the use of the portfolio assessment as a formative process in terms of in students' achievements and learning process and in terms of result from the instructional, educational and interdisciplinary aspects, shows insufficiencies. Therefore, it is necessary to understand that the use of this tool constitutes for the professors a means of teaching and for the students a resource for learning by building.

Introdução: O uso do portfólio para aprendizagem e avaliação tem surgido, nos últimos anos, como uma ferramenta nos processos de formação ao adotar uma nova e renovada visão de ensinar, desenvolver a aprendizagem e a avaliação educacional. Objetivo: Descrever as regularidades e tendências do processo de avaliação por portfólio das disciplinas da carreira de Medicina da Facultad de Ciencias Médicas "Dr. Ernesto Guevara de la Serna", Pinar del Río, Cuba, entre janeiro de 2021 e julho de 2021. Método: Realizou-se um estudo descritivo e transversal, utilizando métodos teóricos, empíricos e estatísticos, em que o universo coincidiu com a amostra representada por 60 profissionais docentes da carreira de Medicina da referida faculdade. Foram analisados os documentos normativos relacionados ao processo avaliativo das disciplinas médicas, em especial a avaliação por portfólio, bem como a opinião dos docentes sobre a relevância dessa modalidade de avaliação. Resultados: A dimensão cognitivo-processual foi considerada baixa ao se levar em conta que a maioria dos indicadores foi avaliada como baixa, devido às dificuldades apresentadas quanto ao domínio de conhecimentos, habilidades e vantagens do objeto de estudo da investigação. Conclusões: A concepção da avaliação de portfólio, como um processo formativo baseado na conquista do desenvolvimento da aprendizagem nos alunos e resultado dos aspectos instrutivo, educacional e interdisciplinar, mostra insuficiências e por isso é necessário entender que o uso de esta ferramenta constitui para o professor um meio de ensino e para os alunos um recurso para aprender construindo.

RESUMO

Predicting long-term student achievement is a critical task for teachers and for educational data mining. However, most of the models do not consider two typical situations in real-life classrooms. The first is that teachers develop their own questions for online formative assessment. Therefore, there are a huge number of possible questions, each of which is answered by only a few students. Second, online formative assessment often involves open-ended questions that students answer in writing. These types of questions in online formative assessment are highly valuable. However, analyzing the responses automatically can be a complex process. In this paper, we address these two challenges. We analyzed 621,575 answers to closed-ended questions and 16,618 answers to open-ended questions by 464 fourth-graders from 24 low socioeconomic status (SES) schools. Using regressors obtained from linguistic features of the answers and an automatic incoherent response classifier, we built a linear model that predicts the score on an end-of-year national standardized test. We found that despite answering 36.4 times fewer open-ended questions than closed questions, including features of the students' open responses in our model improved our prediction of their end-of-year test scores. To the best of our knowledge, this is the first time that a predictor of end-of-year test scores has been improved by using automatically detected features of answers to open-ended questions on online formative assessments.

RESUMO

The pandemic had serious implications for university education, specifically due to the transition from face-to-face teaching to online methodologies. This article analyzes the perception of students undergoing speech therapy from a Chilean University about the E-portfolio incorporation as an evaluative tool during the emergency virtual teaching due to the COVID-19 pandemic. From quantitative research, a survey of 38 questions based on Likert scales was applied to 108 penultimate year undergraduate students. The survey demonstrated that there is an improvement in the methodology and teaching support, as well as in the creativity and professionalism of the students.