RESUMEN
RESUMO Este estudo tem como objetivo apresentar os resultados da tradução, validação transcultural e avaliação preliminar de uma ferramenta, originalmente desenvolvida no Reino Unido, para orientar pesquisadores brasileiros na elaboração de projetos e pesquisas de implementação rigorosos e de alta qualidade: ImpRes-BR. Seguindo boas práticas atualmente estabelecidas para validação transcultural de instrumentos e escalas, a ferramenta, juntamente com seu guia de utilização, foi traduzida e retrotraduzida, submetida a um teste piloto com 20 profissionais de saúde e avaliada por um painel de 10 especialistas que atribuíram os valores utilizados para os cálculos do Índice de Validade de Conteúdo ao nível do item (IVC-I) e escala (IVC-E). Nesse processo, além de índices de validade conceitual superiores à 90%, foi observado um IVC-I de pelo menos 0,90 em todos os domínios da ferramenta e seu guia e um IVC-E de 0,98. Estabelecida a validade da ferramenta e seu guia, a mesma foi aplicada em 14 projetos de pesquisa em fase de planejamento ou execução e foi reconhecida enquanto um instrumento potente para autoanálise das equipes na qualificação de seus projetos e fortalecimento destes em relação aos princípios da Ciência de Implementação.
ABSTRACT This study aims to present the results of the translation, cross-cultural validation and preliminary evaluation of a tool, originally developed in the United Kingdom, to guide Brazilian researchers in the elaboration of projects and rigorous and high-quality implementation research: ImpRes-BR. Following currently established good practices for cross-cultural validation of instruments and scales, the tool, together with its user guide, was translated and back-translated, subjected to a pilot test with 20 health professionals and evaluated by a panel of 10 specialists who assigned the values used for the calculations of the Content Validity Index at the item level (CVI-I) and scale (CVI-E). In this process, in addition to conceptual validity indices greater than 90%, an IVC-I of at least 0.90 was observed in all domains of the tool and its guide, and an IVC-E of 0.98. Having established the validity of the tool and its guide, it was applied in 14 research projects in the planning or execution phase and was recognized as a powerful instrument for self-analysis of the teams in the qualification of their projects and strengthening them in relation to the principles of the Implementation Science.
RESUMEN
urgical thinking around errors and patient safety has changed dramatically over the past 15 years. The relevance of effective teamwork, both within the operating theatre but also across the entire perioperative pathway, is acknowledged as a critical component of safe and effective surgical care, resulting in good outcomes and quick recovery for the surgical patient. Consequently, significant efforts have been made to understand how teams work within surgical care pathways and how to improve teamwork.
Asunto(s)
HumanosRESUMEN
Background. Poor teamwork and nontechnical skill performance are increasingly recognized as important contributing factors to errors and adverse events in the operating room. Assessment of these safety critical skills is important to facilitate improvement, however there are no tools available to assess these safety skills in Latin America. This study aimed to translate, culturally adapt and content validate the Observational Teamwork Assessment for Surgery (OTAS) tool for use in Latin America. Methods. A multi-phase, multi-method study was conducted: Phase 1: translation and back-translation; Phase 2: content validity assessed via expert consensus; Phase 3: inter-rater reliability assessed via real-time observation in 98 general surgical procedures using OTAS-S. Results. The first change in OTAS-S, was to distinguish between the surgical nurses and scrub technicians (both OR team members are captured in the nursing sub-team in the original OTAS). OTAS-S consists of 168 exemplar behaviors: 60/114 identical to the exemplars listed in the original OTAS tool, 48/114 original exemplars underwent minor modifications, 13 were duplicated (to account for the additional sub-team distinguished in OTAS-S), 6 original exemplars were removed, and 47 new exemplar behaviors were added. Inter-observer agreement was substantial (KW = 0.602; IC: 0.581-0.620). The calculated KW by phase, behaviors and teams were between 0.534 and 0.678. Conclusions. The study provides a content validated teamwork assessment tool for use within Colombian operating rooms and potentially Latin-American. OTAS-S can be used to assess the quality of teamwork in ORs, facilitate structured debriefing and thus improve patient safety and reduce team-related errors.
Asunto(s)
Errores Médicos/prevención & control , Quirófanos , Grupo de Atención al Paciente/normas , Traducciones , Colombia , Cultura , Humanos , América Latina , Reproducibilidad de los ResultadosRESUMEN
BACKGROUND: Recent studies show a significant rate of adverse events in hospitalized patients in developing/transitional countries--with approximately 18% of them related to surgical procedures. Understanding and preventing these errors requires adequate training in patient safety research methods--however, relevant training programs are currently lacking. We developed, delivered and evaluated a training program to address this gap. METHODS: A one-day training program was developed based on the recently published WHO core competencies for patient safety research. The focus was on surgical patient safety research - including human factors, operating room (OR) teamwork, the OR environment, and safety culture. Feasibility, relevance and preliminary evaluation of the program ('proof of concept' testing) was conducted in Bogotá, Colombia in July 2011. A validated evaluation framework was utilized, assessing participants' objective knowledge, attitudes, and observational skills. RESULTS: 30 postgraduate students from a range of clinical/non-clinical disciplines signed up and 17 attended the program. Participants' knowledge of surgical patient safety significantly improved upon program completion (Mean pre-course=55% vs. Mean post-course=68%, P<0.01), as did their confidence and understanding of problems and methodologies to assess OR patient safety, and teamwork issues (P<0.05). Observational skills in recognizing safety-related behaviors using OTAS (i.e., quality of teamwork) improved on qualitative evaluation. CONCLUSIONS: We have developed a viable, WHO-driven training program that can be delivered to clinical and non-clinical researchers to develop their competencies and thereby build capacity in developing/transitional countries to carry out surgical safety research. All program materials are available in English and Spanish for research, training and dissemination.