Your browser doesn't support javascript.
loading
ChatGPT as an information tool in rhinology. Can we trust each other today?
Riestra-Ayora, Juan; Vaduva, Cristina; Esteban-Sánchez, Jonathan; Garrote-Garrote, María; Fernández-Navarro, Carlos; Sánchez-Rodríguez, Carolina; Martin-Sanz, Eduardo.
Afiliación
  • Riestra-Ayora J; Department of Medicine, Faculty of Biomedical and Health Sciences, Universidad Europea de Madrid, Villaviciosa de Odón, 28670, Madrid, Spain. juan.riestra@hotmail.com.
  • Vaduva C; Department of Otolaryngology-Head and Neck Surgery, Hospital Universitario de Getafe, Carretera de Toledo, Km 12.500, Getafe, 28905, Madrid, Spain. juan.riestra@hotmail.com.
  • Esteban-Sánchez J; Department of Medicine, Faculty of Biomedical and Health Sciences, Universidad Europea de Madrid, Villaviciosa de Odón, 28670, Madrid, Spain.
  • Garrote-Garrote M; Department of Otolaryngology-Head and Neck Surgery, Hospital Universitario de Getafe, Carretera de Toledo, Km 12.500, Getafe, 28905, Madrid, Spain.
  • Fernández-Navarro C; Department of Medicine, Faculty of Biomedical and Health Sciences, Universidad Europea de Madrid, Villaviciosa de Odón, 28670, Madrid, Spain.
  • Sánchez-Rodríguez C; Department of Otolaryngology-Head and Neck Surgery, Hospital Universitario de Getafe, Carretera de Toledo, Km 12.500, Getafe, 28905, Madrid, Spain.
  • Martin-Sanz E; Department of Otolaryngology-Head and Neck Surgery, Hospital Universitario de Getafe, Carretera de Toledo, Km 12.500, Getafe, 28905, Madrid, Spain.
Eur Arch Otorhinolaryngol ; 281(6): 3253-3259, 2024 Jun.
Article en En | MEDLINE | ID: mdl-38436756
ABSTRACT

PURPOSE:

ChatGPT (Chat-Generative Pre-trained Transformer) has proven to be a powerful information tool on various topics, including healthcare. This system is based on information obtained on the Internet, but this information is not always reliable. Currently, few studies analyze the validity of these responses in rhinology. Our work aims to assess the quality and reliability of the information provided by AI regarding the main rhinological pathologies.

METHODS:

We asked to the default ChatGPT version (GPT-3.5) 65 questions about the most prevalent pathologies in rhinology. The focus was learning about the causes, risk factors, treatments, prognosis, and outcomes. We use the Discern questionnaire and a hexagonal radar schema to evaluate the quality of the information. We use Fleiss's kappa statistical analysis to determine the consistency of agreement between different observers.

RESULTS:

The overall evaluation of the Discern questionnaire resulted in a score of 4.05 (± 0.6). The results in the Reliability section are worse, with an average score of 3.18. (± 1.77). This score is affected by the responses to questions about the source of the information provided. The average score for the Quality section was 3.59 (± 1.18). Fleiss's Kappa shows substantial agreement, with a K of 0.69 (p < 0.001).

CONCLUSION:

The ChatGPT answers are accurate and reliable. It generates a simple and understandable description of the pathology for the patient's benefit. Our team considers that ChatGPT could be a useful tool to provide information under prior supervision by a health professional.
Asunto(s)
Palabras clave
Texto completo
Añadir a Mi BVS
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Otolaringología Límite: Humans Idioma: En Revista: Eur Arch Otorhinolaryngol Asunto de la revista: OTORRINOLARINGOLOGIA Año: 2024 Tipo del documento: Article País de afiliación: España Pais de publicación: Alemania
Texto completo
Añadir a Mi BVS
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Otolaringología Límite: Humans Idioma: En Revista: Eur Arch Otorhinolaryngol Asunto de la revista: OTORRINOLARINGOLOGIA Año: 2024 Tipo del documento: Article País de afiliación: España Pais de publicación: Alemania