Your browser doesn't support javascript.
loading
Enhancing Health Literacy: Evaluating the Readability of Patient Handouts Revised by ChatGPT's Large Language Model.
Swisher, Austin R; Wu, Arthur W; Liu, Gene C; Lee, Matthew K; Carle, Taylor R; Tang, Dennis M.
Afiliación
  • Swisher AR; Department of Otolaryngology-Head and Neck Surgery, Mayo Clinic, Phoenix, Arizona, USA.
  • Wu AW; Division of Otolaryngology-Head and Neck Surgery, Cedars-Sinai, Los Angeles, California, USA.
  • Liu GC; Division of Otolaryngology-Head and Neck Surgery, Cedars-Sinai, Los Angeles, California, USA.
  • Lee MK; Division of Otolaryngology-Head and Neck Surgery, Cedars-Sinai, Los Angeles, California, USA.
  • Carle TR; Division of Otolaryngology-Head and Neck Surgery, Cedars-Sinai, Los Angeles, California, USA.
  • Tang DM; Division of Otolaryngology-Head and Neck Surgery, Cedars-Sinai, Los Angeles, California, USA.
Otolaryngol Head Neck Surg ; 2024 Aug 06.
Article en En | MEDLINE | ID: mdl-39105460
ABSTRACT

OBJECTIVE:

To use an artificial intelligence (AI)-powered large language model (LLM) to improve readability of patient handouts. STUDY

DESIGN:

Review of online material modified by AI.

SETTING:

Academic center.

METHODS:

Five handout materials obtained from the American Rhinologic Society (ARS) and the American Academy of Facial Plastic and Reconstructive Surgery websites were assessed using validated readability metrics. The handouts were inputted into OpenAI's ChatGPT-4 after prompting "Rewrite the following at a 6th-grade reading level." The understandability and actionability of both native and LLM-revised versions were evaluated using the Patient Education Materials Assessment Tool (PEMAT). Results were compared using Wilcoxon rank-sum tests.

RESULTS:

The mean readability scores of the standard (ARS, American Academy of Facial Plastic and Reconstructive Surgery) materials corresponded to "difficult," with reading categories ranging between high school and university grade levels. Conversely, the LLM-revised handouts had an average seventh-grade reading level. LLM-revised handouts had better readability in nearly all metrics tested Flesch-Kincaid Reading Ease (70.8 vs 43.9; P < .05), Gunning Fog Score (10.2 vs 14.42; P < .05), Simple Measure of Gobbledygook (9.9 vs 13.1; P < .05), Coleman-Liau (8.8 vs 12.6; P < .05), and Automated Readability Index (8.2 vs 10.7; P = .06). PEMAT scores were significantly higher in the LLM-revised handouts for understandability (91 vs 74%; P < .05) with similar actionability (42 vs 34%; P = .15) when compared to the standard materials.

CONCLUSION:

Patient-facing handouts can be augmented by ChatGPT with simple prompting to tailor information with improved readability. This study demonstrates the utility of LLMs to aid in rewriting patient handouts and may serve as a tool to help optimize education materials. LEVEL OF EVIDENCE Level VI.
Palabras clave
Texto completo
Añadir a Mi BVS
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Idioma: En Revista: Otolaryngol Head Neck Surg Asunto de la revista: OTORRINOLARINGOLOGIA Año: 2024 Tipo del documento: Article País de afiliación: Estados Unidos Pais de publicación: Reino Unido
Texto completo
Añadir a Mi BVS
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Idioma: En Revista: Otolaryngol Head Neck Surg Asunto de la revista: OTORRINOLARINGOLOGIA Año: 2024 Tipo del documento: Article País de afiliación: Estados Unidos Pais de publicación: Reino Unido