Your browser doesn't support javascript.
loading
A continuous-speech interface to a decision support system: II. An evaluation using a Wizard-of-Oz experimental paradigm.
Detmer, W M; Shiffman, S; Wyatt, J C; Friedman, C P; Lane, C D; Fagan, L M.
Afiliación
  • Detmer WM; Section on Medical Informatics, Stanford University School of Medicine, CA 94305-5479.
J Am Med Inform Assoc ; 2(1): 46-57, 1995.
Article en En | MEDLINE | ID: mdl-7895136
OBJECTIVE: Evaluate the performance of a continuous-speech interface to a decision support system. DESIGN: The authors performed a prospective evaluation of a speech interface that matches unconstrained utterances of physicians with controlled-vocabulary terms from Quick Medical Reference (QMR). The performance of the speech interface was assessed in two stages: in the real-time experiment, physician subjects viewed audiovisual stimuli intended to evoke clinical findings, spoke a description of each finding into the speech interface, and then chose from a list generated by the interface the QMR term that most closely matched the finding. Subjects believed that the speech recognizer decoded their utterances; in reality, a hidden experimenter typed utterances into the interface (Wizard-of-Oz experimental design). Later, the authors replayed the same utterances through the speech recognizer and measured how accurately utterances matched with appropriate QMR terms using the results of the real-time experiment as the "gold standard." MEASUREMENTS: The authors measured how accurately the speech-recognition system converted input utterances to text strings (recognition accuracy) and how accurately the speech interface matched input utterances to appropriate QMR terms (semantic accuracy). RESULTS: Overall recognition accuracy was less than 50%. However, using language-processing techniques that match keywords in recognized utterances to keywords in QMR terms, the semantic accuracy of the system was 81%. CONCLUSIONS: Reasonable semantic accuracy was attained when language-processing techniques were used to accommodate for speech misrecognition. In addition, the Wizard-of-Oz experimental design offered many advantages for this evaluation. The authors believe that this technique may be useful to future evaluators of speech-input systems.
Asunto(s)

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Toma de Decisiones Asistida por Computador / Procesamiento de Lenguaje Natural / Interfaz Usuario-Computador Tipo de estudio: Observational_studies / Prognostic_studies Límite: Adolescent / Animals / Humans Idioma: En Revista: J Am Med Inform Assoc Asunto de la revista: INFORMATICA MEDICA Año: 1995 Tipo del documento: Article Pais de publicación: Reino Unido

Texto completo: 1 Colección: 01-internacional Base de datos: MEDLINE Asunto principal: Toma de Decisiones Asistida por Computador / Procesamiento de Lenguaje Natural / Interfaz Usuario-Computador Tipo de estudio: Observational_studies / Prognostic_studies Límite: Adolescent / Animals / Humans Idioma: En Revista: J Am Med Inform Assoc Asunto de la revista: INFORMATICA MEDICA Año: 1995 Tipo del documento: Article Pais de publicación: Reino Unido