Use of Multiple-Choice Items in Summative Examinations: Questionnaire Survey Among German Undergraduate Dental Training Programs.
JMIR Med Educ
; 10: e58126, 2024 Jun 27.
Article
en En
| MEDLINE
| ID: mdl-38952022
ABSTRACT
Background:
Multiple-choice examinations are frequently used in German dental schools. However, details regarding the used item types and applied scoring methods are lacking.Objective:
This study aims to gain insight into the current use of multiple-choice items (ie, questions) in summative examinations in German undergraduate dental training programs.Methods:
A paper-based 10-item questionnaire regarding the used assessment methods, multiple-choice item types, and applied scoring methods was designed. The pilot-tested questionnaire was mailed to the deans of studies and to the heads of the Department of Operative/Restorative Dentistry at all 30 dental schools in Germany in February 2023. Statistical analysis was performed using the Fisher exact test (P<.05).Results:
The response rate amounted to 90% (27/30 dental schools). All respondent dental schools used multiple-choice examinations for summative assessments. Examinations were delivered electronically by 70% (19/27) of the dental schools. Almost all dental schools used single-choice Type A items (24/27, 89%), which accounted for the largest number of items in approximately half of the dental schools (13/27, 48%). Further item types (eg, conventional multiple-select items, Multiple-True-False, and Pick-N) were only used by fewer dental schools (≤67%, up to 18 out of 27 dental schools). For the multiple-select item types, the applied scoring methods varied considerably (ie, awarding [intermediate] partial credit and requirements for partial credit). Dental schools with the possibility of electronic examinations used multiple-select items slightly more often (14/19, 74% vs 4/8, 50%). However, this difference was statistically not significant (P=.38). Dental schools used items either individually or as key feature problems consisting of a clinical case scenario followed by a number of items focusing on critical treatment steps (15/27, 56%). Not a single school used alternative testing methods (eg, answer-until-correct). A formal item review process was established at about half of the dental schools (15/27, 56%).Conclusions:
Summative assessment methods among German dental schools vary widely. Especially, a large variability regarding the use and scoring of multiple-select multiple-choice items was found.Palabras clave
German; Germany; Kprim; K'; MTF; Multiple-True-False; Pick-N; Type A; Type K; Type K'; Type R; Type X; alternate-choice; assessment; best-answer; dental; dental schools; dental training; education; educational assessment; educational measurement; examination; k of n; medical education; medical student; multiple choice; multiple-select; scoring; scoring system; single choice; single response; test; testing; true-false; true/false; undergraduate; undergraduate curriculum; undergraduate education
Texto completo:
1
Colección:
01-internacional
Base de datos:
MEDLINE
Asunto principal:
Educación en Odontología
/
Evaluación Educacional
Límite:
Humans
País/Región como asunto:
Europa
Idioma:
En
Revista:
JMIR Med Educ
Año:
2024
Tipo del documento:
Article
País de afiliación:
Alemania
Pais de publicación:
Canadá