One-Day Dental Faculty Workshop in Writing Multiple-Choice Questions: An Impact Evaluation

Journal Article

AlFaris, Eiad . 2015

• نوع عمل المنشور: Scientific Research Publication
• رابط المنشور على الويب: dental education, assessment, multiple-choice questions, dental faculty, faculty development, Kirkpatrick’s framework
• الوسوم: dental education, assessment, multiple-choice questions, dental faculty, faculty development, Kirkpa
• المجلة \ الصحيفة: Journal of Dental Education
• رقم العدد: 11
• رقم الإصدار السنوي: 79
• الصفحات: 1305-13

مستخلص المنشور

PURPOSE/OBJECTIVES: Long training workshops on item writing were shown to be effective; however, the effectiveness of short workshops needs to be demonstrated.
The objective of the current study is to evaluate the impact of a one-day faculty-training workshop on the quality of in-house Multiple Choice Questions (MCQs) items.
METHOD: 
Design: Kirkpatrick's four-level evaluation model was used. A quasi-experimental randomized separate sample pretest / post-test design was used to assess the learning effect (Kirkpatrick level 2). The quality of in-house MCQs as a result of training was used for level 3. An interview was held with the school Vice Dean to determine what changes were observed (level 4).
Participants: Twenty-two course directors from a large school of dentistry participated in the levels 1 and 2 of the study at the end of 2012 and beginning of 2013. In-house tests of ten faculty members were selected for level 3; and interview with a Vice Dean (level 4).
Intervention: A six hours workshop for two different cohorts.
RESULTS: A significant positive change was found in participants' knowledge and the in-house MCQs with an effect size of 0.7 and 0.28 consecutively. At the institutional level positive structural changes took place.
CONCLUSION: A faculty short item-writing workshop resulted in changes at all the Kirkpatrick's levels such as the quality of in house MCQs and institutional assessment strategy. The explanation for the change is a leadership buy-in and administrative support after the main intervention.