Are You Measuring What You Think You Are? Writing Board-Style Multiple Choice Questions
Monday April 04, 2022
8:00 am
-
10:00 am
Eastern Time (ET)
109 AB
DPE
Chair :
Rupa Tuan
University of California, San Francisco
Rob Augustyniak
Lincoln Memorial University- DeBusk College of Osteopathic Medicine
Marieke Kruidering
University of California, San Francisco
Health science educators are often tasked with creating relevant exam items without training in question-writing, resulting in questions that are too easy or too difficult with overall low discrimination ability. Due to the COVID-19 pandemic, question banks have been depleted or compromised as a result of wide-spread remote virtual testing. This interactive, skills-building workshop will provide educators with the opportunity to learn the basic steps of writing board-style examination questions and actively work together to improve their own questions using constructive peer feedback. This will help faculty towards developing versatility in item-writing skills based on curricular needs and exam stakes.
Speakers
Marieke Kruidering
- University of California, San Francisco
Miguel Paniagua
- National Board of Medical Examiners (NBME)
Pre-test
A pre-test will be given where participants will assess question items for flaws. Participants work on this pre-test individually first, and then briefly discuss their assessment of the pre-test in pairs.
Adrienne Ables
- Adrienne Ables Consulting
Interactive Large Group
The Interactive Large Group will be led by Miguel and Adrienne and will take a deeper dive into what participants found in the pre-test. Topics covered will include: testwiseness, irrelevant difficulty, one-best-answer items and clinical vignettes.
Miguel Paniagua
- National Board of Medical Examiners (NBME)
Interactive Large Group
Adrienne, Miguel, Rob and Rupa will facilitate small group discussions. Participants will be asked to bring question items they want to work on and receive feedback on. If they do not have their own questions, sub-optimal questions that need improvement will be provided.
Rob Augustyniak
- Lincoln Memorial University- DeBusk College of Osteopathic Medicine
Small groups for peer constructive feedback
Large group wrap-up
In the wrap-up, reporters from each small group will report back to the large group. Miguel and Adrienne will summarize the session and discuss next steps.