In This Section

Are You Measuring What You Think You Are? Writing Board-Style Multiple Choice Questions

Monday April 04, 2022

8:00 am - 10:00 am Eastern Time (ET)

109 AB

DPE

Chair :

Rupa Tuan
University of California, San Francisco

Rob Augustyniak
Lincoln Memorial University- DeBusk College of Osteopathic Medicine

Marieke Kruidering
University of California, San Francisco



Health science educators are often tasked with creating relevant exam items without training in question-writing, resulting in questions that are too easy or too difficult with overall low discrimination ability. Due to the COVID-19 pandemic, question banks have been depleted or compromised as a result of wide-spread remote virtual testing. This interactive, skills-building workshop will provide educators with the opportunity to learn the basic steps of writing board-style examination questions and actively work together to improve their own questions using constructive peer feedback. This will help faculty towards developing versatility in item-writing skills based on curricular needs and exam stakes.

Speakers

Marieke Kruidering - University of California, San Francisco

Introduction

Miguel Paniagua - National Board of Medical Examiners (NBME)

Pre-test

A pre-test will be given where participants will assess question items for flaws. Participants work on this pre-test individually first, and then briefly discuss their assessment of the pre-test in pairs.

Adrienne Ables - Adrienne Ables Consulting

Interactive Large Group

The Interactive Large Group will be led by Miguel and Adrienne and will take a deeper dive into what participants found in the pre-test. Topics covered will include: testwiseness, irrelevant difficulty, one-best-answer items and clinical vignettes.

Miguel Paniagua - National Board of Medical Examiners (NBME)

Interactive Large Group

Adrienne, Miguel, Rob and Rupa will facilitate small group discussions. Participants will be asked to bring question items they want to work on and receive feedback on. If they do not have their own questions, sub-optimal questions that need improvement will be provided.

Rob Augustyniak - Lincoln Memorial University- DeBusk College of Osteopathic Medicine

Small groups for peer constructive feedback

Large group wrap-up

In the wrap-up, reporters from each small group will report back to the large group. Miguel and Adrienne will summarize the session and discuss next steps.