#uncaoe @ryanmadanickmd email: [email protected] twitter: @ryanmadanickmd blog: phone: (919)...

18
#UNCAOE @RyanMadanickMD Email: [email protected] Twitter: @RyanMadanickMD Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan D. Madanick, MD Assistant Professor of Medicine Center for Esophageal Diseases and Swallowing (CEDAS) Division of Gastroenterology and Hepatology University of North Carolina School of Medicine Chapel Hill, NC Writing Meaningful Test Questions

Upload: abel-cain

Post on 04-Jan-2016

215 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Email: [email protected]: @RyanMadanickMDBlog: http://gutcheckblog.com

Phone: (919) 966-2513Fax: (919) 843-2508

Ryan D. Madanick, MDAssistant Professor of Medicine

Center for Esophageal Diseases and Swallowing (CEDAS)Division of Gastroenterology and Hepatology

University of North Carolina School of MedicineChapel Hill, NC

Writing Meaningful Test Questions

Page 2: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Learning Objective

By the end of this session, learners should be able to:–Create a meaningful 1st order multiple

choice question using an objective-based process

Page 3: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Question Components

STEM

OPTIONS

LEAD-IN

Page 4: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Question Components

OBJECTIVE

EXPLANATION

ANSWER

Page 5: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Steps to Writing the MCQ

1. Determine the objective you are testing2. Write the lead-in and options3. Draft the stem4. Write the explanation (if needed)

Page 6: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Improving the Educational Objective

• “Understand peptic ulcer disease”

What is wrong with this objective?How could it be improved?

Page 7: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

The Objective

• Succinct sentence• Specifies a clinical skill to be learned• Uses action verbs to delineate a goal

Recognize, diagnose, treat, manage

• Avoid vague action verbs Remember, recall, know

• Allows you to match curriculum

Page 8: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Action Verbs for Objectives

Page 9: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Improving the Educational Objective

• “Understand peptic ulcer disease”

What is wrong with this objective?How could it be improved?

• 1st order: “Diagnose peptic ulcer disease”• 2nd order: “Select the appropriate test for a

patient with suspected peptic ulcer disease”• 3rd order: “Explain the mechanism of action

for a drug used to treat peptic ulcer disease”

Page 10: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

The Lead-In

• Keep Lead-In generic– What is the best next step in management?

• Use relative terms– What is the most likely diagnosis?

• Avoid negative lead lines– Which of the following is the LEAST LIKELY diagnosis?

• Watch for syntax/grammar cues• “Cover the options” rule

Page 11: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Options

• Avoid mutually exclusive options Increases/decreases Always/never; stop/continue

• Each option should test one concept Drug OR dose OR route OR duration

• Keep options brief; similar in length• Options should be homogeneous

Length, complexity

Page 12: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

The Stem

• Chronologic order of presentation Age, gender (avoid race unless needed) Site of visit (ER, clinic, hospital) Chief complaint (add features) PMH/Meds/FH/SH (relevant or distracter) Vitals/Exam/Labs/Tests (pertinent)

Page 13: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

EXERCISE

Page 14: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Write an objective for a potential test question

Page 15: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Write the lead-in and options for your objective

Page 16: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Draft the stem for your question

Page 17: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan
Page 18: #UNCAOE @RyanMadanickMD Email: madanick@med.unc.edu Twitter: @RyanMadanickMD Blog:  Phone: (919) 966-2513 Fax: (919) 843-2508 Ryan

#UNCAOE@RyanMadanickMD

Learning Objective

By the end of this session, learners should be able to:–Create a meaningful 1st order multiple

choice question using an objective-based process

Special thanks to Amy Oxentenko, MD for some of these slides