One year into medical school, I have essentially become a professional multiple choice test taker. One thing you must learn is how to grind through, and exploit, poorly written test questions. In medical school, most of the professors are NOT full time teachers. They come in for a month or two out of the year and teach their material. The questions they come up with have taught me that multiple choice test writing is a skill that comes to some naturally, and others not so much.
My friend Patrick found this sarcastic quiz online that highlights what I mean.
Can you answer these 6 questions about multiple-choice questions?
1. I opened a course on a topic I know nothing about, clicked through without reading anything, and took the assessment. I passed! What does that suggest?
- I am a genius!
- The assessment was too easy.
- Maybe the course was too easy, too.
- Maybe the course didn’t even need to be written.
- b, c, and d
2. In a multiple-choice question, when is the longest answer the correct answer?
- Rarely
- Sometimes
- It’s almost always the correct answer, and it’s often stuffed with new information that should have gone in the main part of the course but we forgot so now we’re putting it in the quiz because we can’t possibly leave out the tiniest detail
- Occasionally
3. When is “All of the above” the correct answer?
- With alarming regularity
- When we try to cover too much in one question
- When we use a question to teach instead of assess
- All of the above
4. When is it NOT a good idea to avoid negative questions?
- Never
- Sometimes
- Always
- What?
5. How often is the correct answer a?
- Usually
- Frequently
- Often
- Almost never, because if a is the right answer, then the learner doesn’t have to read all the other options we spent so much time writing and revising, and where’s the ROI in that?
6. We can confuse learners when we:
- fail to actually complete the sentence we started in the question.
- inconsistent grammar in the options.
- sometimes we veer off into another idea entirely.
- wombats.
My tests are filled with questions like these, where half the battle is making sure you understand what it is you are being asked. Oh well... 4 months to go!
Source: http://blog.cathy-moore.com/2007/08/can-you-answer-these-6-questions-about-multiple-choice-questions/
1 comment:
Keith, don't be too hard on the test makers - some day you may need to put one together. In training caregivers I loved putting together the curriculum, making lesson plans, teaching but tests - ugh !
Post a Comment