Use of Advanced Multiple Response Questions in Small Groups
Another unique aspect of the way we handle AMR questions is to include the availability of a Critical Failure attribute that can be attached to any answer choice. This is very important in the health sciences, and assessments at the clinical level should include this type of outcome option. For example, while performing a clinical procedure for grade, if a student fails on one step of the rubric, the expectation should be that the student failed the entire procedure. The logic behind this is that in many cases, poor clinical decisions or actions harm patients and negatively affect outcomes. So, with the AMR question, one or more of the answer choices can be assigned a critical failure attribute. If the student selects that answer choice as part of what they believe to be the set of correct responses, they automatically get the question wrong. Getting it wrong means they have not mastered the material sufficiently well to earn a passing grade.
Now imagine you have a small group of students working together, looking at one of these more complex questions. They often will include a detailed clinical scenario or they might include other interpretive information such as charts, radiographs and the like. Now imagine that you assign these students with the task of trying to reach a consensus on what set of answer choices would equate to a correct response, and earn them maximum credit. Now imagine, also, that students are informed that they need to be aware of the land mines: the answer choices tagged with critical failures. Think about the value of having the students work through these questions, and as a team, trying to solve them. Both negative point values and critical failures discourage guessing. Students must constructively work together to identify the best responses. Besides knowledge, comprehension and higher cognitive ability, think about professionalism, interpersonal skills, teamwork, collaboration and even how leadership qualities might play a factor in this type of interaction and problem-solving.
Please let us know what you think. If you are interested in seeing a sample of our latest AMR questions (Family Medicine) please click here. Let us show you how these can be used to your students’ and program’s benefit.