Comparing Exam Master Practice Exam Results to Board Success
All of our practice exams are designed with these requirements in mind:
- Use the most current test plan to ensure that we are testing the concepts and constructs that are supposed to be tested.
- Employ processes for developing quality test items, including alternate test items when applicable (like NCLEX).
- Weight the exam by topic or subject based on the actual exam weighting (e.g., 18% of the questions should cover cardiology) when such weighting information is publicly available.
- Include the same number of questions as the actual board exam, when possible.
- Match the item types (often multiple choice) found on the actual exam, including a mixture of item types where applicable.
With these objectives in mind, we are confident that our practice exams cover the broad topics and subtopics found on the exams they are modeled after, providing the student with as close to the real board exam experience as possible. Of course, we do not have access to the specific contents of the board exam, so we make an educated judgment about what content should be covered. This means that as a diagnostic tool, they are very helpful and they may even serve as a secondary predictive tool.
When extrapolating board exam results from practice exam results, we exercise a healthy caution due to two caveats: scaled scores and cut-off scores. Most standardized exams report scaled scores rather than the raw scores Exam Master reports. Scaled scores are obtained by statistically adjusting and converting raw scores onto a common scale to account for differences in difficulty across different forms. A cut-off (or cut) score is a score that a student must earn to pass the exam: to be considered proficient. Cut scores are determined through a variety of means. The Angoff method, for example, involves a panel of experts estimating the probability of a minimally qualified candidate answering a given item correctly.
Comparing the results of one of our practice exams to those of the actual exam would require rigorous controls to be put in place. A primary reason we do not claim to predict board scores based on practice exam results is because these exams are accessed under a wide variety of circumstances that are generally outside of our control. Some students may be accessing these exams in study mode; some students may review one of our practice exams more than once; some students may have already reviewed some of the practice exam questions from our discipline-specific question banks.
Our practice exams offer key benefits to our end users, both helping them to identify their strengths and weaknesses and providing realistic board exam practice before they sit for the actual exam. In fact, students have often reported to us that our practice exams are more rigorous than what they end up experiencing on the real thing! That’s why we say, “If you can do Exam Master, you can do the boards!”