Consistent scores and the wrong assessment
A training group uses a short multiple-choice quiz that asks learners to name chart symbols. Marking is highly consistent and repeated administrations produce similar scores. The stated course objective, however, requires learners to explain how a proposed plan changes when weather, available equipment or a clearance constraint changes. One learner receives an excellent quiz result yet cannot identify the information missing from a realistic planning scenario. The instructor is considering declaring the whole objective achieved because the quiz has been reliable. No claim is made that the classroom task is a current official knowledge test. The case asks for a distinction between score consistency and the evidence needed for the intended decision, together with a feasible improvement that does not abandon the useful symbol practice.
1. Which assessment issue is central?
Read the worked answer
The quiz may be reliable while lacking sufficient validity for a broader planning-judgment interpretation. Naming symbols alone does not sample the intended changed-condition reasoning.
2. How can the instructor improve the evidence?
Read the worked answer
Retain symbol checks for their narrow purpose and add scenario explanations requiring identification of constraints, missing information and a justified revision using stated criteria.