Reviewing Vocabulary Items Before the Unit Test
Ms. Chen serves on a seventh-grade assessment committee. A colleague submitted three multiple-choice vocabulary items for a unit test. Item 1: 'In the sentence "The scientist's findings were met with skepticism," what does skepticism mean?' Options: anger, doubt, excitement, confusion; key: doubt. Item 2: 'In the sentence "The bank was steep," what does bank mean?' Options: a financial institution, the side of a river, a place to sit, a type of boat; key: the side of a river. Item 3: 'Which word is a synonym for reluctant?' Options: unwilling, eager, careful, slow; key: unwilling. The committee has 40 minutes to review the items before the test is copied. The unit standard requires students to use context to determine word meaning. Ms. Chen notices that several students in the pilot group chose 'confusion' for Item 1 and 'a financial institution' for Item 2. She must decide which items to keep, revise, or replace and explain her reasoning to a colleague who defends all three.
1. Diagnose the strengths and flaws of each item in relation to the unit standard.
Read the worked answer
Item 1 is closer to the standard than Item 3, but its context is thin. 'Skepticism' is not strongly signaled by the sentence, so 'confusion' is plausible to a student who does not know the word; the item may measure prior vocabulary more than context use. Item 2 appears to use context, but 'bank' has a strong prior meaning, and 'steep' may not be enough to override it for seventh graders. The pilot results suggest the context is not doing enough work. Item 3 is a synonym-recall item; it does not ask students to use context at all, so it is misaligned with the standard regardless of item quality. The committee should keep the format of Item 1 but strengthen the context, revise Item 2 to make the river-bank meaning clearer through surrounding clues, and replace Item 3 with a context-based item.
2. Revise the three items so they better measure the standard, and explain how your revisions address the pilot results.
Read the worked answer
For Item 1, add context that supplies a contrast: 'Although the other researchers accepted the results immediately, Dr. Ruiz remained skeptical and demanded three more trials.' Ask what skeptical means. The contrast with 'accepted immediately' and the action of demanding more trials support 'doubtful' and reduce the pull of 'confusion.' For Item 2, extend the context: 'The canoe drifted toward the muddy bank, where willow roots hung over the water.' The canoe, muddy, and willow roots clarify the riverbank meaning. For Item 3, replace the synonym task with a sentence: 'The witness was reluctant to speak, pausing before each answer and looking at the floor.' Ask what reluctant means. The behavioral clues support 'unwilling' without requiring a synonym definition. Each revision keeps the same answer format but requires students to use surrounding words and sentence logic, which is what the standard demands.
3. How should Ms. Chen respond to the colleague who argues that all three items are fine because the keys are correct?
Read the worked answer
She should acknowledge that the keys are correct but distinguish answer accuracy from construct validity. A correct key does not guarantee that the item measures context use; Item 3 clearly measures synonym recall, and Items 1 and 2 may be answerable from prior knowledge or guessing. She can point to the pilot data: students choosing 'confusion' and 'a financial institution' are not necessarily careless; the context is ambiguous enough to permit those choices. The goal is to make the reasoning students must use match the standard. She should propose the revisions as a quick, collaborative fix rather than a criticism, and suggest piloting the revised items with a small group if time allows. With 40 minutes, the committee can approve the revisions and move on, but the conversation should establish a review criterion: every vocabulary item must require context evidence, not just a correct answer.