OSAT Computer Science (OK181) study materials
OSAT Computer Science (OK181) study resources

The 62% Item

OSAT Computer Science (OK181) · Put your knowledge to work in context.

All case studies

The 62% Item

Ms. Chen teaches a 10th-grade computer science course with 28 students. On a quiz about parameter passing, item 7 shows a method that takes an array and modifies one element. The item asks what happens to the caller's array, and 17 of 28 students answer correctly. The most-chosen distractor, selected by 11 students, says the array is unchanged because the method receives a copy. Nine of those 11 students are English language learners, and the item stem uses the phrase copies the reference. A parallel item 8, which uses a diagram and asks students to trace the same concept, is correct for 22 of 28 students. Ms. Chen has one 50-minute class before the unit test. The department requires that quiz items be reviewed for bias, but the review was skipped because of a snow day. She is deciding whether to reteach the concept, revise the item, or move on because the class average is 74%.

1. Interpret the item statistics. What evidence supports a reteach, and what evidence supports an item problem?

Read the worked answer

The 62% correct rate is below a reasonable mastery threshold for a core concept, but the pattern matters more than the average. Eleven students chose the same distractor, which suggests a shared misconception rather than random guessing: they believe the method receives a copy of the array and cannot change the caller's data. However, the parallel item 8, which uses a diagram, is correct for 22 of 28 students. That discrepancy suggests the concept may be partially present but the wording of item 7 is interfering. The phrase copies the reference is ambiguous to students who are still building English academic language, and nine of the eleven students who chose the distractor are English language learners. The skipped bias review matters because it means the item was not checked for unnecessary linguistic complexity. The evidence supports both a targeted reteach and an item revision. Moving on because the class average is 74% would hide the fact that a subgroup is disproportionately affected.

2. Decide how to use the one class period before the unit test. Justify your plan with assessment principles.

Read the worked answer

Ms. Chen should use a short, targeted reteach rather than a full re-lecture. She can begin with a concrete model: draw a caller variable as a box containing an arrow to an array, then show that passing the variable copies the arrow, not the array. Students trace a two-line method that changes one element and predict the caller's output. Then they compare that trace with the diagram from item 8. In the last 15 minutes, she should revise item 7 in plain language and have students answer both the original and revised versions, discussing why the wording changed. This addresses the misconception and the access issue without lowering the concept. She should not simply move on, because the distractor is too popular to be noise. She should also not spend the whole period on test review, because the unit test will sample more than this concept. The plan uses assessment evidence to allocate time and treats item quality as part of instruction.

3. What should Ms. Chen do about the skipped bias review and the ELL pattern after the unit test?

Read the worked answer

She should document the item, the distractor counts, and the ELL pattern, then submit the item for review even though the quiz has already been given. The review should ask whether copies the reference is necessary for the concept or whether simpler wording such as the method receives the same array would assess the same idea. She should also check whether other items use idioms or complex sentence structures that are unrelated to the learning target. For scoring, she should not automatically change grades, but she can offer a corrected item or a short oral explanation opportunity if the district permits. More importantly, she should build a routine for reviewing items before administration, including a plain-language check and a check for cultural or linguistic load. The goal is not to excuse students from the concept but to ensure that the assessment measures the concept rather than English proficiency.