Item Analysis on the Seasons
An eighth-grade teacher gave a 10-item quiz on seasons to 28 students. On the key item-'Why is it warmer in summer in the Northern Hemisphere?'-the options were A) Earth is closer to the Sun; B) the Northern Hemisphere is tilted toward the Sun; C) the Sun is brighter; D) days are longer because Earth spins faster. Eighteen students chose A, six chose B, three chose D, and one chose C. The item's discrimination index was −0.15. In the previous unit, students used a globe and lamp to model the seasons, copied a diagram, and completed a worksheet. The teacher is surprised because most students correctly labeled solstices and equinoxes on a diagram. The principal wants evidence that instruction improved understanding, not just recall.
1. Interpret the distractor pattern and the negative discrimination index. What does this suggest about student understanding and the item?
Read the worked answer
Eighteen of 28 students, or 64%, chose A, while only six chose the correct answer B. That is a strong misconception that distance from the Sun controls seasons. The negative discrimination index means students who scored higher on the whole quiz were slightly more likely than lower scorers to miss this item; the item is not separating strong from weak understanding in the intended direction. That can happen when prior instruction or everyday experience reinforces the distance idea, or when the item is confusing. The correct labeling of solstices and equinoxes shows students can recognize diagram positions, but not explain the cause. The assessment is measuring a memorized label, not a mental model. The teacher needs to treat A as a persistent alternative conception, not a careless error.
2. Design a three-day instructional sequence that would address the misconception and produce evidence of conceptual change.
Read the worked answer
Day 1: elicit the misconception with a written probe asking why summer is warmer, then compare distance and tilt predictions using a globe and lamp. Have students measure light intensity or illuminated area at the same distance but different angles. Day 2: use data, not just a diagram. Students plot average daily temperature, day length, and solar angle for two hemispheres and identify the pattern that both hemispheres cannot be closer at once. They build a physical model with a tilted globe and record which hemisphere receives more direct light. Day 3: transfer task. Students explain seasons on a fictional planet with a circular orbit but a 25° tilt, then compare with a planet with no tilt. Formative checks should ask for prediction, evidence, and reasoning. The teacher should collect pre/post explanations and score them with a rubric for tilt, solar angle, and day length.
3. What assessment evidence would convince the principal that instruction improved understanding rather than recall?
Read the worked answer
Use a pre/post explanation task scored with a rubric that distinguishes distance misconception, partial tilt idea, and complete tilt-plus-solar-angle reasoning. Include a transfer item about a fictional planet or the Southern Hemisphere, because a correct answer there is less likely to be memorized from the Northern Hemisphere diagram. Add a misconception-choice item with A, B, C, D and ask students to justify their choice in writing. Report the percentage choosing the distance misconception before and after, the percentage giving complete explanations, and the item discrimination. A strong result would show fewer distance responses, more tilt-and-angle responses, and positive discrimination on the key item. The principal should see individual matched pre/post scores and samples of student reasoning, not just a higher quiz average.