Assessment Review: Seasons Item and Modeling Task
A tenth-grade Earth and space science team reviews results from a 128-student unit assessment. One four-option item asks, 'Earth has seasons mainly because...' The options are: (A) Earth's distance from the Sun changes during its orbit; (B) Earth's axis is tilted relative to its orbital plane; (C) the Sun's brightness varies seasonally; (D) Earth rotates on its axis. Results: 58% chose A, 24% chose B, 10% chose D, and 8% chose C. On a follow-up modeling task with a lamp and globe, many students who chose B still placed the globe closest to the lamp for Northern Hemisphere summer and said the tilt 'points toward the Sun everywhere.' The department debates whether to reteach the seasons unit, revise the item, or both. They also want a defensible way to document improved understanding without relying only on the same multiple-choice item.
1. Interpret the item and modeling results. What misconception is most persistent, and why might the multiple-choice item overstate or understate understanding?
Read the worked answer
The dominant misconception is that distance from the Sun causes seasons. Option A attracted 58%, far more than the correct option B. The modeling task reveals a second, subtler problem: some students who chose B can state the tilt idea but still reason as if the tilted hemisphere is closer to the Sun, and they treat the tilt as pointing toward the Sun everywhere. That is a verbal-symbolic answer without a working spatial model.
The item both overstates and understates understanding. It overstates the 24% who chose B, because some cannot apply the idea. It understates others, because a student might understand the mechanism but misread 'mainly' or choose A for a different reason. The distractors are not equally plausible: D and C are weak, while A is a strong intuitive alternative. The item measures recognition of a phrase more than the ability to explain the seasonal pattern, so the department should not treat the 24% as mastery.
2. Propose a short instructional sequence that would help students confront the distance misconception and build a correct mental model. Include one specific phenomenon or representation.
Read the worked answer
A short sequence should make the distance idea testable rather than simply telling students it is wrong.
- Phenomenon: Show that both hemispheres cannot be in summer at the same time, and that Earth is actually closest to the Sun in early January. Ask students to reconcile that with Northern Hemisphere winter.
- Model: Use a lamp and a globe with a fixed distance from the lamp. Keep the distance constant while moving the globe around the orbit. Have students observe which hemisphere receives more direct light and longer days at the June solstice and December solstice.
- Measure: Use a light meter or grid to compare the spread of light over equal areas at different latitudes and at different orbital positions. Have students record day length from a globe or data table.
- Explain: Students write a claim-evidence-reasoning paragraph explaining why the Northern Hemisphere has summer in June even though Earth is not closest to the Sun then.
- Transfer: Ask why the Southern Hemisphere has summer in December and why the tropics have less seasonal temperature contrast.
The key is to hold distance constant and vary tilt and orbital position, so students see that insolation angle and day length, not distance, drive the seasons.
3. The team wants to revise the assessment to measure understanding more validly. Describe two changes and explain how each improves validity.
Read the worked answer
Two changes would improve validity:
- Replace the single four-option item with a two-tier or explanation item. For example, ask students to choose the best explanation and then justify it with a diagram showing the tilt and the Sun's rays at the June solstice. A correct choice with an incorrect diagram would not earn full credit. This improves construct validity because it measures the mental model, not just recognition of a phrase.
- Add a performance task with a rubric. Students receive a lamp, a globe, and a set of seasonal data and must predict which hemisphere is experiencing summer, explain the evidence, and correct a statement that 'summer happens when Earth is closest to the Sun.' The rubric should separately score the claim, the use of evidence, and the spatial reasoning. This improves validity by requiring transfer and by making the reasoning visible.
The team should also keep pre- and post-unit evidence, such as annotated diagrams and short written explanations, rather than relying only on the original item's percentage. That documentation shows whether students can apply the model to a new situation.