The Columbian Exchange Item That Split the Class
At the end of a ninth grade Global History unit on the Columbian Exchange, 27 students take a 10-item multiple-choice quiz. One item reads: "Which of the following was a direct result of the Columbian Exchange in the Americas?" The keyed answer is "the introduction of horses, cattle, and wheat." Seventeen students choose "the decline of the encomienda system." In a post-quiz conference, several of those students explain that they learned the encomienda was a labor system and that "the exchange killed so many people that the system faded." The department chair asks whether the item should be discarded. The teacher has one 42-minute period before the unit test. The same quiz shows 24 of 27 students correctly answering an item on the Middle Passage.
1. Diagnose what the 17 students are doing. Is this a flawed item, a content gap, or both? Explain your reasoning.
Read the worked answer
The distractor is doing real intellectual work: students are reasoning that epidemic disease caused demographic collapse, which undermined the labor supply, which contributed to the decline of the encomienda. That is a defensible causal chain at an advanced level, though it is indirect and contested in its timing. So the item is partly flawed: "direct result" is doing too much work, and the keyed answer names only biological and agricultural transfers while the distractor names an institutional change. But there is also a content gap: students are not distinguishing the exchange itself, the movement of plants, animals, and pathogens, from the political and labor policies that responded to it. The 24 of 27 on the Middle Passage shows they know the exchange was triangular and violent, so this is not general ignorance. Discarding the item would erase useful information; the better move is to teach the distinction and then revise the item.
2. What would you do in the 42-minute period, and what would you change about the item for the unit test?
Read the worked answer
I would spend the period on a consequence sort, not a lecture. In groups, students receive eight consequence cards, including "horses spread across the Plains," "Indigenous population collapsed from disease," "encomienda labor declined," and "sugar plantations expanded." They sort into two columns, exchange and policy response, then draw arrows showing indirect links. The point is not that one column is right but that the exchange and the institutional response are different kinds of change. For the unit test I would revise the stem to "Which was a direct biological or agricultural consequence of the Columbian Exchange in the Americas?" and keep the encomienda as a distractor only if I have taught the distinction explicitly. I would also add a short constructed-response item asking students to explain one indirect effect, so the sophisticated reasoning the distractor revealed can earn credit.
3. How would you use the item statistics in a conversation with the department chair who wants to discard the item?
Read the worked answer
I would separate three questions: what the item measures, what the students know, and what the test should report. The item as written measures a fine distinction between direct and indirect consequences, which is worth assessing but was not taught with that wording. The distractor profile, 17 of 27 choosing one option, suggests a shared alternative conception rather than random guessing. That is diagnostic gold. Discarding the item would remove evidence that students can chain causes, and it would hide the ambiguity in my own stem. I would propose revising the item, keeping a record of the original, and reporting the constructed-response item separately so that causal reasoning is visible even when a multiple-choice key cannot capture it.