A Timed On-Demand Essay Used for Placement Decisions
In May, the eighth-grade team administers a 45-minute handwritten on-demand argument essay. The essays help determine placement in ninth-grade English. One student, Elena, is an English learner at level 4 who writes organized, well-reasoned essays when given extra time and a word-to-word glossary but scores at the low end of the timed essay. Another student, Marcus, has a documented dysgraphia and types all classroom writing on a district laptop; the laptop cart is unavailable on test day, so he writes by hand and produces a short, hard-to-read response. The team has each student's writing portfolio, which includes a revised argument essay, a literary analysis, and a research summary. The placement meeting is in two days.
1. What validity concerns do these two cases raise about using the timed essay as a placement measure?
Read the worked answer
The timed essay is intended to measure argument writing, but for these two students it may be measuring something else. For Marcus, the construct includes handwriting fluency and graphomotor speed, which are affected by dysgraphia. His handwritten response is short and hard to read, but that does not tell the team how well he can construct an argument when the transcription barrier is removed. His classroom record, where he types, is more relevant to the construct.
For Elena, the timed conditions and the absence of a glossary may introduce language demands that exceed her current English proficiency. If her portfolio shows organized, well-reasoned essays when she has support, then the timed score may underestimate her writing ability. Extra time is not automatically a valid accommodation if the problem is word retrieval or unfamiliar vocabulary rather than speed; the glossary may be the more relevant support.
In both cases, the scores may have construct-irrelevant variance: differences in scores caused by factors unrelated to the target skill. That does not mean the timed essay is worthless. It may provide useful information about independent writing under constrained conditions. But it should not be the sole or primary basis for placement when the team has stronger evidence of the same construct from the portfolio.
2. What accommodations or alternative evidence should the team consider, and how can it preserve fairness?
Read the worked answer
The team should first ask what the test is meant to measure: argument writing, not handwriting speed or vocabulary knowledge. For Marcus, the appropriate accommodation is the one he uses in instruction: keyboarding with the district laptop, or a scribe if the keyboard is unavailable. He should have the same 45 minutes and the same prompt. For Elena, a word-to-word glossary and extended time are reasonable if they are consistent with her documented supports, but the team should avoid providing sentence starters or a pre-written outline, because those would supply part of the writing being assessed.
The team should apply a consistent rule: accommodations are available to any student for whom they are documented and necessary to access the construct. That avoids the appearance of giving one student an unfair advantage. If the test is re-administered, both students should receive their accommodations under the same conditions as other students.
Fairness also requires documentation. The team should record what accommodation was used, why it was needed, and how it relates to the construct. If re-administration is not possible, the team should use the portfolio as the primary evidence and treat the timed score as one data point, not a gate. The portfolio tasks are common across the grade, so they provide a comparable basis for judging argument writing.
3. How should the placement team combine the timed score and the portfolio evidence, and what should it avoid?
Read the worked answer
The team should use a multiple-measures approach and give greater weight to the evidence that most directly represents the placement construct. For ninth-grade English, the relevant question is whether the student can read and write at grade level with the supports available at the next school. The portfolio-revised argument, literary analysis, and research summary-shows the student's writing across genres and across the writing process. The timed essay adds information about independent, first-draft performance.
A defensible process is to list the evidence for each student, rate it against the same criteria, and discuss discrepancies. For Marcus, the team should note that the timed handwritten essay is not a valid sample of his argument writing and should not be used to place him in a lower level. For Elena, the team should compare her supported work with her timed work and ask whether the difference is a language-proficiency issue that the ninth-grade program can support or a writing-instruction issue.
The team should avoid three things: using a single test score as a cutoff, averaging scores across measures with different purposes, and treating an accommodation as evidence of lower ability. It should also avoid placing a student in a lower track simply because the timed score was low when the portfolio shows stronger performance. The decision should be documented with a rationale and reviewed after the first marking period.