Assessment and Data-Driven Decision Making
Assessment and Data-Driven Decision Making tests whether your assessments produce trustworthy evidence and whether you can convert scores into the next instructional move. Items ask you to judge item quality, interpret results, choose feedback, or decide what a data team should do next.
Core rules
- Purpose first. Formative assessment happens during learning and yields feedback; summative assessment certifies learning at the end. Grading formative practice punitively punishes practice.
- Validity means the task measures the intended construct at the intended cognitive level; reliability means consistent results across raters and occasions. Clear rubrics and more items raise reliability.
- Check constructive alignment: the assessment, the objective, and the instruction must target the same verb and content.
- Item analysis: a p-value is the proportion answering correctly; very high values suggest an easy or flawed item, very low values suggest a misconception or an untaught concept. Examine distractors to see which wrong idea attracted students.
- Feedback should be specific, timely, and about the work rather than the person.
- Data protocol: gather, disaggregate by item and subgroup, form a hypothesis, act, then recheck. Progress monitoring belongs to MTSS, not to a single unit test.
- Criterion-referenced scores report mastery of a standard; norm-referenced scores report position in a group.
Worked example
A fractions quiz shows nine of twenty-six students below seventy percent, and item seven was answered correctly by only twelve percent, with most choosing one distractor that reflects adding denominators. Reasoning: reteach with visual models rather than simply retesting, and inspect item seven for a faulty key, since an extremely low p-value often signals a mis-keyed or confusingly worded item.
Traps that cost marks
- Averaging every score, so early growth is erased by later mastery.
- Treating percent correct as proof of standard mastery.
- Placing students with a single assessment instead of multiple measures.
- Teaching to the item format rather than the standard.