Student Evaluation and Assessment
Evaluate against the standard, not against each other
Assessment answers one question: did the student meet the objective? Formative assessment (quizzes, questioning, skill practice) guides instruction and gives feedback; summative assessment (final written test, practical skills test) certifies performance. Criterion-referenced testing compares performance to a fixed standard and is the correct model for fire service skills. Norm-referenced testing ranks students against each other and should not decide pass/fail on a safety-critical skill.
Know the two quality terms. Validity means the test measures what the objective requires - a written test cannot validate a psychomotor skill. Reliability means consistent results across raters and repeated administrations. Build skills checklists from the objective, score each element, and calibrate evaluators before high-stakes testing. Written items should be tied to objectives, test one idea each, avoid double negatives and “all of the above,” and use plausible distractors; review difficulty and discrimination after use and revise weak items.
Protect test integrity: secure item banks, no coaching during evaluation, no practice attempts counted as a passing summative result, and a documented remediation and retest policy.
Trap: confusing validity with reliability; treating one good practice repetition as a summative pass; failing a candidate who used a different but equally effective technique when the standard does not require a specific method.
Worked example: a hose advance scored on a checklist (PPE, coupling orientation, nozzle control, time) by two calibrated raters against a cut score set in advance is both valid and more reliable than a single instructor’s overall impression.