Assessment, Evaluation, and Documentation: Evidence, Not Impressions
What candidates must know
Assessment answers a simple question: what evidence shows the learner can perform the task to standard? Teach the distinction between formative assessment (during learning, low stakes, feedback-oriented) and summative assessment (at the end, judgment-oriented). Cover validity (does the assessment measure the objective?), reliability (would another evaluator reach the same conclusion?), and practicality. Explain performance standards and grading rubrics built from observable behaviors, plus common rating errors: halo effect, leniency and severity bias, central tendency, recency bias, and confirmation bias. Include documentation expectations - training records, endorsements, deficiency notes, remediation plans, and retention requirements - and the principle that records must be contemporaneous, factual, and defensible. Address retesting policy and how to handle a learner who fails a standard.
Traps that appear in questions
- Assessing attitude or judgment with a checklist designed for a motor skill.
- Confusing reliability with validity; a consistent test can measure the wrong thing.
- Documenting opinions rather than observable behaviors.
- Reconstructing records from memory days later.
- Treating a single failure as a permanent judgment about the learner.
- Allowing rubric language so vague that two evaluators would disagree.
Worked example
Give learners a rubric line: "Performs preflight inspection." Ask them to rewrite it with observable criteria and a standard - for example, completing all inspection items in sequence, identifying any discrepancy, and stating a justified decision. Then ask whether two evaluators would score the same performance identically. Rule of thumb: if two evaluators could disagree, the rubric is not finished.
Teaching move
Have learners score a recorded or role-played performance independently, then compare scores and reconcile differences; the discussion exposes rating bias directly.