PDS 401 - Assessment and Evaluation of Learning
What PDS 401 tests
PDS 401 tests whether you can prove that learning occurred and transferred. It covers validity, reliability, item quality, rubrics, and the Kirkpatrick levels. The domain asks you to defend an assessment decision, not just compute a score.
Core rules and concepts
- Validity is the degree to which evidence supports the intended interpretation of scores. Content validity comes from a blueprint that maps items to objectives; construct validity comes from evidence that the test measures the intended ability.
- Reliability is consistency. Performance assessments need inter-rater reliability: train raters, use anchored rubrics, and calibrate with benchmark samples.
- Kirkpatrick’s four levels are reaction, learning, behavior, and results. Level 1 reaction data is not evidence of learning or transfer.
- Use formative assessment to adjust instruction and summative assessment to judge achievement.
- Write items that avoid double-barreled stems, leading wording, and implausible distractors.
Worked example
A safety course has a 20-item multiple-choice test. Ninety percent pass, but incident rates rise. Level 2 is high; Level 3 is low. The likely gap is the transfer environment: supervisors do not reinforce the checklist and workers lack time to use it. Add an on-the-job observation checklist and a supervisor briefing, then re-measure behavior.
Traps that cost marks
Treating reliability and validity as synonyms; using reaction scores as proof of impact; teaching only to the test; writing rubrics with vague descriptors such as “good understanding”; ignoring whether learners have the opportunity to perform.
Key points
- Blueprint items to objectives for content validity.
- Calibrate raters to improve inter-rater reliability.
- Kirkpatrick Level 1 is not evidence of learning.
- Formative assessment guides instruction; summative judges it.
- Check the transfer climate before blaming the learner.