Training Needs Analysis and Program Evaluation
What the exam tests
This domain separates needs analysis from program evaluation. Needs analysis identifies gaps before training is designed; evaluation judges whether training worked after delivery. Expect questions on organizational, task, and individual analysis, data sources, and the Kirkpatrick levels.
Core rules
- Organizational analysis asks whether training fits goals, resources, and policy.
- Task analysis identifies duties, conditions, standards, and required knowledge or skills.
- Person analysis compares actual performance with the standard.
- Use multiple data sources: incident reports, near-miss reviews, observation, tests, surveys, and compliance audits.
- Kirkpatrick levels are reaction, learning, behavior, and results; reaction alone is weak evidence.
- Use formative evaluation during development and summative evaluation after delivery.
Worked example
SCBA failures rise during drills. A needs analysis shows the failures cluster on one model, during donning checks, among new hires. Task analysis confirms the standard requires a partner check. Person analysis shows new hires can don the pack but skip the check under time pressure. The fix combines refresher practice and a scored check, not a department-wide lecture. Reasoning: the gap is partly individual performance and partly procedural enforcement; training alone may not solve it.
Traps
Treating every performance gap as a training problem; relying only on reaction sheets; skipping a baseline; and confusing a needs assessment with an end-of-course evaluation.