The Academy That Passes the Test but Fails the Post
Northgate Regional Medical Center contracts 26 protection officers through a single security provider. New hires attend a three-day, 24-hour academy before post assignment: Day 1 policy and legal, Day 2 access control and visitor management, Day 3 emergency department (ED) response and infant-protection drills. The lead instructor has 22 years of hospital security experience but no formal adult-education credential; delivery is largely slide lecture with a 40-item multiple-choice exam at the end. First-quarter results: 14 of 26 passed the written exam on the first attempt, but 17 of 26 failed at least one field post check within 30 days - most often ED access control and visitor screening. Nine of the 26 resigned within 90 days, and exit comments cite 'not feeling ready.' The hospital's security director wants more hands-on practice but will not extend the three days or add staff; classrooms are booked, and the contract's training clause requires documented competence before solo post assignment.
1. The security director blames the instructor's lecturing. Before changing the curriculum, what would you examine to establish where the performance gap actually originates, and what evidence would convince you the problem is training design rather than post-checker inconsistency or supervision?
Read the worked answer
Treat the two data points as separate signals. A 54% first-attempt pass on 40 multiple-choice items says the written test is weak or coverage is uneven; a 65% field-check failure rate 30 days later says officers cannot execute procedures under real conditions. Neither finding alone proves the instructor is at fault.
Examine:
- Item analysis of the 40 items. If most test definitions and vocabulary, the exam never measured procedure, so passing it predicts nothing about the post.
- Failure rates by post, shift, and checker. If one officer fails 7 of 9 checks under Checker 1 and 1 of 9 under Checker 2, the instrument is the problem.
- The post-check form. Does it list observable behaviors with pass criteria, or a single satisfactory/unsatisfactory box?
- Two days of classroom observation. Time-on-task, ratio of listening to doing, how many questions are asked and by whom.
- Interviews with five or six failed officers. Can they describe the procedure but not perform it, or neither?
Decision rule: if failures cluster by checker, fix calibration first. If they spread evenly across checkers and posts but concentrate on procedural tasks such as visitor screening and ED access, the design lacks practice and feedback - a training-design problem. That is the likelier explanation here because exit interviews say 'not ready,' not 'we never learned the standard.'
2. Within the fixed three days and existing staff, propose the redesign. Specify what changes in methods, how you use the two classrooms and the 13:1 ratio, and how you would evaluate transfer to the post rather than satisfaction.
Read the worked answer
Keep 24 hours but reallocate roughly 25% to knowledge and 75% to guided practice and scenarios. Split 26 into two cohorts of 13, one per classroom, running the same carousel in parallel.
Day 1: Short policy modules (20 minutes maximum), each closed by a decision vignette drawn from the site's own incident reports - a visitor refuses ED screening while a family member is shouting. Officers write the decision, defend it to a partner, then read the governing post order.
Day 2: Four 40-minute stations - visitor management system, ED badge access and tailgating, infant-protection response, radio and report writing. Each: 25 minutes practice, 10 minutes peer teach-back, 5 minutes feedback against a checklist.
Day 3: Two capstone scenarios with a trained evaluator, plus remediation for anyone who fails a critical item.
Rewrite the site's post-check forms with observable criteria and use those same forms in class, so practice and field standard are identical.
Evaluation: a pre/post practical score, first-time field-check pass rate at 30 days compared with the previous cohort, and 15-minute boosters at days 7, 14, and 30 delivered by the shift supervisor. Satisfaction surveys tell you nothing about transfer and should not be reported as an outcome.
3. The lead instructor has no adult-education training and the client is asking for 'more hands-on.' How do you develop the instructor and document the change so the hospital and any auditor can see a defensible training file?
Read the worked answer
Frame it as performance improvement, not criticism. Three moves:
- Instructor development. Enroll the lead in a recognized 8–16 hour adult-learning or instructor-development course and pair him with a certified instructor for two academy cycles as co-instructor. His 22 years of operational experience is an asset - use him as subject-matter expert and scenario writer while the co-instructor models facilitation.
- Lesson-plan discipline. Require a written plan mapping each terminal objective to a post order, a method, and an assessment. If an activity cannot be tied to a post order, it should not consume classroom time. Review and sign the plan before each cycle.
- Documentation. File the instructor credential, the lesson plan, the revised practical checklists, the inter-rater calibration record, and the cohort outcome metrics. Report quarterly to the hospital: first-time post-check pass rate, 90-day retention, and the specific curriculum changes made.
That file answers 'what did you do when you found the gap?' - for the client, for the contract clause requiring documented competence, and for any regulatory review. State honestly in the report that the original exam measured recall rather than readiness; do not present the old results as evidence of competence.