BCSP ASP study materials
BCSP ASP study resources

100% Trained, Still Getting It Wrong

BCSP ASP · Put your knowledge to work in context.

All case studies

100% Trained, Still Getting It Wrong

A 900-employee distribution center rolled out a 45-minute computer-based hazard communication module in English. Completion is 100 percent and the quiz average is 71 percent against a 70 percent pass mark. About 38 percent of warehouse associates prefer Spanish, and 22 percent read below a sixth-grade level in either language. In the past year there were five incidents in which associates decanted a corrosive into an unlabeled bottle or used the wrong chemical on a spill; each was handled by coaching. Supervisors say associates know the material because they passed the test. New hires shadow a mentor for two weeks, but the mentors were trained by the same computer module. Safety training is tracked by completion percentage in the learning system and reported monthly to the steering committee.

1. Diagnose why 100 percent completion has not produced safe behavior. Separate training causes from non-training causes.

Read the worked answer

Training causes

  • Completion measures exposure to content, not learning. An average of 71 percent against a 70 percent pass mark means many associates are at or below guessing level on recall questions, which is the weakest level of evaluation.
  • The module is in English for a workforce where 38 percent prefer Spanish and 22 percent read below sixth-grade level; comprehension is not established, so the test result is not interpretable.
  • No practice: nobody has handled an actual container, selected a label, or demonstrated a spill response. There is no feedback loop in the first hours and days on the job.
  • Mentors were trained by the same module, so the informal on-the-job training replicates the gap.

Non-training causes

  • If secondary-container labels or dispensing equipment are not available at the point of use, an unlabeled bottle is an environment problem, not a knowledge problem.
  • Supervisors stating that passing equals knowing signals that training is being used as the default control.

Conclusion Fix the environment and the delivery design together; otherwise better training will still lose to a workflow that permits the unsafe act.

2. Redesign the program using recognized training criteria and adult-learning principles. What changes first?

Read the worked answer

Start with a needs assessment Task analysis of actual chemical handling, incident and near-miss data, and the language and literacy profile of each shift. Write objectives as observable behaviors, for example: selects the correct product and PPE, then labels a secondary container with the product identifier and hazard information, within five minutes, unprompted.

Design

  • Deliver in Spanish and English at an appropriate reading level, using pictograms and the plant's actual label and safety data sheet format.
  • Short sessions with hands-on practice using the real containers, dispensers, and spill kit; require return demonstration before sign-off.
  • Train in small groups on shift; involve supervisors so the expected behavior is reinforced on the floor the same week.
  • Spaced follow-up at roughly two and six weeks, plus refresher triggers for new chemicals, incidents, and process change.
  • Assure trainers are competent and that materials and labels exist at the point of use.

Evaluate at more than one level Knowledge check, observed behavior on the job, and results such as labeling audit findings and spill-response performance. Completion percentage stays for compliance but is not the effectiveness measure.

3. What measures would prove the change worked, and how would you present them to the steering committee?

Read the worked answer

Behavior and condition measures

  • Percent of secondary containers correctly labeled in random weekly audits, by area.
  • Percent of dispensing stations stocked with correct labels and equipment.
  • Practical demonstration pass rate at sign-off and at the two-week follow-up.
  • Spill drill performance: correct agent selected, time to contain, kit completeness.
  • Error and near-miss reports mentioning chemical mix-ups, watched as a reporting trend.

Results measures Chemical-handling incidents and their severity, tracked with exposure hours.

How to present it Show completion as context, then the paired behavior and condition data with before-and-after comparison and the audit sample size. State plainly that a high completion number with low observed labeling compliance is a failed program, not a training success. Give each measure an owner and a target so the committee makes a decision rather than receiving a report.