The Compliance Deadline Nobody Can Move
A regional credit union has 90 days to train 640 employees on a new fraud-escalation procedure before a regulatory audit. The compliance officer insists every employee complete a 45-minute module and pass a 20-item quiz at 90%. You inherit a budget of $18,000, one part-time LMS administrator, and no dedicated instructional designer. A subject-matter expert from operations is available 6 hours per week. A pilot with 40 employees showed a 62% first-attempt pass rate, with most failures on three items about escalation thresholds. Frontline staff work staggered shifts across 14 branches, and branch managers say releasing people for 45 minutes during business hours is "not realistic" in the two highest-volume branches. The audit date is fixed.
1. The compliance officer will not reduce the 90% pass threshold or the 45-minute seat time. What needs-assessment and program-design moves do you make in the first two weeks, and what do you recommend changing?
Read the worked answer
The binding constraint is the audit date and the compliance requirement, not the seat time. I would separate the two: the 20-item quiz at 90% may be a genuine regulatory artifact, but the 45-minute module is a design choice. In week one I would run a focused task analysis with the operations SME to document the actual escalation decisions (thresholds, triggers, reporting path) and confirm which of the 20 items map to those decisions. The pilot data already points to a root cause: three items cluster failures, which suggests the content on escalation thresholds is ambiguous or the items test wording rather than judgment. I would review those three items against the SME-documented procedure.
In week two I would re-scope delivery. Rather than a single 45-minute block, I would propose a 15-minute job aid plus a 10-minute scenario practice embedded in existing shift huddles, with the quiz available asynchronously. I would bring the two high-volume branch managers a concrete schedule showing release times of 10-15 minutes at shift change, not 45 minutes mid-shift. I would present the compliance officer with evidence that shorter, spaced practice with the same assessment preserves the compliance outcome while raising pass rates.
I would also set up a weekly dashboard of first-attempt pass rates by branch so we can catch problems before the audit window closes. If the compliance officer refuses any change to seat time, I document the pilot data and the branch-release constraint in writing and escalate the trade-off to the sponsor rather than silently absorbing it.
2. The pilot's 62% pass rate threatens the deadline. How do you use that data without simply making the quiz easier?
Read the worked answer
Making the quiz easier would satisfy the number but break the purpose, which is demonstrating that employees can apply the escalation procedure. Instead I would treat the three failing items as a diagnostic. First, I would check item quality: are they testing the procedure or testing reading comprehension of a poorly worded stem? If the stem is ambiguous, I revise the item, not the threshold. Second, I would check content alignment: if the module never clearly stated the thresholds, the fix is in the instruction, and the three items are doing their job by exposing a content gap.
Third, I would add targeted practice on escalation thresholds before the assessment, using short scenario cards drawn from real branch cases. The pilot group can serve as a comparison: if a revised practice set lifts first-attempt pass rates on the same items, we have evidence the change worked.
I would also build in a retake policy with remediation between attempts, since a 90% threshold with one shot is a scheduling hazard under a 90-day deadline. Retakes with required review preserve the standard while protecting the audit date. Throughout, I keep the 90% threshold fixed and report pass rates transparently to the compliance officer and sponsor.