The Compliance Module That Nobody Finishes
A regional bank's 40-minute online anti-money-laundering refresher has a 61% completion rate. Compliance wants completion at 95% before the regulator's audit in nine weeks. The current module is a narrated slide deck followed by a 20-question quiz; learners must score 80% to pass, and 34% of first attempts fail. The L&D lead proposes cutting the module to 12 minutes by removing the scenario branch and shortening the quiz to 10 questions. The compliance officer objects: the scenarios are what teach staff to spot suspicious transactions, and the regulator has previously criticized 'tick-box' training. Learner interviews reveal that staff do the module in one sitting at month-end, often on a phone, and find the narration too slow. Budget allows either a full redesign or a trimmed version, not both.
1. Diagnose the completion and first-attempt failure data. What is the most likely cause, and how should that shape the redesign decision?
Read the worked answer
The failure pattern (34% first-attempt fail) and the completion pattern (61%) point in different directions and should not be treated as one problem. High failure on a quiz that follows a narrated deck usually signals a practice-test mismatch: the quiz tests application (spotting suspicious transactions) while the instruction delivers declarative content. Learners who finish are being asked to perform a skill they never practiced. The completion gap is more likely environmental: month-end timing, phone use, and slow narration suggest a time-and-attention problem, not a motivation problem.
Implication for the decision: trimming content would address completion but widen the practice-test gap, pushing failure higher. Cutting the scenario branch is the single worst change available because it removes the only application practice. The defensible position is a redesign that (a) shortens seat time by replacing narration with concise text and short checks, (b) keeps and shortens the scenario branch rather than deleting it, and (c) aligns quiz items to practiced scenarios. The framing to Compliance should be: completion is a delivery problem, failure is a design problem; a trim fixes neither.
2. The compliance officer and the L&D lead are deadlocked. Propose a resolution that satisfies both the regulatory concern and the time constraint, and state what evidence you would gather in the first two weeks.
Read the worked answer
Resolve the deadlock by separating the regulatory requirement (documented competence in spotting suspicious transactions) from the delivery format (40-minute narrated deck). The officer's objection is about substance; the lead's proposal is about length. Both can be met.
Proposed design:
- Micro-learning split into 3 x 5-minute segments, each ending in one scenario decision with immediate feedback. Mobile-first, no narration, captions and skimmable text.
- Two-week completion window with a nudge at day 3 and day 10, rather than a single month-end push.
- Quiz reduced to 10 items, each mapped to a practiced scenario; pass mark retained at 80% because the items now test practiced skills.
- Keep a short recorded attestation for the regulator showing scenario performance, not just quiz score.
Evidence in the first two weeks: pilot with one branch (n≈25), measure segment completion, time-on-task, first-attempt pass rate, and whether failures cluster on unpracticed items. Bring the pilot data to the officer and the lead together; the decision should rest on item-level evidence, not on the 40-vs-12-minute argument.