PBP study materials
PBP study resources

Logins Up, Benefit Missing

PBP · Put your knowledge to work in context.

All case studies

Logins Up, Benefit Missing

A three-year transformation carries a benefits case of 7.3 million annual savings from year two. The benefits register lists 26 benefits; 40% are marked 'cashable', but baseline headcount and processing volumes were never independently validated - they came from a 2021 departmental estimate that has since been revised twice. Finance has declined to sign the benefits into the budget. The headline adoption KPI, monthly logins, rose from 1,200 to 4,800; active use of the three features that actually drive the savings is 11% of licensed users. Cost performance index is 0.87 and schedule performance index 0.94, but the status report is amber-green because all 14 milestones were met. The sponsor asks you to move 2.1 million of benefit into the following financial year 'because the system only stabilised in March', and to keep the current-year number in the board pack.

1. Diagnose the benefits measurement problem and set out what a defensible benefits position would look like.

Read the worked answer

The benefits case is not currently measurable, and the headline KPI measures the wrong thing.

  • Baseline. 40% marked cashable, yet the baseline came from a 2021 estimate revised twice and never validated. Without a signed baseline nothing can be attributed. Re-baseline with Finance-owned data: headcount by role, processing volumes, unit cost, and the specific cost pools that will actually fall. If a benefit cannot map to a budget line, it is non-cashable and should be labelled so.
  • Metric. Logins rising from 1,200 to 4,800 shows people can reach the system; 11% active use of the three value-driving features shows the benefit mechanism is not operating. Replace logins with feature-level adoption, cycle time and rework rate - measures on the causal path to savings. Keep logins as a leading indicator at most.
  • Attribution. Savings must be net of what would have happened anyway: attrition, volume changes, other initiatives. Agree the method with Finance before measuring, not after.
  • Double counting. Check the 26 benefits for overlapping cost pools; 40% cashable typically shrinks once overlaps are removed.
  • Output. A one-page realisation plan per benefit: owner, baseline, metric, target, measurement date, evidence source, Finance sign-off. Anything that cannot fill the page comes off the register.

2. The report is amber-green with all milestones met, yet CPI is 0.87 and SPI 0.94. What do you make of that, and what do you recommend?

Read the worked answer

The RAG is inconsistent with the indices, and the milestone argument does not rescue it.

  • What SPI means. 0.94 means earned value is about 6% behind the value of work scheduled at this point, in cost terms. It is not a milestone count. All 14 milestones can be met while the work behind them consumed more effort than planned, because milestones are binary and say nothing about effort, quality or rework.
  • What CPI means. 0.87 means roughly 13 pence in every pound buys nothing. Extrapolate: if budget at completion is 20 million, estimate at completion is 20 / 0.87, about 23 million - a 3 million forecast overrun the amber-green is hiding.
  • The correct report: CPI and CPI-based estimate at completion; schedule performance measured properly; milestones reported separately; variance explanations with root cause.
  • Check for distortions before concluding: is earned value based on 0/100 rules that flatter progress, has the baseline been re-set, are rates current? A CPI of 0.87 alongside met milestones usually means the baseline came from an optimistic estimate, not that performance is fine.
  • Recommend re-forecasting at the next cycle and removing 'green' until indices and narrative agree. A status that survives only because of the metric chosen is precisely what governance exists to catch.

3. The sponsor asks you to move 2.1 million of benefit into next financial year but keep the current-year figure in the board pack. How do you respond?

Read the worked answer

Rephasing can be legitimate, but only on evidence, and never silently.

  • The test. Has the timing assumption actually changed? 'The system stabilised in March' is a claim that the benefit clock started later. If true, there should be evidence - the adoption curve, rollout dates, hypercare exit. With that evidence, restate the forecast, disclose the move and the reason, and get Finance to approve the new profile. That is rephasing.
  • The other version - moving 2.1 million so this year looks better while the original figure stays in the board pack - is not rephasing. The board would be told the programme is on benefit while Finance is told it is not. That is a misstatement risk, and it is exactly the kind of thing that surfaces at year-end with no good explanation available.
  • My response to the sponsor: I will prepare a restated benefits profile with the evidence, a bridge from old to new, and an explicit statement in the pack that the current-year figure has changed and why. I will not present both numbers in the same cycle.
  • If the evidence does not support a move, say so in writing and let the sponsor decide with that on the record.
  • Flag the 11% feature adoption separately. If the benefit mechanism is not operating, shifting the calendar by a few months will not fix it. The plan needs an adoption intervention, not a rephasing.