Green dashboard, unhappy users: monitoring and review failures
Vertex Care provides IT services to 40 clinics. Its monthly service report shows 99.98% availability, 92% of incidents resolved within SLA, and 88% first-contact resolution. The CIO reviews this dashboard monthly. Yet clinic managers complain that appointment scheduling is unusable for 20–40 minutes most mornings, and a staff survey rates IT 2.9/5. The service desk classifies any call that reaches a human as “resolved” if the user does not call back within 24 hours; many users give up and ask a colleague. Internal audit found that the dashboard excludes the scheduling application because its monitoring agent was removed during a migration eight months ago. Management review minutes for the last three meetings contain the same action: “improve communications,” with no owner or due date. The next surveillance audit is in ten weeks. The CIO says the metrics prove IT is performing well and that the complaints are anecdotal.
1. Evaluate the monitoring, measurement, analysis and evaluation arrangements. What are the key weaknesses and what should Vertex do?
Read the worked answer
The arrangements are not effective because the data are incomplete, definitions are misleading and analysis is absent. Availability excludes a critical application, so 99.98% is not a measure of the service customers use. “Resolved” is defined by absence of a call-back, not by restoration or user confirmation, so first-contact resolution is inflated. A 2.9/5 survey and consistent morning complaints are evidence that should trigger investigation, not be dismissed as anecdotal. ISO 20000-1 requires monitoring and measurement against objectives, analysis and evaluation of results. Vertex should restore monitoring for the scheduling application, redefine metrics with the service desk and users, add user-experience and end-to-end measures, analyse trends by time and clinic, and report uncertainty. Then management review can make decisions based on evidence rather than a green dashboard.
2. Distinguish the roles of internal audit, management review and service reporting in this situation. What should happen before the surveillance audit?
Read the worked answer
Internal audit provides an independent conformity check and reports findings; it does not fix the service. Management review is a top-management evaluation of the SMS's continuing suitability, adequacy and effectiveness, and should produce decisions, resources and actions. Service reporting communicates performance to customers and interested parties and must be accurate and not misleading. Here, the internal audit finding about the missing monitoring agent should feed management review, which should decide resources and corrective actions with owners and dates. The service report should be revised so customers are not told a false 99.98%. Before the surveillance audit, Vertex should correct the monitoring, validate the data, hold a management review with recorded decisions, and retain evidence. Rewriting the dashboard without fixing the service would not satisfy the requirement.