CWIIP study materials
CWIIP study resources

Turning Vague Tender Language into Testable Energy-Monitoring Requirements

CWIIP · Put your knowledge to work in context.

All case studies

Turning Vague Tender Language into Testable Energy-Monitoring Requirements

A university facilities team is procuring an energy-monitoring integration for 40 buildings. The tender says the system must provide “real-time alerts”, “99.99% uptime”, “integrate with all BMS vendors”, and “show any meter reading on the dashboard within two seconds”. Meters report through a vendor cloud every 5 minutes for 70% of buildings and every 15 seconds for the rest; the campus network has a 4-hour outage drill twice a year. The procurement office will accept the lowest bid that claims compliance. The sustainability manager wants monthly carbon reports, and the maintenance team wants alerts when a meter stops reporting for 10 minutes. There is no agreed definition of “uptime”, no data retention requirement, and no acceptance test. The project sponsor asks you to turn the tender into measurable requirements and a verification approach before contract award.

1. Rewrite the four vague tender statements into measurable, testable requirements. Identify any conflicts between them and the stated data sources.

Read the worked answer

Replace adjectives with observable conditions, an owner, and a threshold. “Real-time alerts” becomes: for meters reporting at least every 15 seconds, a no-data condition generates an alert within 60 seconds of the expected report; for 5-minute meters, within 2 minutes; alerts enter the maintenance queue and are acknowledged within 15 minutes during business hours. “99.99% uptime” becomes: the dashboard read API is available 99.9% per calendar month, measured by a synthetic query every minute from two locations, excluding announced maintenance windows of up to 4 hours per quarter. 99.99% is about 4.3 minutes per month, incompatible with two 4-hour outage drills and a vendor-cloud dependency; negotiate 99.9% or explicitly exempt drills. “Integrate with all BMS vendors” becomes a named list of protocols and a certification test per building; “all” is untestable. “Within two seconds” becomes: for already-ingested data, p95 dashboard query under 2 seconds at 50 concurrent users; for 5-minute meters, freshness is at most 5 minutes plus 2 minutes. Separate query latency from data freshness.

2. Map the stakeholders and conflicting priorities, then propose how to negotiate a contract that procurement can still award competitively.

Read the worked answer

Stakeholders include sustainability, maintenance, IT/security, procurement, the vendor, and building occupants. The core conflict is procurement's “lowest bid that claims compliance” versus measurable acceptance: claims are not evidence. Another conflict is 99.99% availability versus 5-minute cloud polling and scheduled outage drills; the system cannot guarantee freshness or availability beyond upstream dependencies. Facilitate a workshop and prioritize: must-have = per-building no-data alerts with defined thresholds, retention sufficient for carbon reporting, and security requirements; should-have = 2-second p95 dashboard; could-have = all-vendor BMS integration in phase 2. Put the availability definition, exclusions, and service credits in the contract. Require a pilot building per BMS type and a 30-day operational trial before award. Record decisions in a requirements traceability matrix and a change-control log. Do not let a verbal “real-time” remain in the tender; assign each requirement an owner and a verification method.

3. Define the acceptance tests and post-deployment monitoring that would prove the system meets the rewritten requirements.

Read the worked answer

Write acceptance tests before award. Inject a missing meter report in a test building and measure alert time against the requirement. Run a 50-user dashboard load test and report p95 query latency. Simulate a 4-hour network outage and verify buffering, replay, and no duplicate carbon totals. Query the audit log for a meter reading and confirm who changed what. Restore a backup and verify 10-year aggregate retention. After deployment, monitor freshness per meter, missing-report rate, alert latency, dashboard p95, API error rate, and monthly availability computed from synthetic probes. Hold a monthly service review with the vendor, using a defect severity matrix and a change-control board for new BMS types. Reconcile carbon reports to meter totals before publication. Include exit criteria and data export in the contract. This converts the tender from claims into evidence and gives operations a baseline for maintenance and future changes.