Continuous Testing Foundation case studies
Continuous Testing Foundation · Put your knowledge to work in context.
The Continuous Testing Foundation (CTF)℠ certification is offered by DevOps Institute, now part of the PeopleCert Group. It is aimed at professionals who want to build or validate skills in integrating testing across the continuous delivery pipeline - the source describes continuous testing as enabling "faster, higher quality releases and reduced costs by seamlessly integrating into the Continuous Delivery process to identify and address risks at all stages of the development pipeline thereby minimizing business risk and impact on customers." The published target audience spans developers, DevOps engineers, quality assurance teams and managers, testers, release managers, project managers, IT managers, maintenance and support staff, and lab staff. The Continuous Testing Foundation case studies are 5 cases and about 4,408 words.
1Defending a Continuous Testing Budget With the Wrong Numbers
Northwind Logistics has run a continuous testing programme for two years and must now defend its budget. The QA director reports three headline numbers to the CIO: automated regression coverage rose from 18% to 64%, the pipeline executes 1,900 automated checks per merge, and the test team grew from 12 to 31 people.
843 words, about 4 min2The Sign-Off Gate That Made Quality Somebody Else's Job
Helios Bank's payments division has 300 developers in 22 squads and a separate QA chapter of 40 testers. Squads push builds to a shared nightly drop; testers run a three-day manual regression pass and hold the only authority to approve a production release.
844 words, about 4 min3Queueing a Six-Hour Regression Suite Behind 200 Commits a Day
Orion Insurance is decomposing a 1.2-million-line policy administration monolith into 14 services; eight are live. The regression suite holds 4,200 Selenium UI tests (6 hours 20 minutes), 900 API tests and 1,100 unit tests.
969 words, about 5 min4Thirty-One Percent Flaky, Three Retries, and a Request for More Agents
Vertex Health's clinical portal team keeps 9,800 automated checks in one repository: 7,600 Selenium UI tests, 1,400 API tests and 800 unit tests. The suite takes 3 hours 40 minutes on a 40-agent grid, so it runs nightly plus a 900-test smoke subset per pull request.
885 words, about 4 min5A 94% Pass Rate on the Release That Cannot Slip
Caldera Software must ship a regulatory reporting module by 30 June, with penalties for late filing. The test manager presents the readiness dashboard at the steering committee: 94% pass rate, 88% requirement coverage, 12 open defects (2 critical, 4 high).
867 words, about 4 min