Test strategy
The parent of every test artefact. Replaces heavyweight test documentation with lightweight, machine-checkable gates. The guiding idea: when an agent writes the code and the tests, the scarce, valuable thing is honest verification — so the strategy is built around not letting an agent grade its own homework.
Principles
- Risk-based. Test effort follows risk, not uniform coverage. A rating at Design sets how much testing a change needs.
- Agile Testing Quadrants mapped onto the seven phases — technology-facing and business-facing tests, supporting the team and critiquing the product.
- Every loop deposits test capital. Each escaped defect adds a regression test; each turn of the loop leaves the suite stronger (Flow-state).
Who owns which quality decision
- Manual Tester — the professional sceptic of agent output; session-based exploratory testing with charters.
- Auto Tester — directs agents to generate and maintain the automation, and owns suite health.
- Senior Dev — accountable for the tests merged with the code.
- SME — owns domain-correctness sign-off where flagged.
The standards under this strategy
- Test pyramid & coverage — ratios, thresholds, and mutation testing as the arbiter of test quality.
- AI-generated-test review — how to tell an honest test from one written to pass.
- Acceptance criteria feed tests directly (standard).
Why mutation testing is central
Coverage says the tests ran; it says nothing about whether they assert. An agent can produce 100%-coverage tests that verify nothing. Mutation score — did the tests catch a deliberately injected bug? — is the measure that can't be gamed, so it's the arbiter of test quality at the merge gate.