Testing Approach
Method framework for planning and executing tests, including automation, responsibilities and quality metrics.
Classification
- ComplexityMedium
- Impact areaOrganizational
- Decision typeOrganizational
- Organizational maturityIntermediate
Technical context
Principles & goals
Use cases & scenarios
Compromises
- Over-automation without maintainability leads to fragile suites
- Wrong metrics create misleading confidence
- Insufficient data leads to undetected defects
- Test pyramid: Unit → Integration → End-to-end
- Automate and isolate test data management
- Treat tests as code and version them
I/O & resources
- Acceptance criteria and user stories
- Test environments and test data
- Test tools and CI infrastructure
- Test reports and metrics
- Defect lists and prioritizations
- Release recommendations or rollback decisions
Description
A testing approach defines structured practices, tools and responsibilities for planning, executing and evaluating tests. Its goal is to embed quality assurance into development, detect defects early and reduce release risk. Applicable to manual and automated testing across different domains and system levels.
✔Benefits
- Early defect detection reduces cost
- Higher release confidence and stability
- Measurable quality metrics support decisions
✖Limitations
- Not all scenarios are automatable
- Initial effort to build and maintain tests
- Test environments can be hard to reproduce
Trade-offs
Metrics
- Defect detection rate
Share of defects found per test run relative to executed tests.
- Mean time to detect (MTTD)
Average time to detect a defect after commit.
- Automation ratio
Percentage of test cases automated and executed in CI.
Examples & implementations
Automated regression for ecommerce
An ecommerce team automated checkout and payment flows, reduced manual testing by 70% and shortened release windows.
Exploratory testing in backend team
Backend engineers ran exploratory sessions, found incompatibilities and improved API contract checks.
CI-driven integration checks
Integration tests were integrated into CI, enabling earlier defect detection and fewer hotfixes.
Implementation steps
Perform gap analysis of existing testing practice
Define quality criteria and metrics
Extend CI pipeline and integrate test automation
Provide training for testers and developers
Establish continuous review and maintenance processes
⚠️ Technical debt & bottlenecks
Technical debt
- Outdated test scripts without refactoring
- Manual workarounds instead of automated checks
- Missing infrastructure for parallel execution
Known bottlenecks
Misuse examples
- Automating all UI flows without stabilization
- Measuring number of tests instead of their value
- Only manual tests for critical releases
Typical traps
- Expecting immediate automation gains
- Ignoring test data and environment stability
- Missing maintenance sprints for test suites
Required skills
Architectural drivers
Constraints
- • Budget for test automation limited
- • Regulatory requirements for test documentation
- • Legacy systems hard to automate