Selecting Test Techniques and Automating Test Design
Choosing the test techniques that best mitigate the product risks of a given situation, and the benefits and risks of automating the test design.
5 minutes
5 Questions
In the ISTQB Advanced Level Test Analyst syllabus, selecting test techniques and automating test design are part of applying the most appropriate techniques during test analysis and design.
Selecting Test Techniques: No single technique suits every situation, so the Test Analyst chooses techniques based on context. Key factors include product and project risks, the type and complexity of the test object, the test basis available (requirements, models, business rules), regulatory or contractual requirements, required coverage levels, the test objectives and test level, the skills and experience of the testers, available tools, and time and budget. The test basis largely drives the choice:
- Data-based techniques such as equivalence partitioning, boundary value analysis, domain testing, combinatorial testing and random testing suit input and output domains.
- Behavior-based techniques such as state transition testing, CRUD testing and scenario-based testing suit workflows and system states.
- Rule-based techniques such as decision table testing and metamorphic testing suit business logic.
- Experience-based techniques such as error guessing, checklist-based testing and exploratory testing complement formal techniques, especially when specifications are weak or time is short.
Techniques are usually combined. Higher-risk areas justify more rigorous techniques and higher coverage. The Test Analyst must also balance thoroughness against cost and the number of test cases produced.
Automating Test Design: Tools can generate test cases automatically, mainly through model-based testing (MBT). In MBT, a model of the system, such as a state machine, activity diagram or decision table, is analyzed by a tool to derive tests against chosen coverage criteria. Combinatorial tools such as pairwise generators work in a similar way.
Benefits include faster and more systematic test generation, measurable coverage, early detection of specification defects while modelling, easier maintenance because only the model changes, and reuse across test levels.
Risks and challenges include the cost and skill needed to build accurate models, tool licensing and learning curves, the possibility of generating too many tests, and the fact that defects in the model propagate into the tests. Generated tests also still need test oracles and expected results.
The Test Analyst must therefore judge when automated design adds value and ensure that models are correct, maintainable and aligned with the test objectives.In the ISTQB Advanced Level Test Analyst syllabus, selecting test techniques and automating test design are part of applying the most appropriate techniques during test analysis and design.
Selecting Test Techniques: No single technique suits every situation, so the Test Analyst chooses techniques…