Author: Haroon Khalil

The result of every systematically performed test run is a test (execution) log23. This documents (per test case and/or testing step) the actual behavior observed during the test, the expected behavior, and any deviations between the two24. Analyzing test reports When analyzing a defect report25, you have to decide which of the deviations between expected…

If you want to correct defects reliably, you need a well-thought-out system for recording, communicating, and managing the defects, faults, and other issues that testing reveals. All the activities that this comprises make up the process known as defect management.22 Define the workflow for registering and processing incidents and defects A defect management process consists…

The objective of a test report is to summarize and communicate the current state of testing activity to the project manager and other stakeholders. This normally takes place routinely at the end of an iteration/test cycle or when a particular test activity (for example, performance testing) is completed. However, an interim test report can be…

Test cycle monitoring is all about collecting information and feedback relating to all test activities. Information can be collected manually or automatically and are then used to assess testing progress and evaluate whether the exit criteria or in agile projects the “definition of done” have been fulfilled. For example, these could be fulfillment of product…

Test control comprises all leadership, initiatory, and corrective measures that are performed in order to put into practice all test activities defined in the test plan and the test execution schedule. Controlling measures can directly affect testing activity or any other type of development activity. We differentiate between the following types of situations: React to…

Detail planning for each cycle A testing strategy defines the testing framework (for example, which testing techniques to use), but doesn’t define the details of the individual test cases. The test manager has to define test cases during the detail-planning phase that comes before the start of a new iteration or test cycle. The detail-planning…

The testing strategy that results from strategic test management considerations is just a piece of paper. This means that the test manager’s main task and responsibility is to manage and guarantee the implementation of the testing strategy. To do so, he or she needs to follow four major steps19 (see fig. 6-2): Fig. 6-2Test management cycle This…

Cost-benefit relation If the scope of checks and tests is reduced (or some tests are simply dropped), the number of undiscovered defects will increase accordingly. These then become part of the shipped product and increase the level of product risk and the likelihood of incurring additional costs: The cost of a flawed product Risks due…

The estimated testing effort for a project depends on the factors discussed in the previous section. Most of these factors exert mutual influence on each other and it is virtually impossible to analyze them all exhaustively. Estimation techniques There are two basics approaches you can take to better estimate testing effort and costs: Even if…

The cost of implementing a testing strategy significantly influences the testing strategy itself. The test manager therefore has to estimate the effort involved in performing the planned testing activities and the costs this entails. The resulting cost forecast details either the budget that has to be applied for or the degree to which the planned…