HP ALM Test Instance Status not updating Correctly
| ♥ 0 |
We have a situation where the system is not consistently updating the Test Instance Status correctly. We have a one to one relationship between a test case loaded into HP Plan and copied into Lab. So no test instance is duplicated. Each test has three steps. The first step is passed, the second step failed, and the third is not cmpl. In some instances the Test Case Instance shows "Failed" on the Execution Grid, but in other instances it shows "Not Completed". Also, in some instances when all three steps for a different test case are marked "N/A" we would expect the Test Case Instance to show "N/A" on the Execution Grid. Sometimes it does, other times it does not. Any feedback on this anomaly would be appreciated.
Marked as spam
|
Posted by |
Private answer
According to the User Guide for ALM 11.5x Execution status [for a test instance] can be one of the following: Blocked. One or more steps cannot run. For example, the test is running on a remote machine but cannot continue due to some environmental failure, such as network problems or hardware failure. Failed. One or more steps in the run failed, and none have the status ''Blocked''. N/A. The current status of the test is not applicable. No Run. No steps have been run. Not Completed. One or more steps were not completed or not run, and none have the status ''Blocked'' or ''Failed''. Passed. The run was successful. In my experience, ALM sets the Execution Status for a Test Instance based on the following (in order): An instance starts with a status of No Run, and all steps have a status of No Run. If you start a run, even if you don't change any step status, and you save the run, then the status of the instance is set to Not Completed. If any step has a status of Blocked, then the instance gets a status of blocked. If any step has a status of Failed (and none are marked Blocked), then the instance gets a status of failed. If any step has a status of Not Completed or No Run (and none are marked as Blocked or Failed), the the instance gets a status of Not Completed. If the status of all steps is N/A then the status of the instance is Not Completed. If the status of all steps is Passed, or a mix of Passed and N/A, then the status of the instance is Passed. Marked as spam
 Posted by tclasp (Questions: 1, Answers: 101) Answered on April 17, 2015 6:12 pm
|