Question on run order of tests in a test set
| ♥ 0 |
I have had a test set for over a year that is directed at one machine and it ran in the order of the test instances in the test set. When we lost that machine to a disk crash and I had to change to a new machine, I realized it would be better to use a machine group to direct against and I could just change the name(s) of the machines in the test group. When I did this, the tests ran in a random order, even when there was only one machine in the machine group. Is this the expected behavior? It only matters in a couple of my test sets but I was wondering if it was normal for this functionality.
Marked as spam
|
Posted by |
Private answer
When you run a Test Set that is using the default Execution Flow conditions (i.e., none of the tests are dependent on each other) on a host Group, the Automatic Runner doesn't care about the test order and instead just uses whichever test it ''thinks'' is ready to run on whichever host it ''thinks'' is available next. However, you can easily force it to run in the order that you want by changing the Execution Flow. Simply change the flow conditions to the order you want the tests to run (drag from test to test). With the Execution Flow conditions set to depend on one another, your tests will now run in order using Automatic Runner (with each test/host waiting for its specified turn...rather than all tests/host trying to connect at once). Marked as spam
 Posted by rickjames (Questions: 0, Answers: 771) Answered on April 28, 2015 3:34 pm
|