Before the major updates, when running multiple test lists, tests would run first in order of test lists, then in order of tests.
Now they run in order of tests alone, disregarding test lists.
What is the reason for this change? Do we have / can we get the option to run them either way?
I'm aware that tests are meant to be scoped so they can be run entirely individually but due to the way we use a custom-made DLL to monitor performance in coded steps, our tests are meant to be run in the order we specify. This is largely because of differentiating cold/warm/hot caching tests (so the cold cache tests have to be run first).
If you can't change this back or at least give us the option, we'll have to stick with your earlier version which is obviously not ideal.
Now they run in order of tests alone, disregarding test lists.
What is the reason for this change? Do we have / can we get the option to run them either way?
I'm aware that tests are meant to be scoped so they can be run entirely individually but due to the way we use a custom-made DLL to monitor performance in coded steps, our tests are meant to be run in the order we specify. This is largely because of differentiating cold/warm/hot caching tests (so the cold cache tests have to be run first).
If you can't change this back or at least give us the option, we'll have to stick with your earlier version which is obviously not ideal.