I have a test list where there are few tests in it and its set to re-run failed tests. If a test fails it re-runs and passes after re-run but for some reason the entire test list is marked as failed in HTML results.
Is this expected ? is there a way to re- run entire test list ? or just mark the test list as passed after re-runs pass ?
1 Answer, 1 is accepted
Hi Rohan,
Thank you for starting a discussion on this topic. You are correct that there is some inconsistency in the way test list result is presented, when there is a failed test that passes on the re-run. In Test Studio's Result tab and in the Executive Dashboard the test list appears as passed, with the information that one of the tests failed and was ran again. However, when you export the results the same test list is marked as failed.
This is not expected behavior and I created a public bug report on your behalf and shared it with the rest of the team. They will evaluate it and plan it for future releases. Please add your vote and follow the public item to get updates of its progress.
I do not have a workaround to help you mark the test list result as passed, or to re-run the whole test list again automatically. But you can check the results in the Executive Dashboard, which will show the test list results as you expect them in this case. You can use this feature of Test Studio to quickly determine what is the real state of the test list execution per project. Let me know if that raises any follow up questions.
Thank you again for your feedback and for pointing out this misbehavior!
Regards,
Plamen Mitrev
Progress Telerik