Hello
I'm trying to find documentation around how to use ArtOfTest.Runner to execute tests remotely distributed across machines.
We're planning to use Azure Devops which I've setup the agents.
I've been unable though to find using CLI how to have tests execute distributed in a remote fashion.
We have 4 remote servers (1 controller, 3 runtimes)
I'm hoping to be able to distribute execution of a test list across those machines using ArtOfTest.Runner.
5 Answers, 1 is accepted
Hello David,
Thank you for contacting us and sharing details about the setup that you want to create.
You can find more details and guidelines on how to setup Azure DevOps for continuous integration here. Each agent should be configured to execute a specific test list and it uses the ArtOfTest.Runner.exe to do that. You can adjust other options options and test list settings for the test list execution.
The above way to configure your environment should allow you to distribute the test lists across different execution machines. Please do not hesitate to contact us again, if you need further assistance, or any questions arise.
Regards,
Plamen Mitrev
Progress Telerik
Rank 1
Thanks Plamen.
I did go through the two documents you referenced above.
Unless I missed something I don't believe either of those specifically describe how to execute tests across a distribution of servers in a similar fashion to the functionality "remote execution" that's built into Test Studio.
Is there a setup you can suggest that would allow for this functionality?
Hi David,
The remote execution functionality in Test Studio works with the scheduling service and that takes care of the test list execution. When you take the route of continuous integration with Azure DevOps or other build server, you need to configure the build agents yourself. To do that, you need to follow the steps below.
- Add the agent on the execution machine.
- Add new "Command line" task for each test list that you want to execute on that agent.
- Configure the task to use the ArtOfTest.Runner.exe and specify the test list's path and additional options.
You can add multiple task for that agent and create other agents to utilize all execution machines in your setup. That is how you can distribute test lists in Azure DevOps across your setup with ArtOfTest.Runner.exe.
I hope the above details will help you get things on the way. If you encounter any troubles, please get back to me with more details about the configurations and environment on your end and I will do my best to advise you further.
Thank you for your understanding and cooperation.
Regards,
Plamen Mitrev
Progress Telerik
Rank 1
Hi David,
I am happy to help you with anything related to Test Studio.
Please do not hesitate to contact us again, if you have follow up questions.
Regards,
Plamen Mitrev
Progress Telerik