Currently I am using my own machine to write test case using Telerik Test Studio,
and I setup 2 Virtual machine at within the same network subnet IP address, in order to test the "Run test remotely" functionality.
So I have machine: TestRunner1 and TestRunner2
The scheduling server and data services i Setup on TestRunner1 as well.
I wrote 4 test cases, and put them into 2 test lists, eg: TestList1 = 2 test cases, TestList2 = 2 test cases
Sometimes when i run certain test cases on either one of the TestRunner machines, the test cases hangs and then TestRunner machine stays at "Busy" state, but I see that nothing is running on the machine using remote desktop. But sometimes the test lists pass successfully.
The "distribute test lists" also never works well, none of the test lists being executed, and both TestRunner machines stays at "Busy" state.
Need some help, my company is evaluating this product and we need to run on probably 200-300 Test Runner machine at same time.
9 Answers, 1 is accepted
Thank you for your interest in Test Studio.
The scheduling setup depends on an open network communication between machines in the configuration. Please, verify that there are no firewall or other restrictive software available on any of the machines.
Further on, you have to keep the remote session active during the test execution in order to have any of the recorded desktop actions executed on the execution agents.
These are the most common problems when using remote execution configuration. There could be more specific problems related to the current application under testing as well.
Additional information related to the test execution and problems in the setup could be present in each machine application log. To get the information in the log - it has to be enabled and cleared before reproducing the problem.
Some part of our customers have CI configuration and use only the command line ArtOfTest.Runner to execute tests in scheduled builds. It's up to the specific needs of your company automation policy to choose which approach will suit best.
Please, let us know if you need additional directions or assistance.
Best Regards,
Nikolay Petrov
Progress Telerik
Thanks, sorry it took me more times to reply because I am a little bit busy with other stuffs.
I have tried the https://docs.telerik.com/teststudio/knowledge-base/scheduling-kb/keep-active-session method. so far it looks stable. the only bad thing is it didn't work again if i minimize the RDC. I have try https://docs.telerik.com/teststudio/knowledge-base/test-execution-kb/minimized-rdc but unfortunately it didn't work on Windows Server 2016.
But resizing the RDC and keep it open did not break any tests.
But anyhow your solution solved my the other problem too https://www.telerik.com/forums/upload-file-in-chrome-not-working-when-user-inactive
I disagree with you that this only happened to Windows OS limitation, I personally have tried on Selenium framework. they don't have this issue. It seems like limitation on Telerik instead.
Any how i can extend my trial? because i left 14 days and i need to try a few more complicated test cases like scrolling on web pages and etc JavaScript responsive web page.
I do noticed that if I restart the scheduling services at the other VM, my currently local Test Studio that connected to it will crashed.
Can console ArtOfTest run "distribute test cases"?
Please note that in Selenium all the tests are running on locked machine because most test steps don't use the mouse or keyboard. Instead they are able to inject events (like a Click or Select) directly into the DOM structure of the page while in Test Studio we are simulating system-wide mouse moves and mouse clicks instead. This is where we hit the Windows OS limitation. If you are using our Testing Framework for example you'll get the same experience as in Selenium, however you will not be able to use the full feature set that Test Studio offers.
Regarding extending trial please contact our sales department as we from the engineering are not allowed to extend trials.
We are sorry to hear the Test Studio instance is crashing, please submit a separate ticket with the detailed repro steps and include all the logs so we can investigate this behavior. Please note that you need only one scheduling service installed.
You can distribute test runs using the scheduling feature as shown in this article, unfortunately you cannot use the console.
Should you have any additional questions let us know.
Regards,
Ivaylo
Progress Telerik
It seems like not true.
From this documentation:
https://docs.telerik.com/teststudio/features/scheduling-test-runs/tts-command-line-client
It seems like i can run the ArtOfTest console and setup parameter as "-d" to distribute the test case
Please double confirm.
Please note that using the command-line client you cannot specify to which execution machines to distribute the tests on. That is why I have not provided this option. However if you would like give it a try and see whether this suits your needs.
Otherwise use the scheduled approach I've already advised.
Regards,
Ivaylo
Progress Telerik
Ok, i just tried.
it can run multiple test cases remotely via scheduling server,
but it can't select which test runner, and it can't schedule a time.
So means I need to use jenkins or task scheduler to handle that.
All of these features you describe, as my colleague advised, are available in the Test Studio UI in the Test Lists tab - you could choose a machine to run a test list on, to select appropriate time, etc.
Please let me know more about the use case you would like to accomplish and what your concerns of using directly the UI are. Please note that if you would like to implement Test Studio in a CI environment we recommend using the ArtOfTest.Runner - please find an example how to setup Jenkins to run Test Studio tests.
I will appreciate any additional detailed notes if you will need further assistance.
Thank you in advance!
Regards,
Elena Tsvetkova
Progress Telerik
So i have to use command client.
Thank you for getting back to me. Since you might need to use Jenkins then you could rely on the features a Jenkins CI provides for executing tasks in multiple machines environment. I guess here you could find what you need.
Regards,
Elena Tsvetkova
Progress Telerik