Telerik Test Studio test list run from Azure pipeline fails when triggered by a build completion of another project

0 Answers 31 Views
Azure DevOps Remote Execution Test Configuration Test Execution WPF Testing
Stephen
Top achievements
Rank 1
Iron
Stephen asked on 01 Apr 2024, 05:26 PM

The Test Studio pipeline seems to fail consistently when triggered by a build. However, when we subsequently, manually, run the same Test Studio pipeline, it runs fine.

What are we missing?

This is how we are invoking the test list in the Azure pipeline:

"C:\Program Files (x86)\Progress\Test Studio\Bin\ArtOfTest.Runner.exe" list="TestLists/Test Placer Title Companion (Seller) - Test.aiilist" junit

Elena
Telerik team
commented on 02 Apr 2024, 02:33 PM

Hi Stephen, 

Please, share the aiiresult file generated from the failing pipeline. You can find where it is stored in the build log and then send it zipped.

Regards,
Elena

Stephen
Top achievements
Rank 1
Iron
commented on 02 Apr 2024, 02:57 PM

Below is the error. Note, I ran the same pipeline, with no changes, twice. Both times were successful.

Execute test 'Fee Quote Buyer and Seller' - 
ArtOfTest.Common.Design.Exceptions.ExecutionException: Wait for condition has timed out: After 2000 ms AJAX request is still pending. ---> System.TimeoutException: Wait for condition has timed out: After 2000 ms AJAX request is still pending.
at ArtOfTest.Common.WaitSync.CheckResult(WaitSync wait, String extraExceptionInfo, Object target)
at ArtOfTest.WebAii.Core.Browser.WaitForAjax(Int32 timeout)
at ArtOfTest.WebAii.Design.Execution.ExecutionEngine.ExecuteStep(Int32 order)
--- End of inner exception stack trace ---
Execute test 'Logout' - 
ArtOfTest.Common.Design.Exceptions.ElementFindException: Unable to locate element by Find Expression!
Attempting to find [Html] element using 
Find logic 
(Html): [id 'Exact' next] AND [tagname 'Exact' button]
Unable to locate element. Search failed!
Getting element image for step Verify element 'Sign In Button' 'is' visible. ...
Unable to locate element by image.
Learn more about finding elements here:
http://docs.telerik.com/teststudio/troubleshooting-guide/test-execution-problems-tg/unable-to-locate-element
at ArtOfTest.WebAii.Design.Execution.ExecutionUtils.WaitForAllElements(IAutomationHost host, AutomationDescriptor descriptor, Int32 timeout, Int32 imageSearchTimeout, Int32 imageSearchDelay, Boolean searchByImageFirst)
at ArtOfTest.WebAii.Design.Execution.ExecutionEngine.ExecuteStep(Int32 order)

Stephen
Top achievements
Rank 1
Iron
commented on 03 Apr 2024, 08:25 PM

elena, any update...?
Elena
Telerik team
commented on 04 Apr 2024, 08:41 AM

Hi Stephen, 

As far as I understand the pipeline runs successfully for some of the triggers. That mean that the issue is related to some misynchronization between sending the actions from test and the page responsiveness. 

Based on the error log it seem that there is an AJAX timeout set which is not always sufficient.

After 2000 ms AJAX request is still pending.

Please, check the steps which use the AJAX timeout step property and ensure to increase it - the current 2 seconds are really short timeout. You can set this timeout even to 10-15 seconds as it will be waited only if needed. 

Let me know if this changes the outcome of the pipeline run. 

Regards,
Elena

No answers yet. Maybe you can help?

Tags
Azure DevOps Remote Execution Test Configuration Test Execution WPF Testing
Asked by
Stephen
Top achievements
Rank 1
Iron
Share this question
or