Hello
Telerik Team,
I am facing some issues which executing test studio tests from MTM.
We currently have a UI test suite with about 400+ test cases. We have been facing numerous issues when we try to execute the test studio tests from MTM.
Though all the tests are working correctly when executed locally, I get the below errors from MTM. Strangely, all the tests are in the same solution and same
.dlls. Also, the 1st step of logging into the environment is the same in all of the 3 tests, yet they run to different point through MTM and then fail. I have
verified that all the tests are present in the build folder along with the correct association.
Error 1:
'1/9/2015 1:46:39 PM' - Executing test: 'abc', path: ......'
'1/9/2015 1:46:39 PM' - Using .Net Runtime version: '4.0.30319.34014' for test execution.
Build version is '2014.4.1211.0'.
'1/9/2015 1:46:39 PM' - Starting execution....
'1/9/2015 1:46:44 PM' - Detected custom code in test. Locating test assembly:….
'1/9/2015 1:46:44 PM' - Failure detected during execution. Details:
------------------------------------------------------------
'1/9/2015 1:46:44 PM' - System.IO.FileNotFoundException: Unable to find the code behind assembly. Please make sure you have compiled your code
behind without errors before attempting to execute the test.
Error 2:
'1/9/2015 1:43:09 PM' - Executing test: 'efg', path: '.....'
'1/9/2015 1:43:09 PM' - Using .Net Runtime version: '4.0.30319.34014' for test execution.
Build version is '2014.4.1211.0'.
'1/9/2015 1:43:09 PM' - Starting execution....
'1/9/2015 1:43:13 PM' - Detected custom code in test. Locating test assembly: ….
'1/9/2015 1:43:13 PM' - Assembly Found: ….
'1/9/2015 1:43:13 PM' - Loading code class: 'Class;.
------------------------------------------------------------
------------------------------------------------------------
'1/9/2015 1:43:13 PM' - Enabling Html Popup Tracker. Test expecting Popups.
'1/9/2015 1:43:13 PM' - Using 'InternetExplorer' version '11.0' as default browser.
'1/9/2015 1:43:13 PM' - 'Fail' : 1. Execute test '…'
InnerException:
System.IO.FileNotFoundException: Unable to find test'….tstest'
at
ArtOfTest.WebAii.Design.Execution.ExecutionEngine.ExecuteTestInCurrentContext(String
relativeTestPath)
at
ArtOfTest.WebAii.Design.IntrinsicTranslators.Descriptors.ExecuteTestActionDescriptor.Execute(IAutomationHost
autoHost, TestAsStepResult result)
at
ArtOfTest.WebAii.Design.Execution.ExecutionEngine.ExecuteStep(Int32 order)
------------------------------------------------------------
'1/9/2015 1:43:13 PM' - Detected a failure. Step is
marked 'ContinueOnFailure=False' aborting test execution.
------------------------------------------------------------
'1/9/2015
1:43:13 PM' - Overall Result: Fail
'1/9/2015
1:43:13 PM' - Duration: [0 min: 0 sec: 171 msec]
------------------------------------------------------------
'1/9/2015
1:43:13 PM' - Test completed!
Error 3:
It fails to find an image on the UI, though the image exists.
------------------------------------------------------------
'1/9/2015 10:08:10 AM' - Executing test: 'Test3', path: 'Test3.tstest.'
'1/9/2015 10:08:10 AM' - Using .Net Runtime version: '4.0.30319.34014' for test
execution. Build version is '2014.4.1211.0'.
'1/9/2015 10:08:10 AM' - Starting execution....
------------------------------------------------------------
------------------------------------------------------------
'1/9/2015 10:08:15 AM' - Enabling Html Popup Tracker. Test expecting Popups.
'1/9/2015 10:08:15 AM' - Using 'InternetExplorer' version '11.0' as default browser.
'1/9/2015 10:09:28 AM' - 'Fail' : 1. Execute test 'Test3':Overall Result: Fail
------------------------------------------------------------
'1/9/2015 10:08:15 AM' - Detected custom code in test. Locating test assembly: ….dll.
'1/9/2015 10:08:15 AM' - Assembly Found:….dll
'1/9/2015 10:08:15 AM' - Loading code class: ….
------------------------------------------------------------
------------------------------------------------------------
'1/9/2015 10:08:15 AM' - Enabling Html Popup Tracker. Test expecting Popups.
'1/9/2015 10:08:15 AM' - Using 'InternetExplorer' version '11.0' as default browser.
'1/9/2015 10:08:15 AM' - 'Pass' : 1. Execute test 1:Overall Result: Pass
------------------------------------------------------------
'1/9/2015 10:08:15 AM' - Detected custom code in test. Locating test assembly:….dll.
'1/9/2015 10:08:15 AM' - Assembly Found:….dll
'1/9/2015 10:08:15 AM' - Loading code class: ….
------------------------------------------------------------
------------------------------------------------------------
'1/9/2015 10:08:15 AM' - Enabling Html Popup Tracker. Test expecting Popups.
'1/9/2015 10:08:15 AM' - Using 'InternetExplorer' version '11.0' as default browser.
'1/9/2015 10:08:15 AM' - 'Pass' : 1. Set Environment Type
------------------------------------------------------------
'1/9/2015 10:08:15 AM' - Overall Result: Pass
'1/9/2015 10:08:15 AM' - Duration: [0 min: 0 sec: 0 msec]
------------------------------------------------------------<<<
Test-as-Step '
'1/9/2015 10:09:28 AM' - 'Fail' : 3. Execute test ….tstest' log starts:Overall Result:
Fail
------------------------------------------------------------
'1/9/2015 10:08:15 AM' - Detected custom code in test. Locating test assembly:%%%.dll.
'1/9/2015 10:08:15 AM' - Assembly Found:...dll
'1/9/2015 10:08:15 AM' - Loading code class: ….
------------------------------------------------------------
------------------------------------------------------------
'1/9/2015 10:08:15 AM' - Enabling Html Popup Tracker. Test expecting Popups.
'1/9/2015 10:08:15 AM' - Using 'InternetExplorer' version '11.0' as default browser.
'1/9/2015 10:08:28 AM' - 'Pass' : %%%- 'Pass' : 1. %%% log starts:Overall Result: Pass
------------------------------------------------------------
'1/9/2015 10:08:15 AM' - Detected custom code in test. Locating test assembly: ….dll.
'1/9/2015 10:08:15 AM' - Assembly Found: ….dll
'1/9/2015 10:08:15 AM' - Loading code class: ….
------------------------------------------------------------
------------------------------------------------------------
'1/9/2015 10:08:15 AM' - Enabling Html Popup Tracker. Test expecting Popups.
'1/9/2015 10:08:15 AM' - Using 'InternetExplorer' version '11.0' as default browser.
'1/9/2015 10:08:23 AM' - 'Pass' : 1. Navigate to : ' ###
'1/9/2015 10:08:28 AM' - 'Pass' : 2. Wait for '5000' msec.
'1/9/2015 10:08:28 AM' - 'Pass' : 3. Handle '...' dialog. - DataDriven:
[$(LoginID)][$(Password)][$(WaitInterval)]
------------------------------------------------------------
'1/9/2015 10:08:28 AM' - Overall Result: Pass
'1/9/2015 10:08:28 AM' - Duration: [0 min: 13 sec: 84 msec]
------------------------------------------------------------<<<
Test-….tstest' log ends.
<<<
Step log ends.'1/9/2015 10:09:28 AM' - 'Fail' : 2. Execute test 'HandleDialog'
….tstest'
log starts:Overall Result: Fail
------------------------------------------------------------
'1/9/2015 10:08:28 AM' - Detected custom code in test. Locating test assembly: ....dll.
'1/9/2015 10:08:28 AM' - Assembly Found: ….dll
'1/9/2015 10:08:28 AM' - Loading code class: ….HandleDialog'.
------------------------------------------------------------
------------------------------------------------------------
'1/9/2015 10:08:28 AM' - Enabling Html Popup Tracker. Test expecting Popups.
'1/9/2015 10:08:28 AM' - Using 'InternetExplorer' version '11.0' as default browser.
'1/9/2015 10:08:28 AM' - 'NotRun' : 1. Wait for '5000' msec.
'1/9/2015 10:09:28 AM' - 'Fail' : 2. Wait for element 'Image'
'is' visible.
------------------------------------------------------------
Failure
Information:
~~~~~~~~~~~~~~~
Unable
to find the target host (Browser/SilverlightApp) to locate an element. Failure:
Waiting for frame
'[Frame:id=InlineDialog_Iframe,name=InlineDialog_Iframe,src=^/_forms/navtour/dlg_navtour.aspx,UseQuery:False]'
timed out. Error: Wait for condition has timed out
InnerException:
System.Exception:
Unable to find the target host (Browser/SilverlightApp) to locate an element.
Failure: Waiting for frame
'[Frame:id=InlineDialog_Iframe,name=InlineDialog_Iframe,src=^/_forms/navtour/dlg_navtour.aspx,UseQuery:False]'
timed out. Error: Wait for condition has timed out
at
ArtOfTest.WebAii.Design.Execution.ExecutionUtils.WaitForAllElements(IAutomationHost
host, AutomationDescriptor descriptor, Int32 timeout)
at ArtOfTest.WebAii.Design.Execution.ExecutionEngine.ExecuteStep(Int32 order)
------------------------------------------------------------
'1/9/2015
10:09:28 AM' - Detected a failure. Step is marked 'ContinueOnFailure=False'
aborting test execution.
------------------------------------------------------------
'1/9/2015
10:09:28 AM' - Overall Result: Fail
'1/9/2015
10:09:28 AM' - Duration: [1 min: 0 sec: 310 msec]
Please could you help me in debugging this issue? Why is it that it runs until a certain point in the 3rd case, and fails in the 1st and 2nd case? Even though
the initial steps are the same?
Also, I'm not sure why it fails to find the image when run through MTM, and works fine locally. Am I missing something?
Thanks,
Niharika