Rank 1
Hello,
I have setup smtp email configuration on schedule server and selected option to send email while scheduling test execution.
Test executes just fine but not receiving email. Email smtp config and log file attached.
I also need to send test results via email when test is run through .bat file
my bat file
Title Test Runner
IF EXIST "C:\Program Files (x86)\Progress\Test Studio\Bin" goto :a
echo not found
pause
exit
:a
setlocal
path=C:\Program Files (x86)\Telerik\Test Studio\Bin;%path%
call ArtOfTest.Runner.exe list="C:\..\TestLists\Remote Execution Test.aiilist" serverPublish=true notifyOption=1 mails=myemail@abc.org
Thanks
-
Padmashree
25 Answers, 1 is accepted
Thank you for sending us details about your case. From what I see in scheduling configuration screen shot (smtpemail), you have setup properly mail server for sending mails. The execution log that you sent is empty for some reason.
Now, if I understand you correctly, you trigger a Test List run and did not receive any mail - is that correct?
If yes, can you please tell me if you have setup your project for remote execution according to this article? If you have, next step is to trigger a Scheduled Run, in which to configure send mail options according to this instruction. No mail will be sent if you Run List locally, not from Schedule TestList option.
If you have done this also, but no mail is received, I'm gonna need the Application Log during the scheduled run, from the machine on which the Scheduling Service is running - there should be information in the log when trying to send mail and possible error or exception for us to see.
About your second question, that you want to send mails when running from a .bat file, the way you run the list from ArtOfTest.Runner.exe will not send any emails, because it is performs a local run, and for mails to be sent it should be a remote scheduled run. What you can use instead is the "Telerik.TestStudio.CommandLineClient.exe". located also in same installation folder as ArtOfTestRunner, with which you can trigger a scheduled run and set option to send mail.
Please let me know if the above information was helpful. In case you are still not able to receive mails or configure command line runner, let me know with additional details to work on resolving your case.
Best Regards,
Daniel Djambov
Progress Telerik
Rank 1
Thanks Daniel for your response
I tried scheduling test list execution with email notification option selected. Test List is executing fine but no email notification. I have attached log file .
As per your suggestion tried with 'Telerik.TestStudio.CommandLineClient.exe' command like below but getting error even before starting to execute test.
call Telerik.TestStudio.CommandLineClient -l "C:\TASB\TFS\Test Automation\Enterprise Smoke Test Suite\TestLists\Remote Execution Test.aiilist" -u http://VM1.ms.tasb.org:8009/ -e myemail@tasb.org
Both logs are attached.
Thanks for your help.
-
Padmashree
Rank 1
Oops attached wrong log file. Please find attached correct file.
Thanks
Rank 1
Rank 1
Was getting error on file attachment. Hopefully this time it will work.
Thanks for all details shared so far. Let me, please, step in this discussion as we have recently discussed the scheduling setup on your end and this is somewhat related to the configuration.
As a first step. there is something to sort out for the automatic email notifications - this setting is available out of the box when executing test lists through the scheduling service. The Scheduling command line runner, which mu colleague Daniel had suggested, will allow you to use the mentioned configuration and send emails with some additional adjustments (listed below). However, if you intend to use the local command line runner, which is called ArtOfTest.Runner.exe, this email configuration will not be available.
Please, find below the necessary information to continue adjusting the test list execution on your end.
SMTP Settings
As a next step in this conversation I will describe the necessary settings for the email notifications. You seemed to have set already the required details for the SMTP server in the Scheduling configuration wizard (please refer to the screenshot you have attached in the initial post). However, I suspect that the port listed there will not work with the current details. What I mean is that you have checked the 'SSL' checkbox and thus the appropriate port should be 456. Can you please verify with the responsible team on your end which should be the correct port to use to connect to the SMTP server and set that one accordingly in the Scheduling wizard?
Once the SMTP settings are correct as per the server requirements, you can apply the new settings by clicking on the 'Apply' button. To ensure that the this works, please schedule any sample test list through the Test Studio UI and enable the email notification. Please, generate the application log during that run so that you can provide it in case further investigation will be required. To collect meaningful records in the log, please clear this prior scheduling the sample test list. Then collect the file after it is finished and the result is populated in the Results tab in Test Studio.
Executing test list from the Scheduling Command line runner
If this works as expected, we can move to the next step - executing a test list via the scheduling command line runner. As you have collected a log file already for this type of execution, there are few things I noticed and need to be mentioned. It seems that your project is under source control in TFS - please, correct me if this assumption is incorrect.
However, if this is correct, there is a specific, which you are probably not aware of, but is important for the current setup. In the case when the project is TFS source controlled and test lists are executed via the Scheduling command line runner, the project will be automatically downloaded from the TFS. The respective setting when a test list is scheduled from the UI is to enable the 'Get Latest from TFS' option.
The reason to mention the above notes, is that probably the user under which runs the configured Scheduling service does not have access to the TFS. This user should be the one logged on the machine, which hosts the Scheduling service. To allow that service to access the TFS, you can change the account it will run under - this is described in details here. The account to use is the one which can login successfully to the TFS.
When this is set correctly, you can verify if that works when starting an elevated command prompt and then execute a sample test list as described in the help article. Please, generate the application log for this run as well, to collect and provide it for further analysis if this turns out to be necessary.
Sending Email from the Results tab
As a final note I will address what you mentioned about sending an email with the results from the Results tab in Test Studio. Can you, please, elaborate more on that one?
- Do you see an email to be generated with the selected type of result format attached?
- If no, can you please generate the application log during the attempt to generate the email and send it for reference?
- If yes, please, let me know, if you have changed the default Telerik email address listed in the From field of the generated email? This needs to be changed to the email account configured on that machine. Will an email be sent, if you change this to use the correct email user?
I do understand the above information is quite extensive and may rise additional questions, so please, if I have missed anything, do not hesitate to get back to me and place your queries. Still, I hope this will be useful for you and will help you adjust the remaining settings to continue using the scheduling feature in Test Studio.
Thank you in advance for your cooperation. I will be looking forward to hearing back from you.
Regards,
Elena Tsvetkova
Progress Telerik
Rank 1
Hi Elena
Sorry for delay in responding . I was out of the office.
I tried with changing port to 456 and scheduling the Test List run. Now email is getting generated but failing send email. The error appears to be a permissions error that cannot send the email on my behalf.
My question is , who is the actual sender of the email that is trying to send using email address configured in SMTP?
Attached failed email notification
Thanks,
-
Padmashree
Thank you for getting back to me.
Can you please provide some insights how that email was generated? Did you generate this from the Results tab to export an already existing result or it was automatically generated after a test list execution?
The above details is actually essential as the two approaches mentioned above are using different configurations, which I will try to list below:
SMTP settings in the Scheduling configuration
These are the settings you apply while configuring the Scheduling service. Based on the discussed details so far, the sender of this email should be your own email address (as seen in the screenshots). This directly communicates with the SMTP server using the provided settings.
The recipients will be these, listed in the third step while scheduling a test list.
Generating Email from the Results tab to export an existing test list result
If this is the email we discuss, it is generated using the local email configuration on the computer in use - an email is being directly generated and opened in Outlook, for example. This email message needs some minor adjustment to be sent - the From field is automatically populated with a default Telerik email address, which is not usable - please see the note listed here. So, you need to change this with your email address, which will be listed in the drop down.
Then, list the desired recipients and send the email.
I hope this information will be helpful for you. Though, in case of further questions, please let me know.
Regards,
Elena Tsvetkova
Progress Telerik
Rank 1
Hi Elena,
Email was generated by scheduled test list execution. When I tried again with no changes to configuration I am getting different results.
1) Running Test list through Scheduled job with send email notification option selected
Result: No email generated . Log file attached .
2) Able to email existing test result report when changed to from email to my email.
3) Running test through batch file - CommnadLineClient
This one worked before but now failing to execute. Getting exceptions
Log file attached
Thanks
ERROR from command line
******************************
C:\Users\PatilPad\Desktop>call Telerik.TestStudio.CommandLineClient -l "C:\AAA\
TFS\Test Automation\Enterprise Smoke Test Suite\TestLists\Remote Execution Test.
aiilist" -u http://dev1.ms.tasb.org:8009/ -e myemail@tasb.org
Check whether to compile project
Starting to build job
Job built, Starting Upload to storage
Upload Complete- Queueing job on scheduler
Telerik.TestStudio.Services.Common.Exceptions.SourceControlNotReachableException
: Unable to reach source control server at: https://tasb-it.visualstudio.com/
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<CheckForKn
ownResponseCode>d__35.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNot
ification(Task task)
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<HandleResp
onse>d__33.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNot
ification(Task task)
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<HandleResp
onse>d__34`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNot
ification(Task task)
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<Post>d__28
`2.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNot
ification(Task task)
at Telerik.TestStudio.Shared.Communication.ExecutionManagerCommunicationLayer
.<QueueJobRun>d__11.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNot
ification(Task task)
at Telerik.TestStudio.CommandLineClient.CommandLineProcessor.<Execute>d__9.Mo
veNext()
C:\Users\PatilPad\Desktop>pause
Press any key to continue . . .
Thank you for the shared details on the attempts you have tried. Please find my comments below listed as per the topics in your response.
1. I reviewed the generated log file and there are few things to mention.
- What to check: Verify what settings are applied for the test list. The setting to look for is called RunnerResponseTimeuot - this one will terminate the ArtOfTest.Runner process if this doesn't respond in the set amount of time - in other words if it doesn't return results. However, if the timeout is too short, this could simply terminate the test execution. Based on the log file, it seems that this is what happens.
- How to solve the issue: Therefore, open the settings of the test list and if the RunnerResponseTimeout is enabled (has different than 0 value), please choose between the two available options:
a. disable this (set it to 0), or
b. set a timeout, which exceeds the duration of the longest test in the test list. E.g. if the longest test requires 70 seconds to be executed , then set the RunnerResponseTimeout to at least 90 000 msec.
- What to test: Once the test list settings are saved, schedule the test list run again and verify if the email will be sent. If you still face any troubles, please collect the log file again.
- Observe the execution: Please take some time and observe the execution of the test list - does the included tests execute as expected? Is there anything unusual? Are there any unexpected dialogs?
2. It seems that sending email with the already generated results from calendar works as expected.
3. It seems your project is connected to TFS, thus the execution scheduled from the Telerik.TestStudio.CommandLineClient will always use the TFS as source to get the project files. However, the current user, you are running the tests under, doesn't seem to have access to the TFS. Please, verify if the user you are logged in in Windows, can access the TFS and possibly is using admin permissions - the error listed in the log is:
Check whether to compile projectStarting to build jobJob built, Starting Upload to storageUpload Complete- Queueing job on schedulerTelerik.TestStudio.Services.Common.Exceptions.SourceControlNotReachableException: Unable to reach source control server at: https://tasb-it.visualstudio.com/
Can you please verify the allowed permissions for the users you are working with and then try to execute again.
I am looking forward to hearing from you. Thank you in advance for your cooperation.
Regards,
Elena Tsvetkova
Progress Telerik
Rank 1
Sorry for delayed follow up on this thread. I was pulled into different project .
I am still having issue with sending email notification after scheduled test list is run and also when test is ran through batch script.
Repose to your recommendation
#1 Checked Test List settings , RunnerReponse Timeout is set to 0. Watched testlist test running and didn't see any issues during execution.Testlist execution passed. Logfile attached
2. It seems that sending email with the already generated results from calendar works as expected
Yes , That is correct.
3. Still getting TFS error though logged in user has access to visual studio.
Noticed that when connecting source control though test studio interface , behavior is not consistent. Sometime it get connected without any errors .
C:\Users\PatilPad\Desktop>call Telerik.TestStudio.CommandLineClient -l "C:\TASB\
TFS\Test Automation\Enterprise Smoke Test Suite\TestLists\Remote Execution Test.
aiilist" -u http://dev-12r2-001.ms.tasb.org:8009/ -e padmashree.patil@tasb.org
Check whether to compile project
Compiling project
Starting to build job
Job built, Starting Upload to storage
Upload Complete- Queueing job on scheduler
Telerik.TestStudio.Services.Common.Exceptions.SourceControlNotReachableException
: Unable to reach source control server at: https://tasb-it.visualstudio.com/
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<CheckForKn
ownResponseCode>d__35.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNot
ification(Task task)
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<HandleResp
onse>d__33.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNot
ification(Task task)
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<HandleResp
onse>d__34`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNot
ification(Task task)
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<Post>d__28
`2.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNot
ification(Task task)
at Telerik.TestStudio.Shared.Communication.ExecutionManagerCommunicationLayer
.<QueueJobRun>d__11.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNot
ification(Task task)
at Telerik.TestStudio.CommandLineClient.CommandLineProcessor.<Execute>d__9.Mo
veNext()
C:\Users\PatilPad\Desktop>pause
Press any key to continue . . .
Rank 1
Log file attached.
Thanks,
-
Padmashree
Thanks for sharing details on the current state.
Since we continue a communication thread from over 3 months ago, I prefer to gather some fresh information about the current state of your environment - so, please, excuse me in advance if I request anything you had also provided previously.
Please go through the below notes as per the listed topics:
1. I reviewed the log file of test list execution and there is no attempt to send an email as such there is no enabled configuration for SMTP server. Can you, please, share your input on the below queries:
- how many machines there are in the setup? do you have machines with run-time edition only, dedicated for execution?
- how did you execute the test list - from the Test Studio UI, or through the command line?
- if using the command line what is the exact command entered?
- collect screenshots of Execution status and the three tabs of Scheduling configuration wizard (please ensure to expand the SMTP settings in the third tab).
2. Nothing to add for this topic.
3. Since the issue is intermittent I don't believe it is related to Test Studio and the Scheduling service. Can you please, double check next time when Test Studio cannot connect to the TFS, if you can access the TFS outside of Test Studio? You can also discuss with your IT department if there could be anything network related, which may prevent Test Studio to access the TFS.
In regards the TFS accessibility, please check if you had changed the Scheduling service account and if modifying this will have any effect on the consistent connection to TFS?
Please, get back to me, once you can share further details on the above listed notes. I am looking forward to hearing back from you.
Regards,
Elena Tsvetkova
Progress Telerik
Rank 1
Hi Elena,
Please see my response below
Please go through the below notes as per the listed topics:
1. I reviewed the log file of test list execution and there is no attempt to send an email as such there is no enabled configuration for SMTP server. Can you, please, share your input on the below queries:
- how many machines there are in the setup? do you have machines with run-time edition only, dedicated for execution?
>> I have three VM configured to execute Telerik tests. VM1 has Test studio license installed and on all three VMs Telerik runtime edition is installed. To confirm Scheduling Server configuration on VMs, I have tested running test remotely from VM1 onto VM2 and it is working just fine.
- how did you execute the test list - from the Test Studio UI, or through the command line?
>> I am running test both from Test Studio UI and from the batch file.
- if using the command line what is the exact command entered?
>>File attached
- collect screenshots of Execution atus and the three tabs of Scheduling configuration wizard (please ensure to expand the SMTP settings in the third tab).
>>Screen shot file attached
2. Nothing to add for this topic.
3. Since the issue is intermittent, I don't believe it is related to Test Studio and the Scheduling service. Can you please, double check next time when Test Studio cannot connect to the TFS, if you can access the TFS outside of Test Studio? You can also discuss with your IT department if there could be anything network related, which may prevent Test Studio to access the TFS.
In regards the TFS accessibility, please check if you had changed the Scheduling service account and if modifying this will have any effect on the consistent connection to TFS?
>> I have access to TFS outside the Test studio , no issues there. I have also updated Scheduling Service account with account info with access to Visual studio
Let me know if any additional information is needed.
Thanks ,
-
Padmashree
Rank 1
Hi Elena,
Is email trying to send on behalf of email which is setup under Scheduling Server SMTP setup?
Thanks,
-
Padmashree
Thanks for the shared details.
As of your question - the email will be sent from the email address configured in the Scheduling wizard - step 5. in this article. Do you have any email received after a scheduled execution?
If still having troubles with that, please schedule a job from Test Studio and collect the log file generated during that run. Below you may find detailed steps of how to gather the necessary resources:
1. Ensure the application log is enabled and cleared.
2. Ensure the Scheduling service is running - please collect screenshots from the three tabs after clicking on Apply.
3. Ensure the project is connected to the scheduler.
4. Schedule a test list with email option turned on.
5. Wait for the test list to finish and collect the generated application log.
6. Check if there is an email sent and let me know of the outcome.
In case you still face troubles with that, I would like to know when you will be available for an online troubleshooting session in the upcoming day. Please, share your exact time zone as well so that I can find the best suitable time frame for both sides.
Thanks for your cooperation.
Regards,
Elena
Progress Telerik
Rank 1
Hi Elena,
With IT recommendation I changed the port to 587 and with that change I am finally getting email notification. Yeah !!
Issue I am facing is . screenshots on failure are not loading . getting error below
[07/17 13:20:56,Telerik.TestStudio.ExecutionManagerService.exe(2848:21),Execution] PostListExecutionEmailer.OnAfterTestListCompleted() : Attempting to send email for job 2bb6022f-1219-4e4b-901b-19eb2d9b77c6
[07/17 13:20:58,Telerik.TestStudio.ExecutionManagerService.exe(2848:21),TestStudio] AutomationHostState.LoadFailureImageFromDisk() : Invalid file path to load the bitmap from: C:\Users\Patil\AppData\Local\Temp\ 132078610175035293_files\Login to AMS_0_ImageOnFailure.png
[07/17 13:20:58,Telerik.TestStudio.ExecutionManagerService.exe(2848:21),TestStudio] AutomationHostState.LoadFailureDOMFromDisk() : Invalid file path to load the DOM from: C:\Users\Patil\AppData\Local\Temp\ 132078610175035293_files\Login to AMS_0_DomTreeOnFailure.txt
[07/17 13:20:58,Telerik.TestStudio.ExecutionManagerService.exe(2848:21),TestStudio] AutomationHostState.LoadFailureImageFromDisk() : Invalid file path to load the bitmap from: C:\Users\Patil\AppData\Local\Temp\ 132078610175035293_files\Login to AMS_0_ImageOnFailure.png
[07/17 13:20:58,Telerik.TestStudio.ExecutionManagerService.exe(2848:21),TestStudio] AutomationHostState.LoadFailureDOMFromDisk() : Invalid file path to load the DOM from: C:\Users\Patil\AppData\Local\Temp\ 132078610175035293_files\Login to AMS_0_DomTreeOnFailure.txt
[07/17 13:21:55,Telerik.TestStudio.ExecutionManagerService.exe(2848:61)] First trace message from pool unnamed thread (managed ID = 61, native ID = 3740).
[
Thanks,
-Padmashree
Rank 1
Elena,
Another issue I would like to get resolved is running test from CommandlineClient batch script
Getting below error
07/17 14:31:33,Telerik.TestStudio.CommandLineClient.exe(4600:1),Warning] Loader.IndexLoadedSerializationTypes() : Attempt to index multiple types with the same signature: http://schemas.microsoft.com/netservices/2011/06/servicebus:TryReceiveResponse
[07/17 14:31:34,Telerik.TestStudio.CommandLineClient.exe(4600:14)] First trace message from pool unnamed thread (managed ID = 14, native ID = 3928).
[07/17 14:31:34,Telerik.TestStudio.CommandLineClient.exe(4600:14),Execution] ExecutionContext.RunInternal() : System.Net.Http.HttpRequestException: Response status code does not indicate success: 404 (Not Found).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<HandleResponse>d__33.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<HandleResponse>d__34`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<Get>d__26`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.Shared.Communication.ExecutionManagerCommunicationLayer.<GetAvailableDronesAsync>d__1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.CommandLineClient.JobBuilder.<Build>d__7.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.CommandLineClient.JobBuilder.<Build>d__4.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.CommandLineClient.CommandLineProcessor.<Execute>d__9.MoveNext()
I am in Central zone. let me know what day we can setup meeting to resolve remaining issues.
Thanks,
-
Padmashree
I am pleased to know the SMTP is now configured successfully and the automatic emails are being sent and received.
I would like to have some further details in regards these missing screenshots from the failure details - when do you see these errors in the log file? Is this when you open the result in the Results tab in Test Studio, or the shared log is generated during a test list run, which is supposed to send an email with the results? These details will be important for understanding what the actual trouble could be and how we can resolve it.
As of the other issue you have reported, I would like to know if this happens by each attempt to run a test list or it is intermittent? Based on the shared log file it looks like the Scheduling service is not accessible, or the selected execution machine is not reachable. So, any further details on when this issue appears will be of great help to find out what might be going wrong.
An online meeting will be helpful for us to explore what could be causing the listed errors, but I will also appreciate if you take some time to gather the necessary details even before we meet - that way I can prepare better for the online session.
The first day with available and suitable time frame will be on Tuesday next week (7/23/2019) in 8:00 AM Central US time - will that be convenient for you as well? Once you confirm your availability I will share the meeting details via this thread.
Thank you in advance for your cooperation and understanding.
Regards,
Elena
Progress Telerik
Rank 1
Hi Elena,
I have conflict on Tuesday morning but 7/24 -7/25 8AM CST works for me. Let me know if any day works for you.
Here is response information for above queries
1) Regarding the screenshot on failure : After testlist execution is done and when open the test results , I see failed step but actual result image attached is blank. Error I mentioned above are from the log. I have attached error log and screenshot from the results.
2) Other issue is related to running test from command prompt. On VM2 Telerik Scheduling service was not showing under services. After reinstalling Telerik Runtime Edition , Telerik Scheduling and Storage services are showing up.I am able to run testlist from VM1 on to Vm2.
3) Running testlist from command prompt
This is till failing but now not getting error related to visual studio accessibility but below error
07/22 12:15:15,Telerik.TestStudio.CommandLineClient.exe(5568:1)] First trace message from process 5568: Telerik.TestStudio.CommandLineClient -l "C:\TASB\TFS\Test Automation\Enterprise Smoke Test Suite\TestLists\Remote Execution Test.aiilist" -u http://dev-12r2-001.ms.tasb.org:8492/v1/ -e padmashree.patil@tasb.org
[07/22 12:15:15,Telerik.TestStudio.CommandLineClient.exe(5568:1)] First trace message from foreground unnamed thread (managed ID = 1, native ID = 6076).
[07/22 12:15:15,Telerik.TestStudio.CommandLineClient.exe(5568:1),TestStudio] Program.Main() : ------- Function Start -------
[07/22 12:15:21,Telerik.TestStudio.CommandLineClient.exe(5568:1),TestStudio] Program.Main() : ------- Function End -------
[07/22 12:15:37,Telerik.TestStudio.CommandLineClient.exe(5568:1),Warning] Loader.IndexLoadedSerializationTypes() : Attempt to index multiple types with the same signature: http://schemas.datacontract.org/2004/07/System.ServiceModel:ExceptionDetail
[07/22 12:15:37,Telerik.TestStudio.CommandLineClient.exe(5568:1),Warning] Loader.IndexLoadedSerializationTypes() : Attempt to index multiple types with the same signature: http://schemas.microsoft.com/netservices/2011/06/servicebus:TryReceiveResponse
[07/22 12:15:40,Telerik.TestStudio.CommandLineClient.exe(5568:8)] First trace message from pool unnamed thread (managed ID = 8, native ID = 5656).
[07/22 12:15:40,Telerik.TestStudio.CommandLineClient.exe(5568:8),TestStudio] <>c.<ContinueWhenAllImpl>b__57_1() : Extract elements time: 00:00:01.0724748
[07/22 12:15:40,Telerik.TestStudio.CommandLineClient.exe(5568:8),TestStudio] <>c.<ContinueWhenAllImpl>b__57_1() : Merge elements time: 00:00:00.2246355
[07/22 12:15:40,Telerik.TestStudio.CommandLineClient.exe(5568:8),TestStudio] <>c.<ContinueWhenAllImpl>b__57_1() : Total Elements count: 306
[07/22 12:15:43,Telerik.TestStudio.CommandLineClient.exe(5568:15)] First trace message from pool unnamed thread (managed ID = 15, native ID = 7672).
[07/22 12:15:43,Telerik.TestStudio.CommandLineClient.exe(5568:15),Execution] ExecutionContext.RunInternal() : System.Net.Http.HttpRequestException: Response status code does not indicate success: 404 (Not Found).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<HandleResponse>d__33.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<HandleResponse>d__34`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<Get>d__26`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.Shared.Communication.ExecutionManagerCommunicationLayer.<GetAvailableDronesAsync>d__1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.CommandLineClient.JobBuilder.<Build>d__7.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.CommandLineClient.JobBuilder.<Build>d__4.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Telerik.TestStudio.CommandLineClient.CommandLineProcessor.<Execute>d__9.MoveNext()
[07/22 12:16:18,devenv.exe(3764:1)] First trace message from process 3764: "C:\Program Files (x86)\Microsoft Visual Studio\2017\Enterprise\Common7\IDE\devenv.exe"
[07/22 12:16:18,devenv.exe(3764:1)] First trace message from background unnamed thread (managed ID = 1, native ID = 7800).
[07/22 12:16:18,devenv.exe(3764:1),Warning] Orchestrator.LoadPackages() : Telerik.TestStudio.Load.LoadPkg implements ITestStudioPkg but doesn't support VSTS SKU, so not added!
[07/22 12:16:18,devenv.exe(3764:1),Warning] Orchestrator.LoadPackages() : Telerik.TestStudio.Manual.ManualPkg implements ITestStudioPkg but doesn't support VSTS SKU, so not added!
[07/22 12:16:18,devenv.exe(3764:1),Uncategorized] Orchestrator.LoadPackages() : Telerik.TestStudio.Web.WebPkg implements ITestStudioPkg and was added as a package.
[07/22 12:16:18,devenv.exe(3764:1),Uncategorized] Orchestrator.LoadPackages() : Telerik.TestStudio.Wpf.WpfPkg implements ITestStudioPkg and was added as a package.
[07/22 12:16:18,devenv.exe(3764:1),TestStudio] Loader.LoadTranslatorGroups() : ------- Function Start -------
[07/22 12:16:19,devenv.exe(3764:1),TestStudio] Loader.LoadTranslatorGroups() : ------- Function End -------
Thanks,
-
Padmashree
Wednesday 7/24/2019 in 8:00 AM CST will work fine for me. Let us meet tomorrow and explore the configuration setup and what are the requirements you have. Please, ensure access to all machines included in the setup so that we can test the different scenarios you have.
It is recommended to turn off the UAC for the time of the meeting to possible be able to share controls with me. Please, note that this setting requires restart to take effect and will be necessary to apply it prior the meeting.
Please, find the meeting details below:
1399452 - Email notification not generating
Wed, Jul 24, 2019 8:00 AM - 9:00 AM CST (4:00 PM - 5:00 PM EEST)
Please join my meeting from your computer, tablet or smartphone.
https://global.gotomeeting.com/join/773101293
You can also dial in using your phone.
(For supported devices, tap a one-touch number below to join instantly.)
United States (Toll Free): 1 866 899 4679
- One-touch: tel:+18668994679,,773101293#
United States: +1 (571) 317-3117
- One-touch: tel:+15713173117,,773101293#
Access Code: 773-101-293
Joining from a video-conferencing room or system?
Depending on your device, dial:
773101293@67.217.95.2 or 67.217.95.2##773101293
New to GoToMeeting? Get the app now and be ready when your first meeting starts: https://global.gotomeeting.com/install/773101293
Thanks for your cooperation in advance.
Regards,
Elena
Progress Telerik
Please, excuse me for the delayed response - here is the summary of our meeting yesterday.
TFS issues
The first issue we discussed was the intermittent errors when trying to connect to TFS - you mentioned there are some conflicts and you actually cannot checkin your changes. The Test Studio integration with TFS does not support resolving conflicts, so you need to check these in the Visual Studio Source Control explorer and resolve them. So, once you get done with the conflicts, you can continue working in Test Studio. In case you face any troubles, do not hesitate to get back to me.
Test execution via a batch file
So, one of the requirements to run the tests is to trigger the execution from a batch file. So far, you were trying to use the Telerik.TestStudio.CommandLineClient, which is the command line runner which uses the Scheduling service. However, that runner is quite limited in the available options you can use when running a test list from it.
Therefore my suggestion is to use the ArtOfTest.Runner.exe, which is the default command line runner for Test Studio, which performs only local runs. As you mentioned that emailing the results is one of the things you want to accomplish, I have to admit that ArtOfTest.Runner does not provide such option, but you can configure an output folder where to copy the generated results.
Executing functional tests, when away from the machine
During our conversation we also talked about running tests on locked machine - this is a limitation by the Windows OS which concerns any tools for functional automation testing. Here you can find some additional notes on the topic and few workarounds listed at the bottom of the article.
Test Studio User Session Configuration
However, you can first give a try to the options which Test Studio provides to keep the active desktop session - these are part of the Execution client so you can enable it for the execution machine as well.
Scheduling executions
Enabling the above mentioned options will allow you freely schedule test lists runs with email notifications enabled. Although I am not completely familiar with all requirements you have, you can skip the batch file test execution, if the scheduling works as you expect it.
BaseURL
The application you are automating utilizes different environments and currently you are editing a data file to change the environment you run the tests against. However, Test Studio provides you the option to set a BaseURL for the project and then only change this for testing the different environments. There are few important notes to keep in mind when setting the project up:
- recording options - once you set a BaseURL, it is important to choose the page compare mode for the future recorded elements
- merge the existing elements - the so far recorded elements are not following the newly set logic and you will probably need to merge some of the pages as per the selected compare mode
- connecting to popups when using BaseURL - the particular steps can also rely on the project's BaseURL.
I hope all these details will be helpful for you. Of course, in case of further questions or doubts, please do not hesitate to get back to us. Thank you for your cooperation.
Regards,
Elena
Progress Telerik
Rank 1
Thanks Elena for detailed post. I got pulled into different projects and I thought I had responded to you earlier. Sorry for the delay.
Meeting was really helpful and I will try the suggestions you have recommended .
Thanks,
-
Padmashree
I am pleased to know that the meeting was helpful for you. Luckily I have shared the summary from our meeting and you can rely on the recommendations in written as well.
I hope you will be able to sort out all troubles you have faced.
Regards,
Elena
Progress Telerik
Rank 1
Thanks Elena.