Test results in TFS Build vNext

Hello Shaun,

Thank you for contacting us.

Please elaborate a bit more what exactly do you want to achieve? What do you mean by "the new build system"? 

Test Studio works correctly with TFS 2015.

Hope to hear from you soon.

Regards,
Boyan Boev
Telerik

In TFS 2015 they have created a new build system:
 https://msdn.microsoft.com/en-us/library/vs/alm/build/feature-overview

I have setup a new build and I am trying to run automated tests then publish the results back into TFS using one of the runners:

MSTest is known not to work with the new build system as it can't find the build to publish
ArtOfTest appears to have a similar problem where i can publish to an XAML Build but not to a "vNext" Build

The same problem occurs if you run 

ArtOfTest.Runner.exe /test=test.tstest /root=D:\Tests /server=tfs /build=vNextBuildName /Project=Default /platform=Release /flavor=x86

Thanks

Shaun

Hi Shaun,

According to the link you have provided about the new build MSTEST should work correctly.

My guess here is that you have some incorrect configuration, especially that you can publish results to one build and you are not able to another.

Are there any differences between the two builds (i.e. in configuration)? 

Looking forward to hearing from you.

Regards,
Boyan Boev
Telerik

One build is XAML based - This one is ok to publish to

The other is using the new build system - Can't publish using ArtOfTest or MSTest

 Here is the reason i can't use MSTest:
https://social.msdn.microsoft.com/Forums/vstudio/en-US/1baafce1-8d11-424f-9d6f-64baa92d23be/how-to-publish-trx-file-to-tfs-2015-linking-with-vnext-build?forum=tfsbuild

 Is there a similar reason for ArtOfTest?

Hi Shaun,

Yes, that's maybe the reason. To be honest we have tested this new build system with ArtOfTest.

However if MSTEST is not able to publish with this build system maybe it is the same reason for ArtOfTest.

Is there a way for you to use the old one?

Thank you for your cooperation.

Regards,
Boyan Boev
Telerik

Hi Boyan,

[quote]To be honest we have tested this new build system with ArtOfTest.[/quote]

I am very interested in seeing how you achieved this.  Could you please show me the details and different parameters you entered for each step in the definition?  I am curious how you were able to have the ArtOfTest runner to execute tests on an agent within a vnext build.

Thanks,

Jeff

 

Hi Jeff,

I am sorry for the typo. I wanted to say that we have NOT tested this new build system with ArtOfTest runner.

Excuse me again for the misunderstandings.

Regards,
Boyan Boev
Telerik by Progress

Hi Boyan,

Thanks for clarifying.  Are there any working examples of running a tstest file with TFS vNext?  If not, is this something Telerik will be addressing in the near future?

Thanks,

Jeff

Hello Jeff,

Let me interfere into this thread since my colleague is out of office this week. I am sorry to admit currently there are no plans to test this on our side and create possibly a working example. However I will submit a feature request into our public feedback portal on your behalf and your proposal will be taken into consideration. Here you could follow its progress and vote for your request. 

Thanks for your understanding! 

Regards,
Elena Tsvetkova
Telerik by Progress