Auto Generate Bug through Command Prompt to TFS

Hello Chelsea,

If you enable Auto-submit, as shown in the attached screen shot, it should work.


Regards,
Cody
Telerik

Hi Cody,

In the screenshot, your Team Foundation Server has a green checkmark beside it. Mine has the

black circle with the line through it like the icon beside your TeamPulse Server.

Do you know why that is?

Thanks.

Hi Chelsea,

Yes, the green checkmark means that particular bug tracker has been configured and the configuration saved. The black circle with the line through it means it hasn't been configured for a connection yet.


Regards,
Cody
Telerik

Hi Cody,

 I followed your instructions from the screenshot, but the bug was not generated. What is an arbitrary example of what I should be putting into the command prompt? Do I need to specify there the location ect?

Hi Chelsea,

What method are you using to run the tests? Which command line tool? Are you running a single test or a test list? I'm not sure but I think auto submit only works for a test list.

Regards,
Cody
Telerik

Hi Cody,

I am using the ArtOfTest.Runner.exe on the Command Prompt. I was running a test, not a test list. In the Command Prompt, should I be including the server, build, project, ect as shown under the Result publishing options in the line where I call the test/test list to create the bug?

Hi Chelsea,

It is not necessary to specify server, build, project, platform, flavor when using ArtOfTest.Runner. These only apply when you are pushing your results into a TFS server. They do not apply to submitting a bug.

Please try specifying a test list instead of just a single test. Let me know your results.

Regards,
Cody
Telerik

Hi Cody,

If not pushed to TFS, where would the bug be submitted to?

I ran the test and it failed as expected, but where do I find the

bug?

Hi Chelsea,

Where the bug gets automatically submitted depends on the default you have selected when you configured the bug tracker. See the attached screenshot for one am referring to. My development team confirmed that auto submit only works when running a test list. It does not work when running a single test.

Regards,
Cody
Telerik

Hi Cody,

I am trying to push the tests to TFS and it asks for the Platform and Flavor on the TFS Publishing part of ArtOfTest.Runner.exe. Where can I find these values? Additionally, when checking in results and tests into TFS while directly in Test Studio, how am I able to specify where they go (tests tab etc) rather than both under code?

Hi Chelsea,

I am trying to push the tests to TFS and it asks for the Platform and Flavor on the TFS Publishing part of ArtOfTest.Runner.exe.

Did you mean you're trying to push the test results to TFS? Pushing tests to TFS means you're trying to put them into source control and source control doesn't have the concept of platform or flavor.

When you push results to TFS they are associated with a specific TFS build. So you have to look up a build in TFS in which to connect the results too. If there is no TFS build to associate the results with then you cannot do a push. Usually you're trying to associate the results with a specific build of your product. I suggest you get in touch with your developers and see how your product is being built and if there is a TFS build in which you can associate test results with. They can help you in identifying the platform and flavor of the build.

Regarding putting tests into source control in TFS when you connect a Test Studio project to TFS you choose which folder in the TFS source control tree where you want your test project to be added to. This is documented on our page Connect Project to TFS.

Regards,
Cody
Telerik

Hi Cody,

I don't mean under the folders in source control. In the TFS web portal at the top the tabs are Home, Code, Work, Build and Test. I'm want to know how I can put the tests that I create on Test Studio (not using the Visual Studio Plugin) under the Test tab (where the Test Plan is) when I check it in rather than having them dumped under the Code tab.

As a side note, I ran the ArtOfTest.Runner.exe with the TFS publishing criteria filled out and associated with the appropriate build but I am unable to find where the results have been posted to.

Hi Chelsea,

Ah, I was actually unaware of the Test tab in the TFS web portal. The short answer is you can't. The technical reason is that Test Studio tests are a different kind of object compared to TFS tests. TFS tests actually have no code within them. You can link a TFS test to an automated test, either a Microsoft coded unit test, or a Test Studio test. But as far as TFS is concerned both (coded unit tests and Test Studio tests) are in fact a type of code file and must appear on the code tab.

I don't have access to TFS 2015. Hopefully this link helps you figure out how to view the test results.

Regards,
Cody
Telerik