This is a migrated thread and some comments may be shown as answers.

Multiple Test as arguments to ArtOfTest.Runner

9 Answers 83 Views
General Discussions
This is a migrated thread and some comments may be shown as answers.
VVP
Top achievements
Rank 2
VVP asked on 10 Oct 2015, 05:16 AM

Hi all,

Is it possible to pass multiple tests to ArtofTest.Runner for execution.

I know with testlist, we can accomplish this. But our testing environment is rather dynamic , where tests needs to be selected dynamically. So I have a set of tests, from which some needs to be selected randomly for execution.

You can say like dynamic workflow.

So there are two ways we can accomplish this.

1) Passing multiple tests as arguments to ArtofTest.Runner.

2) Editing a list during runtime by adding needed tests.. ( If list is in xml format, then easy.)

 

Thanks,

VVP

9 Answers, 1 is accepted

Sort by
0
Cody
Telerik team
answered on 12 Oct 2015, 02:26 PM
Hi Vishnu,

I am sorry but the command line runner only accepts one test or one test list as a command line parameter. It will ignore any extras.

However have you researching into using a Dynamic Test List? This might solve the problem.

Regards,
Cody
Telerik
 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
0
VVP
Top achievements
Rank 2
answered on 12 Oct 2015, 04:48 PM

Hi Cody,

In dynamic test list, we need to add all the possible tests first. Then during runtime if condition matches ,it will get executed right.

I am looking at something like

I will get list of tests from some source, say xml . I am planning to iterate each of them or create a list and execute them.

Is it possible to create a blank dynamic list and add tests during runtime.?

Thanks,

VVP

0
Cody
Telerik team
answered on 12 Oct 2015, 06:13 PM
Hi Vishnu,

In dynamic test list, we need to add all the possible tests first.

Actually not true. The purpose of a dynamic test list is that when you go to execute the test list Test Studio will run a query to find all tests contained in the project and only execute those that match the specified criteria. The criteria you can specify is very flexible:
  • Run all tests set to priority 1 and set to Enabled
  • Run all tests set to Feature A and set to Enabled
  • And so on

 Is it possible to create a blank dynamic list and add tests during runtime.?

Again, you cannot add specific tests to a "dynamic" test list. This can only be done to a static test list.


Regards,
Cody
Telerik
 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
0
VVP
Top achievements
Rank 2
answered on 13 Oct 2015, 04:35 AM

Hi Cody,

The ability to select tests based on properties during runtime is awesome.

1) Can we set properties for a test like priority during runtime?

 2) The thought i am having if point 1 is not going to work is, I will append testnames with "AutoExec" and dynamic test will look for test with "AutoExec". WIll it get picked up for execution?

 Tests like

Test1.tstest

Test2.tstest

Test3.tstest​

will be changed to 

Test1_AutoExec.tstest
Test2
_AutoExec.tstest

Test3_AutoExec.tstest

So although this looks a dirty way, in absence of setting test property dynamically, this will work right.

 

Thanks,

VVP

0
Accepted
Cody
Telerik team
answered on 13 Oct 2015, 01:48 PM
Hi,

Can we set properties for a test like priority during runtime?

No I'm sorry. The query parameters and properties of a dynamic test list are stored in the .aiilist file and can only be changed using our IDE (unless you hack the .aiilist file which I cannot recommend).

Yes if you change the filename outside of Test Studio just prior to executing the dynamic test list, the test runner will iterate the files (the .tstest files specifically) that exist on disk and use those. One way I can think of to make it easy would be to move tests between folders. Create a dynamic test list, or lists, that execute all tests from a specific folder. This way you simply move tests around instead of rename the filename.

Regards,
Cody
Telerik
 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
0
VVP
Top achievements
Rank 2
answered on 13 Oct 2015, 04:29 PM

Hi Cody,

You mean to say set the path rule while creating dynamic list.? So we have to specify some path and make sure tests are available at that location right?

Actually i like the option. Makes more easier and less chaotic than renaming files.

Thanks,

VVP

 

0
Cody
Telerik team
answered on 13 Oct 2015, 05:56 PM
Hi,

You mean to say set the path rule while creating dynamic list.?

Yep, that's exactly what I meant!!

Regards,
Cody
Telerik
 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
0
VVP
Top achievements
Rank 2
answered on 17 Oct 2015, 07:40 AM

Thanks a lot Cody.

 

Thanks,

VVP

0
Cody
Telerik team
answered on 19 Oct 2015, 02:56 PM
Hello,

Glad I could help.

Regards,
Cody
Telerik
 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
Tags
General Discussions
Asked by
VVP
Top achievements
Rank 2
Answers by
Cody
Telerik team
VVP
Top achievements
Rank 2
Share this question
or