telerik test studio Runtime Edition Non-interactive (CI/CD)

Hi Yeongseok,

UI functional tests, including the Test Studio tests, require active user session in order to be executed correctly. The only exception are web tests set to run in headless browser mode. 

We haven't explored the setup of running Test Studio tests with GitLab runner. However, in theory there shouldn't be any obstacle for this if some requirements from our end are covered. 

1. Minimum Test Studio installation required on the execution machine is the Run-time edition.
   
   
2. The execution machine requires active user session for running UI functional tests - the Test Studio test runner provides built in options to control the user session. 
   
   Note: The case when the active desktop session is not a must is if you run web tests in headless browser mode. 
   
3. The build agent (GitLab runner in this case) needs to run in interactive mode. 
   
   Note: The case when the build agent can run as a service is if you run web tests in headless browser mode.
   
4. The test or test list execution is triggered with a command through the Test Studio CLI runner called the ArtOfTest.Runner.

So, if we use Azure DevOps for comparison the GitLab runner started as a service can be compared to the Microsoft-hosted agents and thus used only for headless web testing; and the GitLab runner started in interactive mode is the equivalent of Azure DevOps self-hosted agents, which are installed on a local machine and are self-managed. That second type of agents allow you to execute any UI tests, including WPF and desktop tests, with the note that there is an active user session on the machine. 

I hope the provided information will be of further help for you. Let me know in case of any additional questions you may have on the topic.

Regards,
Elena
Progress Telerik