Home
Test Execution Specialist Guide
This guide describes tasks that you must complete before you can configure and run tests in Rational® Test Automation Server. You can find information about configuring runs for the different test types that are supported. You can also find information about other tasks that you can perform on the Resource Monitoring Service, Virtualization, and Integrations with third-party applications. This guide is intended for testers or test execution specialists.
Integrations with other applications
You can integrate certain applications with IBM® Rational® Test Automation Server to run tests, view the test results, and create defects.
Integration with Azure DevOps
When you use Azure DevOps for continuous integration and continuous development of your application, you can run tests created for your application and available in a project on IBM® Rational® Test Automation Server, in Azure DevOps pipelines by using the IBM Rational Test Workbench extension.
Installing the IBM Rational Test Workbench extension
You must install the latest version of the IBM Rational Test Workbench extension in your Azure DevOps organization before you can use the extension for running your application tests in an Azure DevOps pipeline.

Test Execution Specialist Guide
This guide describes tasks that you must complete before you can configure and run tests in Rational® Test Automation Server. You can find information about configuring runs for the different test types that are supported. You can also find information about other tasks that you can perform on the Resource Monitoring Service, Virtualization, and Integrations with third-party applications. This guide is intended for testers or test execution specialists.
- System modeling
  In this topic, you can find information about using the system model feature. You can also find the tasks that you can perform to create a system model. You must configure a repository to save the system model that you created for the application under test.
- Prerequisites to running tests
  Before you can run a test asset in a project on Rational® Test Automation Server, you must read the information about the different tests assets. You can add a remote static agent or Docker host to the project and then select it as an alternate location to run the test assets.
- Management of agents
  You can find information about managing performance agents that you install on remote computers and then configure the remote agents to register with IBM® Rational® Test Automation Server. After the agents are registered, you can add them to your projects and then select them as locations to run tests.
- Management of Docker hosts
  You can find information about the tasks that you can perform on remote Docker hosts. After you set up a remote Docker host, you can register the Docker host with IBM® Rational® Test Automation Server. You must then add the registered remote Docker host to your project before you can run tests on the remote Docker host location.
- Management of remote Kubernetes clusters
  You can find information about the tasks that you can perform on remote Kubernetes clusters. After you set up a remote Kubernetes cluster, you can register the external cluster with a team space on IBM® Rational® Test Automation Server. You must then add the remote cluster to a project before you run test assets or resources on the remote Kubernetes cluster.
- Test run configurations
  You can configure and run tests in IBM® Rational® Test Automation Server after you add the test resources to your project in your team space.
- Configuration of a scan of an application code
  You can use Rational® Test Automation Server to scan your application code for security vulnerabilities similar to using the HCL AppScan CodeSweep plugin to scan code in Visual Studio.
- Management of running tests
  Find information about the tasks that you can perform on a test that you configured for a run either while it runs or after it completes the run.
- Management of virtualized services
  You can find information about the tasks that you can perform on and manage the virtualized services that run on Rational® Test Automation Server. You can start or stop the virtual services that are connected to Rational Test Automation Server. You can view the routing rules and usage statistics of virtualized services, agents, or intercepts that are connected to Rational Test Automation Server.
- Test results
  After the tests, Suites, or schedules are run and completed, you can view the results and open the reports in IBM® Rational® Test Automation Server to analyze the verdict, the performance, and statistics. You can also re-execute tests and schedules from the Result page with the same commit id.
- Resource monitoring
  When you apply load to a system under test, the amount of resources consumed by your system is increasing. If the capacity of the resources does not match the load, you can see performance issues in the results. Resource monitoring in Rational® Test Automation Server helps you monitoring the resources of a system and establish the performance metrics and usage data of the system. Thus, you can observe the health of these resources while a schedule is running.
- Configuration of a change management system
  When you use any application to create and track defects (bugs), issues, or other work items, you can configure the application as a change management system on Rational® Test Automation Server. You can then create defects (bugs), issues, or other work items without the need to open your application.
- Integrations with other applications
  You can integrate certain applications with IBM® Rational® Test Automation Server to run tests, view the test results, and create defects.
  - Integration plugin compatibility matrix
    You can find information about the versions of the integration plugin that are compatible with IBM® Rational® Test Automation Server.
  - Integration with Azure DevOps
    When you use Azure DevOps for continuous integration and continuous development of your application, you can run tests created for your application and available in a project on IBM® Rational® Test Automation Server, in Azure DevOps pipelines by using the IBM Rational Test Workbench extension.
    - Task flow for integrating Azure DevOps
      The table shows the task flow for integrating Rational® Test Automation Server with Azure DevOps by using the IBM Rational Test Workbench extension. You must perform these tasks in sequence as listed in the following table. The table also provides you the links to the information about the tasks.
    - Installing the IBM Rational Test Workbench extension
      You must install the latest version of the IBM Rational Test Workbench extension in your Azure DevOps organization before you can use the extension for running your application tests in an Azure DevOps pipeline.
    - Running tests in an Azure DevOps Pipeline
      After you install the IBM Rational Test Workbench extension in your organization, you can run tests that are available in IBM® Rational® Test Automation Server as a job in Azure DevOps pipelines.
  - Integration with IBM Engineering Test Management
    As a Project Owner, you can integrate IBM® Engineering Test Management as a quality management solution with IBM Rational® Test Automation Server. You can run test assets that are available in a project from Engineering Test Management.
  - Integration with Jenkins
    You can use the IBM® Rational® Test Automation Server plugin to integrate Rational Test Automation Server with Jenkins. After you complete the integration, you can run tests assets that are available in a project of Rational Test Automation Server from a Jenkins server.
  - Integration with UrbanCode™ Deploy
    You can integrate IBM® Rational® Test Automation Server with IBM® UrbanCode™ Deploy to run test assets as a Process from UrbanCode Deploy.
- Managing access to the server
  Desktop clients and third-party integrations use offline user tokens to connect to Rational® Test Automation Server.
- Working with IBM® Rational® Test Automation Server REST services
  When you want to use the IBM® Rational® Test Automation Server REST APIs in your test automation scripts, you can view the REST APIs that are exposed by IBM Rational Test Automation Server. You can also run the APIs from within your project in IBM Rational Test Automation Server.

Installing the `IBM Rational Test Workbench` extension

You must install the latest version of the IBM Rational Test Workbench extension in your Azure DevOps organization before you can use the extension for running your application tests in an Azure DevOps pipeline.

Before you begin

You must have access to the Visual Studio Marketplace portal to install the latest version of the IBM Rational Test Workbench extension.

About this task

After you install the latest version of the IBM Rational Test Workbench extension from the Visual Studio Marketplace portal in your Azure DevOps organization, you can select the tests that you want to run for your application in an Azure DevOps pipeline by using the IBM Rational Test Workbench extension.

Procedure

Log in to the Visual Studio Marketplace portal, if you are not already logged in.
Click the Azure DevOps tab.
Search for the IBM Rational Test Workbench extension.
Click the IBM Rational Test Workbench extension.
Click Get it free.

The Visual Studio Marketplace portal for the IBM Rational Test Workbench extension is displayed.
Select the organization where you want to run your test from the Select an Azure DevOps Organization list.
Click Install.

The installation is completed.
Click Proceed to organization.

The Organization page in Azure DevOps is displayed.
Click Organization settings > Extensions.

The IBM Rational Test Workbench extension is displayed as an installed extension.

Results

You have installed the IBM Rational Test Workbench extension in your Azure DevOps organization.

What to do next

You can run tests that are available in Rational® Test Automation Server as a job in an Azure DevOps pipeline. See Running tests in an Azure DevOps Pipeline.