Home
Test Execution Specialist Guide
This guide describes tasks that you must complete before you can configure and run tests in Rational® Test Automation Server. You can find information about configuring runs for the different test types that are supported. You can also find information about other tasks that you can perform on the Resource Monitoring Service, Virtualization, and Integrations with third-party applications. This guide is intended for testers or test execution specialists.
Integrations with other applications
You can integrate certain applications with IBM® Rational® Test Automation Server to run tests, view the test results, and create defects.
Integration with Jenkins
You can use the IBM® Rational® Test Automation Server plugin to integrate Rational Test Automation Server with Jenkins. After you complete the integration, you can run tests assets that are available in a project of Rational Test Automation Server from a Jenkins server.
Running tests from Jenkins
You can run test assets either from the Jenkins Freestyle or the Pipeline project on the Jenkins server to test an application under test.

Test Execution Specialist Guide
This guide describes tasks that you must complete before you can configure and run tests in Rational® Test Automation Server. You can find information about configuring runs for the different test types that are supported. You can also find information about other tasks that you can perform on the Resource Monitoring Service, Virtualization, and Integrations with third-party applications. This guide is intended for testers or test execution specialists.
- System modeling
  In this topic, you can find information about using the system model feature. You can also find the tasks that you can perform to create a system model. You must configure a repository to save the system model that you created for the application under test.
- Prerequisites to running tests
  Before you can run a test asset in a project on Rational® Test Automation Server, you must read the information about the different tests assets. You can add a remote static agent or Docker host to the project and then select it as an alternate location to run the test assets.
- Management of agents
  You can find information about managing the agents that you must install on remote computers and configure the agents to register with IBM® Rational® Test Automation Server. After the agents are registered, you can add them to your projects and then select them as locations to run tests.
- Management of Docker hosts
  You can find information about the tasks that you can perform on remote Docker hosts. After you set up a remote Docker host, you can register the Docker host with IBM® Rational® Test Automation Server. You must then add the registered remote Docker host to your project before you can run tests on the remote Docker host location.
- Test run configurations
  You can configure and run tests in IBM® Rational® Test Automation Server after you add the test resources to your project in your team space.
- Management of running tests
  Find information about the tasks that you can perform on a test that you configured for a run either while it runs or after it completes the run.
- Management of virtualized services
  You can find information about the tasks that you can perform on and manage the virtualized services that run on Rational® Test Automation Server. You can start or stop the virtual services that are connected to Rational Test Automation Server. You can view the routing rules and usage statistics of virtualized services, agents, or intercepts that are connected to Rational Test Automation Server.
- Test results
  After the tests, Suites, or schedules are run and completed, you can view the results and open the reports in IBM® Rational® Test Automation Server to analyze the verdict, the performance, and statistics. You can also re-execute tests and schedules from the Result page with the same commit id.
- Resource monitoring
  When you apply load to a system under test, the amount of resources consumed by your system is increasing. If the capacity of the resources does not match the load, you can see performance issues in the results. Resource monitoring in Rational® Test Automation Server helps you monitoring the resources of a system and establish the performance metrics and usage data of the system. Thus, you can observe the health of these resources while a schedule is running.
- Configuration of a change management system
  When you use any application to create and track defects (bugs), issues, or other work items, you can configure the application as a change management system on Rational® Test Automation Server. You can then create defects (bugs), issues, or other work items without the need to open your application.
- Integrations with other applications
  You can integrate certain applications with IBM® Rational® Test Automation Server to run tests, view the test results, and create defects.
  - Integration plugin compatibility matrix
    You can find information about the versions of the integration plugin that are compatible with IBM® Rational® Test Automation Server.
  - Integration with Azure DevOps
    When you use Azure DevOps for continuous integration and continuous development of your application, you can run tests created for your application and available in a project on IBM® Rational® Test Automation Server, in Azure DevOps pipelines by using the IBM Rational Test Workbench extension.
  - Integration with IBM Engineering Test Management
    As a Project Owner, you can integrate IBM® Engineering Test Management as a quality management solution with IBM Rational® Test Automation Server. You can run test assets that are available in a project from Engineering Test Management.
  - Integration with Jenkins
    You can use the IBM® Rational® Test Automation Server plugin to integrate Rational Test Automation Server with Jenkins. After you complete the integration, you can run tests assets that are available in a project of Rational Test Automation Server from a Jenkins server.
    - Task flows for running test assets from Jenkins
      You can perform certain tasks to run test assets from the Jenkins Freestyle project or the Pipeline project.
    - Installing the Rational® Test Automation Server Jenkins Plugin
      You must install the Rational® Test Automation Server Jenkins plugin on the Jenkins server before you can use the plugin for running tests that are available in your Rational Test Automation Server project on the Jenkins server.
    - Using a custom trust store
      You can use a custom trust store in the Jenkins build step of a Rational® Test Automation Server Jenkins plugin to establish a trusted and secure connection between the Jenkins server and Rational Test Automation Server.
    - Configuring the Freestyle project
      You must configure a Freestyle project to add a build step, and then run tests that are available in your Rational® Test Automation Server project from Jenkins.
    - Creating a pipeline script from Jenkins
      You must create a pipeline script to run test assets that are available in the Rational® Test Automation Server project from the Jenkins Pipeline project.
    - Configuring the Pipeline project by using the sample script
      You can configure a Pipeline project directly from the Jenkins UI by using the sample pipeline scripts to run test assets from Jenkins.
    - Configuring the Pipeline project by using the script from SCM
      You can configure the Pipeline project to use the pipeline script from the Source Code Management (SCM), and then run test assets that are available in the Rational® Test Automation Server project from the Jenkins Pipeline project.
    - Running tests from Jenkins
      You can run test assets either from the Jenkins Freestyle or the Pipeline project on the Jenkins server to test an application under test.
  - Integration with UrbanCode™ Deploy
    You can integrate IBM® Rational® Test Automation Server with IBM® UrbanCode™ Deploy to run test assets as a Process from UrbanCode Deploy.
- Managing access to the server
  Desktop clients and third-party integrations use offline user tokens to connect to Rational® Test Automation Server.

Running tests from Jenkins

You can run test assets either from the Jenkins Freestyle or the Pipeline project on the Jenkins server to test an application under test.

Before you begin

You must have completed the following tasks:

Configured the Freestyle project, if you want to run test assets from the Freestyle project. See Configuring the Freestyle project.
Configured the Pipeline project either by using the Pipeline script or Pipeline script from SCM, if you want to run test assets from the Pipeline script project. See Configuring the Pipeline project by using the sample script or Configuring the Pipeline project by using the script from SCM.

Procedure

Log in to the Jenkins server.
The Jenkins dashboard is displayed.
Open your Jenkins Freestyle or Pipeline project from the list.
Click Build Now to run the test assets from Jenkins.

Results

You have run the test from the Jenkins server.

What to do next

You can view the build logs by clicking the build number from the Build History pane, and then selecting the Console Output option. After the Jenkins build completes, you view a detailed log of the build from the console output.

You can access the report URLs to view the test run information at any point in time. You can also view the test reports and logs of the test that was run on the Jenkins server from the Results page on Rational® Test Automation Server. See Test results and reports.