Home
Test Execution Specialist Guide
This guide describes tasks that you must complete before you can configure and run tests in Rational® Test Automation Server. You can find information about configuring runs for the different test types that are supported. You can also find information about other tasks that you can perform on the Resource Monitoring Service, Virtualization, and Integrations with third-party applications. This guide is intended for testers or test execution specialists.
Test results
After the tests, Suites, or schedules are run and completed, you can view the results and open the reports in IBM® Rational® Test Automation Server to analyze the verdict, the performance, and statistics. You can also re-execute tests and schedules from the Result page with the same commit id.
Viewing Surefire format reports
After you execute JMeter, JUnit, API, and Functional tests with advanced settings in IBM® Rational® Test Automation Server, you can view the test results in a Surefire format report by using dedicated URLs.

Test Execution Specialist Guide
This guide describes tasks that you must complete before you can configure and run tests in Rational® Test Automation Server. You can find information about configuring runs for the different test types that are supported. You can also find information about other tasks that you can perform on the Resource Monitoring Service, Virtualization, and Integrations with third-party applications. This guide is intended for testers or test execution specialists.
- System modeling
  In this topic, you can find information about using the system model feature. You can also find the tasks that you can perform to create a system model. You must configure a repository to save the system model that you created for the application under test.
- Prerequisites to running tests
  Before you can run a test asset in a project on Rational® Test Automation Server, you must read the information about the different tests assets. You can add a remote static agent or Docker host to the project and then select it as an alternate location to run the test assets.
- Management of agents
  You can find information about managing performance agents that you install on remote computers and then configure the remote agents to register with IBM® Rational® Test Automation Server. After the agents are registered, you can add them to your projects and then select them as locations to run tests.
- Management of Docker hosts
  You can find information about the tasks that you can perform on remote Docker hosts. After you set up a remote Docker host, you can register the Docker host with IBM® Rational® Test Automation Server. You must then add the registered remote Docker host to your project before you can run tests on the remote Docker host location.
- Management of remote Kubernetes clusters
  You can find information about the tasks that you can perform on remote Kubernetes clusters. After you set up a remote Kubernetes cluster, you can register the external cluster with a team space on IBM® Rational® Test Automation Server. You must then add the remote cluster to a project before you run test assets or resources on the remote Kubernetes cluster.
- Test run configurations
  You can configure and run tests in IBM® Rational® Test Automation Server after you add the test resources to your project in your team space.
- Configuration of a scan of an application code
  You can use Rational® Test Automation Server to scan your application code for security vulnerabilities similar to using the HCL AppScan CodeSweep plugin to scan code in Visual Studio.
- Management of running tests
  Find information about the tasks that you can perform on a test that you configured for a run either while it runs or after it completes the run.
- Management of virtualized services
  You can find information about the tasks that you can perform on and manage the virtualized services that run on Rational® Test Automation Server. You can start or stop the virtual services that are connected to Rational Test Automation Server. You can view the routing rules and usage statistics of virtualized services, agents, or intercepts that are connected to Rational Test Automation Server.
- Test results
  After the tests, Suites, or schedules are run and completed, you can view the results and open the reports in IBM® Rational® Test Automation Server to analyze the verdict, the performance, and statistics. You can also re-execute tests and schedules from the Result page with the same commit id.
  - Test results and reports
    Rational® Test Automation Server is a single location for hosting the results and reports of all tests run on different desktop clients and for tests run from the server.
  - Test results data in Grafana
    By using IBM® Rational® Test Automation Server Results Data and Grafana, you can retrieve and explore test log data that is generated in IBM Rational Test Automation Server. You must install and configure the IBM Rational Test Automation Server Results Data plugin in Grafana and create an instance of a data source that you use to explore your test log data.
  - Viewing Surefire format reports
    After you execute JMeter, JUnit, API, and Functional tests with advanced settings in IBM® Rational® Test Automation Server, you can view the test results in a Surefire format report by using dedicated URLs.
  - Test logs
    When you start a run of a test asset, IBM® Rational® Test Automation Server starts to log information about the test run in a test log. You can view the test log while the test runs and after the run is completed from the Test Log page.
  - Test log queries
    When a test run is complete in IBM® Rational® Test Automation Server, if a test log is generated, you can run queries to extract and view test log data. The query is used to search for the events or activities in the test logs with a project or a result scope.
- Resource monitoring
  When you apply load to a system under test, the amount of resources consumed by your system is increasing. If the capacity of the resources does not match the load, you can see performance issues in the results. Resource monitoring in Rational® Test Automation Server helps you monitoring the resources of a system and establish the performance metrics and usage data of the system. Thus, you can observe the health of these resources while a schedule is running.
- Configuration of a change management system
  When you use any application to create and track defects (bugs), issues, or other work items, you can configure the application as a change management system on Rational® Test Automation Server. You can then create defects (bugs), issues, or other work items without the need to open your application.
- Integrations with other applications
  You can integrate certain applications with IBM® Rational® Test Automation Server to run tests, view the test results, and create defects.
- Managing access to the server
  Desktop clients and third-party integrations use offline user tokens to connect to Rational® Test Automation Server.
- Working with IBM® Rational® Test Automation Server REST services
  When you want to use the IBM® Rational® Test Automation Server REST APIs in your test automation scripts, you can view the REST APIs that are exposed by IBM Rational Test Automation Server. You can also run the APIs from within your project in IBM Rational Test Automation Server.

Viewing Surefire format reports

After you execute JMeter, JUnit, API, and Functional tests with advanced settings in IBM® Rational® Test Automation Server, you can view the test results in a Surefire format report by using dedicated URLs.

Before you begin

You must have configured your tests with one of the following parameters:

For JMeter, JUnit, Postman, and HCL AppScan CodeSweep Suites, set the history parameter with cisterna value in the Additional Configuration Parameters field in the Advanced settings .
For API Suites, AFT Suites, Compound tests, Functional tests, and API tests, set the -history cisterna parameter in the Program Arguments field in the Advanced settings .

About this task

When a test run is complete, you can see the test result data in a report that is in a Surefire format. You can view this report by using dedicated URLs, and you do not have to do any import task.

Procedure

Click Analyze > Results in the navigation pane.
The Results page is displayed.
Click a test result and note its project identifier and test result identifier (Id) in the URL of the test log that is displayed in your browser. The URL is in the following format: https://myProductionServer.com/#/Initial/project/<ProjectId>/analyze/test-log/<ResultId>.
The identifiers are required to view the Surefire test logs in the following steps.
Enter one of the following URLs with the appropriate information in a web browser or in an external tool that you use to view Surefire reports:
- /rest/projects/<ProjectId>/data/views/surefire/
  
  Enter your REST API address and the project identifier to view the list of all test cases in the project with details about their status.
  
  Example: https://myProductionServer.com/rest/projects/230200/views/surefire/
- /rest/projects/<ProjectId>/results/<ResultId>/data/views/surefire/
  
  Enter your REST API address, the project identifier, and the test result identifier to view the results for this test result id in the project.
  
  Example: https://myProductionServer.com/rest/projects/230200/results/80250/data/views/surefire/

Results

The test result reports are displayed in a Surefire format.