Home
Test Execution Specialist Guide
This guide describes tasks that you must complete before you can configure and run tests in Rational® Test Automation Server. You can find information about configuring runs for the different test types that are supported. You can also find information about other tasks that you can perform on the Resource Monitoring Service, Virtualization, and Integrations with third-party applications. This guide is intended for testers or test execution specialists.
Test results
After the tests, Suites, or schedules are run and completed, you can view the results and open the reports in IBM® Rational® Test Automation Server to analyze the verdict, the performance, and statistics. You can also re-execute tests and schedules from the Result page with the same commit id.
Test results and reports
Rational® Test Automation Server is a single location for hosting the results and reports of all tests run on different desktop clients and for tests run from the server.
Comparing test reports
After you run performance tests, you can analyze the difference between two or multiple test results in IBM® Rational® Test Automation Server. For example, you can compare the performance of an application at different time slots or different milestone builds between two test results.

Test Execution Specialist Guide
This guide describes tasks that you must complete before you can configure and run tests in Rational® Test Automation Server. You can find information about configuring runs for the different test types that are supported. You can also find information about other tasks that you can perform on the Resource Monitoring Service, Virtualization, and Integrations with third-party applications. This guide is intended for testers or test execution specialists.
- System modeling
  In this topic, you can find information about using the system model feature. You can also find the tasks that you can perform to create a system model. You must configure a repository to save the system model that you created for the application under test.
- Prerequisites to running tests
  Before you can run a test asset in a project on Rational® Test Automation Server, you must read the information about the different tests assets. You can add a remote static agent or Docker host to the project and then select it as an alternate location to run the test assets.
- Management of agents
  You can find information about managing the agents that you must install on remote computers and configure the agents to register with IBM® Rational® Test Automation Server. After the agents are registered, you can add them to your projects and then select them as locations to run tests.
- Management of Docker hosts
  You can find information about the tasks that you can perform on remote Docker hosts. After you set up a remote Docker host, you can register the Docker host with IBM® Rational® Test Automation Server. You must then add the registered remote Docker host to your project before you can run tests on the remote Docker host location.
- Test run configurations
  You can configure and run tests in IBM® Rational® Test Automation Server after you add the test resources to your project in your team space.
- Management of running tests
  Find information about the tasks that you can perform on a test that you configured for a run either while it runs or after it completes the run.
- Management of virtualized services
  You can find information about the tasks that you can perform on and manage the virtualized services that run on Rational® Test Automation Server. You can start or stop the virtual services that are connected to Rational Test Automation Server. You can view the routing rules and usage statistics of virtualized services, agents, or intercepts that are connected to Rational Test Automation Server.
- Test results
  After the tests, Suites, or schedules are run and completed, you can view the results and open the reports in IBM® Rational® Test Automation Server to analyze the verdict, the performance, and statistics. You can also re-execute tests and schedules from the Result page with the same commit id.
  - Test results and reports
    Rational® Test Automation Server is a single location for hosting the results and reports of all tests run on different desktop clients and for tests run from the server.
    - Creating search queries to filter test results
      To filter the test and suite results list, you can create a search query that you apply as a filter in IBM® Rational® Test Automation Server.
    - Comparing test reports
      After you run performance tests, you can analyze the difference between two or multiple test results in IBM® Rational® Test Automation Server. For example, you can compare the performance of an application at different time slots or different milestone builds between two test results.
    - Viewing trending reports
      When the performance test runs are complete, you can view the trend of response time for an application over a period of time in IBM® Rational® Test Automation Server from trending reports. In addition to the response time, you can view the trend for the loops, transactions, and performance requirements for the application.
    - Re-executing tests from results
      You can re-execute a test, a schedule, a collection of tests or schedules from IBM® Rational® Test Automation Server if you want to keep the same commit id.
  - Viewing Surefire format reports
    After you execute JMeter, JUnit, API, and Functional tests with advanced settings in IBM® Rational® Test Automation Server, you can view the test results in a Surefire format report by using dedicated URLs.
  - Test logs
    When you start a run of a test asset, IBM® Rational® Test Automation Server starts to log information about the test run in a test log. You can view the test log while the test runs and after the run is completed from the Test Log page.
  - Test log queries
    When a test run is complete in IBM® Rational® Test Automation Server, if a test log is generated, you can run queries to extract and view test log data. The query is used to search for the events or activities in the test logs with a project or a result scope.
- Resource monitoring
  When you apply load to a system under test, the amount of resources consumed by your system is increasing. If the capacity of the resources does not match the load, you can see performance issues in the results. Resource monitoring in Rational® Test Automation Server helps you monitoring the resources of a system and establish the performance metrics and usage data of the system. Thus, you can observe the health of these resources while a schedule is running.
- Configuration of a change management system
  When you use any application to create and track defects (bugs), issues, or other work items, you can configure the application as a change management system on Rational® Test Automation Server. You can then create defects (bugs), issues, or other work items without the need to open your application.
- Integrations with other applications
  You can integrate certain applications with IBM® Rational® Test Automation Server to run tests, view the test results, and create defects.
- Managing access to the server
  Desktop clients and third-party integrations use offline user tokens to connect to Rational® Test Automation Server.

Comparing test reports

After you run performance tests, you can analyze the difference between two or multiple test results in IBM® Rational® Test Automation Server. For example, you can compare the performance of an application at different time slots or different milestone builds between two test results.

About this task

You can compare the test runs for performance tests that are in the same project or in different projects.

Procedure

Select results in the Results page by checking the boxes in the first column.
Click the icon

Note: When comparing multiple runs, you cannot compare multiple time-ranges or stages.

The two or multiple test results are displayed in a browser window in the same report.