Configuring a run of a Functional Windows test
Before you begin
- Created a Functional Windows test in Rational® Functional Tester and added the test asset to the project repository on IBM® Rational® Test Automation Server.
- Read Considerations for using Jaeger traces in reports, if you want to configure a run and you want Jaeger to report the test results for the test.
- Read and completed the tasks mentioned in Test run considerations for running tests on remote performance agents, if you want to use a remote agent as the location to run the test.
- Ensured that you are assigned a role of a Project Owner in the project. See Managing access to server projects.
- Ensured that you are assigned a role as a Project Owner or Tester in the project. See Managing access to server projects.
About this task
You can run the Functional Windows tests after you create the tests in Rational® Functional Tester, and then add them to your project on IBM® Rational® Test Automation Server.
Procedure
-
Log in to Rational® Test Automation
Server.
The team space that contains your project is displayed.
- Open the project that contains the test assets, and then click Execution.
-
Select the branch of the repository that contains the test
assets.
The test assets that are contained in the selected branch of the repository are displayed in the following tabs on the Execution page:
Tab Description SUITES Lists all suites, compound tests, JMeter tests, JUnit tests, Postman tests, Rate Schedules, or VU Schedules that are in the selected branch of the repository. TESTS Lists all API tests, functional tests, or performance tests that are in the selected branch of the repository. ADVANCED Lists all assets that are displayed when custom filters are applied for assets in the selected branch of the repository. -
Select the tab based on the type of test assets that you want to run as
indicated in the following table:
If... Then... You want to run AFT Suites, API Suites, Compound Tests, Rate Schedules, or VU Schedules..
Click the SUITES tab.
You want to run API tests, functional tests, or performance tests.
Click the TESTS tab.
You want to find Suites and tests by using custom filters, and then run Suites and tests. Click the ADVANCED tab.
The test assets in the selected tab are displayed.
-
Identify the test asset that you want to run by performing any of the
following actions:
- Scroll through the list.Tip: You can hover over the icon in the Type column to know the type of the test asset.Note: You can also identify the type of the asset from the icon that represents the test type as shown in the following table:
Icon Represents Listed in the SUITES tab Listed in the TESTS tab Listed in the ADVANCED tab API test Functional test Performance test AFT Suite API Suite Compound Test Rate Schedule VU Schedule - Search for the test asset by entering any text contained in the test asset name in the Search field.
- Click the Filter icon in the SUITES or
TESTS tab to filter the displayed
assets based on the asset type.
For example, select API Suite in the SUITES tab to display all API Suites or select Functional Test in the TESTS tab to display all functional tests that are in the selected branch of the repository.
- Click the Filter icon in the ADVANCED tab, and
then create a filter query by using the New
filter option by performing the following
steps:
- Click New filter.
- Enter a name for the filter.
- Select an operator, and add a rule or a group of rules.
- Add or enter the relevant parameters and either
select or enter the condition and the criteria for
the condition.You can select a parameter from the following list:
- Type
- Test Asset Name
- Test Asset Path
- Last Result
- Next Run
- Save the filter query to save and apply the filter
query to filter the assets based on the query.
The test assets that match the filter criteria are displayed.
- Retrieve and apply a saved filter query, if you have saved
filter queries previously by performing the following
steps:Note: The filter query applied previously is selected and the assets based on that filter query are displayed. To apply a different filter query, you must have created and saved the filter query.
- Click the Filter icon in the ADVANCED
tab.
The filter queries that you created and saved are displayed.
- Click the filter that you want to apply.
The test assets that match the filter criteria are displayed.
- Click the Filter icon in the ADVANCED
tab.
You have identified the test asset that you want to run.
- Scroll through the list.
-
Click the Execute icon in the row of the identified test asset.
The Execute test asset dialog is displayed.Notes:
-
If you have configured some or all of the settings for the current test run, and you do not want to continue with those settings, you can reset the settings by clicking Reset.
-
If you want to repeat a test run and do not want to use the saved settings from a previous run, you can reset all the saved settings to their default values by clicking Reset.
-
-
Select the version of the test resources
that you want to run by completing any of the following
actions:
Note: The test resources in the version can contain the test assets, datasets, AFT XML files, API environment tags, and other resources specific to projects created from any of the desktop clients.
- Expand the list in the Version field,
find the version of the test resources, and then select the
version.Use the following details about the version of the test resources that are displayed to identify the version that you want:
- Commit message.
- Tags labeled by the user for the version committed.
- The user who committed the version to the repository.
- Relative time of the commit. For example, 2 hours ago or 3 days ago.
The list displays the versions of the test resources committed by all users to the branch in the repository. The versions are arranged with the latest version that is committed, and then followed by the versions committed previously.
- Expand the list in the Version field,
and then search for the version that you want to select by
entering a partial or the complete commit message of that
version.
The version that matches the search criteria is displayed and it is selected for the test run.
The default value for the version selected for the run is the latest version in the selected branch of the repository. If you do not select any version, then the latest version is selected for the test run.Notes:- If you selected a version but you do not want to use that version in the test run, you can remove the selected version by clicking the icon. As a result, the default version is selected for the test run.
- If you repeated a test or ran the test again from the Results page, then the version of the test resources that you chose for the earlier run is shown as selected. You can either retain this version or select any other version from the list. You can also remove the previous version by clicking the icon.
- Expand the list in the Version field,
find the version of the test resources, and then select the
version.
-
Select the time for scheduling the test run from the following
options:
- No action is required if you want to
initiate the test run immediately after you click
Execute.Important: Click Execute only after you have configured the other settings in this dialog.Note: The default time for scheduling a run is Now.
- Select Later and configure the date and time to schedule a test run.
The default time for scheduling a run is Now.
Notes:-
If you have configured some or all of the settings for the current test run, and you do not want to continue with those settings, you can reset the settings by clicking Reset.
-
If you want to repeat a test run and do not want to use the saved settings from a previous run, you can reset all the saved settings to their default values by clicking Reset.
- No action is required if you want to
initiate the test run immediately after you click
Execute.
-
Enter a label for the test run
that helps you to identify the test on the
Results page.
After the test run completes, the label that you entered is displayed for the test under the Labels column on the Results page. After you have created a label, any member of the project can use that label.
The default value for the Label field is null or an empty field.
Important: The configuration that you set for the test run in the Execute test asset dialog is preserved when you run the same test again. Those changes are not visible when another user logs in to Rational® Test Automation Server. For example, if you created new variables on the server, those variables are available only for you when the same test is run again.If you want to run the test immediately or at the scheduled time, click Execute, or continue with the next step.
-
Click Advanced to make
the following advanced configurations:
Note: You must separate the arguments or variables with a white space when you enter them in the same line or start each argument or variable on a new line.
The default value for each of the fields for the advanced settings is null or an empty field.
If you want to run the test immediately or at the scheduled time, click Execute, or continue with the next step.
-
Follow the instructions if you are running a test asset that contains
datasets:
If you want to run the test immediately or at the scheduled time, click Execute, or continue with the next step.
-
Perform the following steps to provide the variables that must be passed to the
test at the test run time. You can either enter the variables or import the file
that contains the variables.
- Select any of the following steps that depends on the location to run the test:
-
Follow the instructions if you want to run a test on the remote
agent:
-
Follow the instructions if you want to change the location of a
Kubernetes cluster for running the test:
Results
What to do next
- Stop the test run at any point after the test run is initiated from the Execution page. See Stopping test runs.
- Cancel a scheduled test run from the Execution page. See Canceling scheduled test runs.
- View all the states of the test asset by clicking the Show in the Progress page icon for the test asset for which you started or scheduled the run. See Viewing the state of test assets.
- View the progress of the test from the Progress page. See Viewing the progress of running test assets.
- View the results, reports, and logs of the test from the Results page after the test completes the run. See Test results.