Setting the statistics displayed during a run
You can set the type of data that you see during a run, the sampling rate for that data, and whether data is collected from all users or a representative sample.
Procedure
To set the level of statistics logging:
-
In the Test Navigator, browse to the schedule and double-click
it.
The schedule opens.
- In the Schedule Contents area, click the name of the schedule.
-
On the Statistics page, set Statistics log level to
one of the following options:
Option Description None No statistics are displayed during the run, and any report that depends on statistics is not generated. At the end of the run, you see only a Summary report that contains three items: the time the run took, whether the results were on the local computer (or, if a remote location, which one), and the status of the run, which is Complete. Schedule Actions Select this option if you are interested only in the number of users. Schedule actions report the number of active and completed users in the run. Primary Test Actions Select this option to limit the processing required by the workbench. Primary test actions include all schedule actions plus: - For HTTP tests, HTTP page-related actions (attempts, hits, and verification points).
- For SAP tests, SAP screens.
- For Citrix tests, all keyboard and mouse actions.
- For socket tests, this option does not apply.
Secondary Test Actions Select this option to limit the processing required by the workbench. Secondary test actions include all primary test actions plus HTTP page element–related actions. - For HTTP tests, HTTP page element–related actions.
- For SAP tests, SAP screen element–related actions.
- For Citrix tests tests, statistics are identical to Primary Test Actions.
- For socket Send and Receive actions, the exchanged data is also available in the test log, by means of attachments.
All For HTTP, SAP, and Citrix tests, provides statistics for all actions. For socket Send and Receive actions, the exchanged data is also available in the test log, by means of attachments.
-
In Statistics sample interval, type
a number and select a time unit.
When you run a schedule, the reports show such information as response time during a specific interval, the frequency of requests being transferred during an interval, and average response trend during an interval. You set this interval here.
-
To set a sampling rate, select Only sample information
from a subset of users, then select one of the following
options.
The number or the percentage that you specify is applied to each user group. If you are running user groups at remote locations, the number or percentage that you select is distributed evenly among the remote locations.
Option Description Fixed number of users The number is applied to each user group. Assume that a schedule contains two user groups. One group contains four users, and another group contains 1000 users. If you specify 2
for this option, two users are sampled from each group.Percentage of users The percentage is applied to each user group, but at least one user will be sampled from each group. Assume that a schedule contains two user groups. One group contains four users, and another group contains 1000 users. If sampling rate is set to 10%, one user is sampled from the first group, and 100 users are sampled from the second group. Similarly, if sampling rate is set to 25%, one user is sampled from the first group, and 250 users are sampled from the second group. -
Typically, you should select Only store All
Hosts statistics.
Selecting this option reduces the amount of statistical data stored, thus enabling you to test a larger load over a longer period of time with significantly less memory usage. Although you will not be able to analyze data from each computer that adds to your test, this data is generally not of interest.
However, if you are running a test over different WANs—and if you are interested in seeing the data from each remote computer—you should clear this box.