Operational summary

To go to the Operational summary page, click > Operational summary.

The Operational summary page gives you insight into your web application's performance: average availability, average response time, number of tests with errors, total test runs, and number of steps in the transaction.

Each test is identified by product (test type) and Browser Agent.

Test type

Backbone

Last Mile

Private Last Mile

Mobile

Browser Agent

Internet Explorer

Firefox

Chrome

Mobile

If the test is in a batch order, the batch order is listed below the test name.

If your account is signed up for benchmarks, you can include benchmark tests in the table by clicking the Include Benchmark tests switch to enabled .

You can sort the table by clicking a column head.

Performance status at a glance

Color-coded status icons let you quickly identify which tests are having performance issues:

  • Good
  • Warning
  • Severe

The severity status is determined by the worse status of availability and response time. For example, if the availability is Good but the response time is Severe, the overall status is Severe. For a test to be Good, both the availability and response time must be Good.

Analysis workflow

You can view the performance trend chart for a selected test, and drill down to analyze a test that shows performance issues.

View the performance trend chart

Click a test's Availability or Response time value, or click the expand icon at the end of the row, to display a chart of the response time and availability over the Operational summary page's time range.

Hover over a data point to see the timestamp and metric values for that point.

Click Response time or Availability in the legend below the chart to remove that metric from the chart.

View drilldown charts

You can drill down to the Trend details chart by clicking View trend chart below the performance trend chart, or to the Raw scatter chart by clicking View raw scatter chart.

The Trend details page displays a response time and availability chart for the selected test. You can modify this chart to analyze the data from different perspectives, and drill down through a raw scatter chart to the Waterfall summary page and the Waterfall chart. From the Trend details page, you can also go to the interactive chart. For more information, see Trend details.

The Raw scatter chart includes a data point for each test execution within the time range configured for the Operational summary page. From this chart, you can drill down to object data, the Waterfall summary page, or an interactive chart of the raw data. If errors occurred, you can drill down to the Error analysis page, and view screen captures if Screen Capture on Error is enabled for the test. For more information, see Raw scatter chart.

Drill down to error analysis

Click a value in the Errors column to drill down to the Error analysis page for the selected test. For details, see Error analysis.

Drill down to the test overview

Click the test name or the Steps value to display the Test overview page.

This page gives you comprehensive information at a glance for the selected test: performance and availability data, high-level error data, summary data for active alerts, and summaries of performance anomalies.

The Test overview page provides further drilldowns for more detailed analysis. For details, see Test overview.

Refining the data display

The default view lists all the tests for your account, and displays performance data for the selected time range. The data is automatically refreshed every 5 minutes.

You can adjust the time range, filter the test list, and reset severity thresholds for selected tests.

Select the time range

By default, the page displays data collected in the last hour. To change the time range, click the time icon and select the new range, from the last 1 hour through the last 45 days.

The time range selected when you log out will be applied the next time you log in.

Filter the test list

Filter by folder

Click All tests in the toolbar at the top of the Portal and select the folder. Folders for benchmark tests are included in the list. If your account has many folders, type a string in the search field to list only folders that have the string in their name.

If the list is filtered by folder when you log out, the filter will be applied the next time you log in.

To display the operational summaries for tests that are not grouped together in a folder, create a custom dashboard with a Synthetic tile.

Filter by test, status, product, or browser

Click the filter icon at the top left of the page to display the filter pane.

You can select any combination of filters to see only the tests of interest:

  • Test – Type a string in the Filter tests field at the top of the pane to list only the tests that have that string in their names.
  • Status – Click one or more severity levels to display only the tests that are in that status. For example, you can display only Severe tests, or all Warning and Severe tests.
  • Product – Click one or more test type; for example, you can display only Mobile tests, or all Last mile and Private last mile tests.
  • Browser – Click one or more Browser Agent types.

To remove a filter:

  • Folder – Select All tests from the folder list.
  • Test name – Click the X at the end of the Filter tests field.
  • Status, Product, and Browser – Click a selected filter to remove that filter.

Set the test thresholds

You can change thresholds for the selected test or for all tests in the same folder. Threshold changes are applied only for the current user; other members of the account do not have the new threshold.

  1. Click Thresholds to display the Thresholds configurator.

    The configurator lists the current thresholds for each test. The default thresholds for the account, set in the Account settings page, are displayed at the bottom of the window.
  2. Click the arrow at the end of a test row to display the threshold settings for the test.
  3. Change the threshold values as needed.
    To set the thresholds to the account defaults, click Reset to default.
    To apply this test's thresholds to all tests in the list, click Apply to xx tests. If you've selected a folder to filter the test list, the new thresholds will only be applied to the tests in that folder.
  4. Click Done to save the changes.

Sharing your Operational summary view

Click the share icon at the top right corner to display a URL that you can share with other users. This URL includes parameters for the filter(s) and time range you've selected.