User experience score

In Dynatrace, a user experience score is a single metric that categorizes every session recorded with Real User Monitoring.

With a user experience score, you can categorize each session that has been recorded by RUM into the following:

  • Frustrated
  • Satisfied
  • Tolerating

To determine these categories, Dynatrace applies performance, error, and usability metrics to each recorded session. These metrics, when combined with the information derived about user flow, are used to calculate a user experience score.

It also takes into account issues such as slow performance, rage clicks, errors occurring right at the end of a user session, and other usability problems that can force the user to abandon the session.

Configure thresholds

  1. In the Dynatrace menu, go to Settings > Web and mobile monitoring > User experience score.
    Thresholds for user experience score
  2. optional Use the toggles to include the last user action and rage clicks in the score calculation.
  3. Use the slider under Threshold for Frustrating user experience to define the percentage of Frustrating user actions beyond which a user session is considered Frustrated.
  4. Use the slider under Threshold for Satisfying user experience to define the minimum percentage of Satisfying user actions required to consider a user session Satisfied.

Calculate the user experience score

To calculate the user experience score, we assigned a weight and an element Apdex to each element that makes up a session, as shown in the following table:

Element Weight Element Apdex
User action 3 Frustrated, Satisfied, or Tolerating
Error event 1 Frustrated
Rage event 2 Frustrated
Crash 5000 Frustrated

As soon as a session starts being recorded, the following process is applied to calculate its user experience score:

  1. Each element of the session is assigned a weight and is classified as Frustrated, Satisfied, or Tolerating. For instance, elements such as crashes, error events, and rage clicks are all classified as Frustrated.
  2. For each of these categories, the total weight of the elements is calculated. For example, F is the total weight of Frustrated elements, S is the total weight of Satisfied elements, and T is the total weight of Tolerating elements.
  3. The total weight of all these categories is calculated: Total=F+S+T
  4. Each of these weights is then divided by this total weight.
  5. Depending on the thresholds defined on the User experience score page, the session is marked Frustrated, Satisfied or Tolerating.

Note: A user session is never marked Satisfied if there is even one Frustrated element in the session. In such cases, the session is determined to be either Frustrated or Tolerating.

Example

To understand this assignment better, consider the following example. A session is made up of 11 elements, including XHR actions, load actions, errors, and other events. The Threshold for Frustrating user experience is set to 30%, and the Threshold for Satisfying user experience is set to 50%.

Each element has been assigned an ID to ease the process of calculation.

User experience score example

Total weight of Frustrated elements (F) = 9
Total weight of Satisfied elements (S) = 6
Total weight of Tolerating elements (T) = 9

Total weight of all the elements in these categories (Total) = 9 + 6 + 9 = 24

F/Total = 9 ÷ 24 = 0.375
S/Total = 6 ÷ 24 = 0.25
T/Total = 9 ÷ 24 = 0.375

Because F/Total > 0.3, the user experience score of this session is Frustrated.