In Dynatrace, a user experience score is a single metric that categorizes every session recorded with Real User Monitoring.
With a user experience score, you can categorize each session that has been recorded by RUM into the following:
To determine these categories, Dynatrace applies performance, error, and usability metrics to each recorded session. These metrics, when combined with the information derived about user flow, are used to calculate a user experience score.
It also takes into account issues such as slow performance, rage clicks, errors occurring right at the end of a user session, and other usability problems that can force the user to abandon the session.
- In the Dynatrace menu, go to Settings > Web and mobile monitoring > User experience score.
- optional Use the toggles to include the last user action and rage clicks in the score calculation.
- Use the slider under Threshold for Frustrating user experience to define the percentage of Frustrating user actions beyond which a user session is considered Frustrated.
- Use the slider under Threshold for Satisfying user experience to define the minimum percentage of Satisfying user actions required to consider a user session Satisfied.
Calculate the user experience score
To calculate the user experience score, we assigned a weight and an element Apdex to each element that makes up a session, as shown in the following table:
|User action||3||Frustrated, Satisfied, or Tolerating|
As soon as a session starts being recorded, the following process is applied to calculate its user experience score:
- Each element of the session is assigned a weight and is classified as Frustrated, Satisfied, or Tolerating. For instance, elements such as crashes, error events, and rage clicks are all classified as Frustrated.
- For each of these categories, the total weight of the elements is calculated. For example, F is the total weight of Frustrated elements, S is the total weight of Satisfied elements, and T is the total weight of Tolerating elements.
- The total weight of all these categories is calculated: Total=F+S+T
- Each of these weights is then divided by this total weight.
- Depending on the thresholds defined on the User experience score page, the session is marked Frustrated, Satisfied or Tolerating.
Note: A user session is never marked Satisfied if there is even one Frustrated element in the session. In such cases, the session is determined to be either Frustrated or Tolerating.
To understand this assignment better, consider the following example. A session is made up of 11 elements, including XHR actions, load actions, errors, and other events. The Threshold for Frustrating user experience is set to 30%, and the Threshold for Satisfying user experience is set to 50%.
Each element has been assigned an ID to ease the process of calculation.
Total weight of Frustrated elements (F) = 9
Total weight of Satisfied elements (S) = 6
Total weight of Tolerating elements (T) = 9
Total weight of all the elements in these categories (Total) = 9 + 6 + 9 = 24
F/Total = 9 ÷ 24 = 0.375
S/Total = 6 ÷ 24 = 0.25
T/Total = 9 ÷ 24 = 0.375
Because F/Total > 0.3, the user experience score of this session is Frustrated.