• Home
  • Solutions
  • Infrastructure Observability
  • Hosts
  • Monitoring
  • OS services monitoring

OS services monitoring

OneAgent version 1.239+

Dynatrace version 1.240+

Dynatrace provides out-of-the-box availability monitoring of OS services.

Requirements

To monitor Linux services, systemd version 230+ is required on the monitored host.

Monitor a service

To monitor an OS service, perform the following steps.

Access OS services monitoring

Add service monitoring policy

Select services you want to monitor

Add custom properties

Access OS services monitoring

In Dynatrace, go to OS services monitoring for the level you are configuring.

Host level
  1. In the Dynatrace menu, go to Hosts.
  2. Find and select your host to display the host overview page.
  3. In the upper-right corner of the host overview page, select More (…) > Settings.
  1. In the host settings, select OS services monitoring.
Host-group level
  1. From the Dynatrace menu, go to Deployment status and then select OneAgents.
  2. On the OneAgent deployment page, turn off Show new OneAgent deployments.
  3. Filter the table by Host group and select the host group you want to configure.

    The Host group property is not displayed when the selected host doesn't belong to any host group.

    This displays the OneAgent deployment page filtered by the selected host group. Each listed host has a Host group: <group name> link, where <group name> is the name of the host group that you want to configure.
  4. Select the host group name in any row.
    As you have filtered by host group, all displayed hosts go to the same host group.
  1. In the host group settings, select OS services monitoring.
Environment level

In the Dynatrace menu, go to Settings and select Monitoring > OS services monitoring.

Add service monitoring policy

Based on the service state and the rules, the service monitoring policy defines the way Dynatrace is monitoring your service. By default, Dynatrace comes with Auto-start Windows OS Services and Auto-start Linux OS Services policies for auto-started Windows and Linux services with failed status.

The order of service monitoring policies is important. Policies that are higher on the list will proceed before those on lower positions until they are fulfilled. This allows for the creation of selective alerts or monitoring with minimal policies. If you want to monitor all auto-started services and not just those created by Microsoft, you need to add a policy with disabled alerting and/or monitoring that will verify if the manufacturer is Microsoft.

  1. On OS services monitoring for the level you are configuring based on your OS, select Add policy and define the policy, which is a collection of rules.

  2. System: select your operating system.

  3. Rule name: enter the name that will be displayed in the Summary field.

  4. Monitor: decide whether you want to monitor service availability using the OS service availability (builtin:osservice.availability) metric. If available, the metric sends the service status every 10 seconds. The status is carried by the Service status (dt.osservice.status) dimension.
    Note that the metric consumes DDUs. For more information, see DDU consumption.

  5. Alert: decide whether you want alerting for your policy.

  6. OneAgent version 1.257+ Alert if service is not installed: whether you want to receive alerts about OS services that are not installed on the host.

  7. Service status: set the service status for which an alert should be triggered.

    You can use logic operations to monitor the service status. For example, $eq(running) monitors the running service state.

    Available logic operations:

    • $not($eq(paused)) – Matches services that are in state different from paused.
    • $or($eq(paused),$eq(running)) – Matches services that are either in paused or running state.

    These are the service statuses you can monitor. Use one of the following values as a parameter for this condition:

    • running
    • stopped
    • start_pending
    • stop_pending
    • continue_pending
    • pause_pending
    • paused

    You can use logic operations to monitor the service status. For example, $eq(active) monitors the active service state.

    Available logic operations:

    • $not($eq(active)) – Matches services with state different from active.
    • $or($eq(inactive),$eq(failed)) – Matches services that are either in inactive or failed state.

    These are the service statuses you can monitor. Use one of the following values as a parameter for this condition:

    • reloading
    • activating
    • deactivating
    • failed
    • inactive
    • active

  8. optional OneAgent version 1.257+ Alerting delay: the number of 10-second measurement cycles for a service to be in configured state before an event is generated.

Next, you need to select which services you want to monitor based on service properties.

Select services you want to monitor

Select Add rule and then select the service you want to monitor.

Service property used for matching:

  • Display name visible for system user.
  • Path to the binary used by OS service.
  • Manufacturer from the binary file of the service.
  • Service Name
  • Startup Type

A monitoring rule may consist of multiple detection rules. All detection rules must be satisfied for the OS Service to match, as a logical AND operation is applied across all specified conditions.

Additional information on Display name, Path, Manufacturer, and Service Name

With these properties, we define the services to be monitored based on:

  • Display name visible to a system user

  • Path to the service binary

  • Manufacturer of the service

  • Service name representing the name or ID under which OS service is recognized

  • Condition in which you can define a string that:

    • Starts with – use $prefix qualifier, for example $prefix(ss).
    • Ends with – use $suffix qualifier, for example $suffix(hd).
    • Equals – use $eq qualifier, for example $eq(sshd).
    • Contains - use $contains qualifier , for example $contains(ssh).

    Available logic operations:

    • $not($eq(sshd)) – Matches if the service's property value is different from sshd.
    • $and($prefix(ss),$suffix(hd)) – Matches if service's property value starts with ss and ends with hd.
    • $or($prefix(ss),$suffix(hd)) – Matches if service's property value starts with ss or ends with hd.
Additional information on Startup Type

With this property we define the services to be monitored based on their startup type.

  • Condition in which you can define a string that:

    • Equals – use $eq qualifier, for example $eq(manual).

    Available logic operations:

    • $not($eq(auto)) – Matches services with startup type different from Automatic.
    • $or($eq(auto),$eq(manual)) – Matches if service's startup type is either Automatic or Manual.

    Use one of the following values as a parameter for this condition:

    • manual for Manual - the service starts only if needed or if you invoke something to start the service.
    • manual_trigger for Manual (Trigger Start) - the service starts along with the startup of another service.
    • auto for Automatic - the service starts automatically.
    • auto_delay for Automatic (Delayed Start) - the service startup is delayed until the system has finished booting.
    • auto_trigger for Automatic (Trigger Start) - the service starts automatically on startup and may be started or stopped due to certain operating system events.
    • auto_delay_trigger for Automatic (Delayed Start, Trigger Start)
    • disabled for Disabled

Service property used for matching:

  • Service Name
  • Startup Type
Additional information on Service Name

With this property we define the services to be monitored based on the service name.

Condition in which you can define a string that:

  • $contains(ssh) – Matches if ssh appears anywhere in the service's property value.
  • $eq(sshd) – Matches if sshd matches the service's property value exactly.
  • $prefix(ss) – Matches if ss matches the prefix of the service's property value.
  • $suffix(hd) – Matches if hd matches the suffix of the service's property value.

Available logic operations:

  • $not($eq(sshd)) – Matches if the service's property value is different from sshd.
  • $and($prefix(ss),$suffix(hd)) – Matches if service's property value starts with ss and ends with hd.
  • $or($prefix(ss),$suffix(hd)) – Matches if service's property value starts with ss or ends with hd.
Additional information on Startup Type

With this property, we define the services to be monitored based on their startup type.

Condition in which you can define a string that:

  • $eq(enabled) – Matches services with startup type equal to enabled.

Available logic operations:

  • $not($eq(enabled)) – Matches services with startup type different from enabled.
  • $or($eq(enabled),$eq(disabled)) - Matches services that are either enabled or disabled.

Use one of the following values as a parameter for this condition:

enabled, enabled-runtime

The service is marked as ready for startup.

static

The unit file is not enabled and has no provisions for enabling in the install unit file section. Static units are installed as dependencies and can only be masked, but are not always executed. They will be executed only if another unit depends on them or if they're manually started.

disabled

The unit file is not enabled, but it contains an install section with installation instructions.

Add custom properties optional

OneAgent version 1.247+

Dynatrace version 1.247+

  1. Select Add property to specify a custom key-value property for the policy.

    Custom message in the Event details

    For example, a property with a Key set to custom.message and Value set to The {dt.osservice.name} is with status {dt.osservice.status} (including placeholders {dt.osservice.name} and {dt.osservice.status}) will extract the OS service name and status values once the rule is triggered. If the placeholder substitution fails, both the key and the value will be unavailable.

    os-service-custom-message

    os-service-custom-message-in-event

    For OneAgent version 1.255+, the {dt.osservice.display_name} placeholder is available.

  2. Select Save changes.

Configure automatically applied tags and management zones

Dynatrace version 1.257+

You need to manually configure automatically applied tags and management zones for OS service entities, as Dynatrace no longer automatically associates OS services with their respective hosts.

To set up automatic tagging for OS services

  1. In the Dynatrace menu, go to Settings.

  2. Go to Tags > Automatically applied tags and select Create tag.

  3. Enter a Tag name and an optional Description for your tag.

  4. Select Add a new rule to define the conditions for the tag.

  5. Rule type: select Entity selector.

  6. Entity selector: define the conditions under which the tag should be applied to OS services.

    • To assign a tag based on the host where the OS service is running, use the following format:

      plaintext
      type(os:service),fromRelationship.runsOn(type(HOST),entityName.startsWith("<host name>"))

      The tag will be applied to any OS service that runs on a host with a name that starts with <host name>.

      Example

      Host example

    • To assign a tag based on the process group instance where the OS service is running, use the following format:

      plaintext
      type(os:service),toRelationship.runsOn(type(PROCESS_GROUP_INSTANCE),entityName.startsWith("<PGI name>"))

      The tag will be applied to any OS service that runs on a PGI with a name that starts with <PGI name>.

      Example

      Process group instance example

  7. Select Save changes.

To set up management zones for OS services

  1. In the Dynatrace menu, go to Settings.

  2. Go to Preferences > Management zones and select Add new management zone.

  3. Enter a Management zone name and an optional Description for your management zone.

  4. Select Add a new rule to define the conditions for the management zone.

  5. Rule type: select Entity selector.

  6. Entity selector: define the conditions under which the management zone should be applied to OS services.

    • To assign a management zone based on the host where the OS service is running, use the following format:

      plaintext
      type(os:service),fromRelationship.runsOn(type(HOST),entityName.startsWith("<host name>"))

      The management zone will be applied to any OS service that runs on a host with a name that starts with <host name>.

      Example

      Host example

    • To assign a management zone based on the process group instance where the OS service is running, use the following format:

      plaintext
      type(os:service),toRelationship.runsOn(type(PROCESS_GROUP_INSTANCE),entityName.startsWith("<PGI name>"))

      The management zone will be applied to any OS service that runs on a PGI with a name that starts with <PGI name>.

      Example

      Process group instance example

Manage monitored OS services

To manage the OS services

  1. In Dynatrace, go to OS services monitoring for the level you are configuring.

    Host level
    1. In the Dynatrace menu, go to Hosts.
    2. Find and select your host to display the host overview page.
    3. In the upper-right corner of the host overview page, select More (…) > Settings.
    1. In the host settings, select OS services monitoring.
    Host-group level
    1. From the Dynatrace menu, go to Deployment status and then select OneAgents.
    2. On the OneAgent deployment page, turn off Show new OneAgent deployments.
    3. Filter the table by Host group and select the host group you want to configure.

      The Host group property is not displayed when the selected host doesn't belong to any host group.

      This displays the OneAgent deployment page filtered by the selected host group. Each listed host has a Host group: <group name> link, where <group name> is the name of the host group that you want to configure.
    4. Select the host group name in any row.
      As you have filtered by host group, all displayed hosts go to the same host group.
    1. In the host group settings, select OS services monitoring.
    Environment level

    In the Dynatrace menu, go to Settings and select Monitoring > OS services monitoring.

  2. The OS services you monitor are displayed in a table under the Add policy button.

    • To stop monitoring a listed service, turn the Enabled setting off.
    • To delete a service from the table, select the delete button in the Delete column
    • To view and edit details, select the expand control in the Details column.

Monitor service availability

Dynatrace version 1.243+

OneAgent version 1.243+

The Host overview page contains the OS services analysis section listing the OS services for which any policy (with active alerting or monitoring) is fulfilled.

  1. In the Dynatrace menu, go to Hosts.
  2. In the OS services analysis section, select the service name to open the Service overview page.

For more information, see Host monitoring with Dynatrace

Configure at scale using Settings API

You can use the Settings API to configure your service availability monitoring at scale.

  1. To learn the schema, use GET a schema with builtin:os-services-monitoring as the schemaId.
  2. Based on the builtin:os-services-monitoring schema, create your configuration object.
  3. To create your configuration, use POST an object.