Fluentd

Fluentd is an open-source data collector that ingests data such as logs and events from a multitude of sources. Fluentd transforms log data and sends it to your backend service of choice. By adding Dynatrace support to Fluentd, you get intelligent observability and automatic root cause analysis for additional log and event data that’s captured and processed by Fluentd.

This is intended for users who want to:

• Complement observability data in Dynatrace, extend the Davis AI engine, and enable DevOps and SRE teams to centrally analyze all log data.

• Leverage any of the 500+ Fluentd plugins, which connect to numerous data sources to get logs and events from your application into Dynatrace where you can immediately benefit from Dynatrace AI-driven root cause analysis.

• Quickly search, explore, and analyze log and event data from a multitude of sources.

Set up Fluentd integration with Dynatrace with the following steps:

• Get a Dynatrace API token with the Ingest Logs scope

• Deploy Fluentd

  • Fluentd can also run as a DaemonSet in a Kubernetes cluster. Built-in resiliency ensures data completeness and consistency even if Fluentd or an endpoint service goes down temporarily.

• Use the Dynatrace Fluentd plugin to stream logs to Dynatrace tenant.

  • Open source Dynatrace Fluentd plugin uses generic log ingestion API to send logs to dynatrace.

Details

Please refer to the following resources for more details:

• Plug-in documentation
• Blog
• Log monitoring Documentation
• Log data ingest Documentation
• Dynatrace Generic log ingest API v2
• Performance clinic
• Blog on isitobservable.io

Get Started

The plugin is available for download from Rubygems.org.

Step-by-step instructions:

To install the Fluentd plugin for Dynatrace, run the following command: fluent-gem install fluent-plugin-dynatrace

If you‘re using td-agent, run: td-agent-gem install fluent-plugin-dynatrace

Follow the configuration instructions on the Fluentd plugin documentation page.

• An instance of Fluentd version 1.0+ from which logs should be exported
• Ruby version 2.4.0+.
• An ActiveGate with the Generic log ingest API v2 enabled.
• A Dynatrace API token with the logs.ingest (Ingest Logs) scope