Google Dataflow

This Dynatrace extension leverages data collected from the Google Operations API to constantly monitor health and performance of Google Dataflow services. This extension combines all relevant data into pre-configured dashboards and provides alerting and event tracking.

This is intended for users, who want to:

• enrich their monitoring data with metrics and logs from Google Operations API

This enables you to:

• View and analyze 23 metrics that are specific to Google Dataflow, like Billable shuffle data processed, Current number of vCPUs in use, Current shuffle slots in use, and more.

• Build custom dashboards for your cloud infrastructure.

• Analyze Google Dataflow logs.

• Set custom alerts that trigger remediation workflows.

Google Dataflow metric and log ingestion requires advanced GCP integration.

Compatibility requirements

• Dynatrace GCP integration version 1.0.0+. To enable metric and log ingestion, see Dynatrace Documentation.
• Dynatrace version 1.230+

This extension package contains:

• Configuration for Google Dataflow metric ingest based on your selected feature set (see full list of feature sets and metrics)

To provide correlation and causation analysis all ingested metrics and logs are analyzed by the Dynatrace Davis AI engine, which consumes DDUs.

To add this extension to your environment:

• Follow the instructions detailed in Dynatrace Documentation. (Ignore the “Add to environment” button below.)
• Ensure that you have GCP integration running in your environment and that Google Dataflow service is configured.

Following GCP integration and Google Dataflow configuration:

• The first data points will be ingested by Dynatrace Davis within ~5 minutes.
• Explore Google Dataflow metrics in Data Explorer and create custom charts.
• Set custom events for alerting