• Home
  • Deploy Dynatrace
  • Set up Dynatrace on cloud platforms
  • Google Cloud Platform
  • Integrations
  • Google Cloud Platform supported service metrics
  • Google Dataflow monitoring

Google Dataflow monitoring

Dynatrace GCP integration leverages data collected from the Google Operation API to constantly monitor health and performance of Google Cloud Platform Services. While combining all relevant data into dashboards, it also enables alerting and event tracking.

Prerequisites

Set up integration

Add services and feature sets optional

After integration, Dynatrace automatically monitors a number of preset GCP services and feature sets (metrics). Besides these, you can add more services or feature sets to monitoring. For details, see Add or remove services.

For a list of feature sets available for this service, see Metric table.

Extensions for GCP services

After adding a service to monitoring, it appears as an enabled extension in Dynatrace. Then, your dashboards and metric events are instantly available in your Dynatrace environment. To see the list of extensions, in the Dynatrace menu, go to Extensions.

Note: If you want to stop a service from sending metrics to Dynatrace, removing the relevant extension isn't enough. You also need to remove the service from monitoring. For details, see Add or remove services.

View metrics

After deploying the integration, you can see metrics from monitored services in the Metrics browser, the Data explorer, and your dashboard tiles.

Metric table

The following feature sets are available for Google Dataflow.

Feature setNameUnitGCP metric identifier
dataflow_job/default_metricsBillable shuffle data processedBytedataflow.googleapis.com/job/billable_shuffle_data_processed
dataflow_job/default_metricsCurrent number of vCPUs in useCountdataflow.googleapis.com/job/current_num_vcpus
dataflow_job/default_metricsCurrent shuffle slots in useCountdataflow.googleapis.com/job/current_shuffle_slots
dataflow_job/default_metricsData watermark lagSeconddataflow.googleapis.com/job/data_watermark_age
dataflow_job/default_metricsElapsed timeSeconddataflow.googleapis.com/job/elapsed_time
dataflow_job/default_metricsElement countCountdataflow.googleapis.com/job/element_count
dataflow_job/default_metricsElements ProducedCountdataflow.googleapis.com/job/elements_produced_count
dataflow_job/default_metricsEstimated byte countBytedataflow.googleapis.com/job/estimated_byte_count
dataflow_job/default_metricsEstimated Bytes ProducedCountdataflow.googleapis.com/job/estimated_bytes_produced_count
dataflow_job/default_metricsFailedCountdataflow.googleapis.com/job/is_failed
dataflow_job/default_metricsPer-stage data watermark lagSeconddataflow.googleapis.com/job/per_stage_data_watermark_age
dataflow_job/default_metricsPer-stage system lagSeconddataflow.googleapis.com/job/per_stage_system_lag
dataflow_job/default_metricsPubsubIO.Read requests from Dataflow jobsCountdataflow.googleapis.com/job/pubsub/read_count
dataflow_job/default_metricsPub/Sub Pull Request LatenciesMilliSeconddataflow.googleapis.com/job/pubsub/read_latencies
dataflow_job/default_metricsPub/Sub Publish RequestsCountdataflow.googleapis.com/job/pubsub/write_count
dataflow_job/default_metricsPub/Sub Publish Request LatenciesMilliSeconddataflow.googleapis.com/job/pubsub/write_latencies
dataflow_job/default_metricsdataflow.googleapis.com/job/status
dataflow_job/default_metricsSystem lagSeconddataflow.googleapis.com/job/system_lag
dataflow_job/default_metricsTotal memory usage timeGigaBytedataflow.googleapis.com/job/total_memory_usage_time
dataflow_job/default_metricsTotal PD usage timeGigaBytedataflow.googleapis.com/job/total_pd_usage_time
dataflow_job/default_metricsTotal shuffle data processedBytedataflow.googleapis.com/job/total_shuffle_data_processed
dataflow_job/default_metricsTotal streaming data processedBytedataflow.googleapis.com/job/total_streaming_data_processed
dataflow_job/default_metricsTotal vCPU timeSeconddataflow.googleapis.com/job/total_vcpu_time
dataflow_job/default_metricsUser CounterCountdataflow.googleapis.com/job/user_counter
Related topics
  • Google Cloud integrations

    Set up and configure Dynatrace on Google Cloud Platform.