Skip to technology filters Skip to main content
Dynatrace Hub

Extend the platform,
empower your team.

Popular searches:
Home hero bg
Google DataprocGoogle Dataproc
Google Dataproc

Google Dataproc

Get insights into Google Dataproc service metrics collected from the Google Operations API to ensure health of your cloud infrastructure.

Extension
Free trial
  • Product information
  • Release notes

Overview

This Dynatrace extension leverages data collected from the Google Operations API to constantly monitor health and performance of Google Dataproc services. This extension combines all relevant data into pre-configured dashboards and provides alerting and event tracking.

This is intended for users, who want to:

  • enrich their monitoring data with metrics and logs from Google Operations API

This enables you to:

  • View and analyze 21 metrics that are specific to Google Dataproc, like HDFS DataNodes, HDFS capacity, HDFS storage utilization, and more.

  • Build custom dashboards for your cloud infrastructure.

  • Analyze Google Dataproc logs.

  • Set custom alerts that trigger remediation workflows.

Google Dataproc metric and log ingestion requires advanced GCP integration.

Compatibility requirements

  • Dynatrace GCP integration version 1.0.0+. To enable metric and log ingestion, see Dynatrace Documentation.
  • Dynatrace version 1.230+

Details

This extension package contains:

  • Configuration for Google Dataproc metric ingest based on your selected feature set (see full list of feature sets and metrics)

To provide correlation and causation analysis all ingested metrics and logs are analyzed by the Dynatrace Davis AI engine, which consumes DDUs.

Get started

To add this extension to your environment:

  • Follow the instructions detailed in Dynatrace Documentation. (Ignore the “Add to environment” button below.)
  • Ensure that you have GCP integration running in your environment and that Google Dataproc service is configured.

Following GCP integration and Google Dataproc configuration:

  • The first data points will be ingested by Dynatrace Davis within ~5 minutes.
  • Explore Google Dataproc metrics in Data Explorer and create custom charts.
  • Set custom events for alerting
Dynatrace
By Dynatrace
Dynatrace support center
Subscribe to new releases
Copy to clipboard

Extension content

Content typeNumber of items included
metric metadata
26
screen injections
1
generic relationship
1
screen actions
1
screen layout
1
generic type
2
screen entities lists
1

Feature sets

Below is a complete list of the feature sets provided in this version. To ensure a good fit for your needs, individual feature sets can be activated and deactivated by your administrator during configuration.

Feature setsNumber of metrics included
Metric nameMetric keyDescriptionUnit
Cluster capacity deviationcloud.gcp.dataproc_googleapis_com.cluster.capacity_deviation-Count
HDFS DataNodescloud.gcp.dataproc_googleapis_com.cluster.hdfs.datanodes-Count
HDFS capacitycloud.gcp.dataproc_googleapis_com.cluster.hdfs.storage_capacity-GibiByte
HDFS storage utilizationcloud.gcp.dataproc_googleapis_com.cluster.hdfs.storage_utilization-Count
Unhealthy HDFS blocks by statuscloud.gcp.dataproc_googleapis_com.cluster.hdfs.unhealthy_blocks-Count
Job durationcloud.gcp.dataproc_googleapis_com.cluster.job.completion_time-Second
Job state durationcloud.gcp.dataproc_googleapis_com.cluster.job.duration-Second
Failed jobscloud.gcp.dataproc_googleapis_com.cluster.job.failed_count-Count
Running jobscloud.gcp.dataproc_googleapis_com.cluster.job.running_count.gauge-Count
Submitted jobscloud.gcp.dataproc_googleapis_com.cluster.job.submitted_count-Count
Expected Nodescloud.gcp.dataproc_googleapis_com.cluster.nodes.expected-Count
Failed Nodescloud.gcp.dataproc_googleapis_com.cluster.nodes.failed_count-Count
Recovered Nodescloud.gcp.dataproc_googleapis_com.cluster.nodes.recovered_count-Count
Running Nodescloud.gcp.dataproc_googleapis_com.cluster.nodes.running-Count
Operation durationcloud.gcp.dataproc_googleapis_com.cluster.operation.completion_time-Second
Operation state durationcloud.gcp.dataproc_googleapis_com.cluster.operation.duration-Second
Failed operationscloud.gcp.dataproc_googleapis_com.cluster.operation.failed_count-Count
Running operationscloud.gcp.dataproc_googleapis_com.cluster.operation.running_count.gauge-Count
Submitted operationscloud.gcp.dataproc_googleapis_com.cluster.operation.submitted_count-Count
YARN allocated memory percentagecloud.gcp.dataproc_googleapis_com.cluster.yarn.allocated_memory_percentage-Count
YARN active applicationscloud.gcp.dataproc_googleapis_com.cluster.yarn.apps-Count
YARN containerscloud.gcp.dataproc_googleapis_com.cluster.yarn.containers-Count
YARN memory sizecloud.gcp.dataproc_googleapis_com.cluster.yarn.memory_size-GibiByte
YARN NodeManagerscloud.gcp.dataproc_googleapis_com.cluster.yarn.nodemanagers-Count
YARN pending memory sizecloud.gcp.dataproc_googleapis_com.cluster.yarn.pending_memory_size-GibiByte
YARN virtual corescloud.gcp.dataproc_googleapis_com.cluster.yarn.virtual_cores-Count

Full version history

To have more information on how to install the downloaded package, please follow the instructions on this page.
ReleaseDate

Full version history

Version 1.1.0

Updated

  • Service entity for Dataproc cluster
  • Updated set of supported metrics
  • Relationships between service entity and project
  • Log linking for service entity
  • Basic UI (list on GCP project details page)

Full version history

Version 1.0.4

Updated

  • Feature sets & metrics section in HUB Product Information page

Full version history

Version 1.0.3

Fixed

  • Empty feature sets in extension description

Full version history

Version 1.0.2

Added

  • Release notes to published extension
  • Auto publishing extensions to Hub

Full version history

No release notes

Full version history

No release notes

Dynatrace Hub
Get data into DynatraceBuild your own app
All (774)Log Management and AnalyticsKubernetesAI and LLM ObservabilityInfrastructure ObservabilitySoftware DeliveryApplication ObservabilityApplication SecurityDigital ExperienceBusiness Analytics
Filter
Type
Built and maintained by
Deployment model
SaaS
  • SaaS
  • Managed
Partner FinderBecome a partnerDynatrace Developer

Discover recent additions to Dynatrace

Problems logo

Problems

Analyze abnormal system behavior and performance problems detected by Davis AI.

Logs logo

Logs

Explore all your logs without writing a single query.

Security Investigator logo

Security Investigator

Fast and precise forensics for security and logs on Grail data with DQL queries.

Business Flow logo

Business Flow

Track, analyze, and optimize your critical business processes.

Cost & Carbon Optimization logo

Cost & Carbon Optimization

Track, analyze, and optimize your IT carbon footprint and public cloud costs.

Davis Anomaly Detection logo

Davis Anomaly Detection

Detect anomalies in timeseries using the Davis AI

Analyze your data

Understand your data better with deep insights and clear visualizations.

Notebooks logo

Notebooks

Create powerful, data-driven documents for custom analytics and collaboration.

Dashboards logo

Dashboards

Transform complex data into clear visualizations with custom dashboards.

Automate your processes

Turn data and answers into actions, securely, and at scale.

Workflows logo

Workflows

Automate tasks in your IT landscape, remediate problems, and visualize processes

Jira logo

Jira

Create, query, comment, transition, and resolve Jira tickets within workflows.

Slack logo

Slack

Automate Slack messaging for security incidents, attacks, remediation, and more.

Secure your cloud application

See vulnerabilities and attacks in your environment.

Security Overview logo

Security Overview

Get a comprehensive overview of the security of your applications.

Code-Level Vulnerabilities logo

Code-Level Vulnerabilities

Detect vulnerabilities in your code in real time.

Threats & Exploits logo

Threats & Exploits

Understand, triage, and investigate application security findings and alerts.

Are you looking for something different?

We have hundreds of apps, extensions, and other technologies to customize your environment

Leverage our newest innovations of Dynatrace Saas

Kick-start your app creation

Kick-start your app creation

Whether you’re a beginner or a pro, Dynatrace Developer has the tools and support you need to create incredible apps with minimal effort.
Go to Dynatrace Developer
Upgrading from Dynatrace Managed to SaaS

Upgrading from Dynatrace Managed to SaaS

Drive innovation, speed, and agility in your organization by seamlessly and securely upgrading.
Learn More
Log Management and Analytics

Log Management and Analytics

Innovate faster and more efficiently with unified log management and log analytics for actionable insights and automation.
Learn more