All
0 Results filtered by:
We couldn't find any results
You can search all listings, or try a different spelling or keyword. Still nothing? Dynatrace makes it easy to create custom apps.
Google DataprocGoogle Dataproc
Get insights into Google Dataproc service metrics collected from the Google Operations API to ensure health of your cloud infrastructure.
Extension- Product information
- Release notes
Overview
This Dynatrace extension leverages data collected from the Google Operations API to constantly monitor health and performance of Google Dataproc services. This extension combines all relevant data into pre-configured dashboards and provides alerting and event tracking.
This is intended for users, who want to:
- enrich their monitoring data with metrics and logs from Google Operations API
This enables you to:
-
View and analyze 21 metrics that are specific to Google Dataproc, like HDFS DataNodes, HDFS capacity, HDFS storage utilization, and more.
-
Build custom dashboards for your cloud infrastructure.
-
Analyze Google Dataproc logs.
-
Set custom alerts that trigger remediation workflows.
Google Dataproc metric and log ingestion requires advanced GCP integration.
Compatibility requirements
- Dynatrace GCP integration version 1.0.0+. To enable metric and log ingestion, see Dynatrace Documentation.
- Dynatrace version 1.230+
Details
Details
This extension package contains:
- Configuration for Google Dataproc metric ingest based on your selected feature set (see full list of feature sets and metrics)
To provide correlation and causation analysis all ingested metrics and logs are analyzed by the Dynatrace Davis AI engine, which consumes DDUs.
Get started
To add this extension to your environment:
- Follow the instructions detailed in Dynatrace Documentation. (Ignore the “Add to environment” button below.)
- Ensure that you have GCP integration running in your environment and that Google Dataproc service is configured.
Following GCP integration and Google Dataproc configuration:
- The first data points will be ingested by Dynatrace Davis within ~5 minutes.
- Explore Google Dataproc metrics in Data Explorer and create custom charts.
- Set custom events for alerting
Extension content
Content typeNumber of items included
metric metadata
26
screen injections
1
generic relationship
1
screen actions
1
screen layout
1
generic type
2
screen entities lists
1
Feature sets
Below is a complete list of the feature sets provided in this version. To ensure a good fit for your needs, individual feature sets can be activated and deactivated by your administrator during configuration.
Feature setsNumber of metrics included
| Metric name | Metric key | Description | Unit |
|---|---|---|---|
| Cluster capacity deviation | cloud.gcp.dataproc_googleapis_com.cluster.capacity_deviation | - | Count |
| HDFS DataNodes | cloud.gcp.dataproc_googleapis_com.cluster.hdfs.datanodes | - | Count |
| HDFS capacity | cloud.gcp.dataproc_googleapis_com.cluster.hdfs.storage_capacity | - | GibiByte |
| HDFS storage utilization | cloud.gcp.dataproc_googleapis_com.cluster.hdfs.storage_utilization | - | Count |
| Unhealthy HDFS blocks by status | cloud.gcp.dataproc_googleapis_com.cluster.hdfs.unhealthy_blocks | - | Count |
| Job duration | cloud.gcp.dataproc_googleapis_com.cluster.job.completion_time | - | Second |
| Job state duration | cloud.gcp.dataproc_googleapis_com.cluster.job.duration | - | Second |
| Failed jobs | cloud.gcp.dataproc_googleapis_com.cluster.job.failed_count | - | Count |
| Running jobs | cloud.gcp.dataproc_googleapis_com.cluster.job.running_count.gauge | - | Count |
| Submitted jobs | cloud.gcp.dataproc_googleapis_com.cluster.job.submitted_count | - | Count |
| Expected Nodes | cloud.gcp.dataproc_googleapis_com.cluster.nodes.expected | - | Count |
| Failed Nodes | cloud.gcp.dataproc_googleapis_com.cluster.nodes.failed_count | - | Count |
| Recovered Nodes | cloud.gcp.dataproc_googleapis_com.cluster.nodes.recovered_count | - | Count |
| Running Nodes | cloud.gcp.dataproc_googleapis_com.cluster.nodes.running | - | Count |
| Operation duration | cloud.gcp.dataproc_googleapis_com.cluster.operation.completion_time | - | Second |
| Operation state duration | cloud.gcp.dataproc_googleapis_com.cluster.operation.duration | - | Second |
| Failed operations | cloud.gcp.dataproc_googleapis_com.cluster.operation.failed_count | - | Count |
| Running operations | cloud.gcp.dataproc_googleapis_com.cluster.operation.running_count.gauge | - | Count |
| Submitted operations | cloud.gcp.dataproc_googleapis_com.cluster.operation.submitted_count | - | Count |
| YARN allocated memory percentage | cloud.gcp.dataproc_googleapis_com.cluster.yarn.allocated_memory_percentage | - | Count |
| YARN active applications | cloud.gcp.dataproc_googleapis_com.cluster.yarn.apps | - | Count |
| YARN containers | cloud.gcp.dataproc_googleapis_com.cluster.yarn.containers | - | Count |
| YARN memory size | cloud.gcp.dataproc_googleapis_com.cluster.yarn.memory_size | - | GibiByte |
| YARN NodeManagers | cloud.gcp.dataproc_googleapis_com.cluster.yarn.nodemanagers | - | Count |
| YARN pending memory size | cloud.gcp.dataproc_googleapis_com.cluster.yarn.pending_memory_size | - | GibiByte |
| YARN virtual cores | cloud.gcp.dataproc_googleapis_com.cluster.yarn.virtual_cores | - | Count |
Full version history
To have more information on how to install the downloaded package, please follow the instructions on this page.
ReleaseDate
Full version history
Version 1.1.0
Updated
- Service entity for Dataproc cluster
- Updated set of supported metrics
- Relationships between service entity and project
- Log linking for service entity
- Basic UI (list on GCP project details page)
Full version history
Version 1.0.4
Updated
- Feature sets & metrics section in HUB Product Information page
Full version history
Version 1.0.3
Fixed
- Empty feature sets in extension description
Full version history
Version 1.0.2
Added
- Release notes to published extension
- Auto publishing extensions to Hub
Full version history
No release notes
Full version history
No release notes