Skip to technology filters Skip to main content
Dynatrace Hub

Extend the platform,
empower your team.

Popular searches:
Home hero bg
Confluent Cloud (Kafka)Confluent Cloud (Kafka)
Confluent Cloud (Kafka)

Confluent Cloud (Kafka)

Remotely monitor your Confluent Cloud Kafka Clusters and other resources!

Extension
Free trialDocumentation
  • Product information
  • Release notes

Overview

This extension provides the ability to remotely monitor your Confluent Cloud Kafka Clusters, Connectors, Schema Registries, and KSQL DB Applications. Every minute using the API provided by Confluent it ingests data about how your different Confluent Resources are performing.

This is intended for users, who:

  • Would like to monitor the health state and performance of their Confluent Cloud Resources.
  • Look for analysis support for Ops, IT and Network Admins.

This enables you to:

  • Monitor infrastructure with a comprehensive dashboard
  • Detect usage anomalies and alert on them

Compatibility Requirements Confluent Cloud Resource(s) and API User/Token

Note: The metrics in the Kafka Lag Partition Metrics and Kafka Lag Consumer Group Metrics feature sets are not provided by the Confluent API. To obtain these metrics the Kafka Lag Exporter is needed. See the Use Cases section for additional information.

Use cases

  • This extension provides monitoring of Confluent Cloud Resources via their public API (see details tab).

  • Also supported, via the Kafka Lag Partition Metrics and Kafka Lag Consumer Group Metrics feature sets, are metrics provided by the Kafka Lag Exporter.

    • NOTE: This exporter is not supported by Dynatrace and needs to be set up and run independently from this extension.
    • Currently the extension only supports ingesting metrics from this exporter.
Dynatrace
Documentation
By Dynatrace
Dynatrace support center
Subscribe to new releases
Copy to clipboard

Extension content

Content typeNumber of items included
alerts
2
list screen layout
8
document dashboard
1
screen dql table
8
screen entities lists
13
screen metric tables
3
screen chart groups
28
metric metadata
52
generic type
8
screen properties
5
generic relationship
5
screen layout
16
dashboards
2
metric query
3

Feature sets

Below is a complete list of the feature sets provided in this version. To ensure a good fit for your needs, individual feature sets can be activated and deactivated by your administrator during configuration.

Feature setsNumber of metrics included
Metric nameMetric keyDescriptionUnit
Confluent Flink Num Records Inconfluent_flink_num_records_inTotal number of records this statement has received.Count
Confluent Flink Num Records Outconfluent_flink_num_records_outTotal number of records this task statement emitted.Count
Confluent Flink Pending Recordsconfluent_flink_pending_recordsTotal amount of available records after the consumer offset in a Kafka partition across all operatorsCount
Confluent Flink Current Input Watermark Millisecondsconfluent_flink_current_input_watermark_millisecondsThe last watermark this statement has received (in milliseconds) for the given table.MilliSecond
Confluent Flink Current Output Watermark Millisecondsconfluent_flink_current_output_watermark_millisecondsThe last watermark this statement has produced (in milliseconds) to the given table.MilliSecond
Metric nameMetric keyDescriptionUnit
Kafka Cluster Received Bytesconfluent_kafka_server_received_bytesThe number of bytes of the customer's data received from the network.Byte
Kafka Cluster Sent Bytesconfluent_kafka_server_sent_bytesThe number of bytes of the customer's data sent over the network.Byte
Kafka Cluster Received Recordsconfluent_kafka_server_received_recordsThe number of records received.Count
Kafka Cluster Sent Recordsconfluent_kafka_server_sent_recordsThe number of records sent.Count
Kafka Cluster Retained Bytesconfluent_kafka_server_retained_bytesThe current number of bytes retained by the cluster.Byte
Kafka Cluster Partition Countconfluent_kafka_server_partition_count.gaugeThe number of partitions.Count
Kafka Cluster Load Rawconfluent_kafka_server_cluster_load_percentA measure of the utilization of the cluster. The value is between 0.0 and 1.0.Count
Metric nameMetric keyDescriptionUnit
Kafka Cluster Request Bytesconfluent_kafka_server_request_bytesThe delta count of total request bytes from the specified request types sent over the network. Each sample is the number of bytes sent since the previous data point. The count is sampled every 60 seconds.Byte
Kafka Cluster Response Bytesconfluent_kafka_server_response_bytesThe delta count of total response bytes from the specified response types sent over the network. Each sample is the number of bytes sent since the previous data point. The count is sampled every 60 seconds.Byte
Kafka Cluster Active Connection Countconfluent_kafka_server_active_connection_count.gaugeThe count of active authenticated connections.Count
Kafka Cluster Request Countconfluent_kafka_server_request_count.gaugeThe number of requests received over the network.Count
Kafka Cluster Successful Authentication Countconfluent_kafka_server_successful_authentication_count.gaugeThe number of successful authentications.Count
Metric nameMetric keyDescriptionUnit
Kafka Server Cluster Link Destination Response Bytesconfluent_kafka_server_cluster_link_destination_response_bytesThe delta count of cluster linking response bytes from all request types. Each sample is the number of bytes sent since the previous data point. The count is sampled every 60 seconds.Byte
Kafka Server Cluster Link Source Response Bytesconfluent_kafka_server_cluster_link_source_response_bytesThe delta count of cluster linking source response bytes from all request types. Each sample is the number of bytes sent since the previous data point. The count is sampled every 60 seconds.Byte
Kafka Server Cluster Link Countconfluent_kafka_server_cluster_link_count.gaugeThe current count of cluster links. The count is sampled every 60 seconds. The implicit time aggregation for this metric is MAX.Count
Kafka Server Cluster Link Mirror Topic Countconfluent_kafka_server_cluster_link_mirror_topic_count.gaugeThe cluster linking mirror topic count for a link. The count is sampled every 60 seconds.Count
Kafka Server Cluster Link Mirror Topic Offset Lagconfluent_kafka_server_cluster_link_mirror_topic_offset_lagThe cluster linking mirror topic offset lag maximum across all partitions. The lag is sampled every 60 seconds.Count
Kafka Server Cluster Link Mirror Topic Bytesconfluent_kafka_server_cluster_link_mirror_topic_bytesThe delta count of cluster linking mirror topic bytes. The count is sampled every 60 seconds.Byte
Metric nameMetric keyDescriptionUnit
Kafka Consumer Group Group Topic Sum Lagkafka_consumergroup_group_topic_sum_lagSum of group offset lag across topic partitionsCount
Kafka Consumer Group Poll Time (ms)kafka_consumergroup_poll_time_msGroup poll timeMilliSecond
Kafka Consumer Group Group Offsetkafka_consumergroup_group_offsetLast group consumed offset of a partitionCount
Kafka Consumer Group Group Sum Lagkafka_consumergroup_group_sum_lagSum of group offset lagCount
Kafka Consumer Group Group Lagkafka_consumergroup_group_lagGroup offset lag of a partitionCount
Kafka Consumer Group Group Lag Secondskafka_consumergroup_group_lag_secondsGroup time lag of a partitionSecond
Kafka Consumer Group Group Max Lagkafka_consumergroup_group_max_lagMax group offset lagCount
Kafka Consumer Group Group Max Lag Secondskafka_consumergroup_group_max_lag_secondsMax group time lagSecond
Metric nameMetric keyDescriptionUnit
Kafka Connect Sent Recordsconfluent_kafka_connect_sent_recordsThe delta count of total number of records sent from the transformations and written to Kafka for the source connector. Each sample is the number of records sent since the previous data point.Count
Kafka Connect Received Recordsconfluent_kafka_connect_received_recordsThe delta count of total number of records received by the sink connector. Each sample is the number of records received since the previous data point.Count
Kafka Connect Sent Bytesconfluent_kafka_connect_sent_bytesThe delta count of total bytes sent from the transformations and written to Kafka for the source connector. Each sample is the number of bytes sent since the previous data point.Byte
Kafka Connect Received Bytesconfluent_kafka_connect_received_bytesThe delta count of total bytes received by the sink connector. Each sample is the number of bytes received since the previous data point.Byte
Kafka Connect Dead Letter Queue Recordsconfluent_kafka_connect_dead_letter_queue_recordsThe delta count of dead letter queue records written to Kafka for the sink connector.Count
Metric nameMetric keyDescriptionUnit
Kafka Schema Registry Schema Countconfluent_kafka_schema_registry_schema_count.gaugeThe number of registered schemas.Count
Kafka Schema Registry Request Countconfluent_kafka_schema_registry_request_count.gaugeThe delta count of requests received by the schema registry server. Each sample is the number of requests received since the previous data point. The count sampled every 60 seconds.Count
Metric nameMetric keyDescriptionUnit
Kafka Ksql Streaming Unit Countconfluent_kafka_ksql_streaming_unit_count.gaugeThe count of Confluent Streaming Units (CSUs) for this KSQL instance. The implicit time aggregation for this metric is MAX.Count
Kafka Ksql Query Saturationconfluent_kafka_ksql_query_saturationThe maximum saturation for a given ksqlDB query across all nodes. Returns a value between 0 and 1, a value close to 1 indicates that ksqlDB query processing is bottlenecked on available resources.Count
Kafka Ksql Task Stored Bytesconfluent_kafka_ksql_task_stored_bytesThe size of a given task's state stores in bytes.Byte
Kafka Ksql Storage Utilizationconfluent_kafka_ksql_storage_utilizationThe total storage utilization for a given ksqlDB application.Percent
Metric nameMetric keyDescriptionUnit
Kafka Partition Earliest Offsetkafka_partition_earliest_offsetEarliest offset of a partitionCount
Kafka Partition Latest Offsetkafka_partition_latest_offsetLatest offset of a partitionCount
Metric nameMetric keyDescriptionUnit
Confluent Flink Statement Statusconfluent_flink_statement_statusThis metric monitors the status of a statement within the system. Its value is always set to 1, signifying the statement's presence. The statement's current operational state is identified through the metric.status tag.Unspecified
Metric nameMetric keyDescriptionUnit
Kafka Server Consumer Lag Offsetsconfluent_kafka_server_consumer_lag_offsetsThe lag between a group member's committed offset and the partition's high watermarkCount
Metric nameMetric keyDescriptionUnit
Confluent Flink Compute Pool Utilization Current CFUsconfluent_flink_compute_pool_utilization_current_cfusThe absolute number of CFUs at a given momentCount
Confluent Flink Compute Pool Utilization CFU Minutes Consumedconfluent_flink_compute_pool_utilization_cfu_minutes_consumedThe number of how many CFUs consumed since the last measurementCount
Confluent Flink Compute Pool Utilization CFU Limitconfluent_flink_compute_pool_utilization_cfu_limitThe possible max number of CFUs for the poolCount

Full version history

To have more information on how to install the downloaded package, please follow the instructions on this page.
ReleaseDate

Full version history

2.3.0

  • DXS-3317
    • Added Platform Dashboard
    • Added dt.security_context attribute to entities

Full version history

V2.2.0

  • DXS-3211
    • Added support for Compute Pool and Flink Statement Metrics
      • Added Compute Pool Metrics,Flink Statement Metrics, and Flink Statement Status Feature Sets
      • Added filters for Table Name, Flink Statement Name, and Flink Statement Status
      • Added new Compute Pool entity type

Full version history

  • Added 3rd gen/platform charts and screens for upcoming compatibility with I&O app

Full version history

DXS-2054

  • Add new calculated metrics to correct aggregation issue
    • func:confluent_kafka_server_received_bytes_per_sec
    • func:confluent_kafka_server_sent_bytes_per_sec

Full version history

v2.1.2

  • Added display names to metrics calculated on the different entity screens

Full version history

v2.1.1

  • Update screens section to help with validation errors seen activation of v2.1.0

Full version history

v2.0.0

  • IMPORTANT : Updated Dynatrace metric keys to match metric keys from Prometheus.
    • This will cause existing Dashboards & Alerts (or anything that relies on the old metric keys) to stop working! Please update them accordingly.
    • Please immediately update your Monitoring Configurations once this new version is activated
    • You can use still view the old metrics either via the Confluent Kafka Overview (Deprecated Dashboard) or the Data Explorer
  • Added new Cluster, Schema Registry and ksqlDB metrics.

Full version history

v1.2.1

  • Updated to use Schema v1.256
  • Added Entity Type to metrics
  • Updated Cluster Count Dashboard Tile

Full version history

v1.1.1

  • Added support for confluent_kafka_server_cluster_load_percentmetric

Full version history

v1.1.0

  • Updates to metric metadata to correct units for Lag Offsets

v1.0.0

  • Initial Version to collect metrics from Confluent Cloud's API & the Kafka Lag Exporter

Full version history

No release notes

Dynatrace Hub
Hub HomeGet data into DynatraceBuild your own app
Log Management and AnalyticsKubernetesAI and LLM ObservabilityInfrastructure ObservabilitySoftware DeliveryApplication ObservabilityApplication SecurityDigital ExperienceBusiness Observability
Filter
Type
Built and maintained by
Deployment model
SaaS
  • SaaS
  • Managed
Partner FinderBecome a partnerDynatrace Developer

All

769 Results filtered by:

Chroma logo

Chroma

Gain insights into the health of your vector and embedding databases from Chroma

Technology
Amazon Kinesis Video Streams logo

Amazon Kinesis Video Streams

Provides you SDKs to install on your devices to make it easy to stream media.

Technology
Fluentd logo

Fluentd

Stream log data to Dynatrace via Fluentd for analysis.

Technology
Palo Alto firewalls logo

Palo Alto firewalls

Palo Alto extension for problems detection

Extension
AWS Elastic Beanstalk logo

AWS Elastic Beanstalk

Quickly deploy and manage applications in the AWS Cloud without having to learn about the infrastructure beneath.

Technology
Workflows logo

Workflows

Automate tasks in your IT landscape, remediate problems, and visualize processes

App
Security Posture Management logo

Security Posture Management

Detect, prioritize, and remediate security and compliance findings with SPM.

App
Amazon Route 53 logo

Amazon Route 53

Effectively connects user requests to infrastructure running in AWS.

Technology
Amazon Inspector logo

Amazon Inspector

Tests the network accessibility of your EC2 instances and the security state of your applications that run on those instances.

Technology
NGINX Plus logo

NGINX Plus

All‑in‑one web server, load balancer, content cache, and media streaming.

Technology
Databases logo

Databases

Easily monitor, troubleshoot, and optimize your entire database fleets.

App
Amazon DocumentDB logo

Amazon DocumentDB

Amazon DocumentDB (with MongoDB compatibility) is a fast, reliable, and fully managed database service.

Technology
Dynatrace MCP Server logo

Dynatrace MCP Server

Fuel your AI agents with high quality data and real-time production insights

Technology
IBM IMS SOAP Gateway logo

IBM IMS SOAP Gateway

Intelligently monitor your transactions end-to-end and analyze the performance of your IMS SOAP Gateway.

Technology
Amazon Keyspaces for Apache Cassandra logo

Amazon Keyspaces for Apache Cassandra

Scalable, highly available, and managed Apache Cassandra–compatible database service.

Technology
Apache Camel logo

Apache Camel

Intelligently monitor, analyze, and optimize your integration framework and all applications deployed in your stack.

Technology
Amazon Elastic Kubernetes Service (EKS) logo

Amazon Elastic Kubernetes Service (EKS)

Harness automation and AI to simplify Kubernetes observability at scale.

Technology
WordPress logo

WordPress

Content management system written in PHP and paired with a MySQL or MariaDB database.

Technology
Azure Cosmos DB logo

Azure Cosmos DB

Fully managed and serverless distributed database supporting open-source PostgreSQL, MongoDB, and Apache Cassandra.

Technology
AWS Glue logo

AWS Glue

Fully managed extract, transform, and load (ETL) service.

Technology
Azure Event Hub Clusters logo

Azure Event Hub Clusters

Big data streaming platform and event ingestion service. It can receive and process millions of events per second.

Technology
Confluent Cloud (Kafka) logo

Confluent Cloud (Kafka)

Remotely monitor your Confluent Cloud Kafka Clusters and other resources!

Extension
Kong - Prometheus logo

Kong - Prometheus

Monitor Prometheus metrics exposed by Kong and proxied upstream services

Extension
BOSH bpm logo

BOSH bpm

Automated monitoring of platform processes running in BOSH bpm containers.

Technology
Prometheus in Kubernetes logo

Prometheus in Kubernetes

Collect metrics from Prometheus exporters in Kubernetes for Dynatrace analytics

Technology
Nutanix Clusters logo

Nutanix Clusters

Monitor Nutanix clusters' performance, usage and availability, with Nutanix API.

Extension
Azure Service-Fabric logo

Azure Service-Fabric

Intelligent end-to-end observability for serverless and hybrid environments using Azure Service Fabric.

Technology
Luna Network HSM Device logo

Luna Network HSM Device

Monitor your Luna Network Hardware Security Module (HSM) Devices through SNMP.

Extension
Consul Service Mesh (StatsD) logo

Consul Service Mesh (StatsD)

Extend visibility into your Consul Service Mesh instances to monitor health and improve performance.

Extension
Azure Relays logo

Azure Relays

Enables you to securely expose services that run in your corporate network to the public cloud.

Technology
Microsoft IIS logo

Microsoft IIS

Flexible and secure web server for hosting with Windows Server.

Extension
Kubernetes Monitoring Statistics logo

Kubernetes Monitoring Statistics

Troubleshoot your Dynatrace Kubernetes monitoring and Prometheus integration.

Extension
Google Cloud logo

Google Cloud

Meet your business challenges head on with cloud computing services from Google.

Technology
Snyk logo

Snyk

Ingest Snyk vulnerability findings, scans, and audit logs.

Extension
Amazon EventBridge logo

Amazon EventBridge

Serverless event bus to connect applications together using data from your own applications, integrated SaaS applications, and AWS services.

Technology
Ruby logo

Ruby

Dynatrace monitors your Ruby applications and services on the process level.

Technology
Apache OpenEJB logo

Apache OpenEJB

Automatically and intelligently monitor, analyze and optimize your applications based on Apache OpenEJB.

Technology
Log ingestion API logo

Log ingestion API

Stream your logs and log records to Dynatrace via the log ingest API

Technology
Citrix DaaS & Virtual Apps and Desktops logo

Citrix DaaS & Virtual Apps and Desktops

Gain insight into your Citrix DaaS & Virtual Apps and Desktops environments

Extension
Azure Device Provisioning Service logo

Azure Device Provisioning Service

Helper service for IoT Hub that enables just-in-time provisioning to the right IoT hub without human intervention.

Technology
Milvus logo

Milvus

Gain insights about vector database resource utilization and cache behavior

Technology
Google Memorystore logo

Google Memorystore

Get insights into Google Memorystore service metrics collected from the Google Operations API to ensure health of your cloud infrastructure.

Extension
Azul Platform Core (Zulu) logo

Azul Platform Core (Zulu)

Automatically and intelligently monitor, analyze, and optimize the performance of your virtual machine.

Technology
VirusTotal logo

VirusTotal

Enrich observables with threat intelligence from VirusTotal.

App
AWS Outposts logo

AWS Outposts

Fully managed service extending AWS infrastructure, services, APIs and more.

Technology
Databricks Workspace logo

Databricks Workspace

Remotely monitor your Databricks Workspaces!

Extension
LlamaIndex logo

LlamaIndex

Monitor your LLM-powered agents and workflows built with LlamaIndex framework.

Technology
UPS Device logo

UPS Device

Monitor your Uninterruptible Power Supplies (UPS) over SNMP

Extension
TensorFlow Keras logo

TensorFlow Keras

Observe the training progress of TensorFlow Keras AI models

Technology
Amazon Elastic Container Service (ECS) logo

Amazon Elastic Container Service (ECS)

Fully managed container orchestration service.

Technology