Extend the platform, empower your team.
Enhanced insights for Spark Components
This extension collects JMX metrics to provide insights into resource usage, job and application status, and performance of your spark components.
Apache Spark metrics are presented alongside other infrastructure measurements, enabling in-depth cluster performance analysis of both current and historical data.
The extension enables insights into the overall health of Spark component instances
Activate this extension in your Dynatrace environment from the in-product Hub and simply select which OneAgents to enable this on.
You must configure the required component metrics to be reported to the JMX sink.
For example, you can enable metric collection to the JmxSink for the master, worker, driver and executor components with a command such as:
cat << EOF > $SPARK_HOME/conf/metrics.properties
Refer to the Spark documentation for more details
This extension can query and collect almost all component instance and namespace metrics as defined in Spark Metric Providers
Below is a complete list of the feature sets provided in this version. To ensure a good fit for your needs, individual metrics can be activated and deactivated by your administrator during configuration.
Enhanced insights for Hadoop HDFS and Yarn services