Dynatrace ETL Service by ESA
Continuously extract metrics and properties for Dynatrace entities, user sessions and more.
- Overview
- Detail
- Get started
- Versions
- Screenshots
The ETL Service provides a continuous extraction of custom-formatted collections of metrics and properties for Dynatrace entities, user sessions and problems. The solution pushes data on a scheduled bases to enterprise messaging infrastructures, databases, files, or APIs. Provided by Enterprise Solutions Architecture (ESA).
This is intended for users, who:
- Want to extract metrics from Dynatrace for consumption elsewhere.
- Want to perform advanced queries of the Smartscape model without burdening the cluster.
This enables you to:
- Stream metrics to any endpoint.
- Extract service flow metrics.
- Extract related entities.
- Query entities by any property or tag.
- Synchronize the Smartscape with a CMDB.
Compatibility Requirements:
The ETL Service requires NodeJS 16+. It leverages an embedded database, but it can use MariaDB or MySQL as well. You do not need to install NodeJS when you deploy this solution with the Solution Server.
Detail
The ETL Service provides a web UI in which you can define jobs that specify which collections of entities or sessions need to be retrieved, which metrics need to be extracted for them, and the frequency of their retrieval.
The Service contains a Controller that elastically schedules and distributes the work, and continuously scales the collection of worker processes to maximize throughput. Worker processes individually optimize and limit their usage of the designated API endpoints.
The Service also contains a Library Service that synchronizes and indexes all Dynatrace entities and relationships in the Smartscape, which enables it to execute your queries very efficiently.
The UI also reports on key performance and health characteristics to help users make informed decisions with respect to the stress their selections impose on the Dynatrace APIs.
Get started
Deploy with the ESA Solution Server
If you have not yet installed the Dynatrace Solution Server, install that first and then continue with the steps below.
Once you have the Solution Server running on the targeted host, do the following:
- Copy the download link on this tile (right-click the Download button, copy link).
- Navigate to
https://your-solution-server.corp.com. Click on the ‘+’ tile, paste the link into the wizard, and click Install. Follow the on-screen instructions. - The Solution Server home page will now show a tile for the ETL Service. Click it to start configuring your jobs.
- You can modify your configuration at any time via the Settings button on the tile.
- Documentation and health status can be accessed from the tile as well.
Deploy as a stand-alone application
- Download the solution to your local system using the Download button.
- Extract the ZIP file to a folder of your choice on the targeted host.
- Install NodeJS 16+ and PM2.
- Optionally install MariaDB or MySQL.
- Edit the various configuration files using a text editor using the instructions on the ESA Documentation Hub.
- Start the ETL service by running
pm2 start ecosystem.config.js. - Navigate to
https://your-etl-service.corp.comto start configuring your jobs.
Deploy in Kubernetes as a container
(Coming soon)
Screenshots
Price: Free to download and run. Extended support or customization requires a services contract. Please contact esa@dynatrace.com for more details.
Keywords
- enterprise-solutions-architecture
Dynatrace Hub
