Integrate Amazon CloudWatch Metric Streams

CloudFormation allows you to deploy a Metric Streams client using a single deployment command to create a stack that groups multiple AWS resources. This approach is faster and makes AWS resource management easier.

You need one client stack for each region you want to monitor. Once deployed, the client starts streaming all metrics produced in its region. You can restrict which metrics are streamed.

Deploy the Metric Streams client for a default region

To fetch the CloudFormation template and deploy it to your AWS account, run the command below. Be sure to replace <your_API_URL> and <your_API_token> with your own values. Consult the parameters table that follows for details.

plaintextcopydownload
DYNATRACE_ENV_URL=<your_API_URL>
DYNATRACE_API_KEY=<your_API_token>
STACK_NAME=dynatrace-aws-metric-streams-client
DELIVERY_ENDPOINT=https://aws.cloud.dynatrace.com/
REQUIRE_VALID_CERTIFICATE=true

wget -O dynatrace-aws-metric-streams-client.yaml  https://assets.cloud.dynatrace.com/awsmetricstreaming/dynatrace-aws-metric-streams-client.yaml && \
 aws cloudformation deploy --capabilities CAPABILITY_NAMED_IAM --template-file ./dynatrace-aws-metric-streams-client.yaml --stack-name $STACK_NAME --parameter-overrides DynatraceEnvironmentUrl=$DYNATRACE_ENV_URL DynatraceApiKey=$DYNATRACE_API_KEY RequireValidCertificate=$REQUIRE_VALID_CERTIFICATE FirehoseHttpDeliveryEndpoint=$DELIVERY_ENDPOINT

Deploy the Metric Streams client for other regions

The command above uses the default AWS CLI profile and its default region. To change the profile and region, you can export additional variables such as AWS_DEFAULT_REGION and AWS_PROFILE and rerun the deployment command. If you are using CloudShell, you can change the region in the AWS console instead. For details on how to configure the AWS CLI, see Environment variables to configure the AWS CLI.

Confirm that the Metric Streams client was deployed correctly optional

To ensure that the Metric Streams client was deployed correctly

1. In the AWS console, go to CloudFormation.
2. Select the stack you created in the CloudFormation deployment.
3. On the Events tab, make sure all events completed successfully and there are no failed events.
4. In Parameters tab, make sure all parameters you provided have correct values.

Restrict which metrics are streamed

If you want to restrict which metrics are streamed

1. In the AWS console, go to CloudFormation.
2. Select the stack you created in the CloudFormation deployment.
3. On the Resources tab, find the resource with type AWS::CloudWatch::MetricStream and note its Physical ID.
4. Go to CloudWatch.
5. Under Metrics, select Streams.
6. In the list of metric streams, select the one whose Name corresponds to the Physical ID that you noted in step 3 and then select Edit.
7. Under Metrics to be streamed, select one of the following options:
   • All namespaces, if you want to automatically stream all namespaces (you can manually select namespaces to exclude).
   • Selected namespaces, if you want to manually select the namespaces to stream.
8. Under Select metrics for the metric stream, select one of the following options:
   • All metrics, if you want to automatically stream all metrics from namespaces selected in step 7.
   • Exclude metrics by metric name, if you want to manually exclude metrics for each namespace.
9. Select Save changes.

If you don't have access to the CloudFormation template, you can manually set up a Metric Streams client in the AWS console. Follow the steps below for instructions.

Create a Kinesis Data Firehose stream

Create a CloudWatch Metric Stream

Create a Kinesis Data Firehose stream

1. In the AWS console, go to Kinesis.
2. Select Create delivery stream.

. Name and source

1. Enter a stream name and save it for later use.
2. In Source, make sure Direct PUT or other sources is selected.
3. Select Next.

. Process records

1. Make sure Data Transformation and Record format conversion are disabled.
2. Select Next.

. Choose a destination

1. Select Third-party service provider and choose Dynatrace.

2. In HTTP endpoint URL, select one of available Dynatrace endpoints (Global, EU, US).

3. In Access key, enter your API token. See Prerequisites for instructions.

4. In Content encoding, make sure GZIP is selected.

5. optional In Parameters, select Add parameter and enter the parameters and their values as follows:

   Parameter	Description
   dt-url	Your API URL. See Prerequisites for instructions.
   require-valid-certificate	Enter true or false. If set to true, Dynatrace verifies the SSL certificate of your Dynatrace environment URL.

6. In Retry duration, enter 900.

7. In S3 backup mode, make sure Failed data only is selected.

8. In S3 bucket, select Create new.

9. Enter a name and (optionally) a region for the S3 bucket, and then select Create S3 bucket.

10. Select Next.

. Configure settings

1. Use the existing default settings.
2. optional In Tags, enter tags to organize your AWS resources.
3. Select Next.

. Review

1. Review your configuration.
2. Select Create delivery stream.

Create a CloudWatch Metric Stream

1. In the AWS console, go to CloudWatch.
2. Under Metrics, select Streams.
3. Select Create metric stream.
4. Select one of the options below:
   • All namespaces, if you want to automatically stream all namespaces (you can manually select namespaces to exclude).
   • Selected namespaces, if you want to manually select the namespaces to stream.
5. Under Select metrics for the metric stream, select one of the following options:
   • All metrics, if you want to automatically stream all metrics from namespaces selected in step 7.
   • Exclude metrics by metric name, if you want to manually exclude metrics for each namespace.
6. In Configuration, select Select an existing Firehose owned by your account and enter the name of the Firehose stream that you created in the previous section.
7. In Change output format, make sure Open Telemetry 0.7 is selected.
8. In Metric stream name, enter a name for your metric stream.
9. Select Create metric stream.