Amazon Simple Storage Service (S3) monitoring

Dynatrace ingests metrics for multiple preselected namespaces, including Amazon Simple Storage Service (S3). You can view metrics for each service instance, split metrics into multiple dimensions, and create custom charts that you can pin to your dashboards.

Prerequisites

To enable monitoring for this service, you need

  • An Environment or Cluster ActiveGate version 1.181+
    Note: For role-based access (whether in a SaaS or Managed deployment), you need an Environment ActiveGate installed on an AWS EC2 host.
  • Dynatrace version 1.182+
  • An updated AWS monitoring policy to include the additional AWS services.

To update the AWS IAM policy, use the JSON below, containing the monitoring policy (permissions) for all supporting services.

If you don't want to add permissions to all services, and just select permissions for certain services, consult the table below. The table contains a set of permissions that are required for all services (All monitored Amazon services) and, for each supporting service, a list of optional permissions specific to that service.

Example of JSON policy for one single service.

In this example, from the complete list of permissions you need to select

  • "apigateway:GET" for Amazon API Gateway

  • "cloudwatch:GetMetricData", "cloudwatch:GetMetricStatistics", "cloudwatch:ListMetrics", "sts:GetCallerIdentity", "tag:GetResources", "tag:GetTagKeys", and "ec2:DescribeAvailabilityZones" for All monitored Amazon services.

  • A request metrics filter for the buckets you want to monitor. For more information, see Creating a request metrics filter for an S3 bucket in AWS documentation.

Enable monitoring

To enable monitoring for this service, you first need to integrate Dynatrace with Amazon Web Services:

Add the service to monitoring

In order to view the service metrics, you must add the service to monitoring in your Dynatrace environment.

Note: Once AWS supporting services are added to monitoring, you might have to wait 15-20 minutes before the metric values are displayed.

Cloud-service monitoring consumption

As of 2021, all cloud services consume Davis data units (DDUs). The amount of DDU consumption per service instance depends on the number of monitored metrics and their dimensions (each metric dimension results in the ingestion of 1 data point; 1 data point consumes 0.001 DDUs). For DDU consumption estimates per service instance (recommended metrics only, predefined dimensions, and assumed dimension values), see DDU consumption estimates per cloud service instance.

Monitor resources based on tags

You can choose to monitor resources based on existing AWS tags, as Dynatrace automatically imports them from service instances. Nevertheless, the transition from AWS to Dynatrace tagging isn't supported for all AWS services. Expand the table below to see which supporting services are filtered by tagging.

To monitor resources based on tags

  1. In the Dynatrace menu, go to Settings > Cloud and virtualization > AWS and select the AWS instance.
  2. For Resource monitoring method, select Monitor resources based on tags.
  3. Enter the Key and Value.
  4. Select Save.

Configure service metrics

Once you add a service, Dynatrace starts automatically collecting a suite of metrics for this particular service. These are recommended metrics. Apart from the recommended metrics, most services have the possibility of enabling optional metrics. You can remove or edit any of the existing metrics or any of their dimensions, where there are multiple dimensions available. Metrics consisting of only one dimension can't be edited. They can only be removed or added.

Service-wide metrics are metrics for the whole service across all regions. Typically, these metrics include dimensions containing Region in their name. If selected, these metrics are displayed on a separate chart when viewing your AWS deployment in Dynatrace. Keep in mind that available dimensions differ among services.

To change a metric's statistics, you have to recreate that metric by choosing different statistics. You can choose among the following statistics: Sum, Minimum, Maximum, Average, and Sample count. The Average + Minimum + Maximum statistics enable you to collect all three statistics as one metric instead of one statistic for three metrics separately. This can reduce your expenses for retrieving metrics from your AWS deployment.

To be able to save a newly added metric, you need to select at least one statistic and one dimension.

Note: Once AWS supporting services are configured, you might have to wait 15-20 minutes before the metric values are displayed.

View service metrics

You can view the service metrics in your Dynatrace environment either on the custom device overview page or on your Dashboards page.

View metrics on the custom device overview page

To access the custom device overview page

  1. In the Dynatrace menu, go to Technologies.
  2. Filter by service name and select the relevant custom device group.
  3. Once you select the custom device group, you're on the custom device group overview page.
  4. The custom device group overview page lists all instances (custom devices) belonging to the group. Select an instance to view the custom device overview page.

View metrics on your dashboard

You can also view metrics in the Dynatrace web UI on dashboards. There is no preset dashboard available for this service, but you can create your own dashboard.

To check the availability of preset dashboards for each AWS service, see the list below.

Available metrics

Name Description Unit Statistics Dimensions Recommended
AllRequests The total number of HTTP requests made to an Amazon S3 bucket, regardless of type Count Sum BucketName, FilterId ✔️
BytesDownloaded The number of bytes downloaded for requests made to an Amazon S3 bucket, where the response includes a body Bytes Multi BucketName, FilterId
BytesDownloaded Bytes Sum BucketName, FilterId
BytesDownloaded Count Count BucketName, FilterId
BytesUploaded The number of bytes uploaded that contain a request body, made to an Amazon S3 bucket Bytes Multi BucketName, FilterId
BytesUploaded Bytes Sum BucketName, FilterId
BytesUploaded Count Count BucketName, FilterId
DeleteRequests The number of HTTP DELETE requests made for objects in an Amazon S3 bucket (includes Delete multiple objects requests). Count Sum BucketName, FilterId
FirstByteLatency Per request, the time from when the Amazon S3 bucket receives the complete request to when the response starts to be returned Milliseconds Multi BucketName, FilterId
FirstByteLatency Milliseconds Sum BucketName, FilterId
FirstByteLatency Count Count BucketName, FilterId
GetRequests The number of HTTP GET requests made for objects in an Amazon S3 bucket (doesn't include list operations) Count Sum BucketName, FilterId
HeadRequests The number of HTTP HEAD requests made to an Amazon S3 bucket Count Sum BucketName, FilterId
ListRequests The number of HTTP requests that list the contents of a bucket Count Sum BucketName, FilterId
PostRequests The number of HTTP POST requests made to an Amazon S3 bucket Count Sum BucketName, FilterId
PutRequests The number of HTTP PUT requests made for objects in an Amazon S3 bucket Count Sum BucketName, FilterId
SelectRequests The number of Amazon S3 SelectObjectContent requests made for objects in an Amazon S3 bucket Count Sum BucketName, FilterId
SelectReturnedBytes The number of bytes of data returned with Amazon S3 SelectObjectContent requests in an Amazon S3 bucket Bytes Multi BucketName, FilterId
SelectReturnedBytes Bytes Sum BucketName, FilterId
SelectReturnedBytes Count Count BucketName, FilterId
SelectScannedBytes The number of bytes of data scanned with Amazon S3 SelectObjectContent requests in an Amazon S3 bucket Bytes Multi BucketName, FilterId
SelectScannedBytes Bytes Sum BucketName, FilterId
SelectScannedBytes Count Count BucketName, FilterId
TotalRequestLatency The time per request, starting from the first byte received to the last byte sent to an Amazon S3 bucket. This includes the time taken to receive the request body and send the response body, which is not included in FirstByteLatency. Milliseconds Multi BucketName, FilterId
TotalRequestLatency Milliseconds Sum BucketName, FilterId
TotalRequestLatency Count Count BucketName, FilterId
4xxErrors The number of HTTP 4xx client error status code requests made to an Amazon S3 bucket with a value of either 0 or 1. The average statistic shows the error rate, and the sum statistic shows the count of that type of error, during each period. Count Multi BucketName, FilterId ✔️
4xxErrors Count Sum BucketName, FilterId
4xxErrors Count Count BucketName, FilterId
5xxErrors The number of HTTP 5xx server error status code requests made to an Amazon S3 bucket with a value of either 0 or 1. The average statistic shows the error rate, and the sum statistic shows the count of that type of error, during each period. Count Multi BucketName, FilterId ✔️
5xxErrors Count Sum BucketName, FilterId
5xxErrors Count Count BucketName, FilterId