Amazon Database Migration Service monitoring

Dynatrace ingests metrics for multiple preselected namespaces, including Amazon Database Migration Service. You can view metrics for each service instance, split metrics into multiple dimensions, and create custom charts that you can pin to your dashboards.

Prerequisites

To enable monitoring for this service, you need

  • An Environment or Cluster ActiveGate version 1.197+
    Note: For role-based access (whether in a SaaS or Managed deployment), you need an Environment ActiveGate installed on an AWS EC2 host.
  • Dynatrace version 1.200+
  • An updated AWS monitoring policy to include the additional AWS services.

To update the AWS IAM policy, use the JSON below, containing the monitoring policy (permissions) for all supporting services.

If you don't want to add permissions to all services, and just select permissions for certain services, consult the table below. The table contains a set of permissions that are required for all services (All monitored Amazon services) and, for each supporting service, a list of optional permissions specific to that service.

Example of JSON policy for one single service.

In this example, from the complete list of permissions you need to select

  • "apigateway:GET" for Amazon API Gateway
  • "cloudwatch:GetMetricData", "cloudwatch:GetMetricStatistics", "cloudwatch:ListMetrics", "sts:GetCallerIdentity", "tag:GetResources", "tag:GetTagKeys", and "ec2:DescribeAvailabilityZones" for All monitored Amazon services.

Enable monitoring

To enable monitoring for this service, you first need to integrate Dynatrace with Amazon Web Services:

Add the service to monitoring

In order to view the service metrics, you must add the service to monitoring in your Dynatrace environment.

Cloud-service monitoring consumption

As of 2021, all cloud services consume Davis data units (DDUs). The amount of DDU consumption per service instance depends on the number of monitored metrics and their dimensions (each metric dimension results in the ingestion of 1 data point; 1 data point consumes 0.001 DDUs).

Monitor resources based on tags

You can choose to monitor resources based on existing AWS tags, as Dynatrace automatically imports them from service instances. Nevertheless, the transition from AWS to Dynatrace tagging isn't supported for all AWS services. Expand the table below to see which supporting services are filtered by tagging.

To monitor resources based on tags

  1. In the Dynatrace menu, go to Settings > Cloud and virtualization > AWS and select Edit for the desired AWS instance.
  2. For Resources to be monitored, select Monitor resources selected by tags.
  3. Enter the Key and Value.
  4. Select Save.

Configure service metrics

Once you add a service, Dynatrace starts automatically collecting a suite of metrics for this particular service. These are recommended metrics.

Recommended metrics:

  • Are enabled by default
  • Can't be disabled
  • Can have recommended dimensions (enabled by default, can't be disabled)
  • Can have optional dimensions (disabled by default, can be enabled)

Apart from the recommended metrics, most services have the possibility of enabling optional metrics.

Optional metrics:

  • Can be added and configured manually

View service metrics

You can view the service metrics in your Dynatrace environment either on the custom device overview page or on your Dashboards page.

View metrics on the custom device overview page

To access the custom device overview page

  1. In the Dynatrace menu, go to Technologies and processes.
  2. Filter by service name and select the relevant custom device group.
  3. Once you select the custom device group, you're on the custom device group overview page.
  4. The custom device group overview page lists all instances (custom devices) belonging to the group. Select an instance to view the custom device overview page.

View metrics on your dashboard

After you add the service to monitoring, a preset dashboard containing all recommended metrics is automatically listed on your Dashboards page. To look for specific dashboards, filter by Preset and then by Name.
aws-presets
Note: For existing monitored services, you might need to resave your credentials for the preset dashboard to appear on the Dashboards page. To resave your credentials, go to Settings > Cloud and virtualization > AWS, select the desired AWS instance, and then select Save.

You can't make changes on a preset dashboard directly, but you can clone and edit it. To clone a dashboard, open the browse menu () and select Clone.
To remove a dashboard from the dashboards page, you can hide it. To hide a dashboard, open the browse menu () and select Hide.
Note: Hiding a dashboard doesn't affect other users. clone-hide-aws

To check the availability of preset dashboards for each AWS service, see the list below.

databasemigration

Available metrics

Name Description Unit Statistics Dimensions Recommended
CDCChangesDiskSource Amount of rows accumulating on disk and waiting to be committed from the source Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier
CDCChangesDiskTarget Amount of rows accumulating on disk and waiting to be committed to the target Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier
CDCChangesMemorySource Amount of rows accumulating in memory and waiting to be committed from the source Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier
CDCChangesMemoryTarget Amount of rows accumulating in memory and waiting to be committed to the target Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier
CDCIncomingChanges The total number of change events at a point in time that are waiting to be applied to the target Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
CDCLatencySource The gap, in seconds, between the last event captured from the source endpoint and the current system timestamp of the AWS DMS instance. CDCLatencySource represents the latency between source and replication instance. Seconds Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
CDCLatencyTarget The gap, in seconds, between the first event timestamp waiting to commit on the target and the current timestamp of the AWS DMS instance. CDCLatencyTarget represents the latency between replication instance and target. Seconds Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
CDCThroughputBandwidthSource Incoming data received for the source in KB per second Kilobytes/Second Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
CDCThroughputBandwidthTarget Outgoing data transmitted for the target in KB per second Kilobytes/Second Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
CDCThroughputRowsSource Incoming task changes from the source in rows per second Count/Second Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
CDCThroughputRowsTarget Outgoing task changes for the target in rows per second Count/Second Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
CPUAllocated The percentage of CPU maximally allocated for the task (0 means no limit) Percent Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier
CPUUtilization The amount of CPU used Percent Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
CPUUtilization Percent Multi ReplicationInstanceIdentifier ✔️
CPUUtilization Percent Multi Region, ReplicationInstanceExternalResourceId ✔️
CPUUtilization Percent Multi Region ✔️
CPUUtilization Percent Multi Region, InstanceClass
DiskQueueDepth The number of outstanding I/Os (read/write requests) waiting to access the disk Count Multi Region, ReplicationInstanceExternalResourceId
DiskQueueDepth Count Multi Region
DiskQueueDepth Count Multi Region, InstanceClass
DiskQueueDepth Count Multi ReplicationInstanceIdentifier
FreeStorageSpace The amount of available storage space Bytes Multi ReplicationInstanceIdentifier ✔️
FreeStorageSpace Bytes Multi Region, ReplicationInstanceExternalResourceId
FreeStorageSpace Bytes Multi Region
FreeStorageSpace Bytes Multi Region, InstanceClass
FreeableMemory The amount of available RAM Bytes Multi ReplicationInstanceIdentifier ✔️
FreeableMemory Bytes Multi Region, ReplicationInstanceExternalResourceId
FreeableMemory Bytes Multi Region
FreeableMemory Bytes Multi Region, InstanceClass
FullLoadThroughputBandwidthSource Incoming data received from a full load from the source in kilobytes (KB) per second Kilobytes/Second Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
FullLoadThroughputBandwidthTarget Outgoing data transmitted from a full load for the target in kilobytes (KB) per second Kilobytes/Second Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
FullLoadThroughputRowsSource Incoming changes from a full load from the source in rows per second Count/Second Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
FullLoadThroughputRowsTarget Outgoing changes from a full load for the target in rows per second Count/Second Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
MemoryAllocated The maximum allocation of memory for the task (0 means no limits) Megabytes Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier
MemoryUsage The resident set size (RSS) occupied by a task. It indicates the portion of memory occupied by a task held in main memory (RAM). Megabytes Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
NetworkReceiveThroughput The incoming (receive) network traffic on the replication instance, including both customer database traffic and AWS DMS traffic used for monitoring and replication Bytes/Second Multi ReplicationInstanceIdentifier ✔️
NetworkReceiveThroughput Bytes/Second Multi Region, ReplicationInstanceExternalResourceId
NetworkReceiveThroughput Bytes/Second Multi Region
NetworkReceiveThroughput Bytes/Second Multi Region, InstanceClass
NetworkTransmitThroughput The outgoing (transmit) network traffic on the replication instance, including both customer database traffic and AWS DMS traffic used for monitoring and replication Bytes/Second Multi ReplicationInstanceIdentifier ✔️
NetworkTransmitThroughput Bytes/Second Multi Region, ReplicationInstanceExternalResourceId
NetworkTransmitThroughput Bytes/Second Multi Region
NetworkTransmitThroughput Bytes/Second Multi Region, InstanceClass
ReadIOPS The average number of disk read I/O operations per second Count/Second Multi ReplicationInstanceIdentifier ✔️
ReadIOPS Count/Second Multi Region, ReplicationInstanceExternalResourceId
ReadIOPS Count/Second Multi Region
ReadIOPS Count/Second Multi Region, InstanceClass
ReadLatency The average amount of time taken per disk I/O (input) operation Seconds Multi ReplicationInstanceIdentifier ✔️
ReadLatency Seconds Multi Region, ReplicationInstanceExternalResourceId
ReadLatency Seconds Multi Region
ReadLatency Seconds Multi Region, InstanceClass
ReadThroughput The average number of bytes read from disk per second Bytes/Second Multi ReplicationInstanceIdentifier ✔️
ReadThroughput Bytes/Second Multi Region, ReplicationInstanceExternalResourceId
ReadThroughput Bytes/Second Multi Region
ReadThroughput Bytes/Second Multi Region, InstanceClass
RecoveryCount Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
RunCounter Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
SwapUsage The amount of swap space used on the replication instance Bytes Multi ReplicationInstanceIdentifier ✔️
SwapUsage Bytes Multi Region, ReplicationInstanceExternalResourceId
SwapUsage Bytes Multi Region
SwapUsage Bytes Multi Region, InstanceClass
ValidationAttemptedRecordCount Number of rows that validation was attempted, per minute Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
ValidationBulkQuerySourceLatency AWS DMS can do data validation in bulk, especially in certain scenarios during a full-load or ongoing replication when there are many changes. This metric indicates the latency required to read a bulk set of data from the source endpoint. Milliseconds Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
ValidationBulkQueryTargetLatency AWS DMS can do data validation in bulk, especially in certain scenarios during a full-load or ongoing replication when there are many changes. This metric indicates the latency required to read a bulk set of data on the target endpoint. Milliseconds Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
ValidationFailedOverallCount Number of rows where validation failed Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
ValidationItemQuerySourceLatency During ongoing replication, data validation can identify ongoing changes and validate those changes. This metric indicates the latency in reading those changes from the source. Milliseconds Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier
ValidationItemQueryTargetLatency During ongoing replication, data validation can identify ongoing changes and validate the changes row by row. This metric gives us the latency in reading those changes from the target. Milliseconds Multi ReplicationInstanceIdentifier, ReplicationTaskIdentifier
ValidationPendingOverallCount Number of rows where the validation is still pending Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
ValidationSucceededRecordCount Number of rows that AWS DMS validated, per minute Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
ValidationSuspendedOverallCount Number of rows where validation was suspended Count Sum ReplicationInstanceIdentifier, ReplicationTaskIdentifier ✔️
WriteIOPS The average number of disk write I/O operations per second Count/Second Multi ReplicationInstanceIdentifier ✔️
WriteIOPS Count/Second Multi Region, ReplicationInstanceExternalResourceId
WriteIOPS Count/Second Multi Region
WriteIOPS Count/Second Multi Region, InstanceClass
WriteLatency The average amount of time taken per disk I/O (output) operation Seconds Multi ReplicationInstanceIdentifier ✔️
WriteLatency Seconds Multi Region, ReplicationInstanceExternalResourceId
WriteLatency Seconds Multi Region
WriteLatency Seconds Multi Region, InstanceClass
WriteThroughput The average number of bytes written to disk per second Bytes/Second Multi ReplicationInstanceIdentifier ✔️
WriteThroughput Bytes/Second Multi Region, ReplicationInstanceExternalResourceId
WriteThroughput Bytes/Second Multi Region
WriteThroughput Bytes/Second Multi Region, InstanceClass

Limitations

To collect metrics about changes captured by the migration task (CDC metrics) on MySQL, the binary logging and automatic backup settings should be enabled.