Why did my AWS DMS task validation fail, or why isn't the validation progressing?

2 minute read
0

I turned on validation for my AWS Database Migration Service (AWS DMS) task, but the validation failed or isn't progressing.

Short description

When you use the validation feature for an AWS DMS task, you can review statistics at the table level and configure data validation settings. To view the data validation information, you can use the AWS DMS console, the AWS Command Line Interface (AWS CLI), or the AWS DMS API.

Resolution

Note: If you receive errors when you run AWS CLI commands, then see Troubleshoot AWS CLI errors. Also, make sure that you're using the most recent AWS CLI version.

  1. Open the AWS DMS console.
  2. From the navigation pane, choose Database migration tasks.
  3. Choose the name of your task.
  4. From the Table statistics section, review the Validation state. Or, to review the data validation report in JSON format, run describe-table-statistics:
    aws dms  describe-table-statistics --replication-task-arn arn:aws:dms:us-east-1:45454545454:rep:XXXXXXXXXXXXXXXXXX

If the validation state is Mismatched records, then query the table awsdms_validation_failures_v1. AWS DMS creates the awsdms_validation_failures_v1 table on the target database:

select \* from awsdms\_validation\_failures\_v1 where TASK\_NAME = 'XXXXXXXXXXXXXXXXXX';

Note: The value of TASK_NAME is the external resource ID of the task and is the last value in the task Amazon Resource Name (ARN).

After you have the primary key of the failed record, query the source and target endpoints to see what part of the record doesn't match.

If the validation state is Pending records, then configure the ThreadCount parameter for task validation settings to improve the validation performance. For more information, see Data validation task settings.

For other validation states, see Replication task statistics. You can use CloudWatch metrics to monitor the progress of the validation.

Related information

Troubleshooting

Limitations

AWS OFFICIAL
AWS OFFICIALUpdated 6 months ago