Configuring how AWS DataSync verifies data integrity - AWS DataSync
Data verification optionsConfiguring data verification

Configuring how AWS DataSync verifies data integrity

During a transfer, AWS DataSync uses checksum verification to verify the integrity of the data that you copy between locations. You also can configure DataSync to perform additional verification at the end of your transfer.

Data verification options

Use the following information to help you decide if and how you want DataSync to perform these additional checks.

Option in console Option in API Description

Verify only transferred data (recommended)

VerifyMode set to ONLY_FILES_TRANSFERRED

DataSync calculates the checksum of transferred data (including metadata) at the source location. At the end of your transfer, DataSync compares this checksum to the checksum calculated on that same data at the destination.

We recommend this option when transferring to S3 Glacier Flexible Retrieval or S3 Glacier Deep Archive storage classes. For more information, see Storage class considerations with Amazon S3 transfers.

Verify all data

VerifyMode set to POINT_IN_TIME_CONSISTENT

At the end of your transfer, DataSync checks the entire source and destination to verify that both locations are fully synchronized.

Note

Not supported when your task uses Enhanced mode.

If you use a manifest, DataSync only scans and verifies what's listed in the manifest.

You can't use this option when transferring to S3 Glacier Flexible Retrieval or S3 Glacier Deep Archive storage classes. For more information, see Storage class considerations with Amazon S3 transfers.

Don't verify data after transfer

VerifyMode set to NONE

 DataSync performs data integrity checks only during your transfer. Unlike other options, there's no additional verification at the end of your transfer.

Configuring data verification

You can configure data verification options when creating a task, updating a task, or starting a task execution.

The following instructions describe how to configure data verification options when creating a task.

To configure data verification by using the console

  1. Open the AWS DataSync console at https://console.aws.amazon.com/datasync/.

  2. In the left navigation pane, expand Data transfer, then choose Tasks, and then choose Create task.

  3. Configure your task's source and destination locations.

    For more information, see Where can I transfer my data with AWS DataSync?

  4. For Verification, choose one of the following:

    • Verify only transferred data (recommended)

    • Verify all data

    • Don't verify data after transfer

You can configure how DataSync verifies data by using the VerifyMode parameter with any of the following operations: