Starting your AWS DataSync task - AWS DataSync

Starting your AWS DataSync task

Once you create your AWS DataSync transfer task, you can start moving data. Each run of a task is called a task execution.

When you start your task, DataSync performs a recursive directory listing to discover all the files, objects, and associated metadata in the transfer's source and destination locations. DataSync identifies differences between the locations and determines what to copy, a process that usually takes between a few minutes and a few hours.

Important

If you're planning to transfer data to or from an Amazon S3 location, review how DataSync can affect your S3 request charges and the DataSync pricing page before you begin.

Running multiple executions of the same task

There are scenarios where you might want to run multiple executions of the same DataSync task. For example, you might be copying data on a schedule or migrating a lot of files incrementally (something you can do with task filtering).

Remember the following about running multiple task executions:

  • Tasks run in a series (first in, first out). If you start a task twice at about the same time, the second task execution by default is queued and doesn't start until the first execution finishes.

  • You can run separate tasks at the same time, but these tasks are queued if they're using the same DataSync agent.

Starting your task

Once you've created your task, you can begin moving data right away.

  1. Open the AWS DataSync console at https://console.aws.amazon.com/datasync/.

  2. In the left navigation pane, expand Data transfer, then choose Tasks.

  3. Choose the task that you want to run.

    Make sure that the task has an Available status. You also can select multiple tasks.

  4. Choose Actions and then choose one of the following options:

    • Start – Runs the task (or tasks if you selected more than one).

    • Start with overriding options – Allows you to modify some of your task settings before you begin moving data. When you're ready, choose Start.

  5. Choose See execution details to view details about the running task execution.

To start your DataSync task, you just need to specify the Amazon Resource Name (ARN) of the task you want to run. Here's an example start-task-execution command:

aws datasync start-task-execution \ --task-arn 'arn:aws:datasync:region:account-id:task/task-id'

The following example starts a task with a few settings that are different than the task's default settings:

aws datasync start-task-execution \ --override-options VerifyMode=NONE,OverwriteMode=NEVER,PosixPermissions=NONE

The command returns an ARN for your task execution similar to the following example:

{ "TaskExecutionArn": "arn:aws:datasync:us-east-1:209870788375:task/task-08de6e6697796f026/execution/exec-04ce9d516d69bd52f" }
Note

Each agent can run a single task at a time.

You can start your task by using the StartTaskExecution operation. Use the DescribeTaskExecution operation to get details about the running task execution.

Once started, you can check the task execution's status as DataSync copies your data. You also can throttle the task execution's bandwidth if needed.