Set up replication for AWS Database Migration Service

Sign in to the AWS Management Console and open the AWS DMS console at https://console.aws.amazon.com/dms/v2/.

On the navigation pane, choose Replication instances, and then choose Create replication instance.

On the Create replication instance page, specify your replication instance configuration:

1. For Name, enter DMS-instance.

2. For Description, enter a short description for your replication instance (optional).

3. For Instance class, leave dms.t3.medium chosen.

   The instance needs enough storage, networking, and processing power for your migration. For more information about how to choose an instance class, see Choosing the right AWS DMS replication instance for your migration.

4. For Engine version, accept the default.

5. For Multi AZ, choose Dev or test workload (Single-AZ).

6. For Allocated storage (GiB), accept the default of 50 GiB.

   In AWS DMS, storage is mostly used by log files and cached transactions. For cache transactions, storage is used only when the cached transactions need to be written to disk. As a result, AWS DMS doesn't use a significant amount of storage.

7. For Network type choose IPv4.

8. For VPC, choose DMSVPC.

9. For Replication subnet group, leave the replication subnet group currently chosen.

10. Clear Publicly accessible.

Choose the Advanced security and network configuration tab to set values for network and encryption settings if you need them:

1. For Availability zone, choose us-west-2a.

2. For VPC security group(s), choose the Default security group if it isn't already chosen.

3. For AWS KMS key, leave (Default) aws/dms chosen.

Leave the settings on the Maintenance tab as they are. The default is a 30-minute window selected at random from an 8-hour block of time for each AWS Region, occurring on a random day of the week.

Choose Create.

On the console, choose Endpoints from the navigation pane and then choose Create Endpoint.

On the Create endpoint page, choose the Source endpoint type. Select the Select RDS DB instance box, and choose the dms-mariadb instance.

In the Endpoint configuration section, enter dms-mysql-source for Endpoint identifier.

For Source engine, leave MySQL chosen.

For Access to endpoint database, choose Provide access information manually. Verify that the Port, Secure Socket Layer (SSL) mode, User name, and Password are correct.

Choose the Test endpoint connection (optional) tab. For VPC, choose DMSVPC.

For Replication instance, leave dms-instance chosen.

Choose Run test.

After you choose Run test, AWS DMS creates the endpoint with the details that you provided and connects to it. If the connection fails, edit the endpoint definition and test the connection again. You can also delete the endpoint manually.

After you have a successful test, choose Create endpoint.

Specify a target database endpoint using the AWS DMS console. To do this, repeat the steps preceding, with the following settings:

In the console navigation pane, choose Database migration tasks, and then choose Create task. The Create database migration task page opens.

In the Task configuration section, specify the following task options:

Choose the Task settings tab. Set the following settings:

Choose the Table mappings tab, and expand Selection rules. Choose Add new selection rule. Set the following settings:

Choose the Migration task startup configuration tab, and then choose Automatically on create.

Choose Create task.

Make sure that your database migration task shows a status of Running but your initial database replication, started in the previous step, isn't complete.

Connect to your Amazon EC2 client, and start the MySQL client with the following command. Provide your MySQL database endpoint.

mysql -h dms-mysql.abcdefg12345.us-west-2.rds.amazonaws.com -P 3306 -u admin -pchangeit dms_sample

Run the following command to insert a record into the source database.

MySQL [dms_sample]> insert person (full_name, last_name, first_name) VALUES ('Test User1', 'User1', 'Test');
Query OK, 1 row affected (0.00 sec)

Exit the MySQL client.

MySQL [dms_sample]> exit
Bye

Before replication completes, query the target database for the new record.

From the Amazon EC2 instance, connect to the target database using the following command, providing your target database endpoint.

psql \
   --host=dms-postgresql.abcdefg12345.us-west-2.rds.amazonaws.com \
   --port=5432 \
   --username=postgres \
   --password \
   --dbname=dms_sample 

Provide the password (changeit) when prompted.

Before replication completes, query the target database for the new record.

dms_sample=> select * from dms_sample.person where first_name = 'Test';
 id | full_name | last_name | first_name
----+-----------+-----------+------------
(0 rows)

While your migration task is running, you can monitor the progress of your database migration as it happens:

For more information about monitoring, see Monitoring AWS DMS tasks.

After replication completes, query the target database again for the new record. AWS DMS migrates the new record after initial replication completes.

dms_sample=> select * from dms_sample.person where first_name = 'Test';
   id    | full_name  | last_name | first_name
---------+------------+-----------+------------
 7077784 | Test User1 | User1     | Test
(1 row)

Exit the psql client.

dms_sample=> quit

Repeat step 1 to connect to the source database again.

Insert another record into the person table.

MySQL [dms_sample]> insert person (full_name, last_name, first_name) VALUES ('Test User2', 'User2', 'Test');
Query OK, 1 row affected (0.00 sec)

Repeat steps 3 and 4 to disconnect from the source database and connect to the target database.

Query the target database for the replicated data again.

dms_sample=> select * from dms_sample.person where first_name = 'Test';
   id    | full_name  | last_name | first_name
---------+------------+-----------+------------
 7077784 | Test User1 | User1     | Test
 7077785 | Test User2 | User2     | Test
(2 rows)

On the AWS DMS console navigation pane, choose Database migration tasks.

Choose dms-task.

Choose Actions, Delete.

On the AWS DMS console navigation pane, choose Replication instances.

Choose DMS-instance.

Choose Actions, Delete.

On the AWS DMS console navigation pane, choose Endpoints.

Choose dms-mysql-source.

Choose Actions, Delete.