Mount Amazon FSx for Lustre to a HyperPod cluster - Amazon SageMaker

Mount Amazon FSx for Lustre to a HyperPod cluster

To mount an Amazon FSx for Lustre shared file system to your HyperPod cluster, set up the following.

  1. Use your Amazon VPC.

    1. For HyperPod cluster instances to communicate within your VPC, make sure that you attach the Setting up SageMaker HyperPod with Amazon VPC to the IAM role for SageMaker HyperPod.

    2. In create_cluster.json, include the following VPC information.

      "VpcConfig": { 
    "SecurityGroupIds": [ "string" ],
    "Subnets": [ "string" ]
}

      For more tips about setting up Amazon VPC, see Prerequisites for using SageMaker HyperPod.

  2. To finish configuring Slurm with Amazon FSx for Lustre, specify the Amazon FSx DNS name and Amazon FSx mount name in provisioning_parameters.json as shown in the figure in the Start with base lifecycle scripts provided by HyperPod section. You can find the Amazon FSx information either from the Amazon FSx for Lustre console in your account or by running the following AWS CLI command, aws fsx describe-file-systems.

    "fsx_dns_name": "fs-12345678a90b01cde.fsx.us-west-2.amazonaws.com",
"fsx_mountname": "1abcdefg"