Shared storage in Deadline Cloud - AWS Deadline Cloud

Shared storage in Deadline Cloud

To use shared storage, workers use the operating system file sharing system for access to a shared storage space for the input and output of your jobs.

The actual method that you use to share files depends on your operating system and the way that you implement shared storage on your network. You're responsible for how you configure file sharing and ensuring that it meets your needs.

If you're using a cross-system file sharing solution, you can use storage profiles to map file locations between Linux and Windows file systems.

Storage profiles in Deadline Cloud

With a storage profile, you can set up farms using cross-platform shared storage. A storage profile maps paths across operating systems for jobs processed on workers with a different operating system than the workstation they were submitted from.

Storage profiles are required when you use a customer-managed fleet with a mixture of operating systems between workstations and workers. Storage profiles are not supported on service-managed fleets.

After you create a storage profile, you must grant access to the queues and fleets that use the profile.

To create a storage profile
  1. Open the Deadline Cloud console.

  2. From Get started, choose Go to Deadline Cloud dashboard.

  3. Choose a farm, and then choose the Storage profiles tab.

  4. Choose Create storage profile.

  5. Choose an Operating system from the dropdown.

  6. Provide a Name for the profile. A clear name helps you choose the storage profile to use when submitting jobs.

  7. For the Path name, enter the root location of job data on the workstation that you submit jobs from.

  8. Choose a Storage type:

    • Local refers to file locations that are not shared between the worker and the workstation. They are uploaded as job attachments.

    • Shared refers to storage that is shared between the worker and the workstation. Files in shared storage are not uploaded as job attachments.

  9. Provide a File system location path. This is the root directory for your job data.

  10. Choose Create.

After you create a storage profile, you must modify your queues and customer-managed fleets to use the new profile. To allow access to a storage profile, use the following procedure after you complete the previous procedure.

To allow queues and customer-managed fleets to use a storage profile
  1. Choose either the Queues or Fleets tab.

  2. Choose the queue or fleet to modify.

  3. To modify a queue, choose the Allowed storage profiles tab.

    To modify a fleet, choose the Storage profile tab.

  4. Choose Modify storage profiles.

  5. Select the storage profile to allow, and the file system locations from that profile.

  6. Choose Save changes.