Autopilot quotas
There are quotas that limit the resources available to you when using Amazon SageMaker Autopilot. Some of these limits are increasable and some are not.
Note
The resource quotas documented in the following sections are valid for versions of Amazon SageMaker Studio Classic 3.22.2 and higher. For information on updating your version of SageMaker AI Studio Classic, see Shut Down and Update SageMaker Studio Classic and Studio Classic Apps.
Quotas that you can increase
The following table contains the resource limits for quotas you can increase:
Resource | Regions | Default limits | Can be increased up to |
---|---|---|---|
Size of input dataset | All | 100 GB | Hundreds of GBs |
Size of a single Parquet file* | All | 2 GB | N/A |
Target dataset size for subsampling** | All | 5 GB | Hundreds of GBs |
Number of concurrent Autopilot jobs | us-east-1, us-east-2,us-west-2, ap-northeast-1, eu-west-1, eu-central-1 | 4 | Hundreds |
Number of concurrent Autopilot jobs | ap-northeast-2, ap-southeast-2, eu-west-2, ap-southeast-1 | 2 | Hundreds |
Number of concurrent Autopilot jobs | All other Regions | 1 | Tens |
Note
*This 2 GB size limit is for a single compressed Parquet file. You can provide a Parquet dataset that includes multiple compressed Parquet files up to the input dataset maximum size. After the files are decompressed, they may each expand to a larger size.
**Autopilot automatically subsamples input datasets that are larger than the target dataset size while accounting for class imbalance and preserving rare class labels.
To request a quota increase:
-
Open the Service Quotas console
. -
Select your quota increase, then choose Request increase at account level.
-
In the Increase quota value, enter the new limit value that you are requesting.
-
Choose Request.
Resource quotas
The following table contains the runtime resource limits for an Amazon SageMaker Autopilot job in an AWS Region.
Resource | Limit per Autopilot job |
---|---|
Maximum runtime for an Autopilot job | 30 days |