InferenceComponentRollingUpdatePolicy
Specifies a rolling deployment strategy for updating a SageMaker AI inference component.
Contents
- MaximumBatchSize
-
The batch size for each rolling step in the deployment process. For each step, SageMaker AI provisions capacity on the new endpoint fleet, routes traffic to that fleet, and terminates capacity on the old endpoint fleet. The value must be between 5% to 50% of the copy count of the inference component.
Type: InferenceComponentCapacitySize object
Required: Yes
- WaitIntervalInSeconds
-
The length of the baking period, during which SageMaker AI monitors alarms for each batch on the new fleet.
Type: Integer
Valid Range: Minimum value of 0. Maximum value of 3600.
Required: Yes
- MaximumExecutionTimeoutInSeconds
-
The time limit for the total deployment. Exceeding this limit causes a timeout.
Type: Integer
Valid Range: Minimum value of 600. Maximum value of 28800.
Required: No
- RollbackMaximumBatchSize
-
The batch size for a rollback to the old endpoint fleet. If this field is absent, the value is set to the default, which is 100% of the total capacity. When the default is used, SageMaker AI provisions the entire capacity of the old fleet at once during rollback.
Type: InferenceComponentCapacitySize object
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following:
