ProductionVariantRoutingConfig - Amazon SageMaker

ProductionVariantRoutingConfig

Settings that control how the endpoint routes incoming traffic to the instances that the endpoint hosts.

Contents

RoutingStrategy

Sets how the endpoint routes incoming traffic:

  • LEAST_OUTSTANDING_REQUESTS: The endpoint routes requests to the specific instances that have more capacity to process them.

  • RANDOM: The endpoint routes each request to a randomly chosen instance.

Type: String

Valid Values: LEAST_OUTSTANDING_REQUESTS | RANDOM

Required: Yes

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following: