AWS::SageMaker::EndpointConfig AsyncInferenceClientConfig
Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.
Syntax
To declare this entity in your AWS CloudFormation template, use the following syntax:
JSON
{ "MaxConcurrentInvocationsPerInstance" :Integer}
YAML
MaxConcurrentInvocationsPerInstance:Integer
Properties
MaxConcurrentInvocationsPerInstance-
The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker will choose an optimal value for you.
Required: No
Type: Integer
Update requires: Replacement
