interface PrefixAwareRoutingConfigProperty

Language	Type name
.NET	Amazon.CDK.AWS.Sagemaker.CfnEndpointConfig.PrefixAwareRoutingConfigProperty
Go	github.com/aws/aws-cdk-go/awscdk/v2/awssagemaker#CfnEndpointConfig_PrefixAwareRoutingConfigProperty
Java	software.amazon.awscdk.services.sagemaker.CfnEndpointConfig.PrefixAwareRoutingConfigProperty
Python	aws_cdk.aws_sagemaker.CfnEndpointConfig.PrefixAwareRoutingConfigProperty
TypeScript	aws-cdk-lib » aws_sagemaker » CfnEndpointConfig » PrefixAwareRoutingConfigProperty

The configuration for prefix-aware routing on a SageMaker real-time inference endpoint.

Specify PrefixLength and ConcurrencyThreshold to control routing behavior.

See also: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-endpointconfig-prefixawareroutingconfig.html

Example

// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const prefixAwareRoutingConfigProperty: sagemaker.CfnEndpointConfig.PrefixAwareRoutingConfigProperty = {
  concurrencyThreshold: 123,
  prefixLength: 123,
};

Properties

Name	Type	Description
concurrencyThreshold?	number	The maximum number of in-flight requests on the target instance before the endpoint routes to another instance.
prefixLength?	number	The maximum length of the prefix used for routing decisions.

---

concurrencyThreshold?

Type: number (optional)

The maximum number of in-flight requests on the target instance before the endpoint routes to another instance.

Required when RoutingStrategy is PREFIX_AWARE. Valid values are 1 to 1024.

See also: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-endpointconfig-prefixawareroutingconfig.html#cfn-sagemaker-endpointconfig-prefixawareroutingconfig-concurrencythreshold

---

prefixLength?

Type: number (optional)

The maximum length of the prefix used for routing decisions.

Required when RoutingStrategy is PREFIX_AWARE. Valid values are 1024 to 65536.

See also: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-endpointconfig-prefixawareroutingconfig.html#cfn-sagemaker-endpointconfig-prefixawareroutingconfig-prefixlength