interface PrefixAwareRoutingConfigProperty

Language	Type name
.NET	Amazon.CDK.CfnPropertyMixins.AWS.SageMaker.CfnEndpointConfigPropsMixin.PrefixAwareRoutingConfigProperty
Go	github.com/aws/aws-cdk-go/awscdkcfnpropertymixins/v2/awssagemaker#CfnEndpointConfigPropsMixin_PrefixAwareRoutingConfigProperty
Java	software.amazon.awscdk.cfnpropertymixins.services.sagemaker.CfnEndpointConfigPropsMixin.PrefixAwareRoutingConfigProperty
Python	aws_cdk.cfn_property_mixins.aws_sagemaker.CfnEndpointConfigPropsMixin.PrefixAwareRoutingConfigProperty
TypeScript	@aws-cdk/cfn-property-mixins » aws_sagemaker » CfnEndpointConfigPropsMixin » PrefixAwareRoutingConfigProperty

The configuration for prefix-aware routing on a SageMaker real-time inference endpoint.

Specify PrefixLength and ConcurrencyThreshold to control routing behavior.

See also: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-endpointconfig-prefixawareroutingconfig.html

Example

// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from '@aws-cdk/cfn-property-mixins';
const prefixAwareRoutingConfigProperty: sagemaker.CfnEndpointConfigPropsMixin.PrefixAwareRoutingConfigProperty = {
  concurrencyThreshold: 123,
  prefixLength: 123,
};

Properties

Name	Type	Description
concurrencyThreshold?	number	The maximum number of in-flight requests on the target instance before the endpoint routes to another instance.
prefixLength?	number	The maximum length of the prefix used for routing decisions.

---

concurrencyThreshold?

Type: number (optional)

The maximum number of in-flight requests on the target instance before the endpoint routes to another instance.

Required when RoutingStrategy is PREFIX_AWARE. Valid values are 1 to 1024.

See also: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-endpointconfig-prefixawareroutingconfig.html#cfn-sagemaker-endpointconfig-prefixawareroutingconfig-concurrencythreshold

---

prefixLength?

Type: number (optional)

The maximum length of the prefix used for routing decisions.

Required when RoutingStrategy is PREFIX_AWARE. Valid values are 1024 to 65536.

See also: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-endpointconfig-prefixawareroutingconfig.html#cfn-sagemaker-endpointconfig-prefixawareroutingconfig-prefixlength