Skip to content
v2.274.0

AsyncInferenceConfigProperty Struct ​

Specifies configuration for how an endpoint performs asynchronous inference.

Example ​

ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const asyncInferenceConfigProperty: sagemaker.CfnEndpointConfig.AsyncInferenceConfigProperty = {
  outputConfig: {
    kmsKeyId: 'kmsKeyId',
    notificationConfig: {
      errorTopic: 'errorTopic',
      includeInferenceResponseIn: ['includeInferenceResponseIn'],
      successTopic: 'successTopic',
    },
    s3FailurePath: 's3FailurePath',
    s3OutputPath: 's3OutputPath',
  },

  // the properties below are optional
  clientConfig: {
    maxConcurrentInvocationsPerInstance: 123,
  },
};

Properties ​

clientConfigoptionalIResolvable | CfnEndpointConfig.AsyncInferenceClientConfigPropertyclient_configoptionaltyping.Union[IResolvable, AsyncInferenceClientConfigProperty]clientConfigoptionalIResolvableClientConfigoptionalIResolvableClientConfigoptionalinterface{}#
Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.
outputConfigIResolvable | CfnEndpointConfig.AsyncInferenceOutputConfigPropertyoutput_configtyping.Union[IResolvable, AsyncInferenceOutputConfigProperty]outputConfigIResolvableOutputConfigIResolvableOutputConfiginterface{}required#
Specifies the configuration for asynchronous inference invocation outputs.