Class CfnInferenceExperiment
- All Implemented Interfaces:
IInspectable,ITaggable,IInferenceExperimentRef,software.amazon.jsii.JsiiSerializable,software.constructs.IConstruct,software.constructs.IDependable
Use this API to setup and schedule an experiment to compare model variants on a Amazon SageMaker inference endpoint. For more information about inference experiments, see Shadow tests .
Amazon SageMaker begins your experiment at the scheduled time and routes traffic to your endpoint's model variants based on your specified configuration.
While the experiment is in progress or after it has concluded, you can view metrics that compare your model variants. For more information, see View, monitor, and edit shadow tests .
Example:
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import software.amazon.awscdk.services.sagemaker.*;
CfnInferenceExperiment cfnInferenceExperiment = CfnInferenceExperiment.Builder.create(this, "MyCfnInferenceExperiment")
.endpointName("endpointName")
.modelVariants(List.of(ModelVariantConfigProperty.builder()
.infrastructureConfig(ModelInfrastructureConfigProperty.builder()
.infrastructureType("infrastructureType")
.realTimeInferenceConfig(RealTimeInferenceConfigProperty.builder()
.instanceCount(123)
.instanceType("instanceType")
.build())
.build())
.modelName("modelName")
.variantName("variantName")
.build()))
.name("name")
.roleArn("roleArn")
.type("type")
// the properties below are optional
.dataStorageConfig(DataStorageConfigProperty.builder()
.destination("destination")
// the properties below are optional
.contentType(CaptureContentTypeHeaderProperty.builder()
.csvContentTypes(List.of("csvContentTypes"))
.jsonContentTypes(List.of("jsonContentTypes"))
.build())
.kmsKey("kmsKey")
.build())
.description("description")
.desiredState("desiredState")
.kmsKey("kmsKey")
.schedule(InferenceExperimentScheduleProperty.builder()
.endTime("endTime")
.startTime("startTime")
.build())
.shadowModeConfig(ShadowModeConfigProperty.builder()
.shadowModelVariants(List.of(ShadowModelVariantConfigProperty.builder()
.samplingPercentage(123)
.shadowModelVariantName("shadowModelVariantName")
.build()))
.sourceModelVariantName("sourceModelVariantName")
.build())
.statusReason("statusReason")
.tags(List.of(CfnTag.builder()
.key("key")
.value("value")
.build()))
.build();
- See Also:
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic final classA fluent builder forCfnInferenceExperiment.static interfaceConfiguration specifying how to treat different headers.static interfaceThe Amazon S3 location and configuration for storing inference request and response data.static interfaceThe metadata of the endpoint.static interfaceThe start and end times of an inference experiment.static interfaceThe configuration for the infrastructure that the model will be deployed to.static interfaceContains information about the deployment options of a model.static interfaceThe infrastructure configuration for deploying the model to a real-time inference endpoint.static interfaceThe configuration ofShadowModeinference experiment type, which specifies a production variant to take all the inference requests, and a shadow variant to which Amazon SageMaker replicates a percentage of the inference requests.static interfaceThe name and sampling percentage of a shadow variant.Nested classes/interfaces inherited from class software.amazon.jsii.JsiiObject
software.amazon.jsii.JsiiObject.InitializationModeNested classes/interfaces inherited from interface software.constructs.IConstruct
software.constructs.IConstruct.Jsii$DefaultNested classes/interfaces inherited from interface software.amazon.awscdk.services.sagemaker.IInferenceExperimentRef
IInferenceExperimentRef.Jsii$Default, IInferenceExperimentRef.Jsii$ProxyNested classes/interfaces inherited from interface software.amazon.awscdk.IInspectable
IInspectable.Jsii$Default, IInspectable.Jsii$ProxyNested classes/interfaces inherited from interface software.amazon.awscdk.ITaggable
ITaggable.Jsii$Default, ITaggable.Jsii$Proxy -
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final StringThe CloudFormation resource type name for this resource class. -
Constructor Summary
ConstructorsModifierConstructorDescriptionprotectedCfnInferenceExperiment(software.amazon.jsii.JsiiObject.InitializationMode initializationMode) protectedCfnInferenceExperiment(software.amazon.jsii.JsiiObjectRef objRef) CfnInferenceExperiment(software.constructs.Construct scope, String id, CfnInferenceExperimentProps props) -
Method Summary
Modifier and TypeMethodDescriptionstatic IInferenceExperimentReffromInferenceExperimentArn(software.constructs.Construct scope, String id, String arn) Creates a new IInferenceExperimentRef from an ARN.static IInferenceExperimentReffromInferenceExperimentName(software.constructs.Construct scope, String id, String inferenceExperimentName) Creates a new IInferenceExperimentRef from a inferenceExperimentName.The ARN for your inference experiment.The timestamp at which the inference experiment was created.The metadata of the endpoint on which the inference experiment ran.The timestamp at which you last modified the inference experiment.The status of the inference experiment.The Amazon S3 location and configuration for storing inference request and response data.The description of the inference experiment.The desired state of the experiment after stopping.The name of the endpoint.A reference to a InferenceExperiment resource.The AWS Key Management Service key that Amazon SageMaker uses to encrypt captured data at rest using Amazon S3 server-side encryption.An array ofModelVariantConfigSummaryobjects.getName()The name of the inference experiment.The ARN of the IAM role that Amazon SageMaker can assume to access model artifacts and container images, and manage Amazon SageMaker Inference endpoints for model deployment.The duration for which the inference experiment ran or will run.The configuration ofShadowModeinference experiment type, which shows the production variant that takes all the inference requests, and the shadow variant to which Amazon SageMaker replicates a percentage of the inference requests.The error message for the inference experiment status result.getTags()Tag Manager which manages the tags for this resource.An array of key-value pairs to apply to this resource.getType()The type of the inference experiment.voidinspect(TreeInspector inspector) Examines the CloudFormation resource and discloses attributes.renderProperties(Map<String, Object> props) voidsetDataStorageConfig(IResolvable value) The Amazon S3 location and configuration for storing inference request and response data.voidThe Amazon S3 location and configuration for storing inference request and response data.voidsetDescription(String value) The description of the inference experiment.voidsetDesiredState(String value) The desired state of the experiment after stopping.voidsetEndpointName(String value) The name of the endpoint.voidThe AWS Key Management Service key that Amazon SageMaker uses to encrypt captured data at rest using Amazon S3 server-side encryption.voidsetModelVariants(List<Object> value) An array ofModelVariantConfigSummaryobjects.voidsetModelVariants(IResolvable value) An array ofModelVariantConfigSummaryobjects.voidThe name of the inference experiment.voidsetRoleArn(String value) The ARN of the IAM role that Amazon SageMaker can assume to access model artifacts and container images, and manage Amazon SageMaker Inference endpoints for model deployment.voidsetSchedule(IResolvable value) The duration for which the inference experiment ran or will run.voidThe duration for which the inference experiment ran or will run.voidsetShadowModeConfig(IResolvable value) The configuration ofShadowModeinference experiment type, which shows the production variant that takes all the inference requests, and the shadow variant to which Amazon SageMaker replicates a percentage of the inference requests.voidThe configuration ofShadowModeinference experiment type, which shows the production variant that takes all the inference requests, and the shadow variant to which Amazon SageMaker replicates a percentage of the inference requests.voidsetStatusReason(String value) The error message for the inference experiment status result.voidsetTagsRaw(List<CfnTag> value) An array of key-value pairs to apply to this resource.voidThe type of the inference experiment.Methods inherited from class software.amazon.awscdk.CfnResource
addDeletionOverride, addDependency, addDependsOn, addMetadata, addOverride, addPropertyDeletionOverride, addPropertyOverride, applyRemovalPolicy, applyRemovalPolicy, applyRemovalPolicy, getAtt, getAtt, getCfnOptions, getCfnResourceType, getMetadata, getUpdatedProperites, getUpdatedProperties, isCfnResource, obtainDependencies, obtainResourceDependencies, removeDependency, replaceDependency, shouldSynthesize, toString, validatePropertiesMethods inherited from class software.amazon.awscdk.CfnRefElement
getRefMethods inherited from class software.amazon.awscdk.CfnElement
getCreationStack, getLogicalId, getStack, isCfnElement, overrideLogicalIdMethods inherited from class software.constructs.Construct
getNode, isConstructMethods inherited from class software.amazon.jsii.JsiiObject
jsiiAsyncCall, jsiiAsyncCall, jsiiCall, jsiiCall, jsiiGet, jsiiGet, jsiiSet, jsiiStaticCall, jsiiStaticCall, jsiiStaticGet, jsiiStaticGet, jsiiStaticSet, jsiiStaticSetMethods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, waitMethods inherited from interface software.constructs.IConstruct
getNodeMethods inherited from interface software.amazon.jsii.JsiiSerializable
$jsii$toJson
-
Field Details
-
CFN_RESOURCE_TYPE_NAME
The CloudFormation resource type name for this resource class.
-
-
Constructor Details
-
CfnInferenceExperiment
protected CfnInferenceExperiment(software.amazon.jsii.JsiiObjectRef objRef) -
CfnInferenceExperiment
protected CfnInferenceExperiment(software.amazon.jsii.JsiiObject.InitializationMode initializationMode) -
CfnInferenceExperiment
@Stability(Stable) public CfnInferenceExperiment(@NotNull software.constructs.Construct scope, @NotNull String id, @NotNull CfnInferenceExperimentProps props) - Parameters:
scope- Scope in which this resource is defined. This parameter is required.id- Construct identifier for this resource (unique in its scope). This parameter is required.props- Resource properties. This parameter is required.
-
-
Method Details
-
fromInferenceExperimentArn
@Stability(Stable) @NotNull public static IInferenceExperimentRef fromInferenceExperimentArn(@NotNull software.constructs.Construct scope, @NotNull String id, @NotNull String arn) Creates a new IInferenceExperimentRef from an ARN.- Parameters:
scope- This parameter is required.id- This parameter is required.arn- This parameter is required.
-
fromInferenceExperimentName
@Stability(Stable) @NotNull public static IInferenceExperimentRef fromInferenceExperimentName(@NotNull software.constructs.Construct scope, @NotNull String id, @NotNull String inferenceExperimentName) Creates a new IInferenceExperimentRef from a inferenceExperimentName.- Parameters:
scope- This parameter is required.id- This parameter is required.inferenceExperimentName- This parameter is required.
-
inspect
Examines the CloudFormation resource and discloses attributes.- Specified by:
inspectin interfaceIInspectable- Parameters:
inspector- tree inspector to collect and process attributes. This parameter is required.
-
renderProperties
@Stability(Stable) @NotNull protected Map<String,Object> renderProperties(@NotNull Map<String, Object> props) - Overrides:
renderPropertiesin classCfnResource- Parameters:
props- This parameter is required.
-
getAttrArn
The ARN for your inference experiment. -
getAttrCreationTime
The timestamp at which the inference experiment was created. -
getAttrEndpointMetadata
The metadata of the endpoint on which the inference experiment ran. -
getAttrEndpointMetadataEndpointConfigName
-
getAttrEndpointMetadataEndpointName
-
getAttrEndpointMetadataEndpointStatus
-
getAttrLastModifiedTime
The timestamp at which you last modified the inference experiment. -
getAttrStatus
The status of the inference experiment. The following are the possible statuses for an inference experiment:.Creating- Amazon SageMaker is creating your experiment.Created- Amazon SageMaker has finished the creation of your experiment and will begin the experiment at the scheduled time.Updating- When you make changes to your experiment, your experiment shows as updating.Starting- Amazon SageMaker is beginning your experiment.Running- Your experiment is in progress.Stopping- Amazon SageMaker is stopping your experiment.Completed- Your experiment has completed.Cancelled- When you conclude your experiment early using the StopInferenceExperiment API, or if any operation fails with an unexpected error, it shows as cancelled.
-
getCfnProperties
- Overrides:
getCfnPropertiesin classCfnResource
-
getInferenceExperimentRef
A reference to a InferenceExperiment resource.- Specified by:
getInferenceExperimentRefin interfaceIInferenceExperimentRef
-
getTags
Tag Manager which manages the tags for this resource. -
getEndpointName
The name of the endpoint. -
setEndpointName
The name of the endpoint. -
getModelVariants
An array ofModelVariantConfigSummaryobjects.Returns union: either
IResolvableor Listinvalid input: '<'eitherIResolvableorCfnInferenceExperiment.ModelVariantConfigProperty> -
setModelVariants
An array ofModelVariantConfigSummaryobjects. -
setModelVariants
An array ofModelVariantConfigSummaryobjects. -
getName
The name of the inference experiment. -
setName
The name of the inference experiment. -
getRoleArn
The ARN of the IAM role that Amazon SageMaker can assume to access model artifacts and container images, and manage Amazon SageMaker Inference endpoints for model deployment. -
setRoleArn
The ARN of the IAM role that Amazon SageMaker can assume to access model artifacts and container images, and manage Amazon SageMaker Inference endpoints for model deployment. -
getType
The type of the inference experiment. -
setType
The type of the inference experiment. -
getDataStorageConfig
The Amazon S3 location and configuration for storing inference request and response data.Returns union: either
IResolvableorCfnInferenceExperiment.DataStorageConfigProperty -
setDataStorageConfig
The Amazon S3 location and configuration for storing inference request and response data. -
setDataStorageConfig
@Stability(Stable) public void setDataStorageConfig(@Nullable CfnInferenceExperiment.DataStorageConfigProperty value) The Amazon S3 location and configuration for storing inference request and response data. -
getDescription
The description of the inference experiment. -
setDescription
The description of the inference experiment. -
getDesiredState
The desired state of the experiment after stopping.The possible states are the following:.
-
setDesiredState
The desired state of the experiment after stopping.The possible states are the following:.
-
getKmsKey
The AWS Key Management Service key that Amazon SageMaker uses to encrypt captured data at rest using Amazon S3 server-side encryption. -
setKmsKey
The AWS Key Management Service key that Amazon SageMaker uses to encrypt captured data at rest using Amazon S3 server-side encryption. -
getSchedule
The duration for which the inference experiment ran or will run.Returns union: either
IResolvableorCfnInferenceExperiment.InferenceExperimentScheduleProperty -
setSchedule
The duration for which the inference experiment ran or will run. -
setSchedule
@Stability(Stable) public void setSchedule(@Nullable CfnInferenceExperiment.InferenceExperimentScheduleProperty value) The duration for which the inference experiment ran or will run. -
getShadowModeConfig
The configuration ofShadowModeinference experiment type, which shows the production variant that takes all the inference requests, and the shadow variant to which Amazon SageMaker replicates a percentage of the inference requests.Returns union: either
IResolvableorCfnInferenceExperiment.ShadowModeConfigProperty -
setShadowModeConfig
The configuration ofShadowModeinference experiment type, which shows the production variant that takes all the inference requests, and the shadow variant to which Amazon SageMaker replicates a percentage of the inference requests. -
setShadowModeConfig
@Stability(Stable) public void setShadowModeConfig(@Nullable CfnInferenceExperiment.ShadowModeConfigProperty value) The configuration ofShadowModeinference experiment type, which shows the production variant that takes all the inference requests, and the shadow variant to which Amazon SageMaker replicates a percentage of the inference requests. -
getStatusReason
The error message for the inference experiment status result. -
setStatusReason
The error message for the inference experiment status result. -
getTagsRaw
An array of key-value pairs to apply to this resource. -
setTagsRaw
An array of key-value pairs to apply to this resource.
-