Package software.amazon.awscdk.services.bedrock

Interface CfnFlow.PromptModelInferenceConfigurationProperty

All Superinterfaces:

software.amazon.jsii.JsiiSerializable

All Known Implementing Classes:

CfnFlow.PromptModelInferenceConfigurationProperty.Jsii$Proxy

Enclosing class:

CfnFlow

@Stability(Stable)
public static interface CfnFlow.PromptModelInferenceConfigurationProperty
extends software.amazon.jsii.JsiiSerializable

Contains inference configurations related to model inference for a prompt.

For more information, see Inference parameters .

Example:

 // The code below shows an example of how to instantiate this type.
 // The values are placeholders you should change.
 import software.amazon.awscdk.services.bedrock.*;
 PromptModelInferenceConfigurationProperty promptModelInferenceConfigurationProperty = PromptModelInferenceConfigurationProperty.builder()
         .maxTokens(123)
         .stopSequences(List.of("stopSequences"))
         .temperature(123)
         .topK(123)
         .topP(123)
         .build();
 

See Also:

• http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-bedrock-flow-promptmodelinferenceconfiguration.html

Nested Class Summary

Nested Classes

Modifier and Type	Interface	Description
static final class	CfnFlow.PromptModelInferenceConfigurationProperty.Builder	A builder for CfnFlow.PromptModelInferenceConfigurationProperty
static final class	CfnFlow.PromptModelInferenceConfigurationProperty.Jsii$Proxy	An implementation for CfnFlow.PromptModelInferenceConfigurationProperty

Method Summary

Modifier and Type	Method	Description
static CfnFlow.PromptModelInferenceConfigurationProperty.Builder	builder()
default Number	getMaxTokens()	The maximum number of tokens to return in the response.
default List<String>	getStopSequences()	A list of strings that define sequences after which the model will stop generating.
default Number	getTemperature()	Controls the randomness of the response.
default Number	getTopK()	The number of most-likely candidates that the model considers for the next token during generation.
default Number	getTopP()	The percentage of most-likely candidates that the model considers for the next token.

Methods inherited from interface software.amazon.jsii.JsiiSerializable

$jsii$toJson

Method Details

getMaxTokens

@Stability(Stable)
@Nullable
default Number getMaxTokens()

The maximum number of tokens to return in the response.

See Also:

• http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-bedrock-flow-promptmodelinferenceconfiguration.html#cfn-bedrock-flow-promptmodelinferenceconfiguration-maxtokens

getStopSequences

@Stability(Stable)
@Nullable
default List<String> getStopSequences()

A list of strings that define sequences after which the model will stop generating.

See Also:

• http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-bedrock-flow-promptmodelinferenceconfiguration.html#cfn-bedrock-flow-promptmodelinferenceconfiguration-stopsequences

getTemperature

@Stability(Stable)
@Nullable
default Number getTemperature()

Controls the randomness of the response.

Choose a lower value for more predictable outputs and a higher value for more surprising outputs.

See Also:

• http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-bedrock-flow-promptmodelinferenceconfiguration.html#cfn-bedrock-flow-promptmodelinferenceconfiguration-temperature

getTopK

@Stability(Stable)
@Nullable
default Number getTopK()

The number of most-likely candidates that the model considers for the next token during generation.

See Also:

• http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-bedrock-flow-promptmodelinferenceconfiguration.html#cfn-bedrock-flow-promptmodelinferenceconfiguration-topk

getTopP

@Stability(Stable)
@Nullable
default Number getTopP()

The percentage of most-likely candidates that the model considers for the next token.

See Also:

• http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-bedrock-flow-promptmodelinferenceconfiguration.html#cfn-bedrock-flow-promptmodelinferenceconfiguration-topp

builder

@Stability(Stable)
static CfnFlow.PromptModelInferenceConfigurationProperty.Builder builder()

Returns:

a CfnFlow.PromptModelInferenceConfigurationProperty.Builder of CfnFlow.PromptModelInferenceConfigurationProperty