Class EvaluatorConfig
- All Implemented Interfaces:
Serializable,SdkPojo,ToCopyableBuilder<EvaluatorConfig.Builder,EvaluatorConfig>
The configuration that defines how an evaluator assesses agent performance, including the evaluation method and parameters.
- See Also:
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic interfacestatic enum -
Method Summary
Modifier and TypeMethodDescriptionstatic EvaluatorConfig.Builderbuilder()final CodeBasedEvaluatorConfigConfiguration for a code-based evaluator that uses a customer-managed Lambda function to programmatically assess agent performance.final DerivedEvaluatorConfigderived()The configuration for an evaluator derived from an existing base evaluator (a built-in or third-party evaluator), run on your own model.final booleanfinal booleanequalsBySdkFields(Object obj) Indicates whether some other object is "equal to" this one by SDK fields.static EvaluatorConfigfromCodeBased(Consumer<CodeBasedEvaluatorConfig.Builder> codeBased) Create an instance of this class withcodeBased()initialized to the given value.static EvaluatorConfigfromCodeBased(CodeBasedEvaluatorConfig codeBased) Create an instance of this class withcodeBased()initialized to the given value.static EvaluatorConfigCreate an instance of this class withderived()initialized to the given value.static EvaluatorConfigfromDerived(DerivedEvaluatorConfig derived) Create an instance of this class withderived()initialized to the given value.static EvaluatorConfigfromLlmAsAJudge(Consumer<LlmAsAJudgeEvaluatorConfig.Builder> llmAsAJudge) Create an instance of this class withllmAsAJudge()initialized to the given value.static EvaluatorConfigfromLlmAsAJudge(LlmAsAJudgeEvaluatorConfig llmAsAJudge) Create an instance of this class withllmAsAJudge()initialized to the given value.final <T> Optional<T> getValueForField(String fieldName, Class<T> clazz) final inthashCode()The LLM-as-a-Judge configuration that uses a language model to evaluate agent performance based on custom instructions and rating scales.static Class<? extends EvaluatorConfig.Builder> Take this object and create a builder that contains all of the current property values of this object.final StringtoString()Returns a string representation of this object.type()Retrieve an enum value representing which member of this object is populated.Methods inherited from interface software.amazon.awssdk.utils.builder.ToCopyableBuilder
copy
-
Method Details
-
llmAsAJudge
The LLM-as-a-Judge configuration that uses a language model to evaluate agent performance based on custom instructions and rating scales.
- Returns:
- The LLM-as-a-Judge configuration that uses a language model to evaluate agent performance based on custom instructions and rating scales.
-
codeBased
Configuration for a code-based evaluator that uses a customer-managed Lambda function to programmatically assess agent performance.
- Returns:
- Configuration for a code-based evaluator that uses a customer-managed Lambda function to programmatically assess agent performance.
-
derived
The configuration for an evaluator derived from an existing base evaluator (a built-in or third-party evaluator), run on your own model. The base evaluator supplies the prompt and scoring.
- Returns:
- The configuration for an evaluator derived from an existing base evaluator (a built-in or third-party evaluator), run on your own model. The base evaluator supplies the prompt and scoring.
-
toBuilder
Description copied from interface:ToCopyableBuilderTake this object and create a builder that contains all of the current property values of this object.- Specified by:
toBuilderin interfaceToCopyableBuilder<EvaluatorConfig.Builder,EvaluatorConfig> - Returns:
- a builder for type T
-
builder
-
serializableBuilderClass
-
hashCode
-
equals
-
equalsBySdkFields
Description copied from interface:SdkPojoIndicates whether some other object is "equal to" this one by SDK fields. An SDK field is a modeled, non-inherited field in anSdkPojoclass, and is generated based on a service model.If an
SdkPojoclass does not have any inherited fields,equalsBySdkFieldsandequalsare essentially the same.- Specified by:
equalsBySdkFieldsin interfaceSdkPojo- Parameters:
obj- the object to be compared with- Returns:
- true if the other object equals to this object by sdk fields, false otherwise.
-
toString
-
getValueForField
-
fromLlmAsAJudge
Create an instance of this class withllmAsAJudge()initialized to the given value.The LLM-as-a-Judge configuration that uses a language model to evaluate agent performance based on custom instructions and rating scales.
- Parameters:
llmAsAJudge- The LLM-as-a-Judge configuration that uses a language model to evaluate agent performance based on custom instructions and rating scales.
-
fromLlmAsAJudge
public static EvaluatorConfig fromLlmAsAJudge(Consumer<LlmAsAJudgeEvaluatorConfig.Builder> llmAsAJudge) Create an instance of this class withllmAsAJudge()initialized to the given value.The LLM-as-a-Judge configuration that uses a language model to evaluate agent performance based on custom instructions and rating scales.
- Parameters:
llmAsAJudge- The LLM-as-a-Judge configuration that uses a language model to evaluate agent performance based on custom instructions and rating scales.
-
fromCodeBased
Create an instance of this class withcodeBased()initialized to the given value.Configuration for a code-based evaluator that uses a customer-managed Lambda function to programmatically assess agent performance.
- Parameters:
codeBased- Configuration for a code-based evaluator that uses a customer-managed Lambda function to programmatically assess agent performance.
-
fromCodeBased
Create an instance of this class withcodeBased()initialized to the given value.Configuration for a code-based evaluator that uses a customer-managed Lambda function to programmatically assess agent performance.
- Parameters:
codeBased- Configuration for a code-based evaluator that uses a customer-managed Lambda function to programmatically assess agent performance.
-
fromDerived
Create an instance of this class withderived()initialized to the given value.The configuration for an evaluator derived from an existing base evaluator (a built-in or third-party evaluator), run on your own model. The base evaluator supplies the prompt and scoring.
- Parameters:
derived- The configuration for an evaluator derived from an existing base evaluator (a built-in or third-party evaluator), run on your own model. The base evaluator supplies the prompt and scoring.
-
fromDerived
Create an instance of this class withderived()initialized to the given value.The configuration for an evaluator derived from an existing base evaluator (a built-in or third-party evaluator), run on your own model. The base evaluator supplies the prompt and scoring.
- Parameters:
derived- The configuration for an evaluator derived from an existing base evaluator (a built-in or third-party evaluator), run on your own model. The base evaluator supplies the prompt and scoring.
-
type
Retrieve an enum value representing which member of this object is populated. When this class is returned in a service response, this will beEvaluatorConfig.Type.UNKNOWN_TO_SDK_VERSIONif the service returned a member that is only known to a newer SDK version. When this class is created directly in your code, this will beEvaluatorConfig.Type.UNKNOWN_TO_SDK_VERSIONif zero members are set, andnullif more than one member is set. -
sdkFields
-
sdkFieldNameToField
- Specified by:
sdkFieldNameToFieldin interfaceSdkPojo- Returns:
- The mapping between the field name and its corresponding field.
-