/AWS1/CL_BDK=>CREATEEVALUATIONJOB()
¶
About CreateEvaluationJob¶
API operation for creating and managing Amazon Bedrock automatic model evaluation jobs and model evaluation jobs that use human workers. To learn more about the requirements for creating a model evaluation job see, Model evaluation.
Method Signature¶
IMPORTING¶
Required arguments:¶
IV_JOBNAME
TYPE /AWS1/BDKEVALUATIONJOBNAME
/AWS1/BDKEVALUATIONJOBNAME
¶
The name of the model evaluation job. Model evaluation job names must unique with your AWS account, and your account's AWS region.
IV_ROLEARN
TYPE /AWS1/BDKROLEARN
/AWS1/BDKROLEARN
¶
The Amazon Resource Name (ARN) of an IAM service role that Amazon Bedrock can assume to perform tasks on your behalf. The service role must have Amazon Bedrock as the service principal, and provide access to any Amazon S3 buckets specified in the
EvaluationConfig
object. To pass this role to Amazon Bedrock, the caller of this API must have theiam:PassRole
permission. To learn more about the required permissions, see Required permissions.
IO_EVALUATIONCONFIG
TYPE REF TO /AWS1/CL_BDKEVALUATIONCONFIG
/AWS1/CL_BDKEVALUATIONCONFIG
¶
Specifies whether the model evaluation job is automatic or uses human worker.
IO_INFERENCECONFIG
TYPE REF TO /AWS1/CL_BDKEVALINFERENCECFG
/AWS1/CL_BDKEVALINFERENCECFG
¶
Specify the models you want to use in your model evaluation job. Automatic model evaluation jobs support a single model or inference profile, and model evaluation job that use human workers support two models or inference profiles.
IO_OUTPUTDATACONFIG
TYPE REF TO /AWS1/CL_BDKEVALOUTPUTDATACFG
/AWS1/CL_BDKEVALOUTPUTDATACFG
¶
An object that defines where the results of model evaluation job will be saved in Amazon S3.
Optional arguments:¶
IV_JOBDESCRIPTION
TYPE /AWS1/BDKEVALUATIONJOBDESC
/AWS1/BDKEVALUATIONJOBDESC
¶
A description of the model evaluation job.
IV_CLIENTREQUESTTOKEN
TYPE /AWS1/BDKIDEMPOTENCYTOKEN
/AWS1/BDKIDEMPOTENCYTOKEN
¶
A unique, case-sensitive identifier to ensure that the API request completes no more than one time. If this token matches a previous request, Amazon Bedrock ignores the request, but does not return an error. For more information, see Ensuring idempotency.
IV_CUSTOMERENCRYPTIONKEYID
TYPE /AWS1/BDKKMSKEYID
/AWS1/BDKKMSKEYID
¶
Specify your customer managed key ARN that will be used to encrypt your model evaluation job.
IT_JOBTAGS
TYPE /AWS1/CL_BDKTAG=>TT_TAGLIST
TT_TAGLIST
¶
Tags to attach to the model evaluation job.