/AWS1/CL_BDK=>CREATEEVALUATIONJOB()¶
About CreateEvaluationJob¶
Creates an evaluation job.
Method Signature¶
IMPORTING¶
Required arguments:¶
IV_JOBNAME TYPE /AWS1/BDKEVALUATIONJOBNAME /AWS1/BDKEVALUATIONJOBNAME¶
A name for the evaluation job. Names must unique with your Amazon Web Services account, and your account's Amazon Web Services region.
IV_ROLEARN TYPE /AWS1/BDKROLEARN /AWS1/BDKROLEARN¶
The Amazon Resource Name (ARN) of an IAM service role that Amazon Bedrock can assume to perform tasks on your behalf. To learn more about the required permissions, see Required permissions for model evaluations.
IO_EVALUATIONCONFIG TYPE REF TO /AWS1/CL_BDKEVALUATIONCONFIG /AWS1/CL_BDKEVALUATIONCONFIG¶
Contains the configuration details of either an automated or human-based evaluation job.
IO_INFERENCECONFIG TYPE REF TO /AWS1/CL_BDKEVALINFERENCECFG /AWS1/CL_BDKEVALINFERENCECFG¶
Contains the configuration details of the inference model for the evaluation job.
For model evaluation jobs, automated jobs support a single model or inference profile, and jobs that use human workers support two models or inference profiles.
IO_OUTPUTDATACONFIG TYPE REF TO /AWS1/CL_BDKEVALOUTPUTDATACFG /AWS1/CL_BDKEVALOUTPUTDATACFG¶
Contains the configuration details of the Amazon S3 bucket for storing the results of the evaluation job.
Optional arguments:¶
IV_JOBDESCRIPTION TYPE /AWS1/BDKEVALUATIONJOBDESC /AWS1/BDKEVALUATIONJOBDESC¶
A description of the evaluation job.
IV_CLIENTREQUESTTOKEN TYPE /AWS1/BDKIDEMPOTENCYTOKEN /AWS1/BDKIDEMPOTENCYTOKEN¶
A unique, case-sensitive identifier to ensure that the API request completes no more than one time. If this token matches a previous request, Amazon Bedrock ignores the request, but does not return an error. For more information, see Ensuring idempotency.
IV_CUSTOMERENCRYPTIONKEYID TYPE /AWS1/BDKKMSKEYID /AWS1/BDKKMSKEYID¶
Specify your customer managed encryption key Amazon Resource Name (ARN) that will be used to encrypt your evaluation job.
IT_JOBTAGS TYPE /AWS1/CL_BDKTAG=>TT_TAGLIST TT_TAGLIST¶
Tags to attach to the model evaluation job.
IV_APPLICATIONTYPE TYPE /AWS1/BDKAPPLICATIONTYPE /AWS1/BDKAPPLICATIONTYPE¶
Specifies whether the evaluation job is for evaluating a model or evaluating a knowledge base (retrieval and response generation).