Use a prompt dataset for a knowledge base evaluation in Amazon Bedrock

You must provide a prompt dataset for a knowledge base evaluation job. The custom prompt datasets must be stored in Amazon S3, and use the JSON line format and use the .jsonl file extension. Each line must be a valid JSON object. There can be up to 1000 prompts in your dataset per evaluation job. The maximum number of turns per conversation is 5.

Use the sections below to learn more about key value pairs that are required based on the type of evaluation job you select.

For job created using the console you must update the Cross Origin Resource Sharing (CORS) configuration on the S3 bucket. To learn more about the required CORS permissions, see Required Cross Origin Resource Sharing (CORS) permissions on S3 buckets.