Skip to content

Bedrock Agent Runtime  >  Structures  >  GenerationConfiguration

GenerationConfiguration

Structure Class

GenerationConfiguration dataclass

Contains configurations for response generation based on the knowledge base query results.

This data type is used in the following API operations:

Attributes

additional_model_request_fields class-attribute instance-attribute 
additional_model_request_fields: dict[str, Document] | None = None

Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows users to provide custom model parameters specific to the language model being used.

guardrail_configuration class-attribute instance-attribute 
guardrail_configuration: GuardrailConfiguration | None = None

The configuration details for the guardrail.

inference_config class-attribute instance-attribute 
inference_config: InferenceConfig | None = None

Configuration settings for inference when using RetrieveAndGenerate to generate responses while using a knowledge base as a source.

performance_config class-attribute instance-attribute 
performance_config: PerformanceConfiguration | None = None

The latency configuration for the model.

prompt_template class-attribute instance-attribute 
prompt_template: PromptTemplate | None = None

Contains the template for the prompt that's sent to the model for response generation. Generation prompts must include the $search_results$ variable. For more information, see Use placeholder variables in the user guide.