GenerationConfiguration¶
Structure Class¶
dataclass
¶
The configuration details for response generation based on retrieved text chunks.
Attributes¶
class-attribute
instance-attribute
¶
additional_model_request_fields: dict[str, Document] | None = None
Additional model parameters and corresponding values not included in the
textInferenceConfig structure for a knowledge base. This allows you to
provide custom model parameters specific to the language model being
used.
class-attribute
instance-attribute
¶
guardrail_configuration: GuardrailConfiguration | None = None
Contains configuration details for the guardrail.
class-attribute
instance-attribute
¶
kb_inference_config: KbInferenceConfig | None = None
Contains configuration details for inference for knowledge base retrieval and response generation.
class-attribute
instance-attribute
¶
prompt_template: PromptTemplate | None = None
Contains the template for the prompt that's sent to the model for response generation.