KnowledgeBaseOrchestrationConfiguration¶
Structure Class¶
dataclass
¶
Configures how the knowledge base orchestrates the retrieval and generation process, allowing for customization of prompts, inference parameters, and performance settings.
Attributes¶
class-attribute
instance-attribute
¶
additional_model_request_fields: dict[str, Document] | None = None
The additional model-specific request parameters as key-value pairs to be included in the request to the foundation model.
class-attribute
instance-attribute
¶
inference_config: PromptInferenceConfiguration | None = None
Contains inference configurations for the prompt.
class-attribute
instance-attribute
¶
performance_config: PerformanceConfiguration | None = None
The performance configuration options for the knowledge base retrieval and generation process.
class-attribute
instance-attribute
¶
prompt_template: KnowledgeBasePromptTemplate | None = None
A custom prompt template for orchestrating the retrieval and generation process.