ExternalSourcesGenerationConfiguration¶
Structure Class¶
ExternalSourcesGenerationConfiguration
dataclass
¶
Contains the generation configuration of the external source wrapper object.
Attributes¶
additional_model_request_fields
class-attribute
instance-attribute
¶
additional_model_request_fields: dict[str, Document] | None = None
Additional model parameters and their corresponding values not included in the textInferenceConfig structure for an external source. Takes in custom model parameters specific to the language model being used.
guardrail_configuration
class-attribute
instance-attribute
¶
guardrail_configuration: GuardrailConfiguration | None = None
The configuration details for the guardrail.
inference_config
class-attribute
instance-attribute
¶
inference_config: InferenceConfig | None = None
Configuration settings for inference when using RetrieveAndGenerate to generate responses while using an external source.
performance_config
class-attribute
instance-attribute
¶
performance_config: PerformanceConfiguration | None = None
The latency configuration for the model.
prompt_template
class-attribute
instance-attribute
¶
prompt_template: PromptTemplate | None = None
Contain the textPromptTemplate string for the external source wrapper object.