InferenceConfig¶
Structure Class¶
InferenceConfig
dataclass
¶
The configuration for inference settings when generating responses using RetrieveAndGenerate.
Attributes¶
text_inference_config
class-attribute
instance-attribute
¶
text_inference_config: TextInferenceConfig | None = None
Configuration settings specific to text generation while generating responses using RetrieveAndGenerate.