Bedrock Agentcore  >  Structures  >  HarnessLiteLlmModelConfig

HarnessLiteLlmModelConfig

Structure Class

HarnessLiteLlmModelConfig dataclass

Configuration for a LiteLLM model provider, enabling connection to third-party model providers.

Attributes

additional_params class-attribute instance-attribute

additional_params: Document | None = None

Provider-specific parameters passed through to the model provider unchanged.

api_base class-attribute instance-attribute

api_base: str | None = field(repr=False, default=None)

The base URL for the model provider's API endpoint.

api_key_arn class-attribute instance-attribute

api_key_arn: str | None = None

The ARN of the API key in AgentCore Identity for authenticating with the model provider.

max_tokens class-attribute instance-attribute

max_tokens: int | None = None

The maximum number of tokens to allow in the generated response per iteration.

model_id instance-attribute

model_id: str

The LiteLLM model identifier (e.g., "anthropic/claude-3-sonnet").

temperature class-attribute instance-attribute

temperature: float | None = None

The temperature to set when calling the model.

top_p class-attribute instance-attribute

top_p: float | None = None

The topP set when calling the model.