Bedrock Agentcore Control  >  Unions  >  InferenceTargetConfiguration

InferenceTargetConfiguration

Union Type

InferenceTargetConfiguration module-attribute

InferenceTargetConfiguration = Union[InferenceTargetConfigurationConnector | InferenceTargetConfigurationProvider | InferenceTargetConfigurationUnknown]

The configuration for an inference target. An inference target routes requests to a large language model (LLM) provider, either through a built-in connector or an explicitly configured provider.

Union Member Types

InferenceTargetConfigurationConnector dataclass

The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.

Attributes

value instance-attribute

value: InferenceConnectorTargetConfiguration

InferenceTargetConfigurationProvider dataclass

The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.

Attributes

value instance-attribute

value: InferenceProviderTargetConfiguration

InferenceTargetConfigurationUnknown dataclass

Represents an unknown variant.

If you receive this value, you will need to update your library to receive the parsed value.

This value may not be deliberately sent.

Attributes

tag instance-attribute

tag: str