Supported Regions and models for inference profiles
For a list of Region codes and endpoints supported in Amazon Bedrock, see Amazon Bedrock endpoints and quotas. This topic describes predefined inference profiles that you can use and the Regions and models that support application inference profiles.
Topics
Supported cross-region inference profiles
Cross region (system-defined) inference profiles are named after the model that they support and the area whose regions they support. You must call an inference profile from one of the regions it includes.
Note
Requests originating from us-east-2 can be routed to us-east-1 or us-west-2. However, requests originating in us-east-1 and us-west-2 won't be routed to us-east-2.
The following cross region inference profiles are available for use:
| Inference profile | Inference profile ID | Regions included |
|---|---|---|
| US Anthropic Claude 3 Haiku | us.anthropic.claude-3-haiku-20240307-v1:0 |
us-east-1 us-east-2 (see note) us-west-2 |
| US Anthropic Claude 3 Opus | us.anthropic.claude-3-opus-20240229-v1:0 |
us-east-1 us-east-2 (see note) us-west-2 |
| US Anthropic Claude 3 Sonnet | us.anthropic.claude-3-sonnet-20240229-v1:0 |
us-east-1 us-east-2 (see note) us-west-2 |
| US Anthropic Claude 3.5 Sonnet | us.anthropic.claude-3-5-sonnet-20240620-v1:0 |
us-east-1 us-east-2 (see note) us-west-2 |
| US Meta Llama 3.1 8B Instruct | us.meta.llama3-1-8b-instruct-v1:0 |
us-east-1 us-east-2 (see note) us-west-2 |
| US Meta Llama 3.1 70B Instruct | us.meta.llama3-1-70b-instruct-v1:0 |
us-east-1 us-east-2 (see note) us-west-2 |
| US Meta Llama 3.2 1B Instruct | us.meta.llama3-2-1b-instruct-v1:0 |
us-east-1 us-east-2 (see note) us-west-2 |
| US Meta Llama 3.2 3B Instruct | us.meta.llama3-2-3b-instruct-v1:0 |
us-east-1 us-east-2 (see note) us-west-2 |
| US Meta Llama 3.2 11B Instruct | us.meta.llama3-2-11b-instruct-v1:0 |
us-east-1 us-east-2 (see note) us-west-2 |
| US Meta Llama 3.2 90B Instruct | us.meta.llama3-2-90b-instruct-v1:0 |
us-east-1 us-east-2 (see note) us-west-2 |
| EU Anthropic Claude 3 Haiku | eu.anthropic.claude-3-haiku-20240307-v1:0 |
eu-central-1 eu-west-1 eu-west-3 |
| EU Anthropic Claude 3 Sonnet | eu.anthropic.claude-3-sonnet-20240229-v1:0 |
eu-central-1 eu-west-1 eu-west-3 |
| EU Anthropic Claude 3.5 Sonnet | eu.anthropic.claude-3-5-sonnet-20240620-v1:0 |
eu-central-1 eu-west-1 eu-west-3 |
| EU Meta Llama 3.2 1B Instruct | eu.meta.llama3-2-1b-instruct-v1:0 |
eu-central-1 eu-west-1 eu-west-3 |
| EU Meta Llama 3.2 3B Instruct | eu.meta.llama3-2-3b-instruct-v1:0 |
eu-central-1 eu-west-1 eu-west-3 |
| APAC Anthropic Claude 3 Haiku | apac.anthropic.claude-3-haiku-20240307-v1:0 |
ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 |
| APAC Anthropic Claude 3 Sonnet | apac.anthropic.claude-3-sonnet-20240229-v1:0 |
ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 |
| APAC Anthropic Claude 3.5 Sonnet | apac.anthropic.claude-3-5-sonnet-20240620-v1:0 |
ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 |
Supported Regions and models for application inference profiles
Application inference profiles can be created in the following Regions:
-
US East (N. Virginia)
-
US East (Ohio)
-
US West (Oregon)
-
Asia Pacific (Mumbai)
-
Asia Pacific (Singapore)
-
Asia Pacific (Sydney)
-
Asia Pacific (Tokyo)
-
Asia Pacific (Seoul)
-
Canada (Central)
-
Europe (Frankfurt)
-
Europe (Ireland)
-
Europe (London)
-
Europe (Paris)
-
South America (São Paulo)
Application inference profiles can be created from any of the cross region (system-defined) inference profiles or from any of the following foundation models in a region that supports it:
-
Amazon Titan Image Generator G1 V1
-
Amazon Titan Image Generator G1 V2
-
Amazon Titan Embeddings G1 - Text
-
Amazon Titan Text Embeddings V2
-
Anthropic Claude v2.1
-
Anthropic Claude 3 Haiku
-
Anthropic Claude 3 Opus
-
Anthropic Claude 3 Sonnet
-
Anthropic Claude 3.5 Sonnet
-
Meta Llama 3 8B Instruct
-
Meta Llama 3 70B Instruct
-
Meta Llama 3.2 1B Instruct
-
Meta Llama 3.2 3B Instruct
-
Meta Llama 3.2 11B Instruct
-
Meta Llama 3.2 90B Instruct
-
Mistral AI Mistral 7B Instruct
-
Mistral AI Mixtral 8X7B Instruct
-
Stability AI Stable Diffusion XL
