You can use a cross region inference profile in place of a foundation model to route requests to multiple Regions. To track costs and usage for a model, in one or multiple Regions, you can use an application inference profile. To learn how to use an inference profile when running model inference, choose the tab for your preferred method, and then follow the steps:
In the console, the only inference profile you can use is the US Anthropic Claude 3 Opus inference profile in the US East (N. Virginia) region.
To use this inference profile, switch to the US East (N. Virginia) region. Do one of the following and select the Anthropic Claude 3 Opus model and Cross region inference as the Throughput when you reach the step to select a model:
-
To use the inference profile in the text generation playground, follow the steps at Generate responses in the console using playgrounds.
-
To use the inference profile in model evaluation, follow the console steps at Starting an automatic model evaluation job in Amazon Bedrock.
