Use a Provisioned Throughput with an Amazon Bedrock resource

After you purchase a Provisioned Throughput, you can use it with the following features to increase your throughput:

Model inference – You can test the Provisioned Throughput in a Amazon Bedrock console playground. When you're ready to deploy the Provisioned Throughput, set up your application to invoke the provisioned model. Choose the tab for your preferred method, and then follow the steps:
Console
To use a Provisioned Throughput in the Amazon Bedrock console playground

Sign in to the AWS Management Console using an IAM role with Amazon Bedrock permissions, and open the Amazon Bedrock console at https://console.aws.amazon.com/bedrock/.

From the left navigation pane, select Chat, Text, or Image under Playgrounds, depending your use case.

Choose Select model.

In the 1. Category column, select a provider or custom model category. Then, in the 2. Model column, select the model that your Provisioned Throughput is associated with.

In the 3. Throughput column, select your Provisioned Throughput.

Choose Apply.
To learn how to use the Amazon Bedrock playgrounds, see Generate responses in the console using playgrounds.
API

To run inference using a Provisioned Throughput, send an InvokeModel, InvokeModelWithResponseStream, Converse, or ConverseStream request with an Amazon Bedrock runtime endpoint. Specify the provisioned model ARN as the modelId parameter. To see requirements for the request body for different models, see Inference request parameters and response fields for foundation models.

See code examples
Associate a Provisioned Throughput with an agent alias – You can associate a Provisioned Throughput when you create or update an agent alias. In the Amazon Bedrock console, you choose the Provisioned Throughput when setting up the alias or editing it. In the Amazon Bedrock API, you specify the provisionedThroughput in the routingConfiguration when you send a CreateAgentAlias or UpdateAgentAlias; request.

Warning Javascript is disabled or is unavailable in your browser.

To use the Amazon Web Services Documentation, Javascript must be enabled. Please refer to your browser's Help pages for instructions.

Document Conventions

Modify a Provisioned Throughput

Delete a Provisioned Throughput

Use a Provisioned Throughput with an Amazon Bedrock resource

To use a Provisioned Throughput in the Amazon Bedrock console playground