Provision additional throughput for your agent's model
To increase the rate and number of tokens that the agent can process during model inference, associate a Provisioned Throughput that you've purchased for the model that your agent is using. To learn more about Provisioned Throughput and how to purchase it, see Increase model invocation capacity with Provisioned Throughput in Amazon Bedrock.
You can associate a Provisioned Throughput when you create or update an agent alias. In the Amazon Bedrock console, you choose the Provisioned Throughput when setting up the alias or editing it. In the Amazon Bedrock API, you specify the provisionedThroughput
in the routingConfiguration
when you send a CreateAgentAlias or UpdateAgentAlias; request.