Use a custom model - Amazon Bedrock

Use a custom model

Before you can use a customized model, you need to purchase Provisioned Throughput for it. For more information about Provisioned Throughput, see Increase model invocation capacity with Provisioned Throughput in Amazon Bedrock. You can then use the resulting provisioned model for inference. Choose the tab for your preferred method, and then follow the steps:

Console
To purchase Provisioned Throughput for a custom model.

  1. Sign in to the AWS Management Console using an IAM role with Amazon Bedrock permissions, and open the Amazon Bedrock console at https://console.aws.amazon.com/bedrock/.

  2. From the left navigation pane, choose Custom models under Foundation models.

  3. In the Models tab, choose the radio button next to the model for which you want to buy Provisioned Throughput or select the model name to navigate to the details page.

  4. Select Purchase Provisioned Throughput.

  5. For more details, follow the steps at Purchase a Provisioned Throughput for an Amazon Bedrock model.

  6. After purchasing Provisioned Throughput for your custom model, follow the steps at Use a Provisioned Throughput with an Amazon Bedrock resource.

When you carry out any operation that supports usage of custom models, you will see your custom model as an option in the model selection menu.

API

To purchase Provisioned Throughput for a custom model, follow the steps at Purchase a Provisioned Throughput for an Amazon Bedrock model to send a CreateProvisionedModelThroughput (see link for request and response formats and field details) request with a Amazon Bedrock control plane endpoint. Use the name or ARN of your custom model as the modelId. The response returns a provisionedModelArn that you can use as the modelId when making an InvokeModel or InvokeModelWithResponseStream request.

See code examples