Select your cookie preferences

We use essential cookies and similar tools that are necessary to provide our site and services. We use performance cookies to collect anonymous statistics, so we can understand how customers use our site and make improvements. Essential cookies cannot be deactivated, but you can choose “Customize” or “Decline” to decline performance cookies.

If you agree, AWS and approved third parties will also use cookies to provide useful site features, remember your preferences, and display relevant content, including relevant advertising. To accept or decline all non-essential cookies, choose “Accept” or “Decline.” To make more detailed choices, choose “Customize.”

Preferences
Contact Us
Feedback
AWS Documentation
Create an AWS Account

Use a reranker model in Amazon Bedrock

PDF
RSS
Focus mode
Use a reranker model in Amazon Bedrock - Amazon Bedrock

You can use a reranker model directly or while retrieving results during knowledge base query. Choose the tab for your preferred method, and then follow the steps:

Console

You can't use a reranker model directly in the AWS Management Console, but you can use a reranker model when querying your knowledge base by doing the following:

  1. When you query a knowledge base, open up the Configurations pane by choosing the icon.

  2. Expand the Reranking section.

  3. Choose Select model and select a reranker model.

  4. If your Amazon Bedrock Knowledge Bases service role is missing permissions to use the reranker model, select Update service role to modify the role with the proper permissions.

  5. (Optional) In the Additional Reranking options section, modify any options that you need to.

  6. Enter a prompt and select Run. The response is the result after applying the reranker model.

For more detailed instructions about carrying out knowledge base query, see Query a knowledge base and retrieve data and Query a knowledge base and generate responses based off the retrieved data.

API

For instructions on using a reranker model during knowledge base query, see Query a knowledge base and retrieve data and Query a knowledge base and generate responses based off the retrieved data.

To use a reranker model directly with the Amazon Bedrock API, send a Rerank request with an Agents for Amazon Bedrock runtime endpoint.

The following fields are required:

Field Basic description
queries An array of one RerankQuery object. Specify TEXT as the type and include the query in the textQuery field.
sources An array of RerankSource objects to submit to the reranking model. For each RerankSource, specify INLINE as the type and include a RerankDocument object in the inlineDocumentSource field. See below for details about RerankDocument.
rerankingConfiguration Includes the Amazon Resource Name (ARN) of the reranking model to use, and the number of results to return after reranking, and, optionally, inference configurations for the model. You specify additional model configurations as key-value pairs. For more information, see Rerank on the Cohere documentation website.

The following fields are optional:

Field Use case
nextToken A token returned in a previous response that you can include to provide the next batch of results.

The format of the RerankSource object that you include depends on the format of the document. To see the format for different RerankSource types, choose the tab that corresponds to the format of the document:

StringJSON object
String

If the document is a string, then specify the value of the type field of the RerankDocument object as TEXT and include the document in the text field. For example:

{
    "inlineDocumentSource": {
        "textDocument": {
            "text": "string"
        },
        "type": "TEXT"
    },
    "type": "INLINE"
}
JSON object

If the document is a JSON object, then specify the value of the type field in the RerankDocument object as JSON and include the document in the jsonDocument field. For example:

{
    "inlineDocumentSource": {
        "jsonDocument": JSON value,
        "type": "JSON"
    },
    "type": "INLINE"
}

The response to your Rerank request returns a list of RerankResult objects in the results field. Each object contains the following fields:

  • document – Includes information about the document that you submitted.

  • relevanceScore – A relevance score for the document, assigned by the reranking model.

  • index – Indicates the document's ranking relative to the other documents in the list. The lower the score, the higher the ranking.

If there are too many results to display, then the response returns a value in the nextToken field. In this case, to see the next batch of results, include that token in a subsequent request.

anchoranchor

You can't use a reranker model directly in the AWS Management Console, but you can use a reranker model when querying your knowledge base by doing the following:

  1. When you query a knowledge base, open up the Configurations pane by choosing the icon.

  2. Expand the Reranking section.

  3. Choose Select model and select a reranker model.

  4. If your Amazon Bedrock Knowledge Bases service role is missing permissions to use the reranker model, select Update service role to modify the role with the proper permissions.

  5. (Optional) In the Additional Reranking options section, modify any options that you need to.

  6. Enter a prompt and select Run. The response is the result after applying the reranker model.

For more detailed instructions about carrying out knowledge base query, see Query a knowledge base and retrieve data and Query a knowledge base and generate responses based off the retrieved data.

Related resources

Amazon Bedrock API Reference
AWS CLI commands for Amazon Bedrock
SDKs & Tools 

Related resources

Amazon Bedrock API Reference
AWS CLI commands for Amazon Bedrock
SDKs & Tools 
PrivacySite termsCookie preferences
© 2025, Amazon Web Services, Inc. or its affiliates. All rights reserved.