Ingest changes directly into a knowledge base

Amazon Bedrock Knowledge Bases allows you to modify your data source and sync the changes in one step. You can take advantage of this feature if your knowledge base is connected to one of the following types of data sources:

With direct ingestion, you can directly add, update, or delete files in a knowledge base in a single action and your knowledge base can have access to documents without the need to sync. Direct ingestion uses the KnowledgeBaseDocuments API operations to index the documents that you submit directly into the vector store set up for the knowledge base. You can also view the documents in your knowledge base directly with these operations, rather than needing to navigate to the connected data source to view them.

Differences from syncing a data source

Amazon Bedrock Knowledge Bases also offers a set of IngestionJob API operations that relate to syncing your data source. When you sync your data source with a StartIngestionJob request, Amazon Bedrock Knowledge Bases scans each document in the connected data source and verifies whether it has already been indexed into the vector store set up for the knowledge base. If it hasn't, it becomes indexed into the vector store.

With an IngestKnowledgeBaseDocuments request, you submit an array of documents to be directly indexed into the vector store. Therefore, you skip the step of adding documents into the data source. See the following paragraphs to understand the use case for these two sets of API operations:

If you use a custom data source

You don't need to sync or use the IngestionJob operations. Documents that you add, modify, or delete with the KnowledgeBaseDocuments operations or in the AWS Management Console become part of both the custom data source and your knowledge base.

If you use an Amazon S3 data source

You use the two sets of operations in different use cases:

Select a topic to learn how to perform direct ingestion of the documents in your data sources: