Amazon FSx (Windows) is a fully managed, cloud based file server system that offers shared storage capabilities. If you're an Amazon FSx (Windows) user, you can use Amazon Kendra to index your Amazon FSx (Windows) data source.
Note
Amazon Kendra now supports an upgraded Amazon FSx (Windows) connector.
The console has been automatically upgraded for you. Any new connectors you create on
the console will use the upgraded architecture. If you use the API, you must now use the
TemplateConfiguration object instead of the
FSxConfiguration
object to configure your connector.
Connectors configured using the older console and API architecture will continue to function as configured. However, you won’t be able to edit or update them. If you want to edit or update your connector configuration, you must create a new connector.
We recommended migrating your connector workflow to the upgraded version. Support for connectors configured using the older architecture is scheduled to end by June 2024.
You can connect Amazon Kendra to your Amazon FSx (Windows) data source using the Amazon Kendra console
For troubleshooting your Amazon Kendra Amazon FSx (Windows) data source connector, see Troubleshooting data sources.
Supported features
Amazon Kendra Amazon FSx (Windows) data source connector supports the following features:
-
Field mappings
-
User access control
-
User identity crawling
-
Inclusion and exclusion filters
-
Full and incremental content syncs
-
Virtual private cloud (VPC)
Prerequisites
Before you can use Amazon Kendra to index your Amazon FSx (Windows) data source, check the details of your Amazon FSx (Windows) and AWS accounts.
For Amazon FSx (Windows), make sure you have:
-
Set up Amazon FSx (Windows) with read and mounting permissions.
-
Noted your file system ID. You can find your file system ID on the File Systems dashboard in the Amazon FSx (Windows) console.
-
Configured a virtual private cloud using Amazon VPC where your Amazon FSx (Windows) file system resides.
-
Noted your Amazon FSx (Windows) authentication credentials for an Active Directory user account. This includes your Active Directory user name with your DNS domain name (for example, user@corp.example.com) and password.
Note
Use only the necessary credentials required for the connector to function. Do not use privileged credentials like domain admin.
Note
We recommend that you regularly refresh or rotate your credentials and secret. Provide only the necessary access level for your own security. We do not recommend that you re-use credentials and secrets across data sources, and connector versions 1.0 and 2.0 (where applicable).
-
Checked each document is unique in Amazon FSx (Windows) and across other data sources you plan to use for the same index. Each data source that you want to use for an index must not contain the same document across the data sources. Document IDs are global to an index and must be unique per index.
In your AWS account, make sure you have:
-
Created an Amazon Kendra index and, if using the API, noted the index ID.
-
Created an IAM role for your data source and, if using the API, noted the ARN of the IAM role.
Note
If you change your authentication type and credentials, you must update your IAM role to access the correct AWS Secrets Manager secret ID.
-
Stored your Amazon FSx (Windows) authentication credentials in an AWS Secrets Manager secret and, if using the API, noted the ARN of the secret.
Note
We recommend that you regularly refresh or rotate your credentials and secret. Provide only the necessary access level for your own security. We do not recommend that you re-use credentials and secrets across data sources, and connector versions 1.0 and 2.0 (where applicable).
If you don’t have an existing IAM role or secret, you can use the console to create a new IAM role and Secrets Manager secret when you connect your Amazon FSx (Windows) data source to Amazon Kendra. If you are using the API, you must provide the ARN of an existing IAM role and Secrets Manager secret, and an index ID.
Connection instructions
To connect Amazon Kendra to your Amazon FSx (Windows) data source, you must provide the necessary details of your Amazon FSx (Windows) data source so that Amazon Kendra can access your data. If you have not yet configured Amazon FSx (Windows) for Amazon Kendra, see Prerequisites.
To connect Amazon Kendra to your Amazon FSx (Windows) file system
-
Sign in to the AWS Management Console and open the Amazon Kendra console
. -
From the left navigation pane, choose Indexes and then choose the index you want to use from the list of indexes.
Note
You can choose to configure or edit your User access control settings under Index settings.
-
On the Getting started page, choose Add data source.
-
On the Add data source page, choose Amazon FSx (Windows) connector, and then choose Add connector. If using version 2 (if applicable), choose Amazon FSx (Windows) connector with the "V2.0" tag.
-
On the Specify data source details page, enter the following information:
-
In Name and description, for Data source name—Enter a name for your data source. You can include hyphens but not spaces.
-
(Optional) Description—Enter an optional description for your data source.
-
In Default language—Choose a language to filter your documents for the index. Unless you specify otherwise, the language defaults to English. Language specified in the document metadata overrides the selected language.
-
In Tags, for Add new tag—Include optional tags to search and filter your resources or track your AWS costs.
-
Choose Next.
-
-
On the Define access and security page, enter the following information:
-
Amazon FSx (Windows) file system ID—Select from the dropdown your existing file system ID, fetched from Amazon FSx (Windows). Or, create an Amazon FSx (Windows) file system
. You can find your file system ID on the File Systems dashboard in the Amazon FSx (Windows) console. -
Authorization—Turn on or off access control list (ACL) information for your documents, if you have an ACL and want to use it for access control. The ACL specifies which documents that users and groups can access. The ACL information is used to filter search results based on the user or their group access to documents. For more information, see User context filtering.
-
Authentication—Choose an existing AWS Secrets Manager secret, or create a new secret to store your file system credentials. If you choose to create a new secret, an AWS Secrets Manager secret window opens.
Provide a secret that stores your authentication credentials of your user name and password. The user name must include your DNS domain name. For example, user@corp.example.com.
Save and add your secret.
-
Virtual Private Cloud (VPC)—You must select an Amazon VPC where your Amazon FSx (Windows) resides. You include the VPC subnet and security groups. See Configuring an Amazon VPC.
-
IAM role—Choose an existing IAM role or create a new IAM role to access your repository credentials and index content.
Note
IAM roles used for indexes cannot be used for data sources. If you are unsure if an existing role is used for an index or FAQ, choose Create a new role to avoid errors.
-
Choose Next.
-
-
On the Configure sync settings page, enter the following information:
-
Sync scope, Regex patterns—Add regular expression patterns to include or exclude certain files.
-
Sync mode—Choose how you want to update your index when your data source content changes. When you sync your data source with Amazon Kendra for the first time, all content is crawled and indexed by default. You must run a full sync of your data if your initial sync failed, even if you don't choose full sync as your sync mode option.
-
Full sync: Freshly index all content, replacing existing content each time your data source syncs with your index.
-
New, modified, deleted sync: Index only new, modified, and deleted content each time your data source syncs with your index. Amazon Kendra can use your data source's mechanism for tracking content changes and index content that changed since the last sync.
-
-
Sync run schedule—For Frequency, choose how often to sync your data source content and update your index.
-
Choose Next.
-
-
On the Set field mappings page, enter the following information:
-
Select from the Amazon Kendra generated default fields of your files that you want to map to your index. To add custom data source fields, create an index field name to map to and the field data type.
-
Choose Next.
-
-
On the Review and create page, check that the information you have entered is correct and then select Add data source. You can also choose to edit your information from this page. Your data source will appear on the Data sources page after the data source has been added successfully.
Learn more
To learn more about integrating Amazon Kendra with your Amazon FSx (Windows) data source, see: