Cross-region processing in Amazon Q Developer
The following sections describe how cross-region inference and cross-region calls are used to provide the Amazon Q Developer service.
Cross-region inference
Amazon Q Developer is powered by Amazon Bedrock, and uses cross-region inference to distribute traffic across different AWS Regions to enhance large language model (LLM) inference performance and reliability. With cross-region inference, you get:
-
Increased throughput and resilience during high demand periods
-
Improved performance
-
Access to newly launched Amazon Q Developer capabilities and features that rely on the most powerful LLMs hosted on Amazon Bedrock
Today, regardless of where you use Amazon Q Developer, your data is processed in a US Region unless you're using Amazon Q generative SQL outside the US regions. With cross-region inferencing, your requests to Amazon Q Developer may be processed in any of our US regions (currently US East (N. Virginia) Region, the US West (Oregon) Region, or the US East (Ohio) Region), even if you're using Amazon Q Developer in a different AWS Region. For information on where data is stored during processing, see Data protection. For information on where you can use Amazon Q Developer, see Supported Regions for Amazon Q Developer. There's no additional cost for using cross-region inference.
If you use Amazon Q generative SQL outside the US regions, your data may be processed locally or across Regions to support cross-region inference, depending on your location. If you choose the Asia Pacific (Seoul) AWS Region, cross-region inference would be used for inference requests due to model availability.
Cross-region calls
Certain requests that you make to Amazon Q Developer may require cross-region calls. Cross-region calls are API calls made by Amazon Q from one AWS Region to another AWS Region. Amazon Q makes cross-region calls when your request requires it to retrieve information from a Region different from your current Region. For example, when you ask Amazon Q questions about your AWS resources that are located in different Regions, it will make a cross-region call to access your resources and retrieve the relevant data to respond to your question.
If you’d like to disable cross-region calls made by Amazon Q Developer, you can create a policy that prevents Amazon Q from making API calls on your behalf. By doing so, you won’t have access to features that require Amazon Q to make API calls on your behalf, even if Amazon Q is making calls within your current Region. For an IAM policy that prevents Amazon Q from making API calls on your behalf, including cross-region calls, see Deny Amazon Q permission to perform actions on your behalf.
