aws-cdk-lib.aws_sqs module

Language	Package
.NET	Amazon.CDK.AWS.SQS
Go	github.com/aws/aws-cdk-go/awscdk/v2/awssqs
Java	software.amazon.awscdk.services.sqs
Python	aws_cdk.aws_sqs
TypeScript	aws-cdk-lib » aws_sqs

Amazon Simple Queue Service Construct Library

Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. SQS eliminates the complexity and overhead associated with managing and operating message oriented middleware, and empowers developers to focus on differentiating work. Using SQS, you can send, store, and receive messages between software components at any volume, without losing messages or requiring other services to be available.

Installation

Import to your project:

import * as sqs from 'aws-cdk-lib/aws-sqs';

Example not in your language?

Basic usage

Here's how to add a basic queue to your application:

new sqs.Queue(this, 'Queue');

Example not in your language?

Encryption

By default queues are encrypted using SSE-SQS. If you want to change the encryption mode, set the encryption property. The following encryption modes are supported:

• KMS key that SQS manages for you
• KMS key that you can managed yourself
• Server-side encryption managed by SQS (SSE-SQS)
• Unencrypted

To learn more about SSE-SQS on Amazon SQS, please visit the Amazon SQS documentation.

// Use managed key
new sqs.Queue(this, 'Queue', {
  encryption: sqs.QueueEncryption.KMS_MANAGED,
});

// Use custom key
const myKey = new kms.Key(this, 'Key');

new sqs.Queue(this, 'Queue', {
  encryption: sqs.QueueEncryption.KMS,
  encryptionMasterKey: myKey,
});

// Use SQS managed server side encryption (SSE-SQS)
new sqs.Queue(this, 'Queue', {
  encryption: sqs.QueueEncryption.SQS_MANAGED,
});

// Unencrypted queue
new sqs.Queue(this, 'Queue', {
  encryption: sqs.QueueEncryption.UNENCRYPTED,
});

Example not in your language?

Encryption in transit

If you want to enforce encryption of data in transit, set the enforceSSL property to true. A resource policy statement that allows only encrypted connections over HTTPS (TLS) will be added to the queue.

new sqs.Queue(this, 'Queue', {
  enforceSSL: true,
});

Example not in your language?

First-In-First-Out (FIFO) queues

FIFO queues give guarantees on the order in which messages are dequeued, and have additional features in order to help guarantee exactly-once processing. For more information, see the SQS manual. Note that FIFO queues are not available in all AWS regions.

A queue can be made a FIFO queue by either setting fifo: true, giving it a name which ends in ".fifo", or by enabling a FIFO specific feature such as: content-based deduplication, deduplication scope or fifo throughput limit.

Dead letter source queues permission

You can configure the permission settings for queues that can designate the created queue as their dead-letter queue using the redriveAllowPolicy attribute.

By default, all queues within the same account and region are permitted as source queues.

declare const sourceQueue: sqs.IQueue;

// Only the sourceQueue can specify this queue as the dead-letter queue.
const queue1 = new sqs.Queue(this, 'Queue2', {
  redriveAllowPolicy: {
    sourceQueues: [sourceQueue],
  }
});

// No source queues can specify this queue as the dead-letter queue.
const queue2 = new sqs.Queue(this, 'Queue', {
  redriveAllowPolicy: {
    redrivePermission: sqs.RedrivePermission.DENY_ALL,
  }
});

Example not in your language?

Monitoring

SQS metrics are available as metric* methods on a queue; metric() returns any metric by name:

const queue = new sqs.Queue(this, 'Queue');

queue.metricApproximateAgeOfOldestMessage().createAlarm(this, 'MessagesTooOld', {
  threshold: Duration.minutes(15).toSeconds(),
  evaluationPeriods: 3,
});

Example not in your language?

metricApproximateNumberOfMessagesOutstanding() returns ApproximateNumberOfMessagesVisible + ApproximateNumberOfMessagesNotVisible as a metric math expression: messages waiting to be picked up, plus messages received but not yet deleted.

Autoscaling consumers on queue depth

Scaling a worker fleet on queue depth needs a different metric in each direction:

• Scale out on ApproximateNumberOfMessagesVisible — work nobody has started yet. An in-flight message is already owned by a consumer, so adding capacity for it produces an idle consumer.
• Scale in on metricApproximateNumberOfMessagesOutstanding() — everything still owed. Receiving a message moves it from Visible to NotVisible, so a policy watching Visible alone cannot tell a consumer that just picked up work from one that finished it, and can terminate a consumer mid-message. The message reappears only after its visibility timeout, so the longer consumers hold messages, the longer that work stalls.

That means two one-sided policies; the change: 0 step keeps each from acting in the other direction:

declare const service: ecs.FargateService;
const queue = new sqs.Queue(this, 'Queue');

const taskCount = service.autoScaleTaskCount({ minCapacity: 1, maxCapacity: 10 });

taskCount.scaleOnMetric('ScaleOutOnWaitingWork', {
  metric: queue.metricApproximateNumberOfMessagesVisible({ period: Duration.minutes(1) }),
  scalingSteps: [
    { upper: 30, change: 0 },
    { lower: 30, change: +1 },
  ],
  adjustmentType: appscaling.AdjustmentType.CHANGE_IN_CAPACITY,
});

// Remove a task only when nothing is outstanding, so it cannot be holding a message.
taskCount.scaleOnMetric('ScaleInOnOutstandingWork', {
  metric: queue.metricApproximateNumberOfMessagesOutstanding({ period: Duration.minutes(1) }),
  scalingSteps: [
    { upper: 0, change: -1 },
    { lower: 0, change: 0 },
  ],
  adjustmentType: appscaling.AdjustmentType.CHANGE_IN_CAPACITY,
});

Example not in your language?

Caveats:

• Target tracking rejects this metric. It accepts only direct metrics, so scaleToTrackCustomMetric() throws Only direct metrics are supported for Target Tracking (aws-cdk#20659).
• ApproximateNumberOfMessagesNotVisible can briefly report non-zero on an empty queue if an SQS storage server is unavailable. Evaluate several consecutive datapoints, especially when scaling in to zero.
• Neither term counts delayed messages. Add metricApproximateNumberOfMessagesDelayed() if you use delay queues or DelaySeconds.