SNS and SQS integration pattern (fan-out) in AWS - Mini Project: Build & Apply

SNS and SQS Integration Pattern (Fan-Out)

📖 Scenario: You are building a notification system where one message sent to a topic needs to be delivered to multiple queues for different processing tasks.This is a common pattern called fan-out, where a single message is copied and sent to multiple destinations.

🎯 Goal: Create an AWS CloudFormation template that sets up an SNS topic and two SQS queues. Then subscribe both queues to the SNS topic to enable fan-out messaging.

📋 What You'll Learn

Create an SNS topic named MyTopic

Create two SQS queues named QueueA and QueueB

Subscribe both QueueA and QueueB to MyTopic

Ensure the subscriptions use the correct protocol and reference the queue ARNs

💡 Why This Matters

🌍 Real World

Fan-out messaging is used in systems where one event triggers multiple independent processing tasks, such as sending notifications, updating databases, and logging.

💼 Career

Understanding SNS and SQS integration is essential for cloud architects and developers building scalable, decoupled event-driven systems on AWS.

1

Create the SNS topic

Create an SNS topic resource named MyTopic in the CloudFormation template.

AWS

# Define the SNS topic resource
# Your code here

Need a hint?

Use AWS::SNS::Topic as the resource type and set TopicName to MyTopic.

2

Create two SQS queues

Add two SQS queue resources named QueueA and QueueB to the CloudFormation template.

AWS

Resources:
  MyTopic:
    Type: AWS::SNS::Topic
    Properties:
      TopicName: MyTopic
# Add SQS queue resources named QueueA and QueueB below
# Your code here

Need a hint?

Use AWS::SQS::Queue as the resource type and set QueueName to QueueA and QueueB respectively.

3

Subscribe QueueA to the SNS topic

Add a subscription resource named SubscriptionA that subscribes QueueA to MyTopic using the sqs protocol and the ARN of QueueA.

AWS

Resources:
  MyTopic:
    Type: AWS::SNS::Topic
    Properties:
      TopicName: MyTopic
  QueueA:
    Type: AWS::SQS::Queue
    Properties:
      QueueName: QueueA
  QueueB:
    Type: AWS::SQS::Queue
    Properties:
      QueueName: QueueB
# Add a subscription resource named SubscriptionA to subscribe QueueA to MyTopic
# Your code here

Need a hint?

Use AWS::SNS::Subscription and set TopicArn to !Ref MyTopic, Protocol to sqs, and Endpoint to !GetAtt QueueA.Arn.

4

Subscribe QueueB to the SNS topic

Add a subscription resource named SubscriptionB that subscribes QueueB to MyTopic using the sqs protocol and the ARN of QueueB.

AWS

Resources:
  MyTopic:
    Type: AWS::SNS::Topic
    Properties:
      TopicName: MyTopic
  QueueA:
    Type: AWS::SQS::Queue
    Properties:
      QueueName: QueueA
  QueueB:
    Type: AWS::SQS::Queue
    Properties:
      QueueName: QueueB
  SubscriptionA:
    Type: AWS::SNS::Subscription
    Properties:
      TopicArn: !Ref MyTopic
      Protocol: sqs
      Endpoint: !GetAtt QueueA.Arn
# Add a subscription resource named SubscriptionB to subscribe QueueB to MyTopic
# Your code here

Need a hint?

Use AWS::SNS::Subscription and set TopicArn to !Ref MyTopic, Protocol to sqs, and Endpoint to !GetAtt QueueB.Arn.