Priority queues in RabbitMQ - Mini Project: Build & Apply

Using Priority Queues in RabbitMQ

📖 Scenario: You are managing a messaging system where some messages are more important than others. You want to make sure that high priority messages get processed first.RabbitMQ supports priority queues to handle this need.

🎯 Goal: Set up a RabbitMQ priority queue, publish messages with different priorities, and consume them to see that higher priority messages are received first.

📋 What You'll Learn

Create a priority queue named task_queue with a max priority of 10

Publish three messages with priorities 5, 10, and 1 respectively

Consume messages from the queue and print their body and priority

Verify that messages are received in order of priority (highest first)

💡 Why This Matters

🌍 Real World

Priority queues are used in real systems to ensure urgent tasks are handled before less important ones, such as in customer support ticketing or order processing.

💼 Career

Understanding how to configure and use priority queues in RabbitMQ is valuable for DevOps engineers managing messaging systems and ensuring efficient task processing.

1

Create a priority queue named task_queue

Write a RabbitMQ queue declaration command to create a queue named task_queue with the argument {'x-max-priority': 10} to enable priority support.

RabbitMQ

# Declare a priority queue named 'task_queue' with max priority 10
# Your code here

Hint

Use queue_declare with the arguments parameter to set x-max-priority.

2

Publish three messages with priorities 5, 10, and 1

Write three basic_publish commands to send messages with bodies 'Message 1', 'Message 2', and 'Message 3' to the task_queue. Set the priority property to 5, 10, and 1 respectively.

RabbitMQ

channel.queue_declare(queue='task_queue', arguments={'x-max-priority': 10})
# Publish 'Message 1' with priority 5
# Publish 'Message 2' with priority 10
# Publish 'Message 3' with priority 1
# Your code here

Hint

Use basic_publish with properties=pika.BasicProperties(priority=...) to set message priority.

3

Consume messages and print their body and priority

Write a consumer callback function named callback that takes ch, method, properties, body and prints the message body and its priority from properties.priority. Then start consuming from task_queue using channel.basic_consume with callback and auto_ack=True.

RabbitMQ

channel.queue_declare(queue='task_queue', arguments={'x-max-priority': 10})
channel.basic_publish(exchange='', routing_key='task_queue', body='Message 1', properties=pika.BasicProperties(priority=5))
channel.basic_publish(exchange='', routing_key='task_queue', body='Message 2', properties=pika.BasicProperties(priority=10))
channel.basic_publish(exchange='', routing_key='task_queue', body='Message 3', properties=pika.BasicProperties(priority=1))

# Define callback to print body and priority
# Start consuming from 'task_queue'
# Your code here

Hint

Define a callback function that prints the message and priority, then use basic_consume to start consuming.

4

Start consuming and observe message order

Write the command to start consuming messages from RabbitMQ using channel.start_consuming(). This will print messages in order of priority.

RabbitMQ

def callback(ch, method, properties, body):
    print(f"Received: {body.decode()} with priority {properties.priority}")

channel.queue_declare(queue='task_queue', arguments={'x-max-priority': 10})
channel.basic_publish(exchange='', routing_key='task_queue', body='Message 1', properties=pika.BasicProperties(priority=5))
channel.basic_publish(exchange='', routing_key='task_queue', body='Message 2', properties=pika.BasicProperties(priority=10))
channel.basic_publish(exchange='', routing_key='task_queue', body='Message 3', properties=pika.BasicProperties(priority=1))

channel.basic_consume(queue='task_queue', on_message_callback=callback, auto_ack=True)

# Start consuming messages
# Your code here

Hint

Use channel.start_consuming() to begin receiving messages.

Practice

1. What does setting x-max-priority on a RabbitMQ queue do?

easy

A. Enables message prioritization so higher priority messages are delivered first

B. Limits the maximum number of messages in the queue

C. Sets the maximum size of each message in bytes

D. Defines the maximum number of consumers allowed on the queue

Solution

1. Step 1: Understand the role of x-max-priority

   This argument enables priority support on the queue, allowing messages to be ordered by priority.

2. Step 2: Identify the effect on message delivery

   With priority enabled, messages with higher priority values are delivered before lower priority ones.

3. Final Answer:

   Enables message prioritization so higher priority messages are delivered first -> Option A

4. Quick Check:

   x-max-priority enables priority queues [OK]

Hint: Remember: x-max-priority sets priority support on queues [OK]

Common Mistakes:

• Confusing x-max-priority with message size limits
• Thinking it limits consumers instead of enabling priority
• Assuming it controls queue length

2. Which of the following is the correct way to declare a priority queue in RabbitMQ using the CLI rabbitmqadmin tool?

easy

A. rabbitmqadmin declare queue name=myqueue arguments={"x-max-priority":10}

B. rabbitmqadmin declare queue name=myqueue priority=10

C. rabbitmqadmin declare queue name=myqueue max-priority=10

D. rabbitmqadmin declare queue name=myqueue x-priority=10

Solution

1. Step 1: Recall the correct argument name for priority queues

   The argument to enable priority is x-max-priority, passed inside the arguments dictionary.

2. Step 2: Match the correct syntax for rabbitmqadmin

   The correct syntax uses arguments={"x-max-priority":10} to set max priority to 10.

3. Final Answer:

   rabbitmqadmin declare queue name=myqueue arguments={"x-max-priority":10} -> Option A

4. Quick Check:

   Use arguments={"x-max-priority":value} to declare priority queue [OK]

Hint: Use arguments with x-max-priority in JSON for priority queues [OK]

Common Mistakes:

• Using priority or max-priority instead of x-max-priority
• Not wrapping x-max-priority inside arguments dictionary
• Incorrect argument key names

3. Given a priority queue with x-max-priority set to 5, what will be the order of message delivery if messages are published with priorities 2, 5, 1, 3?

medium

A. 3, 2, 5, 1

B. 2, 5, 1, 3

C. 1, 2, 3, 5

D. 5, 3, 2, 1

Solution

1. Step 1: Understand priority delivery order

   Messages with higher priority values are delivered before lower priority ones.

2. Step 2: Sort the given priorities descending

   Given priorities: 2, 5, 1, 3. Sorted descending: 5, 3, 2, 1.

3. Final Answer:

   5, 3, 2, 1 -> Option D

4. Quick Check:

   Higher priority first means descending order [OK]

Hint: Higher priority number means earlier delivery [OK]

Common Mistakes:

• Assuming lower numbers have higher priority
• Delivering in order published ignoring priority
• Confusing ascending with descending order

4. You declared a queue with x-max-priority set to 10, but messages published with priority 15 are not prioritized. What is the likely cause?

medium

A. Priority must be set as a header, not a property

B. RabbitMQ does not support priorities above 10 by default

C. Priority values above x-max-priority are ignored or treated as max priority

D. You must set priority on the queue and the exchange separately

Solution

1. Step 1: Understand max priority limit effect

   Messages with priority higher than x-max-priority are capped at the max priority value.

2. Step 2: Identify why priority 15 is not prioritized

   Since max priority is 10, priority 15 is treated as 10, so no extra priority effect beyond max.

3. Final Answer:

   Priority values above x-max-priority are ignored or treated as max priority -> Option C

4. Quick Check:

   Priority capped at x-max-priority value [OK]

Hint: Priority above max is capped to max priority [OK]

Common Mistakes:

• Thinking RabbitMQ supports unlimited priority values
• Believing exchange needs priority setting
• Confusing property and header for priority

5. You want to create a RabbitMQ priority queue that supports priorities from 0 to 20. Which of the following is the correct approach to declare the queue and publish a message with priority 15?

hard

A. Declare queue with arguments={"x-max-priority":15} and publish message with priority=20

B. Declare queue with arguments={"x-max-priority":20} and publish message with priority=15

C. Declare queue with arguments={"x-max-priority":20} and publish message without priority property

D. Declare queue without arguments and publish message with priority=15

Solution

1. Step 1: Set max priority on queue to 20

   To support priorities up to 20, declare the queue with x-max-priority set to 20.

2. Step 2: Publish message with priority 15

   Publish the message with the priority property set to 15, which is within the allowed range.

3. Final Answer:

   Declare queue with arguments={"x-max-priority":20} and publish message with priority=15 -> Option B

4. Quick Check:

   Queue max priority must cover message priority [OK]

Hint: Queue max priority must be >= message priority [OK]

Common Mistakes:

• Setting max priority lower than message priority
• Not setting priority property on message
• Declaring queue without priority argument