Job priorities and queues in Ruby on Rails - Step-by-Step Execution

Concept Flow - Job priorities and queues

Job Created

↓

Assign Priority

↓

Place in Queue Based on Priority

↓

Worker Picks Job from Highest Priority Queue

↓

Job Executed

↓

Job Completed or Failed

↓

Repeat for Next Job

Jobs are created with priorities, placed in queues accordingly, and workers pick jobs from the highest priority queue first.

Execution Sample

Ruby on Rails

class MyJob < ApplicationJob
  queue_as :default
  def perform(*args)
    # job code here
  end
end

MyJob.set(queue: :high_priority).perform_later(*args)

This code creates a job assigned to a high priority queue and enqueues it for later execution.

Execution Table

Step	Action	Job Priority	Queue Placed	Worker Picks Job	Job Status
1	Job Created	default	default	No	Pending
2	Job Created with High Priority	high_priority	high_priority	No	Pending
3	Worker Checks Queues	-	-	Picks from high_priority	-
4	Worker Executes Job	high_priority	high_priority	Yes	Running
5	Job Completes Successfully	high_priority	high_priority	Yes	Completed
6	Worker Checks Queues Again	-	-	Picks from default if any	-
7	No More Jobs	-	-	No	Idle

💡 No more jobs in any queue, workers become idle

Variable Tracker

Variable	Start	After Step 1	After Step 2	After Step 4	After Step 5	Final
Job Priority	none	default	high_priority	high_priority	high_priority	none
Queue State	empty	default:1 job	default:1 job, high_priority:1 job	default:1 job, high_priority:0 jobs	default:1 job, high_priority:0 jobs	empty
Worker Status	idle	idle	idle	running job	idle	idle

Key Moments - 3 Insights

Why does the worker pick from the high_priority queue before the default queue?

Because the execution_table at Step 3 shows the worker checks queues and picks from the highest priority queue first, ensuring urgent jobs run before others.

What happens if no jobs are in the high_priority queue but jobs exist in the default queue?

At Step 6, the worker checks queues again and picks jobs from the default queue if the high_priority queue is empty, as shown in the execution_table.

How does assigning a queue affect job execution order?

Assigning a queue with a priority (like high_priority) places the job in that queue, so workers pick jobs from higher priority queues first, as seen in Steps 2 and 3.

Visual Quiz - 3 Questions

Look at the execution_table, what is the job status at Step 4?

A Pending

B Running

C Completed

D Idle

💡 Hint

Check the 'Job Status' column at Step 4 in the execution_table

At which step does the worker pick a job from the default queue?

A Step 6

B Step 5

C Step 3

D Step 7

💡 Hint

Look at the 'Worker Picks Job' column in the execution_table for when default queue is chosen

If a job is assigned to a low_priority queue, how would the worker pick order change?

A Worker picks low_priority jobs before high_priority

B Worker picks low_priority jobs before default but after high_priority

C Worker picks low_priority jobs after default and high_priority

D Worker ignores low_priority jobs

💡 Hint

Recall that workers pick jobs from highest priority queues first as shown in the concept_flow and execution_table

Concept Snapshot

In Rails, jobs can be assigned to different queues representing priorities.
Workers pick jobs from higher priority queues first.
Use queue_as or set(queue:) to assign jobs.
Jobs run asynchronously in order of queue priority.
This helps manage workload and urgent tasks efficiently.

Full Transcript

In Rails, background jobs can be assigned to different queues to manage priorities. When a job is created, it is assigned a priority by placing it in a specific queue, such as 'default' or 'high_priority'. Workers look at these queues and always pick jobs from the highest priority queue available. The execution table shows that when a job is created with high priority, it goes into the high_priority queue. Workers pick jobs from this queue before the default queue. After the job runs and completes, the worker checks for more jobs. If no jobs remain, the worker becomes idle. This system ensures urgent jobs run first and helps organize background work efficiently.