Named jobs in NestJS - Performance & Optimization

Performance: Named jobs

MEDIUM IMPACT

Named jobs affect how background tasks are scheduled and managed, impacting server responsiveness and resource usage.

Scheduling background tasks without duplicates

NestJS

await this.queue.add('sendEmail', { userId: 1 }, { jobId: 'sendEmail:1' });
await this.queue.add('sendEmail', { userId: 1 }, { jobId: 'sendEmail:1' });

Using a unique jobId prevents duplicate jobs from being added, saving processing time and resources.

📈 Performance GainReduces CPU load and memory usage by avoiding duplicate job executions.

Scheduling background tasks without duplicates

NestJS

await this.queue.add('sendEmail', { userId: 1 });
await this.queue.add('sendEmail', { userId: 1 });

This schedules the same job multiple times without a unique identifier, causing duplicate processing and wasted resources.

📉 Performance CostIncreases CPU and memory usage due to redundant job executions.

Performance Comparison

Pattern	CPU Usage	Memory Usage	Duplicate Jobs	Verdict
Unnamed jobs	High due to duplicates	High due to multiple job data	Yes	[X] Bad
Named jobs with unique jobId	Lower by avoiding duplicates	Lower by single job instance	No	[OK] Good

Rendering Pipeline

Named jobs influence the server's task queue management, affecting how jobs are enqueued and executed without blocking the main event loop.

→Job Scheduling

→Queue Management

→Task Execution

⚠️ BottleneckDuplicate job scheduling causes unnecessary task executions, increasing CPU and memory usage.

Optimization Tips

1Always assign a unique jobId when adding jobs to prevent duplicates.

2Monitor your job queue to detect and remove duplicate jobs.

3Use named jobs to optimize CPU and memory usage in background processing.

Performance Quiz - 3 Questions

What is the main performance benefit of using named jobs in NestJS queues?

A Increases job execution speed by parallel processing

B Prevents duplicate job execution and saves CPU resources

C Reduces network latency for API calls

D Automatically scales the number of workers

DevTools: NestJS Debugger or Queue Monitoring Dashboard

How to check: Monitor the job queue for duplicate job entries and check CPU/memory usage during job processing.

What to look for: Look for repeated job IDs or multiple identical jobs in the queue indicating duplicates and higher resource consumption.

Practice

1. What is the main benefit of using named jobs in NestJS queues?

easy

A. They automatically speed up job processing.

B. They help identify and manage specific background tasks easily.

C. They encrypt job data for security.

D. They allow jobs to run without a queue.

Solution

1. Step 1: Understand the purpose of named jobs

   Named jobs provide a clear label to background tasks, making them easier to find and manage.

2. Step 2: Compare options with the purpose

   Only They help identify and manage specific background tasks easily. matches this purpose. Options B, C, and D describe unrelated features.

3. Final Answer:

   They help identify and manage specific background tasks easily. -> Option B

4. Quick Check:

   Named jobs = easier management [OK]

Hint: Named jobs label tasks for easy tracking [OK]

Common Mistakes:

• Thinking named jobs improve speed
• Confusing named jobs with security features
• Assuming named jobs remove the need for queues

2. Which of the following is the correct way to add a named job to a queue in NestJS?

easy

A. queue.pushJob('emailJob', { to: '[e-mail]' });

B. queue.createJob('emailJob', { to: '[e-mail]' });

C. queue.runJob('emailJob', { to: '[e-mail]' });

D. queue.add('emailJob', { to: '[e-mail]' });

Solution

1. Step 1: Recall the NestJS queue method for adding jobs

   The correct method to add a job with a name is queue.add(name, data).

2. Step 2: Match the method with options

   Only queue.add('emailJob', { to: '[e-mail]' }); uses queue.add with a job name and data correctly.

3. Final Answer:

   queue.add('emailJob', { to: '[e-mail]' }); -> Option D

4. Quick Check:

   Use queue.add(name, data) [OK]

Hint: Use queue.add('jobName', data) to name jobs [OK]

Common Mistakes:

• Using non-existent methods like createJob or pushJob
• Forgetting to pass the job name as first argument
• Confusing job execution with job creation

3. Given this code snippet, what will be the output when checking the job name?

const job = await queue.add('reportGeneration', { userId: 42 });
console.log(job.name);

medium

A. 'reportGeneration'

B. 'default'

C. undefined

D. Throws an error

Solution

1. Step 1: Understand job creation with a name

   When adding a job with queue.add('reportGeneration', data), the job's name property is set to 'reportGeneration'.

2. Step 2: Check the console.log output

   Logging job.name will print 'reportGeneration'.

3. Final Answer:

   'reportGeneration' -> Option A

4. Quick Check:

   Job name property = 'reportGeneration' [OK]

Hint: Job.name matches the string passed to queue.add [OK]

Common Mistakes:

• Assuming default name is used if a name is given
• Expecting undefined if name is not accessed properly
• Thinking job creation throws error without processor

4. Identify the error in this NestJS queue job addition:

queue.add({ name: 'cleanupJob' }, { force: true });

medium

A. Job name should be a string, not inside an object.

B. The second argument must be a string, not an object.

C. The method add() does not exist on queue.

D. The job data cannot contain boolean values.

Solution

1. Step 1: Review the correct syntax for named jobs

   The queue.add method expects the first argument as a string name, not an object.

2. Step 2: Analyze the given code

   The code passes an object { name: 'cleanupJob' } instead of a string, causing a syntax error.

3. Final Answer:

   Job name should be a string, not inside an object. -> Option A

4. Quick Check:

   First argument to add() = string name [OK]

Hint: Pass job name as string, not object, to queue.add [OK]

Common Mistakes:

• Passing job name inside an object instead of string
• Confusing job data with job name argument
• Assuming add() method is missing or invalid

5. You want to cancel all jobs named 'emailNotification' in a queue. Which approach correctly uses named jobs to achieve this?

hard

A. Restart the queue to clear all jobs named 'emailNotification'.

B. Call queue.removeJobs('emailNotification') directly without fetching jobs.

C. Use queue.getJobs(['emailNotification']) and then call remove() on each job.

D. Filter jobs by data property { type: 'emailNotification' } and delete them.

Solution

1. Step 1: Understand how to retrieve named jobs

   Named jobs can be fetched using queue.getJobs(['jobName']) which returns jobs with that name.

2. Step 2: Remove each fetched job

   After fetching, calling remove() on each job deletes them from the queue.

3. Final Answer:

   Use queue.getJobs(['emailNotification']) and then call remove() on each job. -> Option C

4. Quick Check:

   Fetch named jobs then remove [OK]

Hint: Fetch named jobs first, then remove them one by one [OK]

Common Mistakes:

• Trying to remove jobs by name without fetching them
• Filtering jobs by data instead of name
• Restarting queue does not selectively remove jobs