When to use pipelines in Redis - Time & Space Complexity

Time Complexity: When to use pipelines

O(n)

Understanding Time Complexity

We want to understand how using pipelines in Redis affects the time it takes to run commands.

Specifically, we ask: How does the total time grow when sending many commands with and without pipelines?

Scenario Under Consideration

Analyze the time complexity of sending multiple commands with and without pipelines.

# Without pipeline
for i in range(1, n+1):
  r.set('key' + str(i), 'value' + str(i))

# With pipeline
pipe = r.pipeline()
for i in range(1, n+1):
  pipe.set('key' + str(i), 'value' + str(i))
pipe.execute()
    

This code sets n keys in Redis, either sending each command separately or batching them in a pipeline.

Identify Repeating Operations

Look at what repeats as n grows.

• Primary operation: Sending SET commands to Redis.
• How many times: Exactly n times, once per key.
• Difference: Without pipeline, each command is sent separately; with pipeline, commands are batched and sent once.

How Execution Grows With Input

As you increase n, the number of commands grows linearly.

Input Size (n)	Approx. Operations
10	10 separate sends without pipeline, 1 batch send with pipeline
100	100 separate sends without pipeline, 1 batch send with pipeline
1000	1000 separate sends without pipeline, 1 batch send with pipeline

Pattern observation: Without pipelines, the number of send operations grows directly with n. With pipelines, the send operation count stays the same regardless of n.

Final Time Complexity

Time Complexity: O(n)

This means the total time grows linearly with the number of commands, but pipelines reduce the overhead by sending commands in one batch.

Common Mistake

[X] Wrong: "Using pipelines changes the number of commands Redis processes."

[OK] Correct: Pipelines only change how commands are sent over the network, not how many commands Redis executes.

Interview Connect

Understanding when to use pipelines shows you know how to handle many commands efficiently, a useful skill for real projects and interviews.

Self-Check

"What if we used pipelines but sent multiple batches instead of one? How would that affect time complexity?"