Message retention and acknowledgment in GCP - Time & Space Complexity

Time Complexity: Message retention and acknowledgment

O(n)

Understanding Time Complexity

When working with message systems, it is important to know how long messages stay and how acknowledging them affects processing time.

We want to understand how the time to process messages grows as more messages are handled.

Scenario Under Consideration

Analyze the time complexity of the following operation sequence.

// Pull messages from a subscription
const [messages] = await subscription.pull({ maxMessages: n });

// Process each message
for (const message of messages) {
  processMessage(message);
  // Acknowledge message to remove it from the queue
  await subscription.acknowledge(message.ackId);
}

This sequence pulls n messages, processes each one, and acknowledges them to remove from the queue.

Identify Repeating Operations

Identify the API calls, resource provisioning, data transfers that repeat.

• Primary operation: Pulling messages and acknowledging each message.
• How many times: Pull is called once per batch; acknowledge is called once per message (n times).

How Execution Grows With Input

As the number of messages n increases, the number of acknowledgments grows linearly because each message needs one acknowledgment.

Input Size (n)	Approx. Api Calls/Operations
10	1 pull + 10 acknowledges = 11
100	1 pull + 100 acknowledges = 101
1000	1 pull + 1000 acknowledges = 1001

Pattern observation: The total operations grow roughly in direct proportion to the number of messages.

Final Time Complexity

Time Complexity: O(n)

This means the time to process and acknowledge messages grows linearly with the number of messages.

Common Mistake

[X] Wrong: "Acknowledging messages happens once for the whole batch, so time stays constant no matter how many messages."

[OK] Correct: Each message requires its own acknowledgment call, so more messages mean more acknowledgments and more time.

Interview Connect

Understanding how message acknowledgment scales helps you design systems that handle growing workloads smoothly and reliably.

Self-Check

"What if acknowledgments were batched instead of sent individually? How would the time complexity change?"

Practice

1. What happens to a message in Google Cloud Pub/Sub if it is not acknowledged within the retention period?

easy

A. The message is automatically acknowledged.

B. The message is deleted and no longer available for delivery.

C. The message is moved to a dead-letter queue.

D. The message is duplicated and sent again.

Solution

1. Step 1: Understand message retention

   Message retention defines how long unacknowledged messages are kept before deletion.

2. Step 2: Effect of no acknowledgment within retention

   If a message is not acknowledged before retention expires, it is deleted and lost.

3. Final Answer:

   The message is deleted and no longer available for delivery. -> Option B

4. Quick Check:

   Unacknowledged message + retention expired = deleted [OK]

Hint: Unacknowledged messages expire and get deleted after retention [OK]

Common Mistakes:

• Thinking messages auto-acknowledge after retention
• Assuming messages move to dead-letter queue automatically
• Believing messages duplicate on retention expiry

2. Which of the following is the correct way to acknowledge a message in Google Cloud Pub/Sub client libraries?

easy

A. Call message.ack() after processing the message.

B. Call message.delete() to remove the message.

C. Call message.complete() to finish processing.

D. Call message.finish() to acknowledge.

Solution

1. Step 1: Identify acknowledgment method

   In Pub/Sub client libraries, acknowledging a message is done by calling ack() on the message object.

2. Step 2: Verify other options

   Methods like delete(), complete(), or finish() are not valid for acknowledgment.

3. Final Answer:

   Call message.ack() after processing the message. -> Option A

4. Quick Check:

   Use message.ack() to acknowledge [OK]

Hint: Use message.ack() to confirm message processed [OK]

Common Mistakes:

• Using incorrect method names like delete or finish
• Not acknowledging messages at all
• Confusing acknowledgment with message deletion

3. Consider this code snippet using Google Cloud Pub/Sub subscriber client:

def callback(message):
    print(f"Received: {message.data.decode('utf-8')}")
    # No acknowledgment called here

subscriber.subscribe(subscription_path, callback=callback)

What will happen to the messages if the callback never calls message.ack()?

medium

A. Messages will be acknowledged automatically after printing.

B. Messages will be lost immediately after printing.

C. Messages will be redelivered until acknowledged or retention expires.

D. Messages will be sent to a dead-letter topic instantly.

Solution

1. Step 1: Understand callback behavior without ack

   If message.ack() is not called, Pub/Sub considers the message unacknowledged.

2. Step 2: Effect on message delivery

   Unacknowledged messages are redelivered repeatedly until acknowledged or retention period expires.

3. Final Answer:

   Messages will be redelivered until acknowledged or retention expires. -> Option C

4. Quick Check:

   No ack means redelivery until retention ends [OK]

Hint: No ack means message redelivery until retention ends [OK]

Common Mistakes:

• Assuming messages auto-acknowledge after callback
• Thinking messages are lost immediately without ack
• Believing messages go to dead-letter topic without config

4. You have set a message retention duration of 7 days on your Pub/Sub subscription. However, messages are disappearing after 1 day. What is the most likely cause?

medium

A. Messages are being acknowledged by the subscriber before 1 day.

B. The retention duration setting is ignored by Pub/Sub.

C. The subscription is a push type and does not support retention.

D. Messages are automatically deleted after 24 hours regardless of settings.

Solution

1. Step 1: Check retention vs acknowledgment

   Retention controls how long unacknowledged messages stay. If messages are acknowledged, they are removed immediately.

2. Step 2: Analyze disappearance cause

   If messages disappear early, likely they were acknowledged by the subscriber before 1 day.

3. Final Answer:

   Messages are being acknowledged by the subscriber before 1 day. -> Option A

4. Quick Check:

   Acknowledged messages removed before retention ends [OK]

Hint: Acknowledged messages delete immediately, ignoring retention [OK]

Common Mistakes:

• Assuming retention is ignored by Pub/Sub
• Believing push subscriptions don't support retention
• Thinking messages auto-delete after 24 hours always

5. You want to ensure that messages in your Pub/Sub subscription are retained for 3 days even if they are not acknowledged, but also want to avoid message duplication after acknowledgment. Which configuration should you apply?

hard

A. Set message retention duration to 0 and rely on subscriber retries.

B. Set message retention duration to 3 days and disable acknowledgments.

C. Set message retention duration to 7 days and never acknowledge messages.

D. Set message retention duration to 3 days and ensure subscriber acknowledges messages promptly.

Solution

1. Step 1: Understand retention and acknowledgment roles

   Retention keeps unacknowledged messages for specified time. Acknowledgment removes messages to avoid duplicates.

2. Step 2: Choose configuration to meet goals

   Setting retention to 3 days keeps messages if unacknowledged. Prompt acknowledgment removes processed messages, preventing duplicates.

3. Final Answer:

   Set message retention duration to 3 days and ensure subscriber acknowledges messages promptly. -> Option D

4. Quick Check:

   Retention + prompt ack = no duplicates, messages kept [OK]

Hint: Retention keeps unacked; ack removes to prevent duplicates [OK]

Common Mistakes:

• Disabling acknowledgments causing duplicates
• Setting retention to 0 losing unacked messages quickly
• Never acknowledging causing message buildup and duplicates