Divide and Conquer Strategy and Recurrence Relations in DSA Python - Time & Space Complexity

Time Complexity: Divide and Conquer Strategy and Recurrence Relations

O(n log n)

Understanding Time Complexity

We want to understand how dividing a problem into smaller parts affects the time it takes to solve it.

How does breaking tasks down and combining results change the work needed as input grows?

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

def divide_and_conquer(arr):
    if len(arr) <= 1:
        return arr
    mid = len(arr) // 2
    left = divide_and_conquer(arr[:mid])
    right = divide_and_conquer(arr[mid:])
    return merge(left, right)

# Assume merge merges two sorted lists in linear time

This code splits the list into halves, solves each half, then merges the results.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Recursive calls splitting the array into halves and merging sorted halves.
• How many times: The array is split until size 1, so about log₂(n) levels of recursion, with merging at each level.

How Execution Grows With Input

Each level splits the array and merges all parts, doing work proportional to n per level.

Input Size (n)	Approx. Operations
10	About 10 * 3 = 30
100	About 100 * 7 = 700
1000	About 1000 * 10 = 10,000

Pattern observation: Operations grow roughly as n times log n, increasing faster than linear but slower than quadratic.

Final Time Complexity

Time Complexity: O(n log n)

This means the work grows a bit faster than the input size, because we split and merge multiple times.

Common Mistake

[X] Wrong: "Since we split the array in half each time, the time must be O(log n)."

[OK] Correct: Although splitting is fast, merging takes linear time at each level, so total work adds up to n log n.

Interview Connect

Understanding how dividing problems reduces complexity is a key skill for solving many algorithm challenges efficiently.

Self-Check

"What if the merge step took constant time instead of linear? How would the time complexity change?"

Practice

1. What is the main idea behind the Divide and Conquer strategy in algorithms?

easy

A. Break the problem into smaller subproblems, solve them independently, then combine results

B. Solve the problem by trying all possible solutions one by one

C. Use a single loop to solve the problem iteratively

D. Store all intermediate results to avoid repeated calculations

Solution

1. Step 1: Understand the divide and conquer approach

   It splits a big problem into smaller parts that are easier to solve.

2. Step 2: Combine the solutions of subproblems

   After solving smaller parts, their results are merged to get the final answer.

3. Final Answer:

   Break the problem into smaller subproblems, solve them independently, then combine results -> Option A

4. Quick Check:

   Divide and conquer = split, solve, combine [OK]

Hint: Divide big problem into smaller parts, solve, then combine [OK]

Common Mistakes:

• Confusing divide and conquer with brute force
• Thinking it uses only loops without recursion
• Mixing it up with dynamic programming

2. Which of the following is the correct syntax for the recurrence relation of Merge Sort?

easy

A. T(n) = 2T(n/2) + O(n)

B. T(n) = T(n-1) + O(1)

C. T(n) = T(n/2) + O(1)

D. T(n) = 3T(n/3) + O(n^2)

Solution

1. Step 1: Recall Merge Sort recurrence

   Merge Sort splits array into two halves, sorts each half, then merges in linear time.

2. Step 2: Write recurrence relation

   It calls itself twice on half size (2T(n/2)) plus O(n) for merging.

3. Final Answer:

   T(n) = 2T(n/2) + O(n) -> Option A

4. Quick Check:

   Merge Sort recurrence = 2T(n/2) + n [OK]

Hint: Merge sort splits in two, merges in linear time [OK]

Common Mistakes:

• Using T(n-1) instead of T(n/2)
• Confusing merge cost as O(n^2)
• Choosing wrong number of recursive calls

3. What is the output of this Python function that uses divide and conquer to compute sum of a list?

def sum_list(arr):
    if len(arr) == 1:
        return arr[0]
    mid = len(arr) // 2
    left_sum = sum_list(arr[:mid])
    right_sum = sum_list(arr[mid:])
    return left_sum + right_sum

print(sum_list([2, 4, 6, 8]))

medium

A. 16

B. 20

C. Error

D. 10

Solution

1. Step 1: Trace recursive calls

   List splits into [2,4] and [6,8], then further into single elements.

2. Step 2: Calculate sums bottom-up

   Sum of [2,4] = 6, sum of [6,8] = 14, total = 6 + 14 = 20.

3. Final Answer:

   20 -> Option B

4. Quick Check:

   2+4+6+8 = 20 [OK]

Hint: Sum divides list, sums parts, then adds [OK]

Common Mistakes:

• Confusing mid index slicing
• Returning partial sums incorrectly
• Forgetting base case for single element

4. Find the error in this divide and conquer function to find maximum element in a list:

def max_element(arr):
    if len(arr) == 1:
        return arr[0]
    mid = len(arr) // 2
    left_max = max_element(arr[:mid])
    right_max = max_element(arr[mid:])
    if left_max > right_max:
        return left_max
    else:
        return arr[right_max]

medium

A. Function should use iteration instead of recursion

B. Base case missing for empty list

C. Mid calculation should be mid = len(arr) // 3

D. Incorrect return statement: should return right_max, not arr[right_max]

Solution

1. Step 1: Check return statements

   Left max returns value correctly, right max returns index incorrectly by arr[right_max].

2. Step 2: Fix return for right max comparison

   Should return right_max directly, not arr[right_max], because right_max is already a value.

3. Final Answer:

   Incorrect return statement: should return right_max, not arr[right_max] -> Option D

4. Quick Check:

   Return max values, not index or wrong element [OK]

Hint: Return max values, not arr[value] [OK]

Common Mistakes:

• Returning element by index instead of value
• Wrong slicing causing infinite recursion
• Ignoring base case for single element

5. Given the recurrence relation T(n) = 3T(n/3) + n, what is the time complexity using the Master Theorem?

hard

A. O(n)

B. O(n^2)

C. O(n log n)

D. O(log n)

Solution

1. Step 1: Identify parameters for Master Theorem

   Here, a=3, b=3, f(n)=n.

2. Step 2: Calculate n^log_b(a)

   log_3(3) = 1, so n^1 = n.

3. Step 3: Compare f(n) with n^log_b(a)

   f(n) = n matches n^log_b(a) = n, so case 2 applies.

4. Step 4: Apply Master Theorem case 2

   Time complexity is O(n log n).

5. Final Answer:

   O(n log n) -> Option C

6. Quick Check:

   Master Theorem case 2 = O(n log n) [OK]

Hint: Compare f(n) to n^log_b(a) for Master Theorem [OK]

Common Mistakes:

• Confusing log base or value
• Choosing wrong Master Theorem case
• Ignoring the additive term f(n)