Minimum spanning tree (Kruskal's) in Data Structures Theory - Time & Space Complexity

Time Complexity: Minimum spanning tree (Kruskal's)

O(E log E)

Understanding Time Complexity

Analyzing the time complexity of Kruskal's algorithm helps us understand how its running time grows as the graph size increases.

We want to know how the number of edges and vertices affects the work needed to find the minimum spanning tree.

Scenario Under Consideration

Analyze the time complexity of the following Kruskal's algorithm snippet.

function kruskal(graph):
  mst = empty set
  sort edges by weight ascending
  for each edge in sorted edges:
    if adding edge does not form cycle:
      add edge to mst
  return mst
    

This code finds a minimum spanning tree by sorting edges and adding them if they don't create cycles.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Sorting all edges by weight.
• How many times: Sorting runs once on all edges; then each edge is checked once for cycle formation using union-find operations.

How Execution Grows With Input

As the number of edges and vertices grow, sorting edges takes more time, and checking cycles grows with edges.

Input Size (n = edges)	Approx. Operations
10 edges	About 10 log 10 + 10 union-find checks
100 edges	About 100 log 100 + 100 union-find checks
1000 edges	About 1000 log 1000 + 1000 union-find checks

Pattern observation: The sorting step dominates and grows a bit faster than linearly as edges increase.

Final Time Complexity

Time Complexity: O(E log E)

This means the time grows roughly proportional to the number of edges times the logarithm of that number.

Common Mistake

[X] Wrong: "Since we only add edges one by one, the algorithm runs in linear time O(E)."

[OK] Correct: Sorting edges takes more than linear time, and cycle checks add extra work, so the total time is more than just going through edges once.

Interview Connect

Understanding Kruskal's time complexity shows you can analyze how sorting and data structure choices affect algorithm speed, a key skill in many coding challenges.

Self-Check

"What if we used a different data structure for cycle detection, like a simple visited array instead of union-find? How would the time complexity change?"

Practice

1. What is the main goal of Kruskal's algorithm in graph theory?

easy

A. To detect if a graph contains cycles

B. To find the shortest path between two vertices

C. To find the minimum spanning tree connecting all vertices without cycles

D. To sort vertices by their degree

Solution

1. Step 1: Understand the purpose of Kruskal's algorithm

   Kruskal's algorithm is designed to connect all points in a graph with the smallest total edge weight without forming any loops.

2. Step 2: Compare with other graph problems

   Unlike shortest path or cycle detection alone, Kruskal's focuses on building a minimum spanning tree, which is a tree connecting all vertices with minimal cost.

3. Final Answer:

   To find the minimum spanning tree connecting all vertices without cycles -> Option C

4. Quick Check:

   Kruskal's goal = minimum spanning tree [OK]

Hint: Kruskal's connects all points cheaply without loops [OK]

Common Mistakes:

• Confusing minimum spanning tree with shortest path
• Thinking it detects cycles only
• Assuming it sorts vertices instead of edges

2. Which of the following is the correct first step in Kruskal's algorithm?

easy

A. Pick any vertex and start a depth-first search

B. Sort all edges in increasing order of their weights

C. Remove all vertices with degree 1

D. Sort vertices by their labels alphabetically

Solution

1. Step 1: Identify the initial step of Kruskal's algorithm

   Kruskal's algorithm begins by sorting all edges by their weight from smallest to largest to ensure the cheapest edges are considered first.

2. Step 2: Eliminate incorrect options

   Depth-first search and vertex removal are not part of Kruskal's initial steps, and sorting vertices alphabetically is irrelevant.

3. Final Answer:

   Sort all edges in increasing order of their weights -> Option B

4. Quick Check:

   First step = sort edges by weight [OK]

Hint: Always start by sorting edges by weight ascending [OK]

Common Mistakes:

• Sorting vertices instead of edges
• Starting with a search instead of sorting
• Removing vertices prematurely

3. Given the edges with weights: (A-B: 1), (B-C: 4), (A-C: 3), (C-D: 2), what edges will Kruskal's algorithm select for the minimum spanning tree?

medium

A. (A-C), (B-C), (C-D)

B. (A-B), (C-D), (B-C)

C. (A-B), (C-D), (A-C), (B-C)

D. (A-B), (C-D), (A-C)

Solution

1. Step 1: Sort edges by weight

   Edges sorted: (A-B:1), (C-D:2), (A-C:3), (B-C:4).

2. Step 2: Add edges without creating cycles

   Add (A-B), then (C-D). Adding (A-C) connects A and C without cycle. Adding (B-C) would create a cycle, so skip it.

3. Final Answer:

   (A-B), (C-D), (A-C) -> Option D

4. Quick Check:

   Edges chosen = smallest weights without cycles [OK]

Hint: Pick edges from smallest weight, skip if cycle forms [OK]

Common Mistakes:

• Including all edges regardless of cycles
• Choosing heavier edges before lighter ones
• Not checking for cycles before adding edges

4. In Kruskal's algorithm, what is the common error if the algorithm adds an edge that creates a cycle?

medium

A. The disjoint set structure is not used or updated correctly

B. Edges are not sorted by weight

C. Vertices are not labeled properly

D. The graph is directed instead of undirected

Solution

1. Step 1: Understand cycle prevention in Kruskal's

   Kruskal's algorithm uses a disjoint set (union-find) data structure to track connected components and avoid cycles.

2. Step 2: Identify the cause of cycle creation

   If an edge creates a cycle, it means the disjoint set was not used or updated properly to detect that the two vertices are already connected.

3. Final Answer:

   The disjoint set structure is not used or updated correctly -> Option A

4. Quick Check:

   Cycle error = faulty disjoint set use [OK]

Hint: Use disjoint sets to detect cycles before adding edges [OK]

Common Mistakes:

• Ignoring disjoint set updates
• Assuming sorting fixes cycles
• Confusing graph direction with cycle detection

5. You have a graph with edges: (X-Y: 2), (Y-Z: 2), (X-Z: 3), (Z-W: 1), (W-X: 4). Using Kruskal's algorithm, which set of edges forms the minimum spanning tree?

hard

A. (Z-W), (X-Y), (Y-Z)

B. (X-Y), (Y-Z), (X-Z)

C. (Z-W), (X-Z), (W-X)

D. (Z-W), (X-Y), (Y-Z), (W-X)

Solution

1. Step 1: Sort edges by weight

   Edges sorted: (Z-W:1), (X-Y:2), (Y-Z:2), (X-Z:3), (W-X:4).

2. Step 2: Add edges without cycles until all vertices connected

   Add (Z-W), then (X-Y), then (Y-Z). Now all vertices X, Y, Z, W are connected. Adding (W-X) or (X-Z) would create cycles, so skip them.

3. Final Answer:

   (Z-W), (X-Y), (Y-Z) -> Option A

4. Quick Check:

   Minimum spanning tree = edges with smallest weights connecting all nodes [OK]

Hint: Add smallest edges until all vertices connected, avoid cycles [OK]

Common Mistakes:

• Adding extra edges causing cycles
• Skipping necessary edges to connect all vertices
• Choosing heavier edges before lighter ones