Data source dependencies in Terraform - Time & Space Complexity

Time Complexity: Data source dependencies

O(n)

Understanding Time Complexity

When Terraform uses data sources, it fetches information from existing infrastructure. Understanding how the time to fetch this data grows helps us plan for bigger setups.

We want to know: how does the number of data sources affect the total time Terraform takes to get all the data?

Scenario Under Consideration

Analyze the time complexity of the following operation sequence.

    data "aws_subnet" "example" {
      count = var.subnet_count
      id    = var.subnet_ids[count.index]
    }

    output "subnet_cidrs" {
      value = [for s in data.aws_subnet.example : s.cidr_block]
    }
    

This code fetches details for multiple subnets using their IDs, then outputs their CIDR blocks.

Identify Repeating Operations

Identify the API calls, resource provisioning, data transfers that repeat.

• Primary operation: Each aws_subnet data source makes one API call to fetch subnet details.
• How many times: The API call repeats once for each subnet ID in var.subnet_ids.

How Execution Grows With Input

As the number of subnet IDs increases, the number of API calls grows directly with it.

Input Size (n)	Approx. API Calls/Operations
10	10 API calls
100	100 API calls
1000	1000 API calls

Pattern observation: The number of API calls grows in a straight line with the number of subnets.

Final Time Complexity

Time Complexity: O(n)

This means the time to fetch all subnet data grows directly in proportion to how many subnets you ask for.

Common Mistake

[X] Wrong: "Fetching multiple data sources happens all at once, so time stays the same no matter how many."

[OK] Correct: Each data source triggers a separate API call, so more data sources mean more calls and more time.

Interview Connect

Knowing how data source calls add up helps you design Terraform configurations that scale well and avoid surprises in deployment time.

Self-Check

"What if we combined multiple subnet IDs into one data source call using a filter? How would the time complexity change?"

Practice

1. What is the main purpose of using data source dependencies in Terraform?

easy

A. To fetch existing resource information before creating new resources

B. To delete resources automatically after creation

C. To speed up Terraform plan execution by skipping resources

D. To create duplicate resources with the same configuration

Solution

1. Step 1: Understand data source role

   Data sources in Terraform are used to read information about existing resources outside Terraform or created by other means.

2. Step 2: Identify dependency purpose

   Dependencies ensure Terraform fetches this existing info before creating or modifying other resources that rely on it.

3. Final Answer:

   To fetch existing resource information before creating new resources -> Option A

4. Quick Check:

   Data source dependencies = fetch info first [OK]

Hint: Data sources get info before resource creation [OK]

Common Mistakes:

• Thinking data sources create or delete resources
• Confusing dependencies with resource lifecycle
• Assuming data sources speed up plans by skipping

2. Which syntax correctly adds an explicit dependency on a data source named aws_vpc.main in a resource block?

easy

A. depends_on = {aws_vpc.main}

B. depends_on = aws_vpc.main

C. depends_on = ["aws_vpc.main"]

D. depends_on = [aws_vpc.main]

Solution

1. Step 1: Recall depends_on syntax

   Terraform expects depends_on to be a list of resource or data source references without quotes.

2. Step 2: Analyze options

   depends_on = [aws_vpc.main] uses a list with the correct reference syntax. depends_on = aws_vpc.main misses list brackets. depends_on = ["aws_vpc.main"] uses quotes making it a string, not a reference. depends_on = {aws_vpc.main} uses braces which is invalid.

3. Final Answer:

   depends_on = [aws_vpc.main] -> Option D

4. Quick Check:

   depends_on requires list of references [OK]

Hint: Use square brackets and no quotes for depends_on [OK]

Common Mistakes:

• Using quotes around resource names
• Omitting square brackets for depends_on
• Using curly braces instead of square brackets

3. Given this Terraform snippet:

data "aws_ami" "example" {
  most_recent = true
  filter {
    name   = "name"
    values = ["amzn2-ami-hvm-*-x86_64-gp2"]
  }
}

resource "aws_instance" "web" {
  ami           = data.aws_ami.example.id
  instance_type = "t2.micro"
}

What happens if the data source aws_ami.example fails to find a matching AMI?

medium

A. Terraform will skip the instance creation silently

B. Terraform will create the instance with a default AMI

C. Terraform plan will fail with an error before creating the instance

D. Terraform will retry the data source until it finds an AMI

Solution

1. Step 1: Understand data source failure behavior

   If a data source cannot find the requested resource, Terraform plan fails with an error because it cannot resolve the value.

2. Step 2: Check resource dependency

   The resource depends on the data source's output for the AMI ID, so without it, resource creation cannot proceed.

3. Final Answer:

   Terraform plan will fail with an error before creating the instance -> Option C

4. Quick Check:

   Data source failure = plan error [OK]

Hint: Missing data source value causes plan failure [OK]

Common Mistakes:

• Assuming default values are used automatically
• Thinking Terraform retries data sources
• Believing resource creation skips silently

4. You have this Terraform configuration:

data "aws_subnet" "selected" {
  filter {
    name   = "tag:Name"
    values = ["my-subnet"]
  }
}

resource "aws_instance" "app" {
  ami           = "ami-123456"
  instance_type = "t2.micro"
  subnet_id     = data.aws_subnet.selected.id
  depends_on    = [aws_instance.app]
}

What is the problem with this configuration?

medium

A. The resource depends_on itself causing a circular dependency

B. The data source filter syntax is invalid

C. The subnet_id should not use data source references

D. The instance_type is not a valid type

Solution

1. Step 1: Analyze depends_on usage

   The resource aws_instance.app declares depends_on referencing itself, which creates a circular dependency.

2. Step 2: Understand circular dependency impact

   Circular dependencies cause Terraform to fail planning or applying because it cannot resolve resource order.

3. Final Answer:

   The resource depends_on itself causing a circular dependency -> Option A

4. Quick Check:

   depends_on self-reference = circular dependency error [OK]

Hint: Avoid depends_on referencing the same resource [OK]

Common Mistakes:

• Confusing data source filter syntax as error
• Thinking subnet_id cannot use data sources
• Assuming instance_type is invalid without checking

5. You want to create an AWS security group that allows inbound traffic only from instances in a specific subnet fetched via a data source. Which approach correctly ensures Terraform creates the security group only after the subnet data is fetched?

hard

A. Use depends_on = [data.aws_subnet.target] in the security group resource

B. No need for depends_on; Terraform infers dependency from data source usage

C. Create the security group first, then fetch the subnet data source

D. Use a null_resource to delay security group creation

Solution

1. Step 1: Understand implicit dependencies

   When a resource uses a data source attribute (like subnet ID), Terraform automatically creates a dependency to fetch data first.

2. Step 2: Evaluate explicit depends_on necessity

   Explicit depends_on is not needed unless the dependency is indirect or complex; here, implicit dependency suffices.

3. Final Answer:

   No need for depends_on; Terraform infers dependency from data source usage -> Option B

4. Quick Check:

   Data source usage creates implicit dependency [OK]

Hint: Data source references create implicit dependencies [OK]

Common Mistakes:

• Adding unnecessary depends_on for direct data source use
• Creating resources in wrong order ignoring implicit dependencies
• Using null_resource unnecessarily