State file performance at scale in Terraform - Mini Project: Build & Apply

State file performance at scale

📖 Scenario: You are managing infrastructure for a growing company. As the infrastructure grows, the Terraform state file becomes large and slow to handle. You want to organize your Terraform state to improve performance and manageability.

🎯 Goal: Split the Terraform state into multiple smaller state files using workspaces and backend configuration to improve performance at scale.

📋 What You'll Learn

Create a Terraform backend configuration using remote backend with workspace support

Define a workspace variable to select the environment

Use a resource block to simulate infrastructure resources

Configure the backend to use a workspace key prefix for state separation

💡 Why This Matters

🌍 Real World

Large infrastructure projects often have many resources. Splitting state files by workspace helps Terraform run faster and reduces conflicts.

💼 Career

Cloud engineers and DevOps professionals use backend and workspace configurations to manage infrastructure state efficiently in teams and large projects.

1

Create backend configuration block

Create a terraform block with a backend of type remote. Set the hostname to app.terraform.io and organization to example-org.

Terraform

# Your code here

Need a hint?

This block configures Terraform to use the remote backend hosted at app.terraform.io for state storage.

2

Add workspace key prefix configuration

Inside the backend "remote" block, add a workspaces block with prefix set to example-org- to separate state files by workspace.

Terraform

terraform {
  backend "remote" {
    hostname     = "app.terraform.io"
    organization = "example-org"
    # Add workspaces prefix here
  }
}

Need a hint?

The workspaces block with a prefix helps Terraform create separate state files for each workspace.

3

Create a workspace variable

Create a variable called workspace of type string with default value dev to select the Terraform workspace.

Terraform

terraform {
  backend "remote" {
    hostname     = "app.terraform.io"
    organization = "example-org"
    workspaces {
      prefix = "example-org-"
    }
  }
}

# Define workspace variable here
# Your code here

Need a hint?

This variable will help select the workspace when running Terraform commands.

4

Add a sample resource using the workspace variable

Create a resource block of type null_resource named example. Add a triggers map with a key workspace set to the variable workspace.

Terraform

terraform {
  backend "remote" {
    hostname     = "app.terraform.io"
    organization = "example-org"
    workspaces {
      prefix = "example-org-"
    }
  }
}

variable "workspace" {
  type    = string
  default = "dev"
}

# Add null_resource example with triggers using workspace variable
# Your code here

Need a hint?

This resource uses the workspace variable to create a trigger, simulating resource changes per workspace.