Provider caching and mirrors in Terraform - Mini Project: Build & Apply

Provider caching and mirrors

📖 Scenario: You are setting up Terraform for a team project. To speed up Terraform provider downloads and avoid network issues, you want to configure Terraform to use a local cache and a mirror for providers.

🎯 Goal: Configure Terraform to use a local provider cache directory and a provider mirror to improve reliability and speed when downloading providers.

📋 What You'll Learn

Create a Terraform configuration file named terraform.rc

Set the plugin_cache_dir to ~/.terraform.d/plugin-cache

Configure a provider mirror at ~/.terraform.d/mirrors

Use the provider_installation block with direct and filesystem_mirror methods

💡 Why This Matters

🌍 Real World

Teams working with Terraform often face slow or unreliable provider downloads. Using provider caching and mirrors improves speed and reliability.

💼 Career

Cloud engineers and DevOps professionals configure Terraform environments for efficient infrastructure provisioning and management.

1

Create the initial Terraform CLI config file

Create a file named terraform.rc and add the provider_installation block with an empty configuration inside.

Terraform

# Create terraform.rc file with provider_installation block
provider_installation {
  
}

Hint

Start by writing the provider_installation block with opening and closing braces.

2

Add the plugin cache directory configuration

Inside the provider_installation block, add the plugin_cache_dir setting and set it to "~/.terraform.d/plugin-cache".

Terraform

provider_installation {
  # Add plugin_cache_dir setting here
}

Hint

Use the exact path "~/.terraform.d/plugin-cache" for the cache directory.

3

Configure the filesystem mirror for providers

Inside the provider_installation block, add a filesystem_mirror block with the path set to "~/.terraform.d/mirrors".

Terraform

provider_installation {
  plugin_cache_dir = "~/.terraform.d/plugin-cache"
  # Add filesystem_mirror block here
}

Hint

Indent the path setting inside the filesystem_mirror block.

4

Add the direct installation method as fallback

Inside the provider_installation block, add the direct block after the filesystem_mirror block to allow direct downloads if the mirror is unavailable.

Terraform

provider_installation {
  plugin_cache_dir = "~/.terraform.d/plugin-cache"

  filesystem_mirror {
    path    = "~/.terraform.d/mirrors"
  }
  # Add direct block here
}

Hint

The direct block should be empty and placed after the filesystem_mirror block.

Practice

1. What is the main purpose of provider caching in Terraform?

easy

A. To encrypt provider plugins for security

B. To store provider plugins locally and speed up Terraform runs

C. To delete unused providers automatically

D. To force Terraform to always download providers from the internet

Solution

1. Step 1: Understand provider caching concept

   Provider caching means saving provider plugins on your local machine so Terraform doesn't need to download them every time.

2. Step 2: Identify the benefit of caching

   This local storage speeds up Terraform runs by avoiding repeated downloads.

3. Final Answer:

   To store provider plugins locally and speed up Terraform runs -> Option B

4. Quick Check:

   Provider caching = local storage for speed [OK]

Hint: Caching means saving locally to avoid repeated downloads [OK]

Common Mistakes:

• Thinking caching deletes providers
• Confusing caching with encryption
• Assuming caching forces downloads

2. Which block is used in Terraform configuration to specify a local directory for provider caching?

easy

A. direct

B. cache_location

C. filesystem_mirror

D. provider_cache

Solution

1. Step 1: Recall Terraform provider mirror blocks

   Terraform uses filesystem_mirror blocks to define local directories for caching providers.

2. Step 2: Confirm correct block name

   The direct block is for direct downloads, not caching. Other options are invalid.

3. Final Answer:

   filesystem_mirror -> Option C

4. Quick Check:

   Local cache directory = filesystem_mirror [OK]

Hint: Filesystem mirror means local cache folder [OK]

Common Mistakes:

• Confusing direct with caching block
• Using non-existent block names
• Assuming provider_cache is valid

3. Given this Terraform CLI configuration snippet:

provider_installation {
  filesystem_mirror {
    path    = "/cache/providers"
  }
  direct {
    exclude = ["hashicorp/aws"]
  }
}

What happens when Terraform needs the hashicorp/aws provider?

medium

A. Terraform downloads hashicorp/aws directly from the internet

B. Terraform uses the cached version from /cache/providers

C. Terraform throws an error because hashicorp/aws is excluded

D. Terraform ignores the provider and continues without it

Solution

1. Step 1: Analyze the filesystem_mirror and direct blocks

   The filesystem_mirror caches providers locally except those excluded in direct.

2. Step 2: Understand the exclude setting

   The direct block excludes hashicorp/aws, so Terraform will not use the cache for it.

3. Step 3: Determine provider source

   Terraform downloads hashicorp/aws directly from the internet.

4. Final Answer:

   Terraform downloads hashicorp/aws directly from the internet -> Option A

5. Quick Check:

   Exclude means direct download [OK]

Hint: Exclude in direct means download from internet [OK]

Common Mistakes:

• Assuming excluded providers use cache
• Thinking exclusion causes errors
• Believing providers are ignored if excluded

4. You configured a filesystem_mirror path but Terraform still downloads providers from the internet. What is the most likely cause?

medium

A. The filesystem_mirror path is incorrect or inaccessible

B. Terraform does not support provider caching

C. You forgot to install Terraform CLI

D. The provider version is not specified in configuration

Solution

1. Step 1: Check filesystem_mirror path validity

   If the path is wrong or Terraform cannot access it, caching won't work and providers download from the internet.

2. Step 2: Rule out other causes

   Terraform supports caching, CLI must be installed, and version absence doesn't force downloads if cache is valid.

3. Final Answer:

   The filesystem_mirror path is incorrect or inaccessible -> Option A

4. Quick Check:

   Invalid cache path causes downloads [OK]

Hint: Check cache path accessibility first [OK]

Common Mistakes:

• Assuming Terraform lacks caching support
• Ignoring filesystem permissions
• Blaming missing provider version

5. You want to speed up Terraform runs in a team by caching providers locally but still allow direct downloads for some custom providers. Which configuration correctly achieves this?

hard

A. provider_installation {
direct {
include = ["customcorp/custom"]
}
filesystem_mirror {
path = "/team/cache"
}
}

B. provider_installation {
direct {
path = "/team/cache"
}
filesystem_mirror {
exclude = ["customcorp/custom"]
}
}

C. provider_installation {
filesystem_mirror {
exclude = ["customcorp/custom"]
}
direct {
path = "/team/cache"
}
}

D. provider_installation {
filesystem_mirror {
path = "/team/cache"
}
direct {
exclude = ["customcorp/custom"]
}
}

Solution

1. Step 1: Understand correct block usage

   filesystem_mirror defines the local cache path; direct defines providers to download directly.

2. Step 2: Check correct syntax and order

   provider_installation {
     filesystem_mirror {
       path = "/team/cache"
     }
     direct {
       exclude = ["customcorp/custom"]
     }
   }

   correctly sets filesystem_mirror with path and direct with exclude list for custom providers.

3. Step 3: Identify incorrect options

   Other options misuse keys or swap path and exclude incorrectly.

4. Final Answer:

   provider_installation {
     filesystem_mirror {
       path = "/team/cache"
     }
     direct {
       exclude = ["customcorp/custom"]
     }
   }

   -> Option D

5. Quick Check:

   Cache path in filesystem_mirror, exclude in direct [OK]

Hint: Cache path in filesystem_mirror, exclude in direct block [OK]

Common Mistakes:

• Swapping path and exclude keys
• Putting exclude in filesystem_mirror
• Misplacing blocks order