dbt Core vs dbt Cloud - Hands-On Comparison

Understanding dbt Core vs dbt Cloud

📖 Scenario: You work as a data analyst in a company that uses dbt (data build tool) to transform raw data into clean, usable datasets. Your team is deciding whether to use dbt Core or dbt Cloud for their data transformation workflows.To help the team, you will create a simple Python project that models the features of both dbt Core and dbt Cloud, so you can compare them clearly.

🎯 Goal: Build a Python dictionary that lists key features of dbt Core and dbt Cloud. Then, create a filter to select features available only in dbt Cloud. Finally, print these cloud-only features to help your team understand the differences.

📋 What You'll Learn

Create a dictionary named dbt_features with exact keys 'dbt Core' and 'dbt Cloud' and their feature lists.

Create a variable named cloud_only_features to hold features unique to dbt Cloud.

Use a list comprehension to find features in dbt Cloud that are not in dbt Core.

Print the cloud_only_features list as the final output.

💡 Why This Matters

🌍 Real World

Data teams often need to understand the differences between tools like dbt Core and dbt Cloud to choose the best fit for their workflows.

💼 Career

Knowing how to compare tool features and present clear summaries helps data analysts and engineers make informed decisions and communicate effectively with stakeholders.

1

Create the dbt features dictionary

Create a dictionary called dbt_features with two keys: 'dbt Core' and 'dbt Cloud'. Set the value for 'dbt Core' to the list ["Open-source", "Command-line interface", "Local development"] and for 'dbt Cloud' to the list ["Hosted environment", "Job scheduling", "User interface", "Open-source", "Command-line interface"].

dbt

# Create the dbt_features dictionary with exact keys and lists
# Your code here

Hint

Use a dictionary with two keys exactly named 'dbt Core' and 'dbt Cloud'. Assign the exact lists of features as values.

2

Create a variable for cloud-only features

Create a variable called cloud_only_features and set it to an empty list []. This will hold features unique to dbt Cloud.

dbt

dbt_features = {
    'dbt Core': ["Open-source", "Command-line interface", "Local development"],
    'dbt Cloud': ["Hosted environment", "Job scheduling", "User interface", "Open-source", "Command-line interface"]
}

# Create an empty list called cloud_only_features
# Your code here

Hint

Just create a variable named cloud_only_features and assign it an empty list [].

3

Find features unique to dbt Cloud

Use a list comprehension to set cloud_only_features to all features in dbt_features['dbt Cloud'] that are not in dbt_features['dbt Core']. Use the variable names exactly as given.

dbt

dbt_features = {
    'dbt Core': ["Open-source", "Command-line interface", "Local development"],
    'dbt Cloud': ["Hosted environment", "Job scheduling", "User interface", "Open-source", "Command-line interface"]
}

# Use list comprehension to find features in dbt Cloud not in dbt Core
cloud_only_features = [feature for feature in dbt_features['dbt Cloud'] if feature not in dbt_features['dbt Core']]

Hint

Use a list comprehension with feature for feature in dbt_features['dbt Cloud'] if feature not in dbt_features['dbt Core'].

4

Print the cloud-only features

Write a print statement to display the cloud_only_features list.

dbt

dbt_features = {
    'dbt Core': ["Open-source", "Command-line interface", "Local development"],
    'dbt Cloud': ["Hosted environment", "Job scheduling", "User interface", "Open-source", "Command-line interface"]
}

cloud_only_features = [feature for feature in dbt_features['dbt Cloud'] if feature not in dbt_features['dbt Core']]

# Print the cloud_only_features list
# Your code here

Hint

Use print(cloud_only_features) to show the list.

Practice

1. What is the main difference between dbt Core and dbt Cloud?

easy

A. dbt Core has scheduling features, dbt Cloud does not.

B. dbt Core is web-based, and dbt Cloud is a command-line tool.

C. dbt Core is free and command-line based, while dbt Cloud is paid and web-based.

D. dbt Core is only for data visualization, dbt Cloud is for data modeling.

Solution

1. Step 1: Understand the nature of dbt Core

   dbt Core is a free tool that runs on the command line, meaning you use it by typing commands in a terminal.

2. Step 2: Understand the nature of dbt Cloud

   dbt Cloud is a paid platform that runs in a web browser and includes extra features like scheduling and a user interface.

3. Final Answer:

   dbt Core is free and command-line based, while dbt Cloud is paid and web-based. -> Option C

4. Quick Check:

   dbt Core = free CLI, dbt Cloud = paid web [OK]

Hint: Remember: Core = free CLI, Cloud = paid web platform [OK]

Common Mistakes:

• Confusing which tool is command-line vs web-based
• Thinking dbt Core has scheduling built-in
• Assuming dbt Cloud is free

2. Which of the following commands is used to run a dbt project locally with dbt Core?

easy

A. dbt run

B. dbt cloud start

C. dbt deploy web

D. dbt schedule job

Solution

1. Step 1: Identify the command to run models in dbt Core

   The command dbt run is used in dbt Core to execute models locally from the command line.

2. Step 2: Check other options for correctness

   Commands like dbt cloud start, dbt deploy web, and dbt schedule job are not valid dbt Core commands.

3. Final Answer:

   dbt run -> Option A

4. Quick Check:

   Run models locally = dbt run [OK]

Hint: dbt Core runs models with 'dbt run' command [OK]

Common Mistakes:

• Using commands that only exist in dbt Cloud
• Confusing 'dbt run' with scheduling commands
• Trying to run dbt Core with web commands

3. Consider this snippet of a dbt Cloud feature list:

Features:
- Web UI
- Job scheduling
- Team collaboration
- Version control integration

Which feature is NOT available in dbt Core by default?

medium

A. Web UI

B. Version control integration

C. Command-line interface

D. Local model execution

Solution

1. Step 1: Identify features exclusive to dbt Cloud

   dbt Cloud provides a web user interface (Web UI), job scheduling, and collaboration tools.

2. Step 2: Identify features available in dbt Core

   dbt Core provides a command-line interface and allows local model execution but does not have a web UI by default.

3. Final Answer:

   Web UI -> Option A

4. Quick Check:

   Web UI = dbt Cloud only [OK]

Hint: Web UI is a cloud-only feature, not in Core [OK]

Common Mistakes:

• Thinking version control is only in Cloud
• Confusing CLI with UI
• Assuming local execution needs Cloud

4. You try to schedule a dbt job using dbt Core and get an error. Why does this happen?

medium

A. Job scheduling is only possible with the command-line interface.

B. You need to install dbt Cloud to run any dbt commands.

C. Scheduling requires a special command in dbt Core called dbt schedule.

D. dbt Core does not support job scheduling natively.

Solution

1. Step 1: Understand scheduling support in dbt Core

   dbt Core is a command-line tool and does not have built-in job scheduling features.

2. Step 2: Recognize scheduling is a feature of dbt Cloud

   dbt Cloud provides job scheduling through its web interface, which is not available in dbt Core.

3. Final Answer:

   dbt Core does not support job scheduling natively. -> Option D

4. Quick Check:

   Scheduling = dbt Cloud feature only [OK]

Hint: Scheduling needs dbt Cloud, not Core [OK]

Common Mistakes:

• Trying to use a non-existent 'dbt schedule' command in Core
• Thinking dbt Core requires dbt Cloud to run commands
• Confusing CLI with scheduling features

5. Your team wants to collaborate on dbt projects with easy scheduling and a user-friendly interface. Which option best fits your needs?

hard

A. Use dbt Core with manual command-line runs and external schedulers.

B. Use dbt Cloud for built-in scheduling, UI, and collaboration features.

C. Use dbt Core with a third-party web UI but no scheduling.

D. Use dbt Core only for small projects without collaboration.

Solution

1. Step 1: Identify team needs

   The team wants collaboration, scheduling, and a user-friendly interface.

2. Step 2: Match needs to dbt Cloud features

   dbt Cloud offers built-in scheduling, a web UI, and collaboration tools, fitting the team's needs well.

3. Step 3: Compare with dbt Core limitations

   dbt Core lacks built-in scheduling and UI, requiring manual or external tools, which is less convenient for teams.

4. Final Answer:

   Use dbt Cloud for built-in scheduling, UI, and collaboration features. -> Option B

5. Quick Check:

   Team collaboration + scheduling = dbt Cloud [OK]

Hint: For collaboration and scheduling, pick dbt Cloud [OK]

Common Mistakes:

• Choosing dbt Core despite missing scheduling/UI
• Ignoring collaboration needs
• Assuming third-party tools replace dbt Cloud features fully