Installing Airflow locally - Visual Walkthrough

Process Flow - Installing Airflow locally

Start: Prepare environment

↓

Create virtual environment

↓

Activate virtual environment

↓

Install Airflow with pip

↓

Initialize Airflow database

↓

Start Airflow webserver

↓

Start Airflow scheduler

↓

Access Airflow UI in browser

↓

Done

This flow shows the step-by-step process to install and run Airflow locally using a virtual environment.

Execution Sample

Apache Airflow

python3 -m venv airflow_env
source airflow_env/bin/activate
pip install apache-airflow
airflow db init
airflow webserver -p 8080
airflow scheduler

Commands to create a virtual environment, install Airflow, initialize its database, and start the webserver and scheduler.

Process Table

Step	Command	Action	Result/Output
1	python3 -m venv airflow_env	Create virtual environment folder	Folder 'airflow_env' created with isolated Python environment
2	source airflow_env/bin/activate	Activate virtual environment	Shell prompt changes, Python points to 'airflow_env'
3	pip install apache-airflow	Install Airflow package	Airflow and dependencies installed in virtual environment
4	airflow db init	Initialize Airflow metadata database	Database tables created, ready for Airflow use
5	airflow webserver -p 8080	Start Airflow webserver on port 8080	Webserver running, logs show startup success
6	airflow scheduler	Start Airflow scheduler	Scheduler running, ready to execute workflows
7	Access http://localhost:8080	Open Airflow UI in browser	Airflow dashboard loads, showing status and DAGs
8	Exit	Stop commands or close terminal	Airflow services stop, environment deactivated

💡 All steps completed successfully, Airflow is installed and running locally.

Status Tracker

Variable	Start	After Step 1	After Step 2	After Step 3	After Step 4	After Step 5	After Step 6	Final
Virtual Environment	None	Created 'airflow_env'	Activated 'airflow_env'	Active 'airflow_env'	Active 'airflow_env'	Active 'airflow_env'	Active 'airflow_env'	Active 'airflow_env'
Airflow Package	Not installed	Not installed	Installed	Installed	Installed	Installed	Installed	Installed
Airflow DB	Not initialized	Not initialized	Not initialized	Initialized	Initialized	Initialized	Initialized	Initialized
Webserver	Not running	Not running	Not running	Not running	Running	Running	Running	Running
Scheduler	Not running	Not running	Not running	Not running	Not running	Not running	Running	Running

Key Moments - 3 Insights

Why do we create and activate a virtual environment before installing Airflow?

Creating and activating a virtual environment isolates Airflow and its dependencies from other Python projects, preventing conflicts. This is shown in steps 1 and 2 of the execution_table.

What does 'airflow db init' do and why is it necessary?

'airflow db init' sets up the database tables Airflow needs to track workflows and tasks. Without this, Airflow cannot run properly. This is step 4 in the execution_table.

Why do we start both the webserver and the scheduler?

The webserver provides the user interface to monitor workflows, while the scheduler runs the workflows on time. Both are needed for Airflow to function fully, as seen in steps 5 and 6.

Visual Quiz - 3 Questions

Look at the execution_table, after which step is the Airflow package installed?

A After step 2

B After step 3

C After step 4

D After step 5

💡 Hint

Check the 'Airflow Package' row in variable_tracker after step 3.

At which step does the Airflow webserver start running?

A Step 5

B Step 6

C Step 4

D Step 7

💡 Hint

Look at the 'Webserver' variable in variable_tracker and the execution_table step 5.

If you skip activating the virtual environment, what would likely happen when installing Airflow?

A The installation fails with an error

B Airflow installs in the virtual environment anyway

C Airflow installs globally, possibly causing conflicts

D Nothing happens, installation is skipped

💡 Hint

Refer to key_moments about virtual environment purpose and step 2 activation.

Concept Snapshot

Install Airflow locally:
1. Create virtual env: python3 -m venv airflow_env
2. Activate it: source airflow_env/bin/activate
3. Install Airflow: pip install apache-airflow
4. Initialize DB: airflow db init
5. Start webserver: airflow webserver -p 8080
6. Start scheduler: airflow scheduler
Use http://localhost:8080 to access UI.

Full Transcript

To install Airflow locally, first create a virtual environment to keep dependencies isolated. Activate it to use that environment. Then install Airflow using pip inside it. Initialize the Airflow database to prepare metadata storage. Start the Airflow webserver to access the UI and the scheduler to run workflows. Finally, open the browser at localhost port 8080 to see the Airflow dashboard. This process ensures Airflow runs cleanly on your machine without affecting other Python projects.