Airflow metrics with Prometheus - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the purpose of integrating Prometheus with Airflow?

Prometheus collects and stores metrics from Airflow to monitor its performance and health in real time.

beginner

Which Airflow component exposes metrics for Prometheus to scrape?

The Airflow webserver exposes metrics on an HTTP endpoint that Prometheus scrapes.

beginner

Name one common Airflow metric that Prometheus can collect.

One common metric is the number of running DAG runs, which helps track active workflows.

intermediate

How do you enable Prometheus metrics in Airflow's configuration?

Set `metrics.prometheus.enabled = True` in the airflow.cfg file or environment variables.

intermediate

What is the role of the Prometheus scrape config in monitoring Airflow?

It tells Prometheus where and how often to collect metrics from the Airflow metrics endpoint.

Which Airflow component typically exposes metrics for Prometheus?

A Airflow webserver

B Airflow scheduler

C Airflow worker

D Airflow database

The Airflow webserver exposes the metrics endpoint that Prometheus scrapes.

What configuration setting enables Prometheus metrics in Airflow?

A prometheus.metrics.active = yes

B metrics.prometheus.enabled = True

C enable.prometheus.metrics = on

D metrics.enabled.prometheus = true

The correct setting is metrics.prometheus.enabled = True in airflow.cfg or environment variables.

What does Prometheus use to find Airflow metrics?

A Scrape configuration with Airflow metrics endpoint URL

B Direct database queries

C Airflow CLI commands

D Airflow logs

Prometheus scrapes metrics from the HTTP endpoint specified in its scrape config.

Which metric would help monitor how many workflows are currently running in Airflow?

A Number of Airflow users

B CPU usage of Airflow server

C Disk space on Airflow host

D Number of running DAG runs

The number of running DAG runs metric shows active workflows.

Why is monitoring Airflow with Prometheus useful?

A To run Airflow tasks faster

B To replace Airflow's scheduler

C To track Airflow health and performance in real time

D To store Airflow logs permanently

Prometheus helps monitor Airflow's health and performance by collecting metrics.

Explain how Prometheus collects metrics from Airflow and why this is helpful.

Think about how Prometheus finds and uses Airflow data.

Describe the steps to enable and configure Prometheus metrics in Airflow.

Focus on configuration changes and Prometheus setup.