Task failure callbacks in Apache Airflow - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a task failure callback in Airflow?

A task failure callback is a function that runs automatically when a task fails. It helps you respond to failures, like sending alerts or cleaning up resources.

beginner

How do you define a task failure callback in an Airflow DAG?

You define a Python function and assign it to the task's on_failure_callback parameter. This function receives context about the failed task.

intermediate

What kind of information can you access inside a task failure callback function?

You can access the task instance, execution date, exception details, and other context data to understand why the task failed.

intermediate

Why use task failure callbacks instead of just checking logs?

Callbacks let you automate responses like sending emails or notifications immediately after failure, saving time and reducing manual checks.

beginner

Can you use the same failure callback for multiple tasks?

Yes, you can reuse the same failure callback function for many tasks to keep your code simple and consistent.

What parameter do you use to set a failure callback on an Airflow task?

A on_retry_callback

B on_success_callback

C on_failure_callback

D on_complete_callback

The on_failure_callback parameter is used to specify a function that runs when a task fails.

What does the failure callback function receive as input?

A The task context dictionary

B The task logs only

C The DAG definition

D The Airflow scheduler

The failure callback function receives a context dictionary with details about the task and failure.

Which of these is a common use for task failure callbacks?

A Updating Airflow version

B Sending alert emails

C Changing task priority

D Starting a new DAG run

Sending alert emails is a common way to respond immediately to task failures.

Can a failure callback stop the task from failing?

A No, it only runs before the task

B Yes, it can fix the error automatically

C Yes, it prevents failure if set

D No, it runs after failure happens

Failure callbacks run after the task has failed; they do not prevent failure.

Is it possible to share one failure callback function across multiple tasks?

A Yes, it promotes code reuse

B No, each task needs a unique callback

C Only if tasks are in the same DAG

D Only for tasks with the same operator

You can reuse the same failure callback function for many tasks to keep code simple.

Explain how to create and use a task failure callback in Airflow.

Think about what happens when a task fails and how you can respond automatically.

Describe why task failure callbacks are useful in managing Airflow workflows.

Consider how you handle problems in daily tasks and how automation helps.