XCom with return values in Apache Airflow - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is an XCom in Apache Airflow?

An XCom (short for cross-communication) is a way for tasks in Airflow to exchange small pieces of data or messages during a workflow run.

beginner

How do you return a value from a PythonOperator task to be used by another task?

You return the value from the Python function used in the PythonOperator. Airflow automatically pushes this return value as an XCom.

intermediate

How can a downstream task pull an XCom value returned by an upstream task?

Use the task instance's xcom_pull method with the task_id of the upstream task to get the returned value.

intermediate

What is the default key used when pushing XComs with return values?

The default key is 'return_value' when a task returns a value that Airflow pushes as an XCom.

beginner

Why should XComs be used only for small data?

Because XComs store data in the Airflow metadata database, large data can slow down the system and cause performance issues.

What happens when a PythonOperator's Python function returns a value?

A The value is saved to a file.

B The value is ignored unless manually pushed.

C The value is automatically pushed as an XCom with key 'return_value'.

D The task fails.

Airflow automatically pushes the returned value as an XCom with the key 'return_value'.

Which method is used to retrieve an XCom value in a task?

A xcom_push()

B xcom_pull()

C get_xcom()

D fetch_xcom()

The xcom_pull() method is used to retrieve XCom values from other tasks.

What is the recommended size of data to pass via XComs?

A Small pieces of data like strings or numbers

B Large files like images or videos

C Entire databases

D Full application logs

XComs are designed for small data pieces to avoid performance issues.

If you want to pass multiple values via XCom, what should you do?

A Return a dictionary or list from the Python function

B Return multiple values separately

C Use multiple PythonOperators

D XComs do not support multiple values

Returning a dictionary or list bundles multiple values into one XCom payload.

Which Airflow component stores XCom data?

A Scheduler

B Worker logs

C Executor

D Metadata database

XCom data is stored in the Airflow metadata database.

Explain how to pass data from one task to another using XCom return values in Airflow.

Think about how Python functions return values and how Airflow handles them.

Describe best practices and limitations when using XComs for passing data between tasks.

Consider performance and storage when using XComs.