Transformations vs actions in Apache Spark - Interactive Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to create a new RDD by doubling each number.

Apache Spark

rdd2 = rdd.[1](lambda x: x * 2)

Drag options to blanks, or click blank then click option'

Acount

Breduce

Ccollect

Dmap

Attempts:

3 left

💡 Hint

Common Mistakes

Using actions like collect or count instead of transformations.

The map transformation applies a function to each element and returns a new RDD.

2fill in blank

medium

Complete the code to get the total count of elements in the RDD.

Apache Spark

total = rdd.[1]()

Drag options to blanks, or click blank then click option'

Acount

Bmap

Cfilter

DflatMap

Attempts:

3 left

💡 Hint

Common Mistakes

Using transformations like map or filter instead of an action.

The count action returns the number of elements in the RDD and triggers computation.

3fill in blank

hard

Fix the error in the code to collect all elements as a list.

Apache Spark

elements = rdd.[1]()

Drag options to blanks, or click blank then click option'

Acollect

Breduce

Cmap

Dfilter

Attempts:

3 left

💡 Hint

Common Mistakes

Using transformations like map or filter which return RDDs, not lists.

The collect action returns all elements from the RDD to the driver as a list.

4fill in blank

hard

Fill both blanks to create a filtered RDD and count its elements.

Apache Spark

filtered = rdd.[1](lambda x: x > 10)
count = filtered.[2]()

Drag options to blanks, or click blank then click option'

Afilter

Bcount

Cmap

Dcollect

Attempts:

3 left

💡 Hint

Common Mistakes

Using map instead of filter, or collect instead of count.

filter creates a new RDD with elements matching the condition. count returns the number of elements and triggers computation.

5fill in blank

hard

Fill all three blanks to create a mapped RDD, filter it, and collect the results.

Apache Spark

mapped = rdd.[1](lambda x: x * 3)
filtered = mapped.[2](lambda x: x < 20)
result = filtered.[3]()

Drag options to blanks, or click blank then click option'

Amap

Bfilter

Ccollect

Dcount

Attempts:

3 left

💡 Hint

Common Mistakes

Mixing up transformations and actions, or using count instead of collect.

map transforms each element, filter selects elements, and collect brings the results to the driver as a list.