Creating RDDs from collections and files in Apache Spark - Interactive Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to create an RDD from a Python list.

Apache Spark

data = [1, 2, 3, 4, 5]
rdd = sc.[1](data)

Drag options to blanks, or click blank then click option'

Aparallelize

BtextFile

Cread

Dcollect

Attempts:

3 left

💡 Hint

Common Mistakes

Using textFile instead of parallelize for a list.

Trying to use collect to create an RDD.

The parallelize method creates an RDD from an existing Python collection like a list.

2fill in blank

medium

Complete the code to create an RDD by reading a text file.

Apache Spark

rdd = sc.[1]("/path/to/file.txt")

Drag options to blanks, or click blank then click option'

Aparallelize

BreadFile

Cload

DtextFile

Attempts:

3 left

💡 Hint

Common Mistakes

Using parallelize to read a file path string.

Using readFile which is not a Spark method.

The textFile method reads a text file and creates an RDD where each element is a line.

3fill in blank

hard

Fix the error in the code to create an RDD from a list of numbers.

Apache Spark

numbers = [10, 20, 30]
rdd = sc.[1](numbers).collect()

Drag options to blanks, or click blank then click option'

Aparallelize

BtextFile

Cread

Dload

Attempts:

3 left

💡 Hint

Common Mistakes

Using textFile on a list causes errors.

Trying to use read or load which are not valid here.

To create an RDD from a list, use parallelize. The other methods are for files or do not exist.

4fill in blank

hard

Fill both blanks to create an RDD from a list and filter even numbers.

Apache Spark

data = [1, 2, 3, 4, 5]
rdd = sc.[1](data).filter(lambda x: x [2] 2 == 0)

Drag options to blanks, or click blank then click option'

Aparallelize

B%

C//

D==

Attempts:

3 left

💡 Hint

Common Mistakes

Using textFile instead of parallelize.

Using // instead of % for modulus.

Use parallelize to create the RDD and the modulus operator % to check even numbers.

5fill in blank

hard

Fill all three blanks to create an RDD from a file, map each line to uppercase, and collect the results.

Apache Spark

rdd = sc.[1]("/path/to/file.txt")
upper_rdd = rdd.[2](lambda line: line.[3]())
result = upper_rdd.collect()

Drag options to blanks, or click blank then click option'

AtextFile

Bmap

Cupper

Dparallelize

Attempts:

3 left

💡 Hint

Common Mistakes

Using parallelize instead of textFile for reading files.

Using map incorrectly or missing it.

Using lower instead of upper for uppercase conversion.

Use textFile to read the file, map to apply a function to each line, and upper to convert text to uppercase.