Data lake design patterns in Hadoop - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a Data Lake in simple terms?

A Data Lake is a big storage place where you keep all kinds of data, like raw files, logs, and databases, without organizing it first. It's like a big lake where all water flows in without filtering.

beginner

What is the 'Raw Zone' in a Data Lake design pattern?

The Raw Zone is where data is stored exactly as it arrives, without any changes. Think of it as a storage room where you keep all your stuff before sorting it.

beginner

Explain the 'Cleansed Zone' in Data Lake design.

The Cleansed Zone holds data that has been cleaned and organized. It's like a kitchen where you prepare and tidy up ingredients before cooking.

intermediate

What is the purpose of the 'Curated Zone' in a Data Lake?

The Curated Zone contains data that is ready for analysis and reporting. It's like a neatly arranged library where you can easily find and use books.

intermediate

Why use a layered design pattern in Data Lakes?

Layered design helps keep data organized by stages: raw, cleansed, and curated. This makes it easier to manage, find, and trust data, just like sorting mail into inbox, processing, and archive.

Which zone in a Data Lake stores data exactly as it arrives?

A Archive Zone

B Cleansed Zone

C Curated Zone

D Raw Zone

The Raw Zone stores data in its original form without changes.

What is the main purpose of the Curated Zone?

A Prepare data for analysis

B Clean data

C Store raw data

D Delete old data

The Curated Zone holds data ready for analysis and reporting.

Why is layered design important in Data Lakes?

A To organize data by processing stages

B To make data messy

C To delete data faster

D To store only one type of data

Layered design organizes data by stages like raw, cleansed, and curated.

Which Hadoop tool is commonly used to store Data Lake data?

A Hive

B HDFS

C Spark

D YARN

HDFS is the Hadoop Distributed File System used to store large data sets.

What happens in the Cleansed Zone?

A Data is deleted

B Data is stored raw

C Data is cleaned and organized

D Data is archived

The Cleansed Zone contains data that has been cleaned and organized.

Describe the main zones in a Data Lake design pattern and their roles.

Think about how data flows from arrival to analysis.

Explain why a layered approach is useful when designing a Data Lake.

Consider how sorting helps in daily life.