HBase data model (column families) in Hadoop - Mini Project: Build & Apply

Understanding HBase Data Model with Column Families

📖 Scenario: You are working with a large dataset of customer information stored in HBase. To organize the data efficiently, you need to create a table with column families that group related data together.

🎯 Goal: Create an HBase table schema with two column families named personal and contact. Then, add sample data to these column families and finally retrieve the data to see how column families organize the information.

📋 What You'll Learn

Create an HBase table named customers with column families personal and contact

Insert sample data into the personal and contact column families for a customer with row key cust1

Retrieve and display the data stored in the customers table for cust1

💡 Why This Matters

🌍 Real World

HBase is used in big data applications to store large amounts of sparse data efficiently. Column families help group related data for faster access and better storage management.

💼 Career

Understanding HBase data model and column families is essential for roles in big data engineering, data architecture, and backend development working with Hadoop ecosystems.

1

Create HBase table with column families

Write the HBase shell command to create a table named customers with two column families: personal and contact.

Hadoop

# Your code here

Hint

Use the create command in HBase shell followed by the table name and the column family names in quotes.

2

Insert sample data into column families

Write HBase shell commands to insert the following data for row key cust1: in the personal column family, add name as John Doe and age as 30; in the contact column family, add email as [e-mail] and phone as 1234567890.

Hadoop

create 'customers', 'personal', 'contact'
# Your code here

Hint

Use the put command to add data to specific column families and qualifiers.

3

Retrieve data for the customer

Write the HBase shell command to get all data for the row key cust1 from the customers table.

Hadoop

create 'customers', 'personal', 'contact'
put 'customers', 'cust1', 'personal:name', 'John Doe'
put 'customers', 'cust1', 'personal:age', '30'
put 'customers', 'cust1', 'contact:email', '[e-mail]'
put 'customers', 'cust1', 'contact:phone', '1234567890'
# Your code here

Hint

Use the get command with the table name and row key to retrieve data.

4

Display the retrieved data

Run the HBase shell command to display the data for cust1 from the customers table and observe the output showing data grouped by column families.

Hadoop

create 'customers', 'personal', 'contact'
put 'customers', 'cust1', 'personal:name', 'John Doe'
put 'customers', 'cust1', 'personal:age', '30'
put 'customers', 'cust1', 'contact:email', '[e-mail]'
put 'customers', 'cust1', 'contact:phone', '1234567890'
get 'customers', 'cust1'
# Your code here

Hint

The output should show the data grouped under personal and contact column families for cust1.

Practice

1. What is the main purpose of column families in HBase?

easy

A. To encrypt data automatically

B. To store data in rows instead of columns

C. To create indexes for faster searching

D. To group related columns together for better organization

Solution

1. Step 1: Understand the role of column families

   Column families group related columns in HBase tables to organize data logically.

2. Step 2: Identify the main purpose

   This grouping helps manage storage and access efficiently by keeping related data together.

3. Final Answer:

   To group related columns together for better organization -> Option D

4. Quick Check:

   Column families = Group related columns [OK]

Hint: Think of column families as folders grouping related files [OK]

Common Mistakes:

• Confusing column families with rows
• Thinking column families create indexes
• Assuming column families encrypt data

2. Which of the following is the correct way to define a column family in an HBase table schema?

easy

A. create 'mytable', 'cf1'

B. CREATE TABLE mytable (rowkey STRING, cf1:col1 STRING)

C. INSERT INTO mytable (cf1) VALUES ('value')

D. ALTER TABLE mytable ADD COLUMN cf1

Solution

1. Step 1: Recall HBase shell syntax for creating tables

   In HBase shell, tables are created with column families using: create 'table_name', 'column_family'

2. Step 2: Match the correct syntax

   create 'mytable', 'cf1' matches this syntax exactly, defining 'cf1' as a column family.

3. Final Answer:

   create 'mytable', 'cf1' -> Option A

4. Quick Check:

   HBase create table syntax = create 'table', 'cf' [OK]

Hint: Use HBase shell syntax: create 'table', 'column_family' [OK]

Common Mistakes:

• Using SQL syntax instead of HBase shell
• Trying to add columns like in relational DBs
• Confusing insert with create commands

3. Given an HBase table with column families cf1 and cf2, what happens if you insert data only into cf1:colA for a row?

medium

A. Only cf1:colA stores data; cf2 columns remain empty for that row

B. Data is automatically copied to cf2

C. The row is rejected because all column families must have data

D. The entire row is deleted

Solution

1. Step 1: Understand column family independence

   In HBase, column families are independent; data can be stored in any family without affecting others.

2. Step 2: Analyze the effect of inserting data into one family

   Inserting data into cf1:colA stores data only there; cf2 columns remain empty for that row.

3. Final Answer:

   Only cf1:colA stores data; cf2 columns remain empty for that row -> Option A

4. Quick Check:

   Column families store data independently [OK]

Hint: Data in one column family doesn't affect others [OK]

Common Mistakes:

• Assuming data copies across column families
• Thinking all families must have data per row
• Believing row is deleted if some families are empty

4. You tried to create an HBase table with this command: create 'mytable' 'cf1' 'cf2' but got an error. What is the likely cause?

medium

A. You cannot create multiple column families in one command

B. The syntax requires column families as separate arguments with commas

C. Column family names must be enclosed in double quotes

D. Table names cannot contain numbers

Solution

1. Step 1: Review HBase create table syntax

   The correct syntax is: create 'table_name', 'cf1', 'cf2' with commas between column families.

2. Step 2: Identify the error in the command

   The command is missing commas between column families, which is invalid syntax in HBase shell.

3. Final Answer:

   The syntax requires column families as separate arguments with commas -> Option B

4. Quick Check:

   HBase create syntax = with commas between column families [OK]

Hint: List column families with commas in create command [OK]

Common Mistakes:

• Omitting commas between column families
• Using quotes incorrectly
• Thinking table names can't have numbers

5. You want to design an HBase table to store customer data with addresses and orders. Which is the best way to use column families?

hard

A. Create one column family for all data: 'cf_all'

B. Create a column family per customer

C. Create separate column families like 'address' and 'orders' to group related columns

D. Store addresses as rows and orders as columns in one family

Solution

1. Step 1: Understand column family design principles

   Column families group related columns to improve performance and reflect real-world categories.

2. Step 2: Apply to customer data scenario

   Separating 'address' and 'orders' into different column families groups related data logically and optimizes storage.

3. Final Answer:

   Create separate column families like 'address' and 'orders' to group related columns -> Option C

4. Quick Check:

   Use column families to group related data categories [OK]

Hint: Group related data in separate column families for clarity [OK]

Common Mistakes:

• Putting all data in one family causing inefficiency
• Creating a family per customer wastes resources
• Mixing rows and columns incorrectly