HBase data model (column families) in Hadoop

Introduction

Column families group related data together in HBase. They help organize and store data efficiently.

When you want to store different types of data separately but in the same table.

When you need to control how data is stored and accessed for performance.

When you want to apply different settings like compression or versioning to groups of columns.

When designing a schema that reflects real-world categories of data.

When you want to optimize read and write operations by grouping frequently accessed columns.

Syntax

Hadoop

create 'table_name', 'column_family1', 'column_family2'

Column families are defined when creating a table and group columns logically.

Each column family can contain many columns, but all columns in a family share storage settings.

Examples

This table has two column families: info and stats. User name and email are in info, login count is in stats.

Hadoop

create 'users', 'info', 'stats'

Here, details holds product info, and inventory holds stock data.

Hadoop

create 'products', 'details', 'inventory'

Sample Program

This example creates an HBase table named employees with two column families: personal and work. It adds data for one employee and then scans the table to show the stored data.

Hadoop

create 'employees', 'personal', 'work'

put 'employees', 'emp1', 'personal:name', 'Alice'
put 'employees', 'emp1', 'personal:email', '[e-mail]'
put 'employees', 'emp1', 'work:department', 'Sales'

scan 'employees'

Important Notes

All columns in a column family are stored together on disk, which improves read/write speed for those columns.

Too many column families can slow down performance; keep them few and meaningful.

Column families cannot be added or removed easily after table creation, so plan carefully.

Summary

Column families group related columns in HBase tables.

They help organize data and control storage settings.

Use them to improve performance and reflect real-world data categories.

Practice

1. What is the main purpose of column families in HBase?

easy

A. To encrypt data automatically

B. To store data in rows instead of columns

C. To create indexes for faster searching

D. To group related columns together for better organization

Solution

1. Step 1: Understand the role of column families

   Column families group related columns in HBase tables to organize data logically.

2. Step 2: Identify the main purpose

   This grouping helps manage storage and access efficiently by keeping related data together.

3. Final Answer:

   To group related columns together for better organization -> Option D

4. Quick Check:

   Column families = Group related columns [OK]

Hint: Think of column families as folders grouping related files [OK]

Common Mistakes:

• Confusing column families with rows
• Thinking column families create indexes
• Assuming column families encrypt data

2. Which of the following is the correct way to define a column family in an HBase table schema?

easy

A. create 'mytable', 'cf1'

B. CREATE TABLE mytable (rowkey STRING, cf1:col1 STRING)

C. INSERT INTO mytable (cf1) VALUES ('value')

D. ALTER TABLE mytable ADD COLUMN cf1

Solution

1. Step 1: Recall HBase shell syntax for creating tables

   In HBase shell, tables are created with column families using: create 'table_name', 'column_family'

2. Step 2: Match the correct syntax

   create 'mytable', 'cf1' matches this syntax exactly, defining 'cf1' as a column family.

3. Final Answer:

   create 'mytable', 'cf1' -> Option A

4. Quick Check:

   HBase create table syntax = create 'table', 'cf' [OK]

Hint: Use HBase shell syntax: create 'table', 'column_family' [OK]

Common Mistakes:

• Using SQL syntax instead of HBase shell
• Trying to add columns like in relational DBs
• Confusing insert with create commands

3. Given an HBase table with column families cf1 and cf2, what happens if you insert data only into cf1:colA for a row?

medium

A. Only cf1:colA stores data; cf2 columns remain empty for that row

B. Data is automatically copied to cf2

C. The row is rejected because all column families must have data

D. The entire row is deleted

Solution

1. Step 1: Understand column family independence

   In HBase, column families are independent; data can be stored in any family without affecting others.

2. Step 2: Analyze the effect of inserting data into one family

   Inserting data into cf1:colA stores data only there; cf2 columns remain empty for that row.

3. Final Answer:

   Only cf1:colA stores data; cf2 columns remain empty for that row -> Option A

4. Quick Check:

   Column families store data independently [OK]

Hint: Data in one column family doesn't affect others [OK]

Common Mistakes:

• Assuming data copies across column families
• Thinking all families must have data per row
• Believing row is deleted if some families are empty

4. You tried to create an HBase table with this command: create 'mytable' 'cf1' 'cf2' but got an error. What is the likely cause?

medium

A. You cannot create multiple column families in one command

B. The syntax requires column families as separate arguments with commas

C. Column family names must be enclosed in double quotes

D. Table names cannot contain numbers

Solution

1. Step 1: Review HBase create table syntax

   The correct syntax is: create 'table_name', 'cf1', 'cf2' with commas between column families.

2. Step 2: Identify the error in the command

   The command is missing commas between column families, which is invalid syntax in HBase shell.

3. Final Answer:

   The syntax requires column families as separate arguments with commas -> Option B

4. Quick Check:

   HBase create syntax = with commas between column families [OK]

Hint: List column families with commas in create command [OK]

Common Mistakes:

• Omitting commas between column families
• Using quotes incorrectly
• Thinking table names can't have numbers

5. You want to design an HBase table to store customer data with addresses and orders. Which is the best way to use column families?

hard

A. Create one column family for all data: 'cf_all'

B. Create a column family per customer

C. Create separate column families like 'address' and 'orders' to group related columns

D. Store addresses as rows and orders as columns in one family

Solution

1. Step 1: Understand column family design principles

   Column families group related columns to improve performance and reflect real-world categories.

2. Step 2: Apply to customer data scenario

   Separating 'address' and 'orders' into different column families groups related data logically and optimizes storage.

3. Final Answer:

   Create separate column families like 'address' and 'orders' to group related columns -> Option C

4. Quick Check:

   Use column families to group related data categories [OK]

Hint: Group related data in separate column families for clarity [OK]

Common Mistakes:

• Putting all data in one family causing inefficiency
• Creating a family per customer wastes resources
• Mixing rows and columns incorrectly