Sharding and partitioning in DBMS Theory - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is partitioning in databases?

Partitioning is the process of dividing a large database table into smaller, more manageable pieces called partitions. Each partition holds a subset of the data, often based on a specific column value like date or region.

beginner

Define sharding in simple terms.

Sharding is a type of database partitioning where data is split across multiple servers or machines. Each shard holds a portion of the data, helping to spread the load and improve performance.

intermediate

How does sharding differ from partitioning?

Partitioning divides data within a single database or server into parts, while sharding splits data across multiple servers or machines. Sharding is a form of horizontal scaling, whereas partitioning is often within one system.

beginner

Give a real-life example of when sharding is useful.

Imagine a social media app with millions of users. Sharding lets the app store user data on different servers based on user location or ID, so no single server gets overloaded and the app runs faster.

intermediate

What are common ways to partition data?

Data can be partitioned by range (e.g., dates), list (e.g., countries), or hash (using a function to evenly distribute data). These methods help organize data for faster access and easier management.

What does sharding primarily help with?

A Compressing data to save space

B Distributing data across multiple servers

C Encrypting database data

D Backing up data regularly

Sharding splits data across multiple servers to improve performance and scalability.

Which of these is a common partitioning method?

A Backup partitioning

B Encryption partitioning

C Range partitioning

D Compression partitioning

Range partitioning divides data based on ranges like dates or numbers.

Partitioning usually happens within:

A A single database or server

B Multiple servers worldwide

C Only cloud databases

D Backup storage systems

Partitioning divides data inside one database or server.

Which scenario best fits sharding?

A Backing up data to an external drive

B Splitting a table into smaller parts on one server

C Encrypting sensitive data in a database

D A large website spreading user data across servers

Sharding spreads data across servers to handle large scale and traffic.

Hash partitioning means:

A Using a function to evenly distribute data

B Dividing data by date ranges

C Grouping data by country names

D Encrypting data with a hash

Hash partitioning uses a function to spread data evenly across partitions.

Explain the difference between sharding and partitioning in databases.

Think about where the data is divided and why.

Describe a real-life example where sharding would improve a system's performance.

Consider popular apps or websites with many users.

Practice

1. What is the main difference between sharding and partitioning in databases?

easy

A. Sharding divides data within one database; partitioning spreads data across multiple servers.

B. Partitioning divides data within one database; sharding spreads data across multiple servers.

C. Both sharding and partitioning mean the same and are used interchangeably.

D. Partitioning is used only for backups, while sharding is for data security.

Solution

1. Step 1: Understand partitioning

   Partitioning splits data inside a single database into smaller parts for easier management and faster queries.

2. Step 2: Understand sharding

   Sharding spreads data across multiple servers or machines to handle very large datasets and improve performance.

3. Final Answer:

   Partitioning divides data within one database; sharding spreads data across multiple servers. -> Option B

4. Quick Check:

   Partitioning = single database, Sharding = multiple servers [OK]

Hint: Partitioning = one DB; Sharding = many servers [OK]

Common Mistakes:

• Confusing sharding with partitioning
• Thinking both are the same
• Assuming partitioning involves multiple servers

2. Which of the following is a correct way to describe horizontal partitioning in a database?

easy

A. Splitting a table into multiple tables with the same columns but different rows.

B. Splitting a table into multiple tables with different columns but same rows.

C. Combining multiple tables into one large table.

D. Backing up the entire database to a separate server.

Solution

1. Step 1: Define horizontal partitioning

   Horizontal partitioning means dividing a table by rows, so each partition has the same columns but different sets of rows.

2. Step 2: Check options

   Splitting a table into multiple tables with the same columns but different rows. matches this definition exactly, while others describe different concepts or unrelated actions.

3. Final Answer:

   Splitting a table into multiple tables with the same columns but different rows. -> Option A

4. Quick Check:

   Horizontal partitioning = split rows [OK]

Hint: Horizontal partitioning splits rows, not columns [OK]

Common Mistakes:

• Mixing horizontal with vertical partitioning
• Thinking partitioning means backup
• Confusing rows with columns

3. Consider a database sharded by user ID across three servers: Server 1 stores users with IDs ending in 0-3, Server 2 stores 4-6, and Server 3 stores 7-9. If a query requests data for user ID 27, which server will handle the request?

medium

A. Server 3

B. Server 2

C. Server 1

D. All servers

Solution

1. Step 1: Identify the shard key and ranges

   The sharding is based on the last digit of user ID: 0-3 on Server 1, 4-6 on Server 2, 7-9 on Server 3.

2. Step 2: Find the last digit of user ID 27

   The last digit of 27 is 7, which falls in the 7-9 range assigned to Server 3.

3. Final Answer:

   Server 3 -> Option A

4. Quick Check:

   User ID 27 ends with 7, so Server 3 [OK]

Hint: Check last digit of ID to find server [OK]

Common Mistakes:

• Ignoring the last digit and guessing server
• Choosing all servers instead of one
• Mixing up the shard ranges

4. A database administrator tries to shard a database but notices that some shards have much more data than others, causing slow queries. What is the most likely problem?

medium

A. The backup process is running during queries.

B. The database is not partitioned vertically.

C. The database server hardware is outdated.

D. The shard key is not chosen properly, causing uneven data distribution.

Solution

1. Step 1: Understand shard key role

   The shard key determines how data is split across shards. A poor choice can cause uneven data distribution.

2. Step 2: Analyze the problem

   Uneven shard sizes causing slow queries usually mean the shard key is not distributing data evenly.

3. Final Answer:

   The shard key is not chosen properly, causing uneven data distribution. -> Option D

4. Quick Check:

   Uneven shards = bad shard key choice [OK]

Hint: Uneven shards? Check shard key choice [OK]

Common Mistakes:

• Blaming hardware without checking shard key
• Confusing sharding with partitioning issues
• Ignoring data distribution patterns

5. You have a large customer database that is partitioned by region within a single server. To improve performance and handle growth, you want to shard the data across multiple servers. Which approach best combines partitioning and sharding?

hard

A. Use only partitioning by region on one server; sharding is unnecessary.

B. Partition the database by customer type across servers, and shard data by region within each server.

C. Shard the database by region across servers, and within each server, partition data by customer type.

D. Backup the database regularly instead of sharding or partitioning.

Solution

1. Step 1: Understand combining sharding and partitioning

   Sharding splits data across servers; partitioning splits data inside each server for better management.

2. Step 2: Analyze the best approach

   Sharding by region spreads data geographically, and partitioning by customer type inside each shard improves query speed and organization.

3. Final Answer:

   Shard the database by region across servers, and within each server, partition data by customer type. -> Option C

4. Quick Check:

   Shard by region, partition by type inside servers [OK]

Hint: Shard first, then partition inside shards [OK]

Common Mistakes:

• Mixing up shard and partition levels
• Ignoring partitioning after sharding
• Thinking backup replaces sharding