Pig vs Hive comparison in Hadoop - Practice Questions

Challenge - 5 Problems

🧠 Conceptual

intermediate

Primary Language Used in Pig and Hive

Which language is primarily used to write scripts in Apache Pig and Apache Hive respectively?

A Pig Latin for Pig and HiveQL for Hive

B SQL for Pig and Java for Hive

C Python for Pig and Pig Latin for Hive

D HiveQL for Pig and Pig Latin for Hive

💡 Hint

Think about the scripting languages designed specifically for each tool.

Apache Pig uses Pig Latin, a procedural language, while Apache Hive uses HiveQL, a SQL-like declarative language.

🧠 Conceptual

intermediate

Data Processing Model Difference

What is the main difference in data processing models between Pig and Hive?

A Both use declarative models but Hive supports more data types

B Pig uses a procedural data flow model; Hive uses a declarative SQL-like model

C Both use procedural models but with different syntax

D Pig uses a declarative model; Hive uses a procedural model

💡 Hint

Consider how users specify data transformations in each tool.

Pig scripts describe step-by-step data transformations (procedural), while Hive queries specify what data to retrieve (declarative).

❓ Predict Output

advanced

Output of Pig Latin Script

What is the output of this Pig Latin script given the input data below?

Input data (file):
1,apple,10
2,banana,20
3,apple,15

Script:
fruit_data = LOAD 'input' USING PigStorage(',') AS (id:int, name:chararray, quantity:int);
apple_data = FILTER fruit_data BY name == 'apple';
total = FOREACH (GROUP apple_data ALL) GENERATE SUM(apple_data.quantity) as total_quantity;
DUMP total;

Hadoop

fruit_data = LOAD 'input' USING PigStorage(',') AS (id:int, name:chararray, quantity:int);
apple_data = FILTER fruit_data BY name == 'apple';
total = FOREACH (GROUP apple_data ALL) GENERATE SUM(apple_data.quantity) as total_quantity;
DUMP total;

A ({45})

B ({30})

C ({15})

D ({25})

💡 Hint

Add the quantities for all rows where name is 'apple'.

The script filters rows with name 'apple' (quantities 10 and 15) and sums them: 10 + 15 = 25. The output is ({25}).

❓ Predict Output

advanced

Hive Query Output for Grouping

Given a Hive table 'fruits' with columns (id INT, name STRING, quantity INT) and data:
1,apple,10
2,banana,20
3,apple,15

What is the output of this HiveQL query?
SELECT name, SUM(quantity) as total_quantity FROM fruits GROUP BY name ORDER BY total_quantity DESC;

Hadoop

SELECT name, SUM(quantity) as total_quantity FROM fruits GROUP BY name ORDER BY total_quantity DESC;

A [('banana', 30), ('apple', 25)]

B [('banana', 20), ('apple', 25)]

C [('apple', 25), ('banana', 20)]

D [('apple', 15), ('banana', 20)]

💡 Hint

Sum quantities per fruit and order descending by total quantity.

Apple total: 10 + 15 = 25, Banana total: 20.

Ordering by total_quantity DESC means apple first, then banana.

🚀 Application

expert

Choosing Between Pig and Hive for a Task

You have a large dataset with complex data transformations involving multiple steps and custom functions. You want to write scripts that allow step-by-step data manipulation and debugging. Which tool is more suitable?

A Pig, because it supports procedural scripts with stepwise transformations and custom functions

B Hive, because it supports SQL-like queries and is easier for analysts

C Hive, because it is faster for all types of data processing

D Pig, because it only supports simple queries and no custom functions

💡 Hint

Think about which tool is designed for complex data flows and custom code.

Pig is designed for procedural data flows and supports custom functions, making it better for complex transformations.

Hive is more declarative and suited for SQL-like queries.