Hive architecture in Hadoop - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is Apache Hive?

Apache Hive is a data warehouse software built on top of Hadoop. It allows users to query and manage large datasets using a SQL-like language called HiveQL.

beginner

Name the main components of Hive architecture.

The main components are: 1) Hive Driver, 2) Compiler, 3) Execution Engine, 4) Metastore, and 5) Hive Clients.

beginner

What is the role of the Hive Metastore?

The Hive Metastore stores metadata about tables, partitions, and schemas. It helps Hive understand the structure of the data stored in Hadoop.

intermediate

How does the Hive Driver function in the architecture?

The Hive Driver receives the HiveQL query, manages the lifecycle of the query, and passes it to the compiler for processing.

intermediate

Explain the role of the Execution Engine in Hive.

The Execution Engine executes the tasks created by the compiler. It interacts with Hadoop's MapReduce or other execution frameworks to run the query.

Which component in Hive stores metadata about tables and partitions?

A Metastore

B Execution Engine

C Compiler

D Driver

The Metastore holds metadata information such as table schemas and partition details.

What language does Hive use to query data?

A SQL

B Java

C Python

D HiveQL

Hive uses HiveQL, a SQL-like language designed for querying data in Hadoop.

Which Hive component is responsible for converting HiveQL queries into execution plans?

A Metastore

B Compiler

C Driver

D Execution Engine

The Compiler parses HiveQL and creates execution plans.

What does the Execution Engine in Hive do?

A Stores metadata

B Compiles queries

C Executes tasks on Hadoop

D Receives user queries

The Execution Engine runs the tasks on Hadoop using MapReduce or other frameworks.

Which of these is NOT a component of Hive architecture?

A Hive Executor

B Hive Compiler

C Hive Driver

D Hive Metastore

Hive Executor is not a standard component; the correct term is Execution Engine.

Describe the main components of Hive architecture and their roles.

Think about how a query flows from user input to execution.

Explain how Hive interacts with Hadoop to process data.

Focus on the flow from query to data processing.