ResourceManager and NodeManager in Hadoop - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the main role of the ResourceManager in Hadoop?

The ResourceManager manages the allocation of resources across all the nodes in the cluster. It tracks available resources and assigns them to applications.

beginner

What does the NodeManager do in a Hadoop cluster?

The NodeManager runs on each node and manages the node's resources. It monitors resource usage like CPU and memory and reports this to the ResourceManager.

intermediate

How do ResourceManager and NodeManager work together?

ResourceManager allocates resources and schedules tasks, while NodeManager executes tasks on its node and reports status back to ResourceManager.

intermediate

Why is ResourceManager considered the master in YARN architecture?

Because it centrally manages all resource allocation and scheduling decisions for the entire cluster, coordinating all NodeManagers.

advanced

What happens if a NodeManager fails in the cluster?

The ResourceManager detects the failure because it stops receiving heartbeats from that NodeManager and reallocates tasks to other healthy nodes.

Which component in Hadoop is responsible for tracking resource usage on individual nodes?

A NodeManager

B ResourceManager

C NameNode

D JobTracker

NodeManager runs on each node and monitors resource usage like CPU and memory.

What is the primary function of the ResourceManager?

A Store data blocks

B Manage resource allocation across the cluster

C Execute tasks on nodes

D Monitor network traffic

ResourceManager manages resource allocation and scheduling for the whole cluster.

If a NodeManager stops sending heartbeats, what does the ResourceManager do?

A Reallocates tasks to other nodes

B Ignores it

C Shuts down the cluster

D Restarts the NodeManager automatically

ResourceManager reallocates tasks to healthy nodes when a NodeManager fails.

Which of these is NOT a responsibility of the NodeManager?

A Monitoring resource usage on the node

B Reporting node status to ResourceManager

C Launching and managing containers

D Allocating resources cluster-wide

ResourceManager handles cluster-wide resource allocation, not NodeManager.

In YARN, the ResourceManager acts as the:

A Data storage node

B Slave node

C Master node

D Client node

ResourceManager is the master node managing resource allocation and scheduling.

Explain the roles of ResourceManager and NodeManager in Hadoop and how they interact.

Think about who controls the whole cluster and who controls each node.

Describe what happens when a NodeManager fails in a Hadoop cluster.

Focus on failure detection and task reassignment.