ResourceManager and NodeManager in Hadoop - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Role of ResourceManager in Hadoop YARN

What is the primary role of the ResourceManager in Hadoop YARN?

A It stores the actual data blocks in the Hadoop cluster.

B It executes tasks on the worker nodes directly.

C It manages the allocation of cluster resources and schedules applications.

D It monitors the health of the Hadoop Distributed File System.

💡 Hint

Think about which component decides how resources are shared among applications.

The ResourceManager is responsible for managing and allocating cluster resources and scheduling applications in Hadoop YARN.

🧠 Conceptual

intermediate

Function of NodeManager in Hadoop YARN

Which of the following best describes the function of the NodeManager in Hadoop YARN?

A It stores metadata about the cluster nodes.

B It schedules jobs across the entire cluster.

C It coordinates communication between ResourceManagers.

D It manages resources and monitors containers on a single node.

💡 Hint

Consider which component runs on each node and manages local resources.

The NodeManager runs on each node and manages resources and containers locally, reporting status to the ResourceManager.

❓ data_output

advanced

YARN Resource Allocation Output

Given the following YARN cluster resource report, what is the total available memory across all NodeManagers?

NodeManager1: 8 GB
NodeManager2: 16 GB
NodeManager3: 12 GB

A 36 GB

B 32 GB

C 30 GB

D 40 GB

💡 Hint

Add the memory available on each NodeManager.

Sum of 8 + 16 + 12 equals 36 GB total available memory.

🔧 Debug

advanced

Identifying NodeManager Failure Cause

A NodeManager is not reporting to the ResourceManager. Which of the following is the most likely cause?

A NodeManager service is stopped or crashed on that node.

B ResourceManager is overloaded with too many applications.

C HDFS DataNode is running normally on the node.

D The cluster has no available memory.

💡 Hint

Think about what would prevent a NodeManager from communicating with ResourceManager.

If the NodeManager service is stopped or crashed, it cannot report to the ResourceManager.

🚀 Application

expert

Analyzing ResourceManager Scheduling Behavior

In a Hadoop YARN cluster, the ResourceManager uses the Capacity Scheduler. If one queue is configured with 50% capacity but only uses 20%, what happens to the unused resources?

A NodeManagers automatically redistribute resources without ResourceManager involvement.

B Unused resources are temporarily allocated to other queues until needed by the original queue.

C ResourceManager shuts down the underutilized queue to save resources.

D Unused resources remain idle and cannot be used by other queues.

💡 Hint

Consider how Capacity Scheduler manages resource sharing among queues.

The Capacity Scheduler allows unused resources in one queue to be temporarily used by other queues to maximize cluster utilization.