YARN vs MapReduce v1 in Hadoop - Quick Revision & Key Differences

Recall & Review

beginner

What is the main role of YARN in Hadoop?

YARN manages resources and schedules tasks across the cluster, allowing multiple applications to run simultaneously.

beginner

How does MapReduce v1 handle resource management?

MapReduce v1 uses a single JobTracker to manage both resource allocation and job scheduling, which can cause bottlenecks.

intermediate

What is a key limitation of MapReduce v1 compared to YARN?

MapReduce v1 can only run MapReduce jobs, while YARN supports multiple types of applications beyond MapReduce.

intermediate

How does YARN improve scalability over MapReduce v1?

YARN separates resource management and job scheduling into ResourceManager and ApplicationMaster, reducing bottlenecks and improving scalability.

intermediate

What components replace the JobTracker and TaskTracker in YARN?

YARN replaces JobTracker with ResourceManager and ApplicationMaster, and TaskTracker with NodeManager.

Which component in YARN is responsible for managing cluster resources?

A TaskTracker

B ResourceManager

C JobTracker

D ApplicationMaster

ResourceManager manages cluster resources in YARN.

In MapReduce v1, which component handles both job scheduling and resource management?

A ApplicationMaster

B ResourceManager

C NodeManager

D JobTracker

JobTracker handles both job scheduling and resource management in MapReduce v1.

What is a major advantage of YARN over MapReduce v1?

A Runs multiple types of applications

B Does not manage resources

C Uses a single JobTracker

D Supports only MapReduce jobs

YARN supports multiple types of applications, unlike MapReduce v1.

Which YARN component runs on each node to manage containers?

A ResourceManager

B JobTracker

C NodeManager

D ApplicationMaster

NodeManager runs on each node to manage containers.

Why can MapReduce v1 become a bottleneck in large clusters?

A Because JobTracker handles all scheduling and resource management

B Because it uses multiple ResourceManagers

C Because it supports multiple application types

D Because NodeManagers are overloaded

JobTracker handling all scheduling and resource management can cause bottlenecks.

Explain the architectural differences between YARN and MapReduce v1.

Think about how resource management and job scheduling are divided.

Describe how YARN improves cluster resource utilization compared to MapReduce v1.

Focus on resource allocation and application management.