YARN scheduling policies in Hadoop - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is YARN in Hadoop?

YARN stands for Yet Another Resource Negotiator. It manages resources and schedules tasks in a Hadoop cluster.

beginner

Name the three main YARN scheduling policies.

The three main YARN scheduling policies are FIFO (First In First Out), Capacity Scheduler, and Fair Scheduler.

beginner

How does FIFO scheduling work in YARN?

FIFO scheduling runs jobs in the order they arrive. The first job submitted runs first, and others wait in line.

intermediate

What is the Capacity Scheduler in YARN?

Capacity Scheduler divides cluster resources into queues with set capacities. Each queue gets a guaranteed share of resources.

intermediate

Explain the Fair Scheduler in YARN.

Fair Scheduler tries to give all jobs an equal share of resources over time. It balances resources so no job waits too long.

Which YARN scheduler runs jobs strictly in the order they arrive?

A FIFO Scheduler

B Capacity Scheduler

C Fair Scheduler

D Round Robin Scheduler

FIFO Scheduler runs jobs in the order they arrive, first come first served.

What does the Capacity Scheduler guarantee?

A Equal resource share for all jobs

B Resources allocated randomly

C Resources divided into queues with set capacities

D Jobs run in arrival order

Capacity Scheduler divides resources into queues, each with a guaranteed capacity.

Which scheduler aims to balance resource usage fairly among all jobs?

A Fair Scheduler

B Capacity Scheduler

C FIFO Scheduler

D Priority Scheduler

Fair Scheduler balances resources so all jobs get a fair share over time.

YARN stands for:

A Your Application Resource Network

B Yet Another Resource Negotiator

C Yielding Advanced Resource Node

D Yard Allocation Resource Node

YARN means Yet Another Resource Negotiator, managing resources in Hadoop.

Which scheduling policy is best when you want guaranteed resource shares for different teams?

A FIFO Scheduler

B Fair Scheduler

C Random Scheduler

D Capacity Scheduler

Capacity Scheduler allows setting resource capacities per queue, useful for teams.

Describe the differences between FIFO, Capacity, and Fair scheduling policies in YARN.

Think about how each scheduler treats job order and resource allocation.

Explain why you might choose the Capacity Scheduler over FIFO in a multi-team Hadoop cluster.

Consider resource guarantees and fairness for different users.