Hadoop - Performance Tuning
You have a Hadoop job with 10 map tasks. Each map task requires 3 GB of Java heap memory. To avoid container failures, what is the minimum container memory size you should set per map task?
You have a Hadoop job with 10 map tasks. Each map task requires 3 GB of Java heap memory. To avoid container failures, what is the minimum container memory size you should set per map task?
hard📝 Application Q15 of 15
Step-by-Step Solution
Solution:
Step 1: Calculate container memory with overhead
Container memory must be larger than Java heap size to allow overhead (usually 25-30%). Heap = 3 GB, so container memory should be at least 3 GB + 25% = 3.75 GB, rounded to 4 GB.Final Answer:
4 GB -> Option AQuick Check:
Container memory > heap size + overhead [OK]
Quick Trick: Add 25% overhead to heap for container memory [OK]
Common Mistakes:
- Setting container memory equal to heap size
- Ignoring overhead memory needs
- Confusing total job memory with per-task memory
Master "Performance Tuning" in Hadoop
Want More Practice?
15+ quiz questions · All difficulty levels · Free
Free Signup - Practice All QuestionsMore Hadoop Quizzes