[Solved] Given this Hadoop MapReduce snippet to merge small files, what will be the output format of... Given this Hadoop MapReduce snippet to merge small files, what will be the output format of the job? | Hadoop

Hadoop - Performance Tuning

Given this Hadoop MapReduce snippet to merge small files, what will be the output format of the job?

job.setInputFormatClass(CombineFileInputFormat.class);
job.setOutputFormatClass(SequenceFileOutputFormat.class);

AMultiple small files as output

BText files with combined content

COne large SequenceFile containing merged data

DCompressed small files

Step-by-Step Solution

Solution:

Step 1: Understand CombineFileInputFormat role
It combines multiple small input files into fewer splits for efficient processing.
Step 2: Understand SequenceFileOutputFormat role
It writes output as SequenceFiles, which are binary files storing key-value pairs.
Final Answer:
One large SequenceFile containing merged data -> Option C
Quick Check:
CombineFileInput + SequenceFileOutput = large merged SequenceFile [OK]

Quick Trick: CombineFileInput + SequenceFileOutput = merged large file [OK]

Common Mistakes:

Master "Performance Tuning" in Hadoop

9 interactive learning modes - each teaches the same concept differently

More Hadoop Quizzes

Given this Hadoop MapReduce snippet to merge small files, what will be the output format of the job?