Log management and troubleshooting in Hadoop - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ Predict Output

intermediate

Understanding Hadoop Log Levels

What will be the output of the following Hadoop log configuration snippet when the log level is set to WARN?

log4j.logger.org.apache.hadoop=INFO, console
log4j.logger.org.apache.hadoop.hdfs=WARN, console
log4j.logger.org.apache.hadoop.mapreduce=ERROR, console

Assuming a log event of level INFO from org.apache.hadoop.hdfs and a log event of level WARN from org.apache.hadoop.mapreduce, which will be printed to the console?

Hadoop

log4j.logger.org.apache.hadoop=INFO, console
log4j.logger.org.apache.hadoop.hdfs=WARN, console
log4j.logger.org.apache.hadoop.mapreduce=ERROR, console

A Only the INFO log from org.apache.hadoop.hdfs is printed

B Only the WARN log from org.apache.hadoop.hdfs is printed

C Only the WARN log from org.apache.hadoop.mapreduce is printed

D Both INFO from org.apache.hadoop.hdfs and WARN from org.apache.hadoop.mapreduce are printed

💡 Hint

Remember that logs are printed only if their level is equal or higher than the configured level.

The org.apache.hadoop.hdfs logger is set to WARN, so INFO logs are ignored. The WARN log from org.apache.hadoop.mapreduce is below ERROR level, so it is ignored. Only WARN logs from org.apache.hadoop.hdfs or higher are printed.

❓ data_output

intermediate

Parsing Hadoop Logs for Error Counts

Given a Hadoop log file with lines like:

2024-06-01 12:00:01,234 INFO Client: Connection established
2024-06-01 12:00:02,345 ERROR DataNode: Disk failure detected
2024-06-01 12:00:03,456 WARN NameNode: High memory usage

Which Python code snippet correctly counts the number of ERROR log entries?

Hadoop

log_lines = [
    '2024-06-01 12:00:01,234 INFO Client: Connection established',
    '2024-06-01 12:00:02,345 ERROR DataNode: Disk failure detected',
    '2024-06-01 12:00:03,456 WARN NameNode: High memory usage'
]

# Count ERROR logs

A error_count = len([line for line in log_lines if 'error' in line.lower()])

B error_count = len([line for line in log_lines if line.startswith('ERROR')])

C error_count = sum(1 for line in log_lines if line.split()[2] == 'ERROR')

D error_count = sum(1 for line in log_lines if 'ERROR' in line)

💡 Hint

Check how the log level appears in each line and how to detect it.

The log level appears after the timestamp and comma, so checking if 'ERROR' is in the line works. Option D fails because lines do not start with 'ERROR'. Option D fails because the third word is the time with comma, not the log level. Option D works but is case insensitive and less direct.

🔧 Debug

advanced

Troubleshooting Missing Hadoop Logs

A Hadoop cluster admin notices that logs from org.apache.hadoop.mapreduce are missing in the log files, even though tasks are running. The log4j.properties file contains:

log4j.logger.org.apache.hadoop=INFO, console
log4j.logger.org.apache.hadoop.mapreduce=OFF, console

What is the cause of missing logs for MapReduce?

A The console appender is not defined, so logs are not saved

B The log4j.properties file is missing the root logger configuration

C The log level OFF disables all logging for org.apache.hadoop.mapreduce

D The INFO level is too low to capture MapReduce logs

💡 Hint

Check what the OFF log level means in log4j.

Setting log level to OFF disables all logging for that logger. Hence, no MapReduce logs appear. The console appender is defined. INFO level is higher than OFF, so it does not affect MapReduce logger. Root logger missing would affect all logs.

🚀 Application

advanced

Visualizing Hadoop Log Error Trends

You have extracted daily counts of ERROR logs from Hadoop over 7 days:

errors = [5, 7, 3, 8, 6, 10, 4]

Which Python code using matplotlib will correctly plot these error counts as a line chart with days on the x-axis labeled from 1 to 7?

Hadoop

import matplotlib.pyplot as plt
errors = [5, 7, 3, 8, 6, 10, 4]

A

plt.plot(range(1, 8), errors)
plt.xlabel('Day')
plt.ylabel('Error Count')
plt.title('Hadoop Error Trends')
plt.show()

B

plt.plot(errors)
plt.xlabel('Error Count')
plt.ylabel('Day')
plt.title('Hadoop Error Trends')
plt.show()

C

plt.bar(range(7), errors)
plt.xlabel('Day')
plt.ylabel('Error Count')
plt.title('Hadoop Error Trends')
plt.show()

D

plt.scatter(range(1, 8), errors)
plt.xlabel('Error Count')
plt.ylabel('Day')
plt.title('Hadoop Error Trends')
plt.show()

💡 Hint

Check axis labels and plot type for a line chart with days on x-axis.

Option A correctly plots a line chart with days 1 to 7 on x-axis and error counts on y-axis. Option A plots a bar chart, not line. Option A swaps axes labels incorrectly. Option A uses scatter plot with swapped labels.

🧠 Conceptual

expert

Root Cause Analysis Using Hadoop Logs

During a Hadoop job failure, the logs show repeated java.net.ConnectException: Connection refused errors from DataNode to NameNode. Which is the most likely root cause?

A NameNode service is down or unreachable from DataNode

B DataNode has disk failure causing connection errors

C Network bandwidth is saturated causing slow connections

D MapReduce job configuration has incorrect memory settings

💡 Hint

Think about what 'Connection refused' means in network communication.

'Connection refused' means the target service is not accepting connections, likely because NameNode is down or unreachable. Disk failure or bandwidth issues cause different errors. Memory settings affect job execution but not connection refusals.