Handling missing values (na.rm, na.omit) in R Programming - Mini Project: Build & Apply

Handling missing values (na.rm, na.omit)

📖 Scenario: You have collected temperature readings for a week, but some values are missing. You want to calculate the average temperature, ignoring the missing values.

🎯 Goal: Build a small R program that creates a vector with missing values, sets a helper variable to handle missing data, calculates the average temperature ignoring missing values, and prints the result.

📋 What You'll Learn

Create a numeric vector called temps with exactly these values: 23, NA, 25, 22, NA, 24, 26

Create a logical variable called remove_na and set it to TRUE

Calculate the average temperature using the mean() function with the argument na.rm = remove_na

Print the average temperature using print()

💡 Why This Matters

🌍 Real World

Handling missing data is common in real-world data analysis, like weather data, surveys, or sensor readings where some values might be missing.

💼 Career

Data analysts and scientists must know how to handle missing values to get accurate results and avoid errors in reports or models.

1

Create the temperature vector with missing values

Create a numeric vector called temps with these exact values: 23, NA, 25, 22, NA, 24, 26

R Programming

# Create the temps vector with missing values
# Your code here

Hint

Use the c() function to create a vector. Use NA to represent missing values.

2

Set the helper variable to remove missing values

Create a logical variable called remove_na and set it to TRUE

R Programming

temps <- c(23, NA, 25, 22, NA, 24, 26)
# Create remove_na variable and set it to TRUE
# Your code here

Hint

Use <- to assign TRUE to remove_na.

3

Calculate the average temperature ignoring missing values

Calculate the average temperature using the mean() function with the argument na.rm = remove_na and store it in a variable called avg_temp

R Programming

temps <- c(23, NA, 25, 22, NA, 24, 26)
remove_na <- TRUE
# Calculate average temperature ignoring missing values
# Your code here

Hint

Use mean(temps, na.rm = remove_na) to calculate the average ignoring missing values.

4

Print the average temperature

Print the variable avg_temp using the print() function

R Programming

temps <- c(23, NA, 25, 22, NA, 24, 26)
remove_na <- TRUE
avg_temp <- mean(temps, na.rm = remove_na)
# Print the average temperature
# Your code here

Hint

Use print(avg_temp) to display the average temperature.

Practice

1. What does the argument na.rm = TRUE do when used inside functions like sum() or mean() in R?

easy

A. It tells the function to ignore missing values (NA) during calculation.

B. It replaces missing values with zero before calculation.

C. It stops the function and returns an error if there are missing values.

D. It counts the number of missing values in the data.

Solution

1. Step 1: Understand the role of na.rm argument

   The na.rm argument stands for "NA remove" and controls whether missing values should be ignored.

2. Step 2: Effect of setting na.rm = TRUE

   When set to TRUE, the function skips over any NA values and calculates the result using only the available data.

3. Final Answer:

   It tells the function to ignore missing values (NA) during calculation. -> Option A

4. Quick Check:

   na.rm = TRUE means ignore NA values [OK]

Hint: Remember: na.rm = TRUE means "remove NA" during calculation [OK]

Common Mistakes:

• Thinking na.rm replaces NA with zero
• Assuming na.rm causes an error on NA
• Confusing na.rm with counting NAs

2. Which of the following is the correct syntax to remove missing values from a vector x using na.omit() in R?

easy

A. clean_x <- na.remove(x)

B. clean_x <- omit.na(x)

C. clean_x <- na.omit(x)

D. clean_x <- remove.na(x)

Solution

1. Step 1: Recall the function name for removing NAs

   The correct function in R to remove missing values is na.omit().

2. Step 2: Check the syntax usage

   It is used as na.omit(x) where x is the vector or data frame.

3. Final Answer:

   clean_x <- na.omit(x) -> Option C

4. Quick Check:

   Use na.omit() to remove NAs [OK]

Hint: Use na.omit() exactly as written to remove missing values [OK]

Common Mistakes:

• Swapping function name parts like omit.na
• Using non-existent functions like na.remove
• Confusing na.omit with na.rm argument

3. What is the output of the following R code?

x <- c(2, NA, 5, NA, 8)
sum(x)
sum(x, na.rm = TRUE)

medium

A. [1] 15 and [1] 15

B. [1] NA and [1] 15

C. [1] 15 and [1] NA

D. [1] NA and [1] NA

Solution

1. Step 1: Calculate sum without removing NAs

   Calling sum(x) with NA values returns NA because missing values cause the sum to be undefined.

2. Step 2: Calculate sum with na.rm = TRUE

   Calling sum(x, na.rm = TRUE) ignores NAs and sums only 2 + 5 + 8 = 15.

3. Final Answer:

   [1] NA and [1] 15 -> Option B

4. Quick Check:

   sum() returns NA if NA present unless na.rm=TRUE [OK]

Hint: sum() returns NA if NA present; use na.rm=TRUE to ignore [OK]

Common Mistakes:

• Assuming sum ignores NA by default
• Mixing output order of the two sums
• Thinking sum with na.rm=TRUE returns NA

4. You run this code in R:

data <- c(4, NA, 7, NA, 10)
mean(data)

But it returns NA. How can you fix it to get the mean ignoring missing values?

medium

A. Both A and C are correct

B. Use mean(data, na.rm = TRUE)

C. Use mean(na.omit(data))

D. Replace NA with zero manually before mean

Solution

1. Step 1: Understand why mean returns NA

   By default, mean() returns NA if any missing values exist in the data.

2. Step 2: Ways to ignore missing values

   You can either set na.rm = TRUE inside mean() or remove NAs first using na.omit() and then calculate mean.

3. Step 3: Check options

   Both mean(data, na.rm = TRUE) and mean(na.omit(data)) will give the correct mean ignoring NAs.

4. Final Answer:

   Both A and C are correct -> Option A

5. Quick Check:

   Use na.rm=TRUE or na.omit() to ignore NAs in mean [OK]

Hint: Use na.rm=TRUE or na.omit() to ignore missing values [OK]

Common Mistakes:

• Forgetting to add na.rm=TRUE
• Thinking mean automatically ignores NA
• Replacing NA with zero without reason

5. Given a data frame df with numeric column score containing some NAs, which code correctly calculates the average score excluding missing values and also removes rows with NA in score before calculating the mean?

hard

A. mean(df$score, na.rm = FALSE); df_clean <- na.omit(df); mean(df_clean$score)

B. mean(na.omit(df)); df_clean <- na.omit(df); mean(df_clean$score)

C. mean(df$score); df_clean <- na.omit(df$score); mean(df_clean)

D. mean(df$score, na.rm = TRUE); df_clean <- na.omit(df); mean(df_clean$score)

Solution

1. Step 1: Calculate mean ignoring NAs in the column

   Using mean(df$score, na.rm = TRUE) calculates average excluding NAs directly.

2. Step 2: Remove rows with NA in entire data frame

   na.omit(df) removes all rows with any NA values, including in score.

3. Step 3: Calculate mean on cleaned data

   Then mean(df_clean$score) calculates mean on data without missing values.

4. Final Answer:

   mean(df$score, na.rm = TRUE); df_clean <- na.omit(df); mean(df_clean$score) -> Option D

5. Quick Check:

   Use na.rm=TRUE for mean and na.omit() to clean data frame [OK]

Hint: Use na.rm=TRUE for mean and na.omit() to clean data frame [OK]

Common Mistakes:

• Using na.omit on vector but not on data frame
• Forgetting na.rm=TRUE in mean calculation
• Using na.omit incorrectly on a vector instead of data frame