Outer join behavior in Pandas - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is an outer join in pandas?

An outer join in pandas combines all rows from both DataFrames, matching rows where possible and filling with NaN where there is no match.

beginner

What happens to rows that do not have matching keys in an outer join?

Rows without matching keys in either DataFrame are still included in the result, with missing values filled as NaN.

beginner

Which pandas function is used to perform an outer join?

The pandas function used is pd.merge() with the parameter how='outer'.

intermediate

How does an outer join differ from an inner join in pandas?

An inner join returns only rows with matching keys in both DataFrames, while an outer join returns all rows from both DataFrames, filling missing matches with NaN.

intermediate

What is the result of an outer join if both DataFrames have unique keys with no overlap?

The result will contain all rows from both DataFrames, with NaN values in columns where there is no matching key.

In pandas, what does how='outer' do in pd.merge()?

A Includes all rows from both DataFrames, matching where possible

B Includes only rows with matching keys in both DataFrames

C Includes only rows from the left DataFrame

D Includes only rows from the right DataFrame

An outer join includes all rows from both DataFrames, matching rows where keys align and filling missing values with NaN.

What value fills missing data in an outer join result in pandas?

A Empty string

B 0

C NaN

D False

Missing data in pandas outer join results is filled with NaN to indicate absence of a matching value.

Which join type returns only rows with keys present in both DataFrames?

A Inner join

B Left join

C Outer join

D Right join

Inner join returns only rows where keys match in both DataFrames.

If two DataFrames have no overlapping keys, what does an outer join return?

A An empty DataFrame

B Only rows from the right DataFrame

C Only rows from the left DataFrame

D All rows from both DataFrames with NaN in unmatched columns

Outer join returns all rows from both DataFrames, filling unmatched columns with NaN.

Which pandas method parameter controls the join type?

A join_type

B how

C method

D type

The parameter how in pd.merge() controls the join type, e.g., 'outer', 'inner', 'left', 'right'.

Explain in your own words what an outer join does in pandas and how it handles unmatched rows.

Think about including everything from both tables, even if they don't match.

Describe the difference between an outer join and an inner join in pandas.

Consider which rows are kept or dropped in each join type.

Practice

1. What does an outer join do when merging two DataFrames in pandas?

easy

A. Keeps only rows from the right DataFrame

B. Keeps only rows that match in both DataFrames

C. Keeps all rows from both DataFrames, filling missing values with NaN

D. Keeps only rows from the left DataFrame

Solution

1. Step 1: Understand the join types in pandas

   Inner join keeps only matching rows, left join keeps all from left, right join keeps all from right, outer join keeps all from both.

2. Step 2: Identify behavior of outer join

   Outer join includes all rows from both DataFrames and fills missing matches with NaN.

3. Final Answer:

   Keeps all rows from both DataFrames, filling missing values with NaN -> Option C

4. Quick Check:

   Outer join = all rows kept with NaN for missing [OK]

Hint: Outer join keeps all rows, fills missing with NaN [OK]

Common Mistakes:

• Confusing outer join with inner join
• Thinking outer join keeps only left or right rows
• Assuming missing data is dropped instead of NaN

2. Which of the following is the correct syntax to perform an outer join on DataFrames df1 and df2 using pandas?

easy

A. pd.merge(df1, df2, how='outer')

B. pd.merge(df1, df2, join='outer')

C. df1.join(df2, join='outer')

D. df1.merge(df2, type='outer')

Solution

1. Step 1: Recall the pandas merge syntax

   The function pd.merge() takes parameters including left DataFrame, right DataFrame, and how to join.

2. Step 2: Identify correct parameter for outer join

   The parameter to specify join type is how='outer'. Other options like join='outer' or type='outer' are invalid.

3. Final Answer:

   pd.merge(df1, df2, how='outer') -> Option A

4. Quick Check:

   Use how='outer' in pd.merge() [OK]

Hint: Use how='outer' in pd.merge() for outer join [OK]

Common Mistakes:

• Using join='outer' instead of how='outer'
• Using type='outer' which is invalid
• Using df1.join() without specifying correct parameters

3. Given the following DataFrames:

df1 = pd.DataFrame({'key': ['A', 'B'], 'val1': [1, 2]})
df2 = pd.DataFrame({'key': ['B', 'C'], 'val2': [3, 4]})

What is the result of pd.merge(df1, df2, on='key', how='outer')?

medium

A. {'key': ['A', 'B'], 'val1': [1, 2], 'val2': [NaN, 3]}

B. {'key': ['A', 'B', 'C'], 'val1': [1, 2, NaN], 'val2': [NaN, 3, 4]}

C. {'key': ['B'], 'val1': [2], 'val2': [3]}

D. {'key': ['B', 'C'], 'val1': [2, NaN], 'val2': [3, 4]}

Solution

1. Step 1: Identify keys and values in both DataFrames

   df1 keys: A, B with val1 1, 2; df2 keys: B, C with val2 3, 4.

2. Step 2: Perform outer join on 'key'

   Outer join keeps all keys: A, B, C. For A val2 is missing (NaN), for C val1 is missing (NaN), B has both values.

3. Final Answer:

   {'key': ['A', 'B', 'C'], 'val1': [1, 2, NaN], 'val2': [NaN, 3, 4]} -> Option B

4. Quick Check:

   Outer join keeps all keys with NaN for missing values [OK]

Hint: Outer join keys = union of keys, missing values become NaN [OK]

Common Mistakes:

• Confusing outer join with inner join (only B)
• Missing keys from either DataFrame
• Not filling missing values with NaN

4. You wrote this code but got an error:

pd.merge(df1, df2, how='outer', on='key', left_index=True)

What is the likely cause of the error?

medium

A. Cannot use both 'on' and 'left_index=True' together in merge

B. Missing 'right_index=True' parameter

C. The 'how' parameter should be 'outerjoin' not 'outer'

D. DataFrames must have the same columns to merge

Solution

1. Step 1: Understand parameters 'on' and 'left_index'

   'on' specifies column to join on; 'left_index=True' uses index for join. Both cannot be used simultaneously.

2. Step 2: Identify conflict causing error

   Using 'on' and 'left_index=True' together causes pandas to raise an error because join keys are ambiguous.

3. Final Answer:

   Cannot use both 'on' and 'left_index=True' together in merge -> Option A

4. Quick Check:

   'on' and 'left_index=True' conflict in merge [OK]

Hint: Don't mix 'on' with 'left_index=True' in merge [OK]

Common Mistakes:

• Assuming 'how'='outerjoin' is valid
• Forgetting that 'on' and 'left_index' conflict
• Thinking DataFrames must have same columns to merge

5. You have two DataFrames:

df1 = pd.DataFrame({'id': [1, 2, 3], 'score': [10, 20, 30]})
df2 = pd.DataFrame({'id': [2, 3, 4], 'grade': ['B', 'A', 'C']})

You want to merge them with an outer join but replace all NaN in 'score' with 0 and in 'grade' with 'N/A'. Which code correctly does this?

hard

A. result = pd.merge(df1, df2, on='id', how='outer').fillna({'score': 0})

B. result = pd.merge(df1, df2, on='id', how='outer').fillna(0).fillna('N/A')

C. result = pd.merge(df1, df2, on='id', how='outer').fillna({'score': 'N/A', 'grade': 0})

D. result = pd.merge(df1, df2, on='id', how='outer').fillna({'score': 0, 'grade': 'N/A'})

Solution

1. Step 1: Perform outer join on 'id'

   Outer join keeps all ids: 1, 2, 3, 4. Missing 'score' or 'grade' will be NaN.

2. Step 2: Replace NaN with correct values per column

   Use fillna with a dictionary to specify 0 for 'score' and 'N/A' for 'grade'. Other options either fill all with 0 or wrong values.

3. Final Answer:

   result = pd.merge(df1, df2, on='id', how='outer').fillna({'score': 0, 'grade': 'N/A'}) -> Option D

4. Quick Check:

   Use fillna with dict for column-specific NaN replacement [OK]

Hint: Use fillna({'col1': val1, 'col2': val2}) for different columns [OK]

Common Mistakes:

• Using fillna(0) for all columns, replacing strings incorrectly
• Swapping fillna values between columns
• Not filling NaN for all missing columns