Creating DataFrame from list of lists in Pandas - Performance & Efficiency

Time Complexity: Creating DataFrame from list of lists

O(n × m)

Understanding Time Complexity

We want to understand how the time needed to create a DataFrame from a list of lists changes as the list grows.

How does the work increase when we add more rows or columns?

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

import pandas as pd

# List of lists with data
data = [[1, 2, 3], [4, 5, 6], [7, 8, 9]]

# Create DataFrame from list of lists
df = pd.DataFrame(data, columns=['A', 'B', 'C'])
print(df)

This code creates a DataFrame from a list of lists, where each inner list is a row.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Reading each element in the list of lists to build the DataFrame.
• How many times: Once for each element in the input data (rows × columns).

How Execution Grows With Input

As the number of rows and columns grows, the work grows by the total number of elements.

Input Size (rows × columns)	Approx. Operations
10 × 3 = 30	About 30 operations
100 × 3 = 300	About 300 operations
1000 × 3 = 3000	About 3000 operations

Pattern observation: The time grows roughly in direct proportion to the total number of elements.

Final Time Complexity

Time Complexity: O(n × m)

This means the time to create the DataFrame grows linearly with the number of rows (n) times the number of columns (m).

Common Mistake

[X] Wrong: "Creating a DataFrame from a list of lists is always very fast and does not depend on data size."

[OK] Correct: The time actually depends on how many elements are in the list. More rows or columns mean more work to build the DataFrame.

Interview Connect

Understanding how data size affects DataFrame creation helps you reason about performance in real projects and interviews.

Self-Check

What if we changed the input from a list of lists to a list of dictionaries? How would the time complexity change?

Practice

1. What does creating a DataFrame from a list of lists in pandas mainly help you do?

easy

A. Organize data into rows and columns for easy analysis

B. Run SQL queries directly on the list

C. Convert data into images automatically

D. Encrypt data for security

Solution

1. Step 1: Understand DataFrame purpose

   A DataFrame is a table-like structure with rows and columns to organize data.

2. Step 2: Connect list of lists to DataFrame

   A list of lists can be converted into this table format for easier data handling.

3. Final Answer:

   Organize data into rows and columns for easy analysis -> Option A

4. Quick Check:

   DataFrame = Table format [OK]

Hint: DataFrames = tables; list of lists = rows [OK]

Common Mistakes:

• Thinking DataFrame encrypts data
• Confusing DataFrame with image conversion
• Assuming list of lists runs SQL

2. Which of the following is the correct way to create a DataFrame from a list of lists data = [[1, 2], [3, 4]] with columns named 'A' and 'B'?

easy

A. pd.DataFrame(data, columns=['A', 'B'])

B. pd.DataFrame(data, names=['A', 'B'])

C. pd.DataFrame(data, cols=['A', 'B'])

D. pd.DataFrame(data, header=['A', 'B'])

Solution

1. Step 1: Recall DataFrame column naming syntax

   Use the parameter columns to name columns when creating a DataFrame.

2. Step 2: Check each option

   Only pd.DataFrame(data, columns=['A', 'B']) uses columns=['A', 'B'], which is correct syntax.

3. Final Answer:

   pd.DataFrame(data, columns=['A', 'B']) -> Option A

4. Quick Check:

   Use columns= for column names [OK]

Hint: Use columns= to name DataFrame columns [OK]

Common Mistakes:

• Using names= instead of columns=
• Using cols= or header= which are invalid here
• Forgetting to pass columns parameter

3. What will be the output of the following code?

import pandas as pd
data = [[10, 20], [30, 40]]
df = pd.DataFrame(data, columns=['X', 'Y'])
print(df)

medium

A. X Y
0 20 10
1 40 30

B. X Y
0 10 20
1 30 40

C. 0 1
X 10 20
Y 30 40

D. Error: columns parameter missing

Solution

1. Step 1: Create DataFrame with given data and columns

   The list of lists becomes rows; columns=['X', 'Y'] names columns accordingly.

2. Step 2: Print DataFrame

   Output shows index 0 and 1 with values 10,20 and 30,40 under columns X and Y.

3. Final Answer:

   X Y 0 10 20 1 30 40 -> Option B

4. Quick Check:

   DataFrame prints rows with columns X, Y [OK]

Hint: Rows = inner lists; columns = names list [OK]

Common Mistakes:

• Swapping row and column values
• Confusing index with columns
• Expecting error without columns parameter

4. Identify the error in this code snippet:

import pandas as pd
data = [[1, 2], [3, 4]]
df = pd.DataFrame(data, columns=['A'])
print(df)

medium

A. DataFrame cannot be created from list of lists

B. Data should be a dictionary, not list of lists

C. Missing import statement for pandas

D. The columns list length does not match data inner list length

Solution

1. Step 1: Check data shape and columns length

   Each inner list has 2 elements, but columns list has only 1 name.

2. Step 2: Understand pandas error

   pandas requires columns length to match number of elements per row.

3. Final Answer:

   The columns list length does not match data inner list length -> Option D

4. Quick Check:

   Columns count = data columns count [OK]

Hint: Columns count must match inner list length [OK]

Common Mistakes:

• Ignoring mismatch between columns and data
• Thinking list of lists is invalid input
• Forgetting to import pandas

5. You have sales data as a list of lists: sales = [[100, 200], [150, 250], [300, 400]] representing sales in two regions. How do you create a DataFrame with columns 'Region1' and 'Region2' and add a new column 'Total' that sums both regions for each row?

hard

A. df = pd.DataFrame(sales, columns=['Region1', 'Region2'])
df['Total'] = sales[0] + sales[1]
print(df)

B. df = pd.DataFrame(sales)
df['Total'] = df[0] + df[1]
print(df)

C. df = pd.DataFrame(sales, columns=['Region1', 'Region2'])
df['Total'] = df['Region1'] + df['Region2']
print(df)

D. df = pd.DataFrame(sales, columns=['Region1', 'Region2'])
df['Total'] = df.sum()
print(df)

Solution

1. Step 1: Create DataFrame with correct columns

   Use columns=['Region1', 'Region2'] to name columns properly.

2. Step 2: Add 'Total' column by summing the two region columns

   Use df['Total'] = df['Region1'] + df['Region2'] to sum row-wise.

3. Final Answer:

   df = pd.DataFrame(sales, columns=['Region1', 'Region2']) df['Total'] = df['Region1'] + df['Region2'] print(df) -> Option C

4. Quick Check:

   Sum columns row-wise for total [OK]

Hint: Sum columns with df['Total'] = df['A'] + df['B'] [OK]

Common Mistakes:

• Adding lists instead of DataFrame columns
• Using df.sum() without axis=1 for row sums
• Not naming columns when creating DataFrame