Jupyter Notebook best practices in Data Analysis Python - Time & Space Complexity

Time Complexity: Jupyter Notebook best practices

O(n)

Understanding Time Complexity

We want to understand how the time it takes to run code in a Jupyter Notebook grows as the notebook gets bigger or more complex.

How does adding more cells or data affect the time to run the notebook?

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

import pandas as pd

data = pd.read_csv('large_data.csv')

for i in range(len(data)):
    row = data.iloc[i]
    # process each row
    print(row['value'])

This code reads a large CSV file and then processes each row one by one.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Looping through each row of the data.
• How many times: Once for every row in the dataset.

How Execution Grows With Input

As the number of rows grows, the time to process grows roughly the same amount.

Input Size (n)	Approx. Operations
10	10 operations
100	100 operations
1000	1000 operations

Pattern observation: The time grows directly with the number of rows. Double the rows, double the work.

Final Time Complexity

Time Complexity: O(n)

This means the time to run the code grows in a straight line with the size of the data.

Common Mistake

[X] Wrong: "Running more cells or adding comments does not affect execution time."

[OK] Correct: While comments do not affect time, adding many cells with heavy computations or repeated data loading can increase total run time significantly.

Interview Connect

Understanding how code execution time grows in notebooks helps you write efficient data analysis and explain your approach clearly in real projects or interviews.

Self-Check

"What if we replaced the loop with vectorized operations using pandas? How would the time complexity change?"

Practice

1. Why is it important to use Markdown cells in a Jupyter Notebook?

easy

A. To add titles and explanations that make the notebook easier to understand

B. To run code faster

C. To store large datasets

D. To change the notebook's theme

Solution

1. Step 1: Understand the role of Markdown cells

   Markdown cells are used to write text, titles, and explanations, not code.

2. Step 2: Identify the benefit of explanations

   Adding explanations helps others and yourself understand the notebook's purpose and steps.

3. Final Answer:

   To add titles and explanations that make the notebook easier to understand -> Option A

4. Quick Check:

   Markdown cells = explanations [OK]

Hint: Markdown = text and titles, not code [OK]

Common Mistakes:

• Thinking Markdown runs code
• Using Markdown to store data
• Ignoring explanations

2. Which of the following is the correct way to add a comment in a Python code cell in Jupyter Notebook?

easy

A. // This is a comment

B. # This is a comment

C.

D. /* This is a comment */

Solution

1. Step 1: Recall Python comment syntax

   Python uses the hash symbol (#) to start a comment.

2. Step 2: Identify correct comment style

   Only # This is a comment uses the correct Python comment syntax.

3. Final Answer:

   # This is a comment -> Option B

4. Quick Check:

   Python comments start with # [OK]

Hint: Python comments start with # [OK]

Common Mistakes:

• Using // which is for other languages
• Using HTML comment syntax
• Using C-style comments

3. Consider this Jupyter Notebook code sequence:

1. x = 5
2. y = x + 2
3. print(y)

What will be the output after running all cells from top to bottom?

medium

A. 2

B. 5

C. Error

D. 7

Solution

1. Step 1: Trace variable assignments

   x is assigned 5, then y is assigned x + 2, which is 7.

2. Step 2: Understand print output

   Printing y will output 7.

3. Final Answer:

   7 -> Option D

4. Quick Check:

   5 + 2 = 7 [OK]

Hint: Follow variable values step-by-step [OK]

Common Mistakes:

• Assuming print shows x instead of y
• Forgetting to run cells in order
• Expecting error without reason

4. You have a notebook with cells:

1. a = 10
2. print(a)
3. a = 20

If you run cells in order 1, 3, 2, what will happen?

medium

A. Prints 20

B. Prints 10

C. Error: variable a not defined

D. Prints nothing

Solution

1. Step 1: Analyze cell execution order

   Cell 1 sets a=10, cell 3 sets a=20, then cell 2 prints a.

2. Step 2: Determine printed value

   Since a was last set to 20 before printing, print(a) outputs 20.

3. Final Answer:

   Prints 20 -> Option A

4. Quick Check:

   Last assignment before print = 20 [OK]

Hint: Run cells top to bottom to avoid confusion [OK]

Common Mistakes:

• Assuming print shows old value
• Thinking print runs before assignment
• Expecting error due to order

5. You want to share a Jupyter Notebook with a colleague. Which practice ensures they see your results correctly?

hard

A. Delete all Markdown cells to reduce size

B. Only run the last cell before sharing

C. Run all cells from top to bottom before sharing

D. Share only the .py script exported from notebook

Solution

1. Step 1: Understand notebook execution state

   Running all cells top to bottom ensures outputs match code and order.

2. Step 2: Identify sharing best practice

   Sharing a fully run notebook avoids confusion and missing outputs.

3. Final Answer:

   Run all cells from top to bottom before sharing -> Option C

4. Quick Check:

   Run all cells = consistent notebook [OK]

Hint: Always run all cells before sharing [OK]

Common Mistakes:

• Sharing without running cells
• Deleting Markdown removes explanations
• Sharing only scripts loses notebook features