Exporting to JSON in Data Analysis Python - Time & Space Complexity

Time Complexity: Exporting to JSON

O(n)

Understanding Time Complexity

We want to understand how the time to export data to JSON grows as the data size increases.

How does the work change when we have more data to save?

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

import pandas as pd

n = 1000  # Define n before using it

# Create a sample DataFrame
data = pd.DataFrame({
    'A': range(n),
    'B': [str(x) for x in range(n)]
})

# Export DataFrame to JSON file
data.to_json('output.json', orient='records')

This code creates a table of data with n rows and saves it as a JSON file.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Going through each row of the DataFrame to convert it to JSON format.
• How many times: Once for each of the n rows in the data.

How Execution Grows With Input

As the number of rows grows, the time to export grows roughly the same way.

Input Size (n)	Approx. Operations
10	About 10 operations
100	About 100 operations
1000	About 1000 operations

Pattern observation: The work grows directly with the number of rows.

Final Time Complexity

Time Complexity: O(n)

This means if you double the data size, the time to export roughly doubles too.

Common Mistake

[X] Wrong: "Exporting to JSON is instant no matter how big the data is."

[OK] Correct: The program must look at every row to write it out, so bigger data takes more time.

Interview Connect

Understanding how data export time grows helps you explain performance in real projects clearly and confidently.

Self-Check

"What if we export the data in chunks instead of all at once? How would the time complexity change?"

Practice

1. What is the main purpose of exporting data to JSON format in data analysis?

easy

A. To save data in a format that is easy to share and widely used

B. To make data unreadable for security

C. To convert data into an Excel spreadsheet

D. To compress data to reduce file size

Solution

1. Step 1: Understand JSON format use

   JSON is a text format that is easy to share and read by many programs.

2. Step 2: Identify the purpose of exporting

   Exporting to JSON helps save data in this easy-to-share format.

3. Final Answer:

   To save data in a format that is easy to share and widely used -> Option A

4. Quick Check:

   Exporting to JSON = Easy sharing [OK]

Hint: JSON is for sharing data simply and widely [OK]

Common Mistakes:

• Thinking JSON is for data compression
• Confusing JSON with Excel format
• Believing JSON makes data unreadable

2. Which of the following is the correct way to export a pandas DataFrame df to a JSON file named data.json?

easy

A. df.write_json('data.json')

B. df.export_json('data.json')

C. df.to_json('data.json')

D. df.save_json('data.json')

Solution

1. Step 1: Recall pandas export method

   The correct pandas method to export JSON is to_json.

2. Step 2: Match method with filename

   Using df.to_json('data.json') saves the DataFrame to the file.

3. Final Answer:

   df.to_json('data.json') -> Option C

4. Quick Check:

   pandas export JSON = to_json() [OK]

Hint: Use df.to_json(filename) to save DataFrame as JSON [OK]

Common Mistakes:

• Using non-existent methods like export_json
• Confusing save_json or write_json with to_json
• Forgetting to provide the filename as a string

3. Given the DataFrame df = pd.DataFrame({'A':[1,2], 'B':[3,4]}), what is the output of df.to_json(orient='records')?

medium

A. '{"A":{"0":1,"1":2},"B":{"0":3,"1":4}}'

B. '[{"A":1,"B":3},{"A":2,"B":4}]'

C. '{"0":{"A":1,"B":3},"1":{"A":2,"B":4}}'

D. '[1,2,3,4]'

Solution

1. Step 1: Understand orient='records'

   This option converts each row to a JSON object in a list.

2. Step 2: Convert DataFrame rows to JSON objects

   Rows become [{"A":1,"B":3}, {"A":2,"B":4}].

3. Final Answer:

   '[{"A":1,"B":3},{"A":2,"B":4}]' -> Option B

4. Quick Check:

   orient='records' = list of row dicts [OK]

Hint: orient='records' makes list of row dictionaries [OK]

Common Mistakes:

• Confusing 'records' with default 'columns' orient
• Expecting a nested dictionary instead of list
• Misreading JSON string format

4. What is wrong with this code snippet for exporting a DataFrame df to JSON?

df.to_json('output.json', orient='wrong')

medium

A. It raises a ValueError because 'wrong' is not a valid orient

B. It will save the file but with empty content

C. It ignores the orient and uses default silently

D. It saves the file but with incorrect JSON format

Solution

1. Step 1: Check valid orient options

   Valid options include 'records', 'columns', 'index', etc., but not 'wrong'.

2. Step 2: Understand error behavior

   Using an invalid orient raises a ValueError immediately.

3. Final Answer:

   It raises a ValueError because 'wrong' is not a valid orient -> Option A

4. Quick Check:

   Invalid orient = ValueError [OK]

Hint: Invalid orient causes ValueError, check spelling [OK]

Common Mistakes:

• Assuming invalid orient defaults silently
• Expecting empty file instead of error
• Thinking JSON format is saved anyway

5. You want to export a DataFrame df with nested dictionaries in a column to JSON, preserving the nested structure. Which orient option should you use to keep the nested data intact?

hard

A. 'records'

B. 'split'

C. 'index'

D. 'table'

Solution

1. Step 1: Understand nested data export needs

   Nested dictionaries require a format that preserves complex structure.

2. Step 2: Identify orient='table' features

   Orient='table' exports data with schema and supports nested structures well.

3. Step 3: Compare other options

   'records' flattens rows, 'split' and 'index' do not preserve nested well.

4. Final Answer:

   'table' -> Option D

5. Quick Check:

   Nested data export = orient='table' [OK]

Hint: Use orient='table' to keep nested JSON structure [OK]

Common Mistakes:

• Using 'records' which flattens nested data
• Choosing 'split' or 'index' which lose nested info
• Not specifying orient and losing structure