Creating DataFrames (dict, list, CSV) in Data Analysis Python

Introduction

We create DataFrames to organize and analyze data easily in tables. DataFrames help us see and work with data like a spreadsheet.

You have data in a dictionary and want to analyze it as a table.

You have a list of lists or list of records and want to turn it into a table.

You want to load data from a CSV file to explore or analyze it.

You want to combine data from different sources into one table.

You want to prepare data for charts or reports.

Syntax

Data Analysis Python

import pandas as pd

# From dictionary
data = {'Name': ['Alice', 'Bob'], 'Age': [25, 30]}
df = pd.DataFrame(data)

# From list of lists
data_list = [['Alice', 25], ['Bob', 30]]
df2 = pd.DataFrame(data_list, columns=['Name', 'Age'])

# From CSV file
df3 = pd.read_csv('filename.csv')

Use pd.DataFrame() to create a DataFrame from dict or list.

Use pd.read_csv() to load data from a CSV file.

Examples

This creates an empty DataFrame with no columns or rows.

Data Analysis Python

import pandas as pd

# Empty dictionary
empty_dict = {}
df_empty = pd.DataFrame(empty_dict)
print(df_empty)

DataFrame with one row and one column.

Data Analysis Python

import pandas as pd

# Dictionary with one element
data_one = {'Name': ['Alice']}
df_one = pd.DataFrame(data_one)
print(df_one)

DataFrame created from a list with one row.

Data Analysis Python

import pandas as pd

# List with one row
data_list_one = [['Alice', 25]]
df_list_one = pd.DataFrame(data_list_one, columns=['Name', 'Age'])
print(df_list_one)

Loads data from a CSV file with headers.

Data Analysis Python

import pandas as pd

# CSV file with header
# Assume 'people.csv' content:
# Name,Age
# Alice,25
# Bob,30
df_csv = pd.read_csv('people.csv')
print(df_csv)

Sample Program

This program shows three ways to create DataFrames: from a dictionary, from a list of lists, and from a CSV file. It prints each DataFrame to see the data.

Data Analysis Python

import pandas as pd

# Create DataFrame from dictionary
data_dict = {'Name': ['Alice', 'Bob', 'Charlie'], 'Age': [25, 30, 35]}
df_dict = pd.DataFrame(data_dict)
print('DataFrame from dictionary:')
print(df_dict)

# Create DataFrame from list of lists
data_list = [['Alice', 25], ['Bob', 30], ['Charlie', 35]]
df_list = pd.DataFrame(data_list, columns=['Name', 'Age'])
print('\nDataFrame from list of lists:')
print(df_list)

# Create a sample CSV file
csv_content = 'Name,Age\nAlice,25\nBob,30\nCharlie,35'
with open('sample_people.csv', 'w') as file:
    file.write(csv_content)

# Load DataFrame from CSV
df_csv = pd.read_csv('sample_people.csv')
print('\nDataFrame loaded from CSV file:')
print(df_csv)

Important Notes

Creating a DataFrame from a dictionary or list is very fast and uses little memory.

Loading from CSV depends on file size; large files take longer.

Common mistake: forgetting to specify column names when creating from a list.

Use dictionary input when you have named columns; use list input when you have row data without names.

Summary

DataFrames organize data in tables for easy analysis.

You can create DataFrames from dictionaries, lists, or CSV files.

Always check your data after creating to make sure it looks right.

Practice

1. What is the main purpose of creating a DataFrame in data analysis?

easy

A. To organize data in a table format for easy analysis

B. To write data to a text file

C. To create a list of numbers

D. To perform calculations without storing data

Solution

1. Step 1: Understand what a DataFrame is

   A DataFrame is like a table with rows and columns, used to organize data clearly.

2. Step 2: Identify the purpose of DataFrames

   They help analyze data easily by structuring it in rows and columns.

3. Final Answer:

   To organize data in a table format for easy analysis -> Option A

4. Quick Check:

   DataFrame = Table for data analysis [OK]

Hint: DataFrames = tables for data, not just lists or files [OK]

Common Mistakes:

• Confusing DataFrame with a simple list
• Thinking DataFrame is for saving files only
• Believing DataFrame is just for calculations

2. Which of the following is the correct way to create a DataFrame from a dictionary in Python using pandas?

easy

A. pd.DataFrame(name=['Alice', 'Bob'], age=[25, 30])

B. pd.DataFrame({'name': ['Alice', 'Bob'], 'age': [25, 30]})

C. pd.DataFrame({'name': 'Alice', 'age': 25})

D. pd.DataFrame['name', 'age'] = ['Alice', 'Bob'], [25, 30]

Solution

1. Step 1: Recall pandas DataFrame creation syntax

   Use pd.DataFrame() with a dictionary where keys are column names and values are lists of column data.

2. Step 2: Check each option

   pd.DataFrame({'name': ['Alice', 'Bob'], 'age': [25, 30]}) correctly uses a dictionary with lists for columns. Others have syntax errors or wrong formats.

3. Final Answer:

   pd.DataFrame({'name': ['Alice', 'Bob'], 'age': [25, 30]}) -> Option B

4. Quick Check:

   Dictionary with lists = pd.DataFrame() [OK]

Hint: Use dictionary with lists inside pd.DataFrame() [OK]

Common Mistakes:

• Using pd.DataFrame with wrong brackets
• Passing single values instead of lists
• Trying to assign columns after creating DataFrame

3. What will be the output of this code?

import pandas as pd
data = [[1, 'Alice'], [2, 'Bob']]
df = pd.DataFrame(data, columns=['ID', 'Name'])
print(df)

medium

A. A DataFrame with columns 'ID' and 'Name' showing the two rows of data

B. A list of lists printed as is

C. An error because columns parameter is missing

D. A DataFrame with default numeric column names

Solution

1. Step 1: Understand DataFrame creation from list of lists

   Passing a list of lists with columns names creates a DataFrame with those columns and rows.

2. Step 2: Check the print output

   The DataFrame will show two rows with columns 'ID' and 'Name' filled with given data.

3. Final Answer:

   A DataFrame with columns 'ID' and 'Name' showing the two rows of data -> Option A

4. Quick Check:

   List + columns = DataFrame table [OK]

Hint: List + columns param creates labeled DataFrame [OK]

Common Mistakes:

• Expecting a list output instead of DataFrame
• Forgetting columns parameter causes default columns
• Confusing list of lists with dictionary input

4. Identify the error in this code that tries to create a DataFrame from a CSV file:

import pandas as pd
df = pd.read_csv('data.csv', header=2)
print(df.head())

medium

A. read_csv cannot read CSV files

B. The file name must be 'data.txt' not 'data.csv'

C. The header parameter should be 0 to read the first row as column names

D. print(df.head()) is incorrect syntax

Solution

1. Step 1: Understand header parameter in read_csv

   header=2 means pandas treats the third row as column names, which may be wrong if first row has headers.

2. Step 2: Identify correct header usage

   Usually header=0 is used to read the first row as column names. Using 2 can cause wrong column names or data misalignment.

3. Final Answer:

   The header parameter should be 0 to read the first row as column names -> Option C

4. Quick Check:

   header=0 reads first row as columns [OK]

Hint: Use header=0 to read first row as column names [OK]

Common Mistakes:

• Setting header to wrong row number
• Confusing file extensions
• Misunderstanding print(df.head()) usage

5. You have a CSV file with columns 'Name', 'Age', and 'Score'. You want to create a DataFrame but only keep rows where 'Score' is above 80. Which code correctly creates the DataFrame and filters it?

hard

A. import pandas as pd\ndf = pd.read_csv('file.csv', filter='Score > 80')\nprint(df)

B. import pandas as pd\ndf = pd.read_csv('file.csv')\ndf_filtered = df.where('Score' > 80)\nprint(df_filtered)

C. import pandas as pd\ndf = pd.read_csv('file.csv')\ndf_filtered = df.filter('Score > 80')\nprint(df_filtered)

D. import pandas as pd\ndf = pd.read_csv('file.csv')\ndf_filtered = df[df['Score'] > 80]\nprint(df_filtered)

Solution

1. Step 1: Read CSV file into DataFrame

   Use pd.read_csv('file.csv') to load all data.

2. Step 2: Filter rows where 'Score' > 80

   Use boolean indexing: df[df['Score'] > 80] to keep only rows with Score above 80.

3. Final Answer:

   import pandas as pd\ndf = pd.read_csv('file.csv')\ndf_filtered = df[df['Score'] > 80]\nprint(df_filtered) -> Option D

4. Quick Check:

   Boolean indexing filters rows [OK]

Hint: Use df[df['Score'] > 80] to filter rows [OK]

Common Mistakes:

• Trying to filter inside read_csv
• Using df.filter() incorrectly
• Using df.where() without proper condition