First data analysis walkthrough in Data Analysis Python - Step-by-Step Execution

Concept Flow - First data analysis walkthrough

Load data from file

↓

Check data structure

↓

Clean data if needed

↓

Calculate basic stats

↓

Visualize data

↓

Draw conclusions

This flow shows the main steps in a simple data analysis: loading data, checking it, cleaning, analyzing, visualizing, and concluding.

Execution Sample

Data Analysis Python

import pandas as pd

data = pd.read_csv('data.csv')
print(data.head())
print(data.describe())

Load data from a CSV file, show first rows, and print basic statistics.

Execution Table

Step	Action	Code Line	Result/Output
1	Import pandas library	import pandas as pd	pandas module ready
2	Load data from 'data.csv'	data = pd.read_csv('data.csv')	DataFrame with rows and columns loaded
3	Show first 5 rows	print(data.head())	Table with first 5 rows displayed
4	Calculate basic stats	print(data.describe())	Summary stats like mean, std, min, max shown
5	End of sample code	-	Data loaded and basic info displayed

💡 Finished loading and summarizing data for first analysis

Variable Tracker

Variable	Start	After Load	After head()	After describe()
data	None	DataFrame with all rows	Same DataFrame (head() just views)	Same DataFrame (describe() just views)

Key Moments - 2 Insights

Why do we use data.head() instead of printing the whole data?

Printing the whole data can be very large and hard to read. data.head() shows just the first 5 rows to quickly check the data structure, as seen in step 3 of the execution_table.

What does data.describe() tell us?

data.describe() gives basic statistics like mean, standard deviation, min, and max for numeric columns. This helps understand data spread, shown in step 4 of the execution_table.

Visual Quiz - 3 Questions

Look at the execution table, what is the output of step 3?

A Summary statistics of data

B First 5 rows of the data

C Empty DataFrame

D Error message

💡 Hint

Check the 'Result/Output' column for step 3 in the execution_table.

At which step is the data actually loaded into memory?

A Step 3

B Step 1

C Step 2

D Step 4

💡 Hint

Look at the 'Action' and 'Code Line' columns to find when pd.read_csv is called.

If the data file was missing, which step would fail?

A Step 2

B Step 3

C Step 1

D Step 4

💡 Hint

Loading the file happens at step 2, so failure would occur there.

Concept Snapshot

First data analysis steps:
1. Import pandas
2. Load data with pd.read_csv
3. Use data.head() to preview
4. Use data.describe() for stats
5. Analyze and visualize next

Full Transcript

This walkthrough shows how to start analyzing data using Python's pandas library. First, we import pandas. Then, we load data from a CSV file into a DataFrame. We check the first few rows with data.head() to understand the structure. Next, we get basic statistics with data.describe() to see mean, min, max, and more. This helps us understand the data before deeper analysis or visualization.

Practice

1. What is the main purpose of using head() on a DataFrame during the first data analysis walkthrough?

easy

A. To check the data types of each column

B. To get summary statistics of numerical columns

C. To quickly see the first few rows of the data

D. To remove missing values from the data

Solution

1. Step 1: Understand the function head()

   The head() function shows the first few rows of a DataFrame, usually the first 5 rows by default.

2. Step 2: Purpose in data analysis walkthrough

   Seeing the first few rows helps you quickly understand what kind of data you have and check if it loaded correctly.

3. Final Answer:

   To quickly see the first few rows of the data -> Option C

4. Quick Check:

   head() shows first rows [OK]

Hint: Remember: head() shows top rows fast [OK]

Common Mistakes:

• Confusing head() with describe()
• Thinking head() gives statistics
• Assuming head() cleans data

2. Which of the following is the correct syntax to get a summary of data types and non-null counts in a DataFrame named df?

easy

A. df.describe()

B. df.info()

C. df.head()

D. df.summary()

Solution

1. Step 1: Identify the function for data types and non-null counts

   The info() method on a DataFrame shows data types and counts of non-null values per column.

2. Step 2: Match syntax with DataFrame df

   Calling df.info() correctly applies this method to the DataFrame named df.

3. Final Answer:

   df.info() -> Option B

4. Quick Check:

   info() shows data types and counts [OK]

Hint: Use info() to check data types and missing data [OK]

Common Mistakes:

• Using describe() to check data types
• Trying summary() which does not exist
• Confusing head() with info()

3. Given the following code:

import pandas as pd
data = {'age': [25, 30, 22, 40, 28], 'salary': [50000, 60000, 45000, 80000, 52000]}
df = pd.DataFrame(data)
summary = df.describe()

What will be the output of summary.loc['mean', 'salary']?

medium

A. 52000.0

B. SyntaxError

C. 60000.0

D. 57400.0

Solution

1. Step 1: Calculate the mean of the 'salary' column

   Sum salaries: 50000 + 60000 + 45000 + 80000 + 52000 = 287000. Number of entries: 5. Mean = 287000 / 5 = 57400.0.

2. Step 2: Understand describe() output

   The describe() method returns a DataFrame with statistics including 'mean' as an index row. Accessing summary.loc['mean', 'salary'] gives the mean salary value.

3. Final Answer:

   57400.0 -> Option D

4. Quick Check:

   Mean salary = 57400.0 [OK]

Hint: Sum values and divide by count for mean [OK]

Common Mistakes:

• Adding incorrectly or missing one value
• Confusing mean with median or mode
• Using wrong index or column name

4. You run the following code but get an error:

import pandas as pd
data = {'name': ['Alice', 'Bob'], 'age': [25, 30]}
df = pd.DataFrame(data)
print(df.describe())

What is the most likely reason for the error or unexpected output?

medium

A. The describe() method cannot handle string columns by default

B. The DataFrame is missing a numeric column

C. The DataFrame is empty

D. The describe() method requires a parameter

Solution

1. Step 1: Check DataFrame columns and types

   The DataFrame has a string column 'name' and a numeric column 'age'.

2. Step 2: Understand describe() behavior

   By default, describe() summarizes only numeric columns. It ignores string columns unless specified.

3. Final Answer:

   The describe() method cannot handle string columns by default -> Option A

4. Quick Check:

   describe() skips strings by default [OK]

Hint: describe() defaults to numeric columns only [OK]

Common Mistakes:

• Expecting describe() to summarize strings automatically
• Thinking DataFrame is empty
• Assuming describe() needs parameters always

5. You have a DataFrame df with columns ['product', 'price', 'quantity']. You want to quickly find the average price of products that have quantity greater than 10. Which code snippet correctly performs this first data analysis step?

hard

A. df[df['quantity'] > 10]['price'].mean()

B. df['price'].mean(df['quantity'] > 10)

C. df.mean()['price'] > 10

D. df.describe('price' > 10)

Solution

1. Step 1: Filter rows where quantity > 10

   Use df[df['quantity'] > 10] to select only rows with quantity greater than 10.

2. Step 2: Calculate mean of 'price' column on filtered data

   Access the 'price' column of filtered rows and call mean() to get average price.

3. Final Answer:

   df[df['quantity'] > 10]['price'].mean() -> Option A

4. Quick Check:

   Filter then mean() gives correct average [OK]

Hint: Filter first, then calculate mean [OK]

Common Mistakes:

• Passing condition inside mean() incorrectly
• Using mean() on entire DataFrame without filtering
• Wrong syntax for describe()