Loading datasets (CSV, built-in datasets) in ML Python - Model Pipeline Trace

Model Pipeline - Loading datasets (CSV, built-in datasets)

This pipeline shows how data is loaded from CSV files and built-in datasets, then prepared for machine learning models.

Data Flow - 4 Stages

1Load CSV file

N/A→Read CSV file into a table with rows and columns→1000 rows x 5 columns

CSV file with columns: Age, Salary, Gender, Purchased, Score

↓

2Load built-in dataset

N/A→Load dataset from library (e.g., Iris dataset)→150 rows x 5 columns

Iris dataset with columns: SepalLength, SepalWidth, PetalLength, PetalWidth, Species

↓

3Data cleaning

1000 rows x 5 columns→Remove rows with missing values→980 rows x 5 columns

Dropped 20 rows with missing Salary values

↓

4Feature selection

980 rows x 5 columns→Select relevant columns for model→980 rows x 3 columns

Selected Age, Salary, Purchased columns

Training Trace - Epoch by Epoch

Loss
0.7 |****
0.6 |*** 
0.5 |**  
0.4 |*   
0.3 |*   
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.65	0.60	Model starts learning with moderate loss and accuracy
2	0.50	0.75	Loss decreases and accuracy improves
3	0.40	0.82	Model continues to improve
4	0.35	0.85	Loss decreases steadily, accuracy rises
5	0.30	0.88	Model converges with good accuracy

Prediction Trace - 5 Layers

Layer 1: Input data

Layer 2: Model input layer

Layer 3: Hidden layer with ReLU

Layer 4: Output layer with sigmoid

Layer 5: Prediction decision

Model Quiz - 3 Questions

What happens to the data shape after loading a CSV file with 1000 rows and 5 columns?

A 5 rows x 1000 columns

B 1000 rows x 5 columns

C 1000 rows x 3 columns

D 500 rows x 5 columns

Key Insight

Loading data correctly is the first step in machine learning. Clean and well-shaped data helps models learn better and make accurate predictions.

Practice

1. What is the main purpose of loading datasets in machine learning?

easy

A. To get data from files or built-in sources for training models

B. To save the model after training

C. To visualize the model's predictions

D. To delete unused data from memory

Solution

1. Step 1: Understand dataset loading

   Loading datasets means bringing data into your program so you can work with it.

2. Step 2: Identify the purpose in machine learning

   Data is needed to train and test machine learning models, so loading datasets is the first step.

3. Final Answer:

   To get data from files or built-in sources for training models -> Option A

4. Quick Check:

   Loading datasets = Getting data [OK]

Hint: Loading datasets means getting data ready for models [OK]

Common Mistakes:

• Confusing loading data with saving models
• Thinking loading means visualizing results
• Mixing loading with deleting data

2. Which Python code correctly loads a CSV file named data.csv using pandas?

easy

A. import pandas as pd
df = pd.csv_read('data.csv')

B. import pandas as pd
df = pd.load_csv('data.csv')

C. import pandas as pd
df = pd.read('data.csv')

D. import pandas as pd
df = pd.read_csv('data.csv')

Solution

1. Step 1: Recall pandas CSV loading syntax

   The correct function to load CSV files in pandas is read_csv().

2. Step 2: Check each option's function name

   Only import pandas as pd df = pd.read_csv('data.csv') uses pd.read_csv('data.csv'), which is correct syntax.

3. Final Answer:

   import pandas as pd\ndf = pd.read_csv('data.csv') -> Option D

4. Quick Check:

   pandas.read_csv() loads CSV files [OK]

Hint: Use pandas.read_csv() to load CSV files [OK]

Common Mistakes:

• Using wrong function names like load_csv or csv_read
• Forgetting to import pandas
• Using read() instead of read_csv()

3. What will be the output type of the following code?

from sklearn.datasets import load_iris
iris = load_iris()
print(type(iris.data))

medium

A. <class 'numpy.ndarray'>

B. <class 'list'>

C. <class 'pandas.DataFrame'>

D. <class 'dict'>

Solution

1. Step 1: Understand sklearn's load_iris output

   The load_iris() function returns a Bunch object with data as a NumPy array.

2. Step 2: Check the type of iris.data

   Printing type(iris.data) shows it is a numpy.ndarray.

3. Final Answer:

   <class 'numpy.ndarray'> -> Option A

4. Quick Check:

   sklearn data attribute = numpy.ndarray [OK]

Hint: Sklearn datasets return numpy arrays for data [OK]

Common Mistakes:

• Thinking iris.data is a list or dict
• Confusing with pandas DataFrame
• Not knowing sklearn returns numpy arrays

4. Identify the error in this code snippet that tries to load a CSV file:

import pandas as pd
df = pd.read_csv('data.csv', delimiter=';')
print(df.head())

Assuming the CSV uses commas, what is wrong?

medium

A. Missing import statement for csv module

B. The delimiter should be ',' not ';'

C. The function read_csv does not exist

D. print(df.head()) is incorrect syntax

Solution

1. Step 1: Check delimiter parameter usage

   The code uses delimiter=';' but the CSV file uses commas, so this is wrong.

2. Step 2: Understand correct delimiter for comma CSV

   For comma-separated files, the delimiter should be ',' or omitted (default).

3. Final Answer:

   The delimiter should be ',' not ';' -> Option B

4. Quick Check:

   Delimiter must match CSV separator [OK]

Hint: Match delimiter to CSV separator character [OK]

Common Mistakes:

• Using wrong delimiter for CSV files
• Thinking read_csv is missing
• Confusing print syntax errors

5. You want to load the built-in digits dataset from sklearn and convert it to a pandas DataFrame with feature columns named pixel_0 to pixel_63. Which code correctly does this?

hard

A. import pandas as pd
df = pd.read_csv('digits.csv')
df.columns = [f'pixel_{i}' for i in range(64)]

B. from sklearn.datasets import load_digits
import pandas as pd
digits = load_digits()
df = pd.DataFrame(digits, columns=[f'pixel_{i}' for i in range(64)])

C. from sklearn.datasets import load_digits
import pandas as pd
digits = load_digits()
df = pd.DataFrame(digits.data, columns=[f'pixel_{i}' for i in range(64)])

D. from sklearn.datasets import load_digits
import pandas as pd
digits = load_digits()
df = pd.DataFrame(digits.target, columns=[f'pixel_{i}' for i in range(64)])

Solution

1. Step 1: Load digits dataset correctly

   Use load_digits() to get the dataset object with data attribute for features.

2. Step 2: Create DataFrame with correct data and columns

   Pass digits.data to pd.DataFrame() and set columns to pixel_0 to pixel_63.

3. Final Answer:

   from sklearn.datasets import load_digits\nimport pandas as pd\ndigits = load_digits()\ndf = pd.DataFrame(digits.data, columns=[f'pixel_{i}' for i in range(64)]) -> Option C

4. Quick Check:

   Use digits.data for features in DataFrame [OK]

Hint: Use digits.data for features, not digits or digits.target [OK]

Common Mistakes:

• Passing digits object directly to DataFrame
• Using digits.target as data
• Trying to load digits from CSV without file