Loading datasets (CSV, built-in datasets) in ML Python - ML Experiment: Train & Evaluate

Experiment - Loading datasets (CSV, built-in datasets)

Problem:You want to train a machine learning model but first need to load data correctly. Currently, you have a CSV file and want to compare it with a built-in dataset from sklearn. You tried loading the CSV but are unsure if the data is loaded properly and if the built-in dataset matches your needs.

Current Metrics:N/A (Data loading step, no model trained yet)

Issue:Data loading is not verified. You might have missing values or wrong data types. Also, you don't know how to load and explore built-in datasets properly.

Your Task

Load a CSV dataset and a built-in sklearn dataset correctly, check their shapes and basic statistics, and prepare them for model training.

Use pandas to load the CSV file.

Use sklearn.datasets to load a built-in dataset (e.g., Iris).

Do not train any model yet.

Focus on loading and exploring data only.

Hint 1

Hint 2

Hint 3

Hint 4

Solution

ML Python

import pandas as pd
from sklearn.datasets import load_iris

# Load CSV dataset
csv_file_path = 'data.csv'  # Replace with your CSV file path
csv_data = pd.read_csv(csv_file_path)

# Explore CSV data
print('CSV Data Shape:', csv_data.shape)
print('CSV Data Info:')
csv_data.info()
print('CSV Data Preview:')
print(csv_data.head())
print('CSV Data Description:')
print(csv_data.describe())

# Load built-in Iris dataset
iris = load_iris()
iris_data = pd.DataFrame(iris.data, columns=iris.feature_names)
iris_target = iris.target

# Explore Iris data
print('\nIris Data Shape:', iris_data.shape)
print('Iris Data Preview:')
print(iris_data.head())
print('Iris Target Preview:')
print(iris_target[:5])

Added pandas to load CSV data.

Used sklearn.datasets.load_iris() to load built-in dataset.

Printed shape, info, head, and describe for CSV data.

Converted Iris data to DataFrame for easy exploration.

Printed shape and preview of Iris data and target.

Results Interpretation

Before: Data loading was uncertain, no checks done.

After: CSV and built-in datasets are loaded and explored with shape, info, and preview outputs.

Proper data loading and exploration are essential first steps before training any machine learning model. This helps catch issues early and understand the data structure.

Bonus Experiment

Try loading a different built-in dataset like 'digits' from sklearn and compare its shape and target distribution with the Iris dataset.

💡 Hint

Use sklearn.datasets.load_digits() and explore similarly with pandas DataFrame.

Practice

1. What is the main purpose of loading datasets in machine learning?

easy

A. To get data from files or built-in sources for training models

B. To save the model after training

C. To visualize the model's predictions

D. To delete unused data from memory

Solution

1. Step 1: Understand dataset loading

   Loading datasets means bringing data into your program so you can work with it.

2. Step 2: Identify the purpose in machine learning

   Data is needed to train and test machine learning models, so loading datasets is the first step.

3. Final Answer:

   To get data from files or built-in sources for training models -> Option A

4. Quick Check:

   Loading datasets = Getting data [OK]

Hint: Loading datasets means getting data ready for models [OK]

Common Mistakes:

• Confusing loading data with saving models
• Thinking loading means visualizing results
• Mixing loading with deleting data

2. Which Python code correctly loads a CSV file named data.csv using pandas?

easy

A. import pandas as pd
df = pd.csv_read('data.csv')

B. import pandas as pd
df = pd.load_csv('data.csv')

C. import pandas as pd
df = pd.read('data.csv')

D. import pandas as pd
df = pd.read_csv('data.csv')

Solution

1. Step 1: Recall pandas CSV loading syntax

   The correct function to load CSV files in pandas is read_csv().

2. Step 2: Check each option's function name

   Only import pandas as pd df = pd.read_csv('data.csv') uses pd.read_csv('data.csv'), which is correct syntax.

3. Final Answer:

   import pandas as pd\ndf = pd.read_csv('data.csv') -> Option D

4. Quick Check:

   pandas.read_csv() loads CSV files [OK]

Hint: Use pandas.read_csv() to load CSV files [OK]

Common Mistakes:

• Using wrong function names like load_csv or csv_read
• Forgetting to import pandas
• Using read() instead of read_csv()

3. What will be the output type of the following code?

from sklearn.datasets import load_iris
iris = load_iris()
print(type(iris.data))

medium

A. <class 'numpy.ndarray'>

B. <class 'list'>

C. <class 'pandas.DataFrame'>

D. <class 'dict'>

Solution

1. Step 1: Understand sklearn's load_iris output

   The load_iris() function returns a Bunch object with data as a NumPy array.

2. Step 2: Check the type of iris.data

   Printing type(iris.data) shows it is a numpy.ndarray.

3. Final Answer:

   <class 'numpy.ndarray'> -> Option A

4. Quick Check:

   sklearn data attribute = numpy.ndarray [OK]

Hint: Sklearn datasets return numpy arrays for data [OK]

Common Mistakes:

• Thinking iris.data is a list or dict
• Confusing with pandas DataFrame
• Not knowing sklearn returns numpy arrays

4. Identify the error in this code snippet that tries to load a CSV file:

import pandas as pd
df = pd.read_csv('data.csv', delimiter=';')
print(df.head())

Assuming the CSV uses commas, what is wrong?

medium

A. Missing import statement for csv module

B. The delimiter should be ',' not ';'

C. The function read_csv does not exist

D. print(df.head()) is incorrect syntax

Solution

1. Step 1: Check delimiter parameter usage

   The code uses delimiter=';' but the CSV file uses commas, so this is wrong.

2. Step 2: Understand correct delimiter for comma CSV

   For comma-separated files, the delimiter should be ',' or omitted (default).

3. Final Answer:

   The delimiter should be ',' not ';' -> Option B

4. Quick Check:

   Delimiter must match CSV separator [OK]

Hint: Match delimiter to CSV separator character [OK]

Common Mistakes:

• Using wrong delimiter for CSV files
• Thinking read_csv is missing
• Confusing print syntax errors

5. You want to load the built-in digits dataset from sklearn and convert it to a pandas DataFrame with feature columns named pixel_0 to pixel_63. Which code correctly does this?

hard

A. import pandas as pd
df = pd.read_csv('digits.csv')
df.columns = [f'pixel_{i}' for i in range(64)]

B. from sklearn.datasets import load_digits
import pandas as pd
digits = load_digits()
df = pd.DataFrame(digits, columns=[f'pixel_{i}' for i in range(64)])

C. from sklearn.datasets import load_digits
import pandas as pd
digits = load_digits()
df = pd.DataFrame(digits.data, columns=[f'pixel_{i}' for i in range(64)])

D. from sklearn.datasets import load_digits
import pandas as pd
digits = load_digits()
df = pd.DataFrame(digits.target, columns=[f'pixel_{i}' for i in range(64)])

Solution

1. Step 1: Load digits dataset correctly

   Use load_digits() to get the dataset object with data attribute for features.

2. Step 2: Create DataFrame with correct data and columns

   Pass digits.data to pd.DataFrame() and set columns to pixel_0 to pixel_63.

3. Final Answer:

   from sklearn.datasets import load_digits\nimport pandas as pd\ndigits = load_digits()\ndf = pd.DataFrame(digits.data, columns=[f'pixel_{i}' for i in range(64)]) -> Option C

4. Quick Check:

   Use digits.data for features in DataFrame [OK]

Hint: Use digits.data for features, not digits or digits.target [OK]

Common Mistakes:

• Passing digits object directly to DataFrame
• Using digits.target as data
• Trying to load digits from CSV without file