Checking data types in Data Analysis Python

Introduction

We check data types to understand what kind of information each column holds. This helps us decide how to work with the data correctly.

When you load a new dataset and want to see what kind of data each column has.

Before cleaning data, to find columns with wrong or unexpected types.

When preparing data for analysis or machine learning to ensure correct processing.

To detect if numeric data is mistakenly stored as text.

When debugging errors caused by incompatible data types.

Syntax

Data Analysis Python

dataframe.dtypes

This command shows the data type of each column in a DataFrame.

Data types include int64 (integers), float64 (decimal numbers), object (text), bool (True/False), and datetime64[ns] (dates).

Examples

This example creates a DataFrame with numbers and text, then prints the data types of each column.

Data Analysis Python

import pandas as pd

data = {'age': [25, 30, 22], 'name': ['Alice', 'Bob', 'Charlie']}
df = pd.DataFrame(data)
print(df.dtypes)

This shows the data type of a single value in the 'age' column.

Data Analysis Python

print(type(df['age'][0]))

This prints the data type of the entire 'name' column.

Data Analysis Python

print(df['name'].dtype)

Sample Program

This program creates a DataFrame with different types of data: numbers, text, booleans, and dates. Then it prints the data type of each column to understand the data.

Data Analysis Python

import pandas as pd

# Create a sample dataset
data = {
    'temperature': [22.5, 23.0, 21.8, 22.1],
    'city': ['Paris', 'London', 'Berlin', 'Madrid'],
    'rainy': [False, True, False, True],
    'date': pd.to_datetime(['2024-06-01', '2024-06-02', '2024-06-03', '2024-06-04'])
}

# Create DataFrame
weather_df = pd.DataFrame(data)

# Check data types of each column
print(weather_df.dtypes)

Important Notes

Sometimes numbers are stored as text (object type). You may need to convert them to numeric types for calculations.

Use pd.to_datetime() to convert text to date types.

Knowing data types helps avoid errors when analyzing or visualizing data.

Summary

Checking data types helps you understand your data better.

Use dataframe.dtypes to see each column's type.

Correct data types are important for proper analysis and calculations.

Practice

1. What does the DataFrame.dtypes attribute show in a pandas DataFrame?

easy

A. The data type of each column in the DataFrame

B. The number of rows in the DataFrame

C. The summary statistics of numeric columns

D. The first five rows of the DataFrame

Solution

1. Step 1: Understand what dtypes means

   The dtypes attribute in pandas shows the data type of each column in a DataFrame.

2. Step 2: Compare options with the definition

   Only The data type of each column in the DataFrame ('The data type of each column in the DataFrame') correctly describes this: it shows the data type of each column.

3. Final Answer:

   The data type of each column in the DataFrame -> Option A

4. Quick Check:

   DataFrame.dtypes = column types [OK]

Hint: Remember: dtypes means data types per column [OK]

Common Mistakes:

• Confusing dtypes with DataFrame shape
• Thinking dtypes shows data values
• Mixing dtypes with summary statistics

2. Which of the following is the correct way to check data types of columns in a pandas DataFrame named df?

easy

A. df.types()

B. df.dtypes

C. df.type()

D. df.get_types()

Solution

1. Step 1: Recall pandas syntax for data types

   In pandas, dtypes is an attribute (not a method), so it is accessed without parentheses.

2. Step 2: Evaluate each option

   df.dtypes uses df.dtypes correctly. Options A, B, and C use incorrect method names or parentheses.

3. Final Answer:

   df.dtypes -> Option B

4. Quick Check:

   Use attribute dtypes without parentheses [OK]

Hint: Use df.dtypes without parentheses to check types [OK]

Common Mistakes:

• Adding parentheses after dtypes
• Using incorrect method names
• Confusing dtypes with type() function

3. Given the following code:

import pandas as pd
data = {'age': [25, 30], 'name': ['Alice', 'Bob'], 'score': [88.5, 92.0]}
df = pd.DataFrame(data)
print(df.dtypes)

What will be the output?

medium

A. age int64
name object
score float64
dtype: object

B. age float64
name object
score int64
dtype: object

C. age int32
name string
score float32
dtype: object

D. age object
name object
score object
dtype: object

Solution

1. Step 1: Check data types of each column in the dictionary

   Column 'age' has integers (25, 30) so type is int64 by default. 'name' has strings, so type is object. 'score' has floats (88.5, 92.0), so type is float64.

2. Step 2: Confirm pandas default data types

   Pandas uses int64 for integers, object for strings, and float64 for floats by default.

3. Final Answer:

   age int64 name object score float64 dtype: object -> Option A

4. Quick Check:

   Integers=int64, Strings=object, Floats=float64 [OK]

Hint: Integers=int64, strings=object, floats=float64 in pandas [OK]

Common Mistakes:

• Assuming strings have type 'string' instead of 'object'
• Mixing int and float types
• Confusing int32 with int64 default

4. You run this code:

import pandas as pd
data = {'A': [1, 2], 'B': ['x', 'y']}
df = pd.DataFrame(data)
print(df.dtypes())

But it gives an error. What is the problem?

medium

A. The DataFrame is empty

B. You need to import numpy first

C. The column names must be integers

D. You should use df.dtypes without parentheses

Solution

1. Step 1: Identify the error cause

   The code uses df.dtypes() with parentheses, but dtypes is an attribute, not a method.

2. Step 2: Correct the syntax

   Remove parentheses and use df.dtypes to get the data types without error.

3. Final Answer:

   You should use df.dtypes without parentheses -> Option D

4. Quick Check:

   dtypes is attribute, not method [OK]

Hint: No parentheses after dtypes attribute [OK]

Common Mistakes:

• Adding parentheses after dtypes
• Thinking DataFrame is empty causes error
• Believing numpy import is needed for dtypes

5. You have a DataFrame df with columns: ['id', 'value', 'flag']. The flag column contains only 0 and 1 but is stored as integers. You want to convert flag to a boolean type for better memory use. Which code correctly changes the data type?

hard

A. df['flag'] = df['flag'].to_bool()

B. df['flag'] = bool(df['flag'])

C. df['flag'] = df['flag'].astype(bool)

D. df['flag'] = df['flag'].convert(bool)

Solution

1. Step 1: Understand how to convert column types in pandas

   Use the astype() method to convert a column to a different data type.

2. Step 2: Check each option's validity

   df['flag'] = df['flag'].astype(bool) uses astype(bool) correctly. df['flag'] = bool(df['flag']) tries to convert the whole Series to bool, which returns a single True/False, not a column. Options C and D use non-existent methods.

3. Final Answer:

   df['flag'] = df['flag'].astype(bool) -> Option C

4. Quick Check:

   Use astype(bool) to convert column to boolean [OK]

Hint: Use astype(bool) to convert column to boolean type [OK]

Common Mistakes:

• Using bool() on entire Series instead of astype
• Trying non-existent methods like to_bool()
• Confusing convert() with astype()