dtypes and data type checking in Pandas - Cheat Sheet & Quick Revision

Recall & Review

beginner

What does dtypes represent in a pandas DataFrame?

dtypes shows the data type of each column in a pandas DataFrame, like integers, floats, or strings.

beginner

How can you check the data type of a single pandas Series?

Use the .dtype attribute on the Series to see its data type.

beginner

Why is it important to check data types in a DataFrame before analysis?

Because correct data types ensure calculations and operations work properly, like summing numbers or filtering text.

intermediate

What pandas function can convert a column to a different data type?

You can use pd.to_numeric(), pd.to_datetime(), or astype() to change data types.

beginner

What data type does pandas use for text/string columns?

Pandas uses the object dtype for text or string columns by default.

Which attribute shows the data types of all columns in a pandas DataFrame?

A .dtypes

B .dtype

C .type

D .info

.dtypes lists the data types of all columns. .dtype is for a single Series.

What data type does pandas assign to a column with numbers and missing values by default?

A int64

B object

C float64

D bool

Columns with numbers and missing values are usually float64 because integers can't hold NaN.

Which method converts a pandas column to datetime type?

A astype('str')

B pd.to_numeric()

C astype('int')

D pd.to_datetime()

pd.to_datetime() converts columns to datetime type.

If a column contains text, what dtype will pandas usually assign?

A object

B float64

C int64

D category

Text columns are usually object dtype in pandas.

How do you check the data type of a single pandas Series named col?

A col.dtypes

B col.dtype

C col.type

D col.info()

col.dtype gives the data type of a single Series.

Explain how to check and interpret the data types of columns in a pandas DataFrame.

Think about how you see the type of each column at once.

Describe why converting data types in pandas might be necessary before analysis.

Consider what happens if numbers are stored as text.

Practice

1. What does the dtypes attribute in a pandas DataFrame tell you?

easy

A. The type of data stored in each column

B. The number of rows in the DataFrame

C. The names of the columns

D. The total memory used by the DataFrame

Solution

1. Step 1: Understand what dtypes represents

   The dtypes attribute shows the data type of each column in a DataFrame, such as integer, float, or object (text).

2. Step 2: Compare with other DataFrame attributes

   Other attributes like shape give row and column counts, and columns give column names, but dtypes specifically shows data types.

3. Final Answer:

   The type of data stored in each column -> Option A

4. Quick Check:

   dtypes = data types per column [OK]

Hint: Remember: dtypes = data types of columns [OK]

Common Mistakes:

• Confusing dtypes with number of rows
• Thinking dtypes shows column names
• Assuming dtypes shows memory usage

2. Which of the following is the correct way to check the data type of a single column named 'age' in a pandas DataFrame df?

easy

A. df.dtypes('age')

B. df['age'].dtype

C. df.dtype['age']

D. df.get_dtype('age')

Solution

1. Step 1: Recall syntax for accessing column dtype

   To get the data type of a single column, use df['column_name'].dtype.

2. Step 2: Check other options for correctness

   Options B, C, and D use incorrect syntax or methods that do not exist in pandas.

3. Final Answer:

   df['age'].dtype -> Option B

4. Quick Check:

   Single column dtype = df['column'].dtype [OK]

Hint: Use df['column'].dtype to check one column's type [OK]

Common Mistakes:

• Using parentheses with dtypes like a function
• Trying to access dtype as a dictionary
• Using non-existent methods like get_dtype

3. Given the following code:

import pandas as pd
data = {'name': ['Anna', 'Bob'], 'score': [85, 92]}
df = pd.DataFrame(data)
print(df.dtypes)

What will be the output?

medium

A. name object
score object
dtype: object

B. name int64
score int64
dtype: object

C. name float64
score int64
dtype: object

D. name object
score int64
dtype: object

Solution

1. Step 1: Identify data types of each column

   The 'name' column contains text, so pandas assigns it the 'object' dtype. The 'score' column contains integers, so it gets 'int64'.

2. Step 2: Understand pandas output format

   Printing df.dtypes shows each column name with its dtype, followed by 'dtype: object' indicating the Series type.

3. Final Answer:

   name object score int64 dtype: object -> Option D

4. Quick Check:

   Text = object, integers = int64 [OK]

Hint: Text columns show as object, numbers as int64 or float64 [OK]

Common Mistakes:

• Assuming text columns show as string dtype
• Confusing int64 with float64 for integers
• Expecting score to be object dtype

4. You run this code:

import pandas as pd
data = {'A': [1, 2], 'B': ['x', 'y']}
df = pd.DataFrame(data)
print(df['A'].dtypes())

What error will you get?

medium

A. AttributeError: 'Series' object has no attribute 'dtypes'

B. TypeError: 'dtype' object is not callable

C. SyntaxError: invalid syntax

D. No error, prints int64

Solution

1. Step 1: Identify the issue with the code

   A pandas Series (df['A']) has a .dtype attribute (singular), not .dtypes (plural, which is for DataFrames).

2. Step 2: Understand the error caused

   Accessing .dtypes on a Series raises AttributeError: 'Series' object has no attribute 'dtypes'. The parentheses would cause further issues if the attribute existed.

3. Final Answer:

   AttributeError: 'Series' object has no attribute 'dtypes' -> Option A

4. Quick Check:

   Series: .dtype | DataFrame: .dtypes [OK]

Hint: Series: .dtype | DataFrame: .dtypes [OK]

Common Mistakes:

• Confusing Series .dtype with DataFrame .dtypes
• Adding parentheses after attributes
• Expecting no error from wrong attribute

5. You have a DataFrame df with columns ['id', 'value', 'date']. The value column is stored as object dtype but contains numbers as strings. Which pandas command will convert value to numeric dtype safely, turning invalid parsing into NaN?

hard

A. df['value'] = df['value'].astype('float64')

B. df['value'] = df['value'].astype(int)

C. df['value'] = pd.to_numeric(df['value'], errors='coerce')

D. df['value'] = df['value'].convert_dtypes()

Solution

1. Step 1: Understand the problem with object dtype

   The 'value' column has numbers stored as strings, so converting directly with astype(int) or astype(float64) may fail if there are invalid strings.

2. Step 2: Use pd.to_numeric with errors='coerce'

   This function converts strings to numbers and replaces invalid parsing with NaN, preventing errors.

3. Step 3: Check other options

   df['value'] = df['value'].convert_dtypes() uses convert_dtypes() which infers types but does not coerce invalid strings safely.

4. Final Answer:

   df['value'] = pd.to_numeric(df['value'], errors='coerce') -> Option C

5. Quick Check:

   Use pd.to_numeric with errors='coerce' for safe conversion [OK]

Hint: Use pd.to_numeric with errors='coerce' to convert safely [OK]

Common Mistakes:

• Using astype(int) on strings causing errors
• Assuming convert_dtypes fixes string numbers
• Not handling invalid strings causing crashes