Reading CSV with options (sep, header, encoding) in Data Analysis Python

Introduction

We use options when reading CSV files to correctly understand how the data is organized. This helps us load the data exactly as it is saved.

When the data columns are separated by a character other than a comma, like a tab or semicolon.

When the CSV file does not have a header row with column names.

When the file uses a special text encoding, like UTF-8 or Latin-1.

When you want to skip some rows or specify which row is the header.

When reading CSV files from different countries with different formats.

Syntax

Data Analysis Python

pandas.read_csv(filepath, sep=',', header='infer', encoding='utf-8')

sep defines the character that separates columns (default is comma).

header tells which row to use as column names (default is first row).

Examples

Reads a CSV where columns are separated by semicolons instead of commas.

Data Analysis Python

import pandas as pd

df = pd.read_csv('data.csv', sep=';')

Reads a CSV file without a header row, so pandas assigns default column numbers.

Data Analysis Python

df = pd.read_csv('data.csv', header=None)

Reads a CSV file encoded with Latin-1 instead of UTF-8.

Data Analysis Python

df = pd.read_csv('data.csv', encoding='latin1')

Reads a tab-separated CSV with the first row as header and UTF-8 encoding.

Data Analysis Python

df = pd.read_csv('data.csv', sep='\t', header=0, encoding='utf-8')

Sample Program

This code writes a small CSV file with semicolons and a header row, then reads it using the correct options to load the data properly.

Data Analysis Python

import pandas as pd

# Create a sample CSV file with semicolon separator and a header row
csv_content = """name;age;city
Alice;30;New York
Bob;25;Los Angeles"""

with open('sample.csv', 'w', encoding='utf-8') as f:
    f.write(csv_content)

# Read the CSV specifying separator and header row

df = pd.read_csv('sample.csv', sep=';', header=0, encoding='utf-8')

print(df)

Important Notes

If you use the wrong separator, the data will not split into columns correctly.

Setting header=None means pandas will treat all rows as data and assign default column names like 0, 1, 2.

Encoding must match the file's actual encoding to avoid errors or strange characters.

Summary

Use sep to tell pandas how columns are separated.

Use header to specify which row has column names or if there is none.

Use encoding to read files saved with different text encodings.