Why Analyzing index usage with pg_stat in PostgreSQL? - Purpose & Use Cases

The Big Idea

What if you could instantly know which parts of your database are slowing you down without guessing?

The Scenario

Imagine you have a huge library of books and you want to find your favorite stories quickly. Without any system, you have to flip through every page manually to find what you want.

The Problem

Manually checking which indexes help your database is like flipping through every page in a giant book--it takes forever and you might miss important clues. It's slow, tiring, and full of mistakes.

The Solution

Using pg_stat views in PostgreSQL is like having a smart assistant who tells you exactly which indexes are used and which are not. This helps you keep your database fast and clean without guesswork.

Before vs After

✗ Before

SELECT * FROM pg_indexes; -- just lists indexes, no usage info

✓ After

SELECT indexrelname, idx_scan FROM pg_stat_user_indexes; -- shows how often each index is used

What It Enables

This lets you easily spot unused indexes to remove and optimize your database performance effortlessly.

Real Life Example

A website owner notices their site is slow. By checking pg_stat_user_indexes, they find some indexes never used and remove them, making the site faster and saving storage.

Key Takeaways

Manual index checks are slow and error-prone.

pg_stat views show real index usage clearly.

Helps keep your database fast and efficient.

Practice

1. What does the idx_scan column in pg_stat_user_indexes represent?

easy

A. The number of times an index was used in a scan operation

B. The total size of the index in bytes

C. The number of rows in the indexed table

D. The creation date of the index

Solution

1. Step 1: Understand the purpose of pg_stat_user_indexes

   This system view tracks usage statistics for user-created indexes in PostgreSQL.

2. Step 2: Identify the meaning of idx_scan

   The idx_scan column counts how many times the index was used in scan operations, showing its usage frequency.

3. Final Answer:

   The number of times an index was used in a scan operation -> Option A

4. Quick Check:

   idx_scan = index usage count [OK]

Hint: Remember idx_scan counts index scans, not size or rows [OK]

Common Mistakes:

• Confusing idx_scan with index size
• Thinking idx_scan shows table row count
• Assuming idx_scan is creation date

2. Which of the following SQL queries correctly retrieves index usage statistics from pg_stat_user_indexes for a table named customers?

easy

A. SELECT * FROM pg_stat_user_indexes WHERE relname = 'customers';

B. SELECT * FROM pg_stat_user_indexes WHERE tablename = 'customers';

C. SELECT * FROM pg_stat_user_indexes WHERE indexname = 'customers';

D. SELECT * FROM pg_stat_user_indexes WHERE table_name = 'customers';

Solution

1. Step 1: Check the column names in pg_stat_user_indexes

   The correct column for the table name is relname, not tablename or table_name.

2. Step 2: Verify the query syntax

   SELECT * FROM pg_stat_user_indexes WHERE relname = 'customers'; uses relname = 'customers', which is correct to filter indexes for the table named 'customers'.

3. Final Answer:

   SELECT * FROM pg_stat_user_indexes WHERE relname = 'customers'; -> Option A

4. Quick Check:

   Use relname to filter by table name [OK]

Hint: Use relname column to filter by table in pg_stat_user_indexes [OK]

Common Mistakes:

• Using incorrect column names like tablename or table_name
• Filtering by indexname instead of table name
• Syntax errors in WHERE clause

3. Given the following query:

SELECT indexrelname, idx_scan FROM pg_stat_user_indexes WHERE relname = 'orders';

Which output correctly shows index usage if the table orders has two indexes orders_pkey with 150 scans and orders_date_idx with 0 scans?

medium

A. [{"indexrelname": "orders_pkey", "idx_scan": null}, {"indexrelname": "orders_date_idx", "idx_scan": null}]

B. [{"indexrelname": "orders_pkey", "idx_scan": 0}, {"indexrelname": "orders_date_idx", "idx_scan": 150}]

C. [{"indexrelname": "orders_pkey", "idx_scan": 150}]

D. [{"indexrelname": "orders_pkey", "idx_scan": 150}, {"indexrelname": "orders_date_idx", "idx_scan": 0}]

Solution

1. Step 1: Understand the query output

   The query selects index names and their scan counts for the 'orders' table, so both indexes should appear with their respective scan counts.

2. Step 2: Match the scan counts to indexes

   Given orders_pkey has 150 scans and orders_date_idx has 0, the output must show both with correct values.

3. Final Answer:

   [{"indexrelname": "orders_pkey", "idx_scan": 150}, {"indexrelname": "orders_date_idx", "idx_scan": 0}] -> Option D

4. Quick Check:

   Index names match scan counts correctly [OK]

Hint: Check idx_scan values match index names exactly [OK]

Common Mistakes:

• Swapping scan counts between indexes
• Showing null instead of zero for unused indexes
• Omitting indexes with zero scans

4. You run this query to find unused indexes:

SELECT indexrelname FROM pg_stat_user_indexes WHERE idx_scan = 0;

But it returns no rows, even though you know some indexes are unused. What is the likely cause?

medium

A. The idx_scan column does not track usage

B. The query syntax is incorrect and missing a semicolon

C. The statistics collector has not been reset or updated recently

D. The table has no indexes at all

Solution

1. Step 1: Verify query correctness

   The query syntax is correct and will return indexes with zero scans if any exist.

2. Step 2: Understand pg_stat_user_indexes behavior

   Index usage stats depend on the statistics collector. If it was recently reset or the server restarted, idx_scan may be zeroed or not updated yet.

3. Final Answer:

   The statistics collector has not been reset or updated recently -> Option C

4. Quick Check:

   Stats collector state affects idx_scan values [OK]

Hint: Check if stats collector was reset before trusting idx_scan [OK]

Common Mistakes:

• Assuming query syntax error causes no results
• Thinking idx_scan never tracks usage
• Believing no indexes exist without checking

5. You want to improve database performance by removing unused indexes. Which query helps you identify indexes that have never been scanned since the last stats reset, for table products?

hard

A. SELECT indexrelname FROM pg_stat_user_indexes WHERE idx_scan > 0 AND relname = 'products';

B. SELECT indexrelname FROM pg_stat_user_indexes WHERE relname = 'products' AND idx_scan = 0;

C. SELECT indexrelname FROM pg_stat_user_indexes WHERE relname = 'products' AND idx_tup_read = 0;

D. SELECT indexrelname FROM pg_stat_user_indexes WHERE relname = 'products' AND idx_scan IS NULL;

Solution

1. Step 1: Filter indexes by table name

   Use relname = 'products' to focus on indexes for the products table.

2. Step 2: Identify unused indexes by scan count

   Indexes with idx_scan = 0 have never been used since last stats reset, so they are candidates for removal.

3. Final Answer:

   SELECT indexrelname FROM pg_stat_user_indexes WHERE relname = 'products' AND idx_scan = 0; -> Option B

4. Quick Check:

   Unused indexes have idx_scan = 0 [OK]

Hint: Filter by relname and idx_scan = 0 to find unused indexes [OK]

Common Mistakes:

• Using idx_scan > 0 to find unused indexes
• Confusing idx_tup_read with idx_scan
• Checking for NULL instead of zero scans