Correlated subquery execution model in SQL

Introduction

A correlated subquery helps find related data by using values from the main query. It runs once for each row in the main query to give precise matching results.

When you want to compare each row in a table with related rows in another table.

When you need to filter rows based on a condition that depends on each row's data.

When you want to calculate a value for each row using data from another table.

When you want to check if a related record exists for each row in the main query.

Syntax

SQL

SELECT column1, column2
FROM table1
WHERE column3 operator (
  SELECT columnX
  FROM table2
  WHERE table2.columnY = table1.columnZ
);

The subquery uses a column from the outer query to filter its results.

The subquery runs once for each row of the outer query, making it 'correlated'.

Examples

Find employees whose salary is higher than the average salary in their own department.

SQL

SELECT e.name
FROM employees e
WHERE e.salary > (
  SELECT AVG(salary)
  FROM employees
  WHERE department = e.department
);

Find customers who have placed orders after January 1, 2024.

SQL

SELECT c.customer_id, c.name
FROM customers c
WHERE EXISTS (
  SELECT 1
  FROM orders o
  WHERE o.customer_id = c.customer_id
  AND o.order_date > '2024-01-01'
);

Sample Program

This query finds employees who earn more than the average salary in their department using a correlated subquery.

SQL

CREATE TABLE employees (
  id INT,
  name VARCHAR(50),
  department VARCHAR(50),
  salary INT
);

INSERT INTO employees VALUES
(1, 'Alice', 'Sales', 5000),
(2, 'Bob', 'Sales', 4000),
(3, 'Charlie', 'HR', 4500),
(4, 'Diana', 'HR', 5500);

SELECT name, salary
FROM employees e
WHERE salary > (
  SELECT AVG(salary)
  FROM employees
  WHERE department = e.department
);

Important Notes

Correlated subqueries can be slower because they run once per outer row.

Use indexes on columns used in the correlation to improve performance.

Sometimes, you can rewrite correlated subqueries as joins for better speed.

Summary

A correlated subquery uses data from the outer query to filter results.

It runs once for each row in the outer query, making it dynamic and precise.

Useful for comparing or checking related data row by row.

Practice

1. What is a correlated subquery in SQL?

easy

A. A subquery that runs independently of the outer query

B. A subquery that uses values from the outer query to filter results

C. A query that joins two tables without conditions

D. A query that only returns aggregate values

Solution

1. Step 1: Understand subquery types

   A correlated subquery depends on the outer query's current row to run.

2. Step 2: Identify correlation

   It uses columns from the outer query inside the subquery's WHERE clause.

3. Final Answer:

   A subquery that uses values from the outer query to filter results -> Option B

4. Quick Check:

   Correlated subquery = uses outer query values [OK]

Hint: Correlated subqueries reference outer query columns [OK]

Common Mistakes:

• Thinking subquery runs once independently
• Confusing with JOIN operations
• Assuming it returns only aggregates

2. Which of the following is the correct syntax for a correlated subquery?

easy

A. SELECT e.name FROM employees e WHERE e.salary > (SELECT AVG(salary) FROM employees WHERE department = e.department)

B. SELECT e.name FROM employees e WHERE salary > 50000

C. SELECT e.name FROM employees e WHERE e.salary > (SELECT AVG(salary) FROM employees)

D. SELECT e.name FROM employees e JOIN departments d ON e.department = d.id

Solution

1. Step 1: Identify correlation in subquery

   SELECT e.name FROM employees e WHERE e.salary > (SELECT AVG(salary) FROM employees WHERE department = e.department) uses 'e.department' inside the subquery, linking it to the outer query.

2. Step 2: Check other options

   SELECT e.name FROM employees e WHERE e.salary > (SELECT AVG(salary) FROM employees) has no reference to outer query in subquery; the option with 'salary > 50000' lacks a subquery and the JOIN option is not a subquery.

3. Final Answer:

   SELECT e.name FROM employees e WHERE e.salary > (SELECT AVG(salary) FROM employees WHERE department = e.department) -> Option A

4. Quick Check:

   Correlation needs outer query column inside subquery [OK]

Hint: Look for outer query columns inside subquery WHERE clause [OK]

Common Mistakes:

• Missing outer query reference inside subquery
• Confusing JOIN with subquery
• Using subquery without correlation

3. Given the tables employees(id, name, department, salary) and the query:

SELECT e1.name FROM employees e1 WHERE e1.salary > (SELECT AVG(e2.salary) FROM employees e2 WHERE e2.department = e1.department);

What does this query return?

medium

A. Employees whose salary is above the average salary of their own department

B. Employees whose salary is above the average salary of all employees

C. Employees with salary above 50000

D. All employees regardless of salary

Solution

1. Step 1: Understand the subquery correlation

   The subquery calculates average salary for the department of the current employee (e1.department).

2. Step 2: Compare salaries

   The outer query selects employees whose salary is greater than that department average.

3. Final Answer:

   Employees whose salary is above the average salary of their own department -> Option A

4. Quick Check:

   Salary > department average = Employees whose salary is above the average salary of their own department [OK]

Hint: Check which outer column is used inside subquery condition [OK]

Common Mistakes:

• Assuming average is for all employees
• Ignoring the correlation condition
• Confusing with simple WHERE salary > value

4. Identify the error in the following correlated subquery:

SELECT c.customer_id FROM customers c WHERE c.orders_count > (SELECT AVG(o.orders_count) FROM orders o WHERE o.customer_id = c.customer_id);

medium

A. The subquery will return multiple rows causing an error

B. The subquery uses a wrong table alias 'o' which is not defined

C. The subquery compares orders_count incorrectly; should use SUM instead of AVG

D. The subquery references the outer query correctly; no error

Solution

1. Step 1: Analyze correlation

   The subquery correctly uses 'c.customer_id' from the outer query in its WHERE clause.

2. Step 2: Check aggregation and output

   AVG(o.orders_count) is an aggregate that returns a single scalar value, even for customers with multiple orders.

3. Final Answer:

   The subquery references the outer query correctly; no error -> Option D

4. Quick Check:

   Subquery must return single value for comparison [OK]

Hint: Ensure subquery returns one value for comparison [OK]

Common Mistakes:

• Thinking AVG returns multiple rows without GROUP BY
• Assuming alias 'o' is undefined
• Believing SUM is needed instead of AVG

5. You want to find all products whose price is higher than the average price of products in the same category. Which query correctly uses a correlated subquery to achieve this?

hard

A. SELECT p.product_name FROM products p JOIN categories c ON p.category = c.id WHERE p.price > c.avg_price

B. SELECT p.product_name FROM products p WHERE p.price > (SELECT AVG(price) FROM products)

C. SELECT p.product_name FROM products p WHERE p.price > (SELECT AVG(price) FROM products WHERE category = p.category)

D. SELECT product_name FROM products WHERE price > ALL (SELECT price FROM products)

Solution

1. Step 1: Identify correlation condition

   SELECT p.product_name FROM products p WHERE p.price > (SELECT AVG(price) FROM products WHERE category = p.category) uses 'p.category' inside the subquery to calculate average price per category, correlating outer and inner queries.

2. Step 2: Verify other options

   SELECT p.product_name FROM products p WHERE p.price > (SELECT AVG(price) FROM products) compares to overall average, not per category; the option using JOIN with categories uses a JOIN but no subquery; the option using > ALL compares to all individual prices, not average.

3. Final Answer:

   SELECT p.product_name FROM products p WHERE p.price > (SELECT AVG(price) FROM products WHERE category = p.category) -> Option C

4. Quick Check:

   Correlated subquery filters by category [OK]

Hint: Use outer query column inside subquery WHERE for correlation [OK]

Common Mistakes:

• Using overall average instead of per category
• Confusing JOIN with subquery
• Using ALL instead of AVG in subquery