DBSCAN clustering in ML Python - ML Experiment: Train & Evaluate

Experiment - DBSCAN clustering

Problem:You want to group points in a 2D space into clusters using DBSCAN. The current model uses default parameters but creates too many small clusters and labels many points as noise.

Current Metrics:Number of clusters found: 8, Number of noise points: 50 out of 200

Issue:The model over-segments the data, creating many small clusters and labeling many points as noise, which means the clustering is not meaningful.

Your Task

Adjust DBSCAN parameters to reduce the number of noise points to less than 10 and find meaningful clusters between 2 and 5.

You can only change the 'eps' and 'min_samples' parameters of DBSCAN.

Do not change the dataset or use other clustering algorithms.

Hint 1

Hint 2

Hint 3

Solution

ML Python

import numpy as np
from sklearn.cluster import DBSCAN
from sklearn.datasets import make_blobs

# Create sample data
X, _ = make_blobs(n_samples=200, centers=3, cluster_std=0.60, random_state=0)

# Adjusted DBSCAN parameters
dbscan = DBSCAN(eps=0.8, min_samples=5)
clusters = dbscan.fit_predict(X)

# Count clusters and noise
labels = clusters
n_clusters = len(set(labels)) - (1 if -1 in labels else 0)
noise_points = list(labels).count(-1)

print(f"Number of clusters found: {n_clusters}")
print(f"Number of noise points: {noise_points} out of {len(X)}")

Increased 'eps' from default 0.5 to 0.8 to allow points to be closer and form bigger clusters.

Kept 'min_samples' at 5 to require a reasonable number of points to form a cluster.

Results Interpretation

Before: 8 clusters, 50 noise points (many small clusters and many points not assigned)

After: 3 clusters, 7 noise points (clusters match data centers better, less noise)

Adjusting DBSCAN's 'eps' parameter controls cluster size and noise. Increasing 'eps' reduces noise and merges small clusters into meaningful groups.

Bonus Experiment

Try changing 'min_samples' to 10 while keeping 'eps' at 0.8 and observe how the number of clusters and noise points change.

💡 Hint

Increasing 'min_samples' makes it harder to form clusters, which may increase noise points but can remove small clusters.

Practice

1. What is the main advantage of using DBSCAN clustering compared to K-Means?

easy

A. It does not require specifying the number of clusters beforehand.

B. It always produces clusters of equal size.

C. It only works with numerical data.

D. It requires labeled data to work.

Solution

1. Step 1: Understand DBSCAN's clustering approach

   DBSCAN groups points based on density and does not need the number of clusters as input.

2. Step 2: Compare with K-Means

   K-Means requires the number of clusters to be specified before running the algorithm.

3. Final Answer:

   It does not require specifying the number of clusters beforehand. -> Option A

4. Quick Check:

   DBSCAN = no cluster count needed [OK]

Hint: DBSCAN finds clusters by density, no cluster count needed [OK]

Common Mistakes:

• Thinking DBSCAN needs number of clusters like K-Means
• Assuming DBSCAN only works with numerical data
• Believing DBSCAN requires labeled data

2. Which of the following is the correct way to import and create a DBSCAN model in Python using scikit-learn?

easy

A. import DBSCAN from sklearn\ndbscan = DBSCAN(0.5, 5)

B. import dbscan from sklearn.cluster\ndbscan = dbscan(eps=0.5, min_samples=5)

C. from sklearn.cluster import dbscan\ndbscan = dbscan(eps=0.5, min_samples=5)

D. from sklearn.cluster import DBSCAN\ndbscan = DBSCAN(eps=0.5, min_samples=5)

Solution

1. Step 1: Check correct import syntax

   The correct import is from sklearn.cluster import DBSCAN with capital letters.

2. Step 2: Check model creation syntax

   DBSCAN is created by calling DBSCAN(eps=0.5, min_samples=5) with named parameters.

3. Final Answer:

   from sklearn.cluster import DBSCAN\ndbscan = DBSCAN(eps=0.5, min_samples=5) -> Option D

4. Quick Check:

   Correct import and parameters = from sklearn.cluster import DBSCAN\ndbscan = DBSCAN(eps=0.5, min_samples=5) [OK]

Hint: Use capital DBSCAN and named parameters eps, min_samples [OK]

Common Mistakes:

• Using lowercase dbscan instead of DBSCAN
• Wrong import syntax like import dbscan from sklearn.cluster
• Passing parameters without names or in wrong order

3. Given the following code, what will be the output of print(labels)?

from sklearn.cluster import DBSCAN
import numpy as np

X = np.array([[1, 2], [2, 2], [8, 7], [8, 8], [25, 80]])
dbscan = DBSCAN(eps=3, min_samples=2)
dbscan.fit(X)
labels = dbscan.labels_
print(labels)

medium

A. [0 0 1 1 -1]

B. [0 1 0 1 -1]

C. [1 1 0 0 -1]

D. [-1 -1 -1 -1 -1]

Solution

1. Step 1: Understand DBSCAN parameters and data points

   eps=3 means points within distance 3 are neighbors; min_samples=2 means at least 2 points to form a cluster. Points [1,2] and [2,2] are close, so cluster 0. Points [8,7] and [8,8] are close, so cluster 1. Point [25,80] is far and isolated, so noise (-1).

2. Step 2: Assign labels based on clusters and noise

   First cluster points get label 0, second cluster 1, noise points get -1.

3. Final Answer:

   [0 0 1 1 -1] -> Option A

4. Quick Check:

   Clusters and noise labels = [0 0 1 1 -1] [OK]

Hint: Close points cluster, isolated points labeled -1 noise [OK]

Common Mistakes:

• Mixing cluster labels order
• Forgetting noise points get label -1
• Assuming all points form one cluster

4. You run DBSCAN with eps=0.5 and min_samples=3 on a dataset but get all points labeled as -1. What is the most likely cause?

medium

A. The dataset has too many clusters.

B. The eps value is too small, so no points have enough neighbors.

C. The min_samples value is too low, causing all points to be noise.

D. DBSCAN requires the number of clusters to be set manually.

Solution

1. Step 1: Analyze effect of eps and min_samples

   eps controls neighborhood radius; if too small, points have few neighbors. min_samples=3 means at least 3 points needed to form a cluster.

2. Step 2: Reason why all points are noise

   If eps is too small, no point has 3 neighbors within that radius, so all points become noise (-1).

3. Final Answer:

   The eps value is too small, so no points have enough neighbors. -> Option B

4. Quick Check:

   Small eps causes all noise = The eps value is too small, so no points have enough neighbors. [OK]

Hint: Too small eps means no clusters, all points noise [OK]

Common Mistakes:

• Thinking min_samples too low causes noise
• Believing DBSCAN needs cluster count input
• Assuming many clusters cause noise labels

5. You have a dataset with two dense clusters and some scattered noise points. You want DBSCAN to find the clusters and mark noise correctly. Which combination of eps and min_samples is best to try first?

hard

A. eps=0.3, min_samples=10

B. eps=5, min_samples=2

C. eps=1, min_samples=5

D. eps=0.1, min_samples=1

Solution

1. Step 1: Understand parameter effects

   eps controls neighborhood size; min_samples controls minimum points to form cluster. Too small eps or too high min_samples may miss clusters; too large eps or too low min_samples may merge clusters or label noise incorrectly.

2. Step 2: Choose balanced parameters

   eps=1 and min_samples=5 is a common starting point balancing cluster detection and noise filtering for dense clusters.

3. Final Answer:

   eps=1, min_samples=5 -> Option C

4. Quick Check:

   Balanced eps and min_samples = eps=1, min_samples=5 [OK]

Hint: Start with moderate eps=1 and min_samples=5 for dense clusters [OK]

Common Mistakes:

• Using too small eps causing all noise
• Using too low min_samples merging noise as clusters
• Choosing very large eps merging clusters incorrectly