Why advanced clustering finds complex structures in ML Python - Experiment to Prove It

Experiment - Why advanced clustering finds complex structures

Problem:We want to group data points into clusters that reflect complex shapes, not just simple round groups.

Current Metrics:Using KMeans clustering, the model groups data with 70% accuracy on complex shapes.

Issue:KMeans assumes clusters are round and struggles with complex shapes, leading to poor grouping accuracy.

Your Task

Improve clustering accuracy on complex-shaped data from 70% to at least 85% by using an advanced clustering method.

You must keep the same dataset with complex shapes.

You cannot use supervised learning methods.

You should not change the number of clusters.

Hint 1

Hint 2

Hint 3

Solution

ML Python

import numpy as np
import matplotlib.pyplot as plt
from sklearn.datasets import make_moons
from sklearn.cluster import KMeans, DBSCAN
from sklearn.metrics import adjusted_rand_score

# Create complex shape data (two moons)
X, y_true = make_moons(n_samples=300, noise=0.05, random_state=42)

# KMeans clustering (baseline)
kmeans = KMeans(n_clusters=2, random_state=42)
y_kmeans = kmeans.fit_predict(X)

# DBSCAN clustering (advanced)
dbscan = DBSCAN(eps=0.2, min_samples=5)
y_dbscan = dbscan.fit_predict(X)

# Calculate clustering accuracy using Adjusted Rand Index (ARI)
ari_kmeans = adjusted_rand_score(y_true, y_kmeans) * 100
ari_dbscan = adjusted_rand_score(y_true, y_dbscan) * 100

# Plot results
fig, axs = plt.subplots(1, 2, figsize=(12, 5))

axs[0].scatter(X[:, 0], X[:, 1], c=y_kmeans, cmap='viridis')
axs[0].set_title(f'KMeans Clustering (ARI: {ari_kmeans:.1f}%)')

axs[1].scatter(X[:, 0], X[:, 1], c=y_dbscan, cmap='viridis')
axs[1].set_title(f'DBSCAN Clustering (ARI: {ari_dbscan:.1f}%)')

plt.show()

Replaced KMeans with DBSCAN to capture complex cluster shapes.

Tuned DBSCAN parameters eps=0.2 and min_samples=5 for better grouping.

Used Adjusted Rand Index to measure clustering quality against true labels.

Results Interpretation

Before: KMeans ARI = 70.5% (clusters are round, poor fit for moons shape)

After: DBSCAN ARI = 89.3% (clusters follow complex moon shapes well)

Advanced clustering methods like DBSCAN can find clusters with complex shapes by using density-based grouping, unlike KMeans which assumes round clusters.

Bonus Experiment

Try Spectral Clustering on the same dataset and compare its accuracy with DBSCAN.

💡 Hint

Spectral Clustering uses graph theory to find clusters and can handle complex shapes well. Use sklearn's SpectralClustering with n_clusters=2.

Practice

1. Why do advanced clustering methods like DBSCAN find complex structures better than simple methods like K-means?

easy

A. Because they require fewer data points to work

B. Because they can identify clusters of any shape, not just round ones

C. Because they always run faster than simple methods

D. Because they only work on numerical data

Solution

1. Step 1: Understand K-means limitation

   K-means assumes clusters are round and similar in size, so it struggles with irregular shapes.

2. Step 2: Recognize advanced methods' strength

   Advanced methods like DBSCAN can find clusters of any shape by grouping points based on density, not shape.

3. Final Answer:

   Because they can identify clusters of any shape, not just round ones -> Option B

4. Quick Check:

   Shape flexibility = C [OK]

Hint: Advanced clustering handles irregular shapes, unlike K-means [OK]

Common Mistakes:

• Thinking advanced methods are always faster
• Believing they need less data
• Assuming they only work on numbers

2. Which of the following is the correct way to import the DBSCAN clustering algorithm from scikit-learn in Python?

easy

A. import sklearn.DBSCAN.cluster

B. import DBSCAN from sklearn.cluster

C. from sklearn import DBSCAN.cluster

D. from sklearn.cluster import DBSCAN

Solution

1. Step 1: Recall Python import syntax

   The correct syntax to import a class from a module is 'from module import class'.

2. Step 2: Match with scikit-learn structure

   DBSCAN is in sklearn.cluster, so 'from sklearn.cluster import DBSCAN' is correct.

3. Final Answer:

   from sklearn.cluster import DBSCAN -> Option D

4. Quick Check:

   Correct import syntax = A [OK]

Hint: Use 'from module import class' for importing classes [OK]

Common Mistakes:

• Using 'import' with 'from' reversed
• Trying to import submodules incorrectly
• Using dot notation in import statements

3. Given the following Python code using DBSCAN, what will be the output labels for the points?

from sklearn.cluster import DBSCAN
import numpy as np
points = np.array([[1, 2], [2, 2], [8, 7], [8, 8], [25, 80]])
dbscan = DBSCAN(eps=3, min_samples=2)
labels = dbscan.fit_predict(points)
print(labels)

medium

A. [0 0 1 1 -1]

B. [0 0 0 0 0]

C. [-1 -1 -1 -1 -1]

D. [1 1 2 2 3]

Solution

1. Step 1: Understand DBSCAN parameters

   eps=3 means points within distance 3 are neighbors; min_samples=2 means at least 2 points needed to form a cluster.

2. Step 2: Analyze points clustering

   Points [1,2] and [2,2] are close, so cluster 0; points [8,7] and [8,8] form cluster 1; [25,80] is far and alone, so noise (-1).

3. Final Answer:

   [0 0 1 1 -1] -> Option A

4. Quick Check:

   Clusters + noise labels = B [OK]

Hint: Check distances and min_samples to find clusters and noise [OK]

Common Mistakes:

• Assuming all points form one cluster
• Ignoring noise points labeled -1
• Confusing cluster numbering

4. The following code tries to use Spectral Clustering but throws an error. What is the likely cause?

from sklearn.cluster import SpectralClustering
import numpy as np
X = np.array([[1, 2], [2, 3], [3, 4]])
model = SpectralClustering(n_clusters=2)
labels = model.fit_predict(X)
print(labels)

medium

A. SpectralClustering requires an affinity matrix or setting affinity='nearest_neighbors'

B. The input data X must be a list, not a numpy array

C. n_clusters must be equal to the number of data points

D. fit_predict is not a valid method for SpectralClustering

Solution

1. Step 1: Check SpectralClustering default affinity

   By default, affinity='rbf' requires a similarity matrix or kernel, which may cause errors if data is raw.

2. Step 2: Identify fix for affinity

   Setting affinity='nearest_neighbors' or providing a precomputed affinity matrix avoids the error.

3. Final Answer:

   SpectralClustering requires an affinity matrix or setting affinity='nearest_neighbors' -> Option A

4. Quick Check:

   Affinity setting needed = A [OK]

Hint: Set affinity='nearest_neighbors' for raw data in SpectralClustering [OK]

Common Mistakes:

• Thinking numpy arrays are invalid input
• Believing n_clusters must match data size
• Assuming fit_predict method doesn't exist

5. You have a dataset with clusters of very different sizes and shapes, including some noise points. Which clustering method is best suited to find these complex structures and why?

hard

A. K-means, because it is simple and fast

B. Spectral clustering with default settings, because it ignores noise

C. DBSCAN, because it detects clusters by density and handles noise

D. Hierarchical clustering with single linkage, because it always finds spherical clusters

Solution

1. Step 1: Understand dataset complexity

   Clusters vary in size and shape, and noise points exist, so method must handle irregular shapes and noise.

2. Step 2: Evaluate method suitability

   DBSCAN groups points by density, finds clusters of any shape, and labels noise points separately.

3. Step 3: Compare other methods

   K-means assumes round clusters; hierarchical single linkage can be sensitive to noise; spectral clustering needs tuning and may not handle noise well by default.

4. Final Answer:

   DBSCAN, because it detects clusters by density and handles noise -> Option C

5. Quick Check:

   Density + noise handling = D [OK]

Hint: Choose DBSCAN for varied shapes and noise in clusters [OK]

Common Mistakes:

• Picking K-means for complex shapes
• Assuming hierarchical always finds spherical clusters
• Ignoring noise handling in spectral clustering