t-SNE for visualization in ML Python - Model Pipeline Trace

Model Pipeline - t-SNE for visualization

t-SNE is a tool that helps us see complex data by turning many features into just two or three, so we can plot and understand it better.

Data Flow - 3 Stages

1Input Data

1000 rows x 50 columns→Raw high-dimensional data with 50 features per sample→1000 rows x 50 columns

Sample 1: [0.5, 1.2, 3.3, ..., 0.7]

↓

2Preprocessing

1000 rows x 50 columns→Normalize each feature to have zero mean and unit variance→1000 rows x 50 columns

Sample 1 normalized: [-0.1, 0.3, 1.0, ..., -0.2]

↓

3t-SNE Embedding

1000 rows x 50 columns→Compute pairwise similarities and map data to 2D space preserving local structure→1000 rows x 2 columns

Sample 1 embedded: [12.3, -5.6]

Training Trace - Epoch by Epoch

Loss
1.2 |*       
1.0 | *      
0.8 |  **    
0.6 |   **   
0.4 |    **  
0.2 |     ** 
0.0 +--------
     1 5 10 20 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	1.2	N/A	Initial embedding with high loss, points scattered randomly
5	0.8	N/A	Clusters start to form, loss decreases as local similarities improve
10	0.5	N/A	Clearer clusters, loss steadily decreasing
20	0.3	N/A	Stable embedding, loss converges, clusters well separated

Prediction Trace - 3 Layers

Layer 1: Input Sample

Layer 2: Normalization

Layer 3: t-SNE Mapping

Model Quiz - 3 Questions

What does t-SNE mainly help us do with data?

A Increase the number of features

B See high-dimensional data in 2D or 3D

C Train a classification model

D Clean missing data

Key Insight

t-SNE transforms complex, high-dimensional data into a simple 2D map that reveals hidden groupings, making it easier to understand patterns visually.

Practice

1. What is the main purpose of using t-SNE in machine learning?

easy

A. To increase the number of features in the dataset

B. To train a predictive model for classification

C. To visualize high-dimensional data in 2D or 3D to find patterns

D. To clean and preprocess data by removing missing values

Solution

1. Step 1: Understand t-SNE's function

   t-SNE is a tool that reduces many features into 2 or 3 dimensions for easy visualization.

2. Step 2: Identify its main use

   It helps us see groups or clusters in complex data, not to train models or clean data.

3. Final Answer:

   To visualize high-dimensional data in 2D or 3D to find patterns -> Option C

4. Quick Check:

   t-SNE = visualization tool [OK]

Hint: t-SNE = visualize complex data simply [OK]

Common Mistakes:

• Thinking t-SNE trains prediction models
• Confusing t-SNE with data cleaning methods
• Assuming t-SNE increases feature count

2. Which of the following is the correct way to import t-SNE from scikit-learn in Python?

easy

A. from sklearn.manifold import TSNE

B. import tsne from sklearn

C. from sklearn.decomposition import TSNE

D. import TSNE from sklearn.manifold

Solution

1. Step 1: Recall correct import syntax

   scikit-learn's t-SNE is in the manifold module and imported as TSNE.

2. Step 2: Check each option

   from sklearn.manifold import TSNE uses correct Python import syntax and correct module. Others have wrong syntax or module.

3. Final Answer:

   from sklearn.manifold import TSNE -> Option A

4. Quick Check:

   Correct import = from sklearn.manifold import TSNE [OK]

Hint: t-SNE is in sklearn.manifold, import as TSNE [OK]

Common Mistakes:

• Using wrong module like sklearn.decomposition
• Incorrect import syntax causing errors
• Confusing lowercase and uppercase in TSNE

3. What will be the shape of the output from the following code snippet?

from sklearn.manifold import TSNE
import numpy as np
X = np.random.rand(100, 50)
tsne = TSNE(n_components=2, random_state=42)
X_embedded = tsne.fit_transform(X)
print(X_embedded.shape)

medium

A. (50, 2)

B. (2, 100)

C. (100, 50)

D. (100, 2)

Solution

1. Step 1: Understand input and t-SNE output

   Input X has 100 samples and 50 features. t-SNE reduces features to 2 dimensions.

2. Step 2: Determine output shape

   Output shape is (number of samples, n_components) = (100, 2).

3. Final Answer:

   (100, 2) -> Option D

4. Quick Check:

   Output shape = (samples, components) [OK]

Hint: Output shape = (samples, n_components) [OK]

Common Mistakes:

• Confusing features with samples in output shape
• Swapping rows and columns in shape
• Assuming output shape matches input shape

4. You run t-SNE on your dataset but get a ValueError: 'perplexity must be less than n_samples'. What is the likely cause and fix?

medium

A. Input data is not scaled; apply normalization

B. Perplexity is set too high; reduce it below number of samples

C. Random state is not set; set random_state parameter

D. Data contains missing values; remove or fill them

Solution

1. Step 1: Understand the error message

   The error says perplexity must be less than number of samples, so perplexity is too large.

2. Step 2: Fix by adjusting perplexity

   Reduce perplexity parameter to a value smaller than the number of samples in your data.

3. Final Answer:

   Perplexity is set too high; reduce it below number of samples -> Option B

4. Quick Check:

   Perplexity < samples [OK]

Hint: Keep perplexity less than sample count [OK]

Common Mistakes:

• Ignoring perplexity limits and increasing it
• Trying to fix by scaling data instead
• Changing unrelated parameters like random_state

5. You have a dataset with 1000 samples and 100 features. You want to visualize it with t-SNE but also keep track of clusters found by KMeans. Which approach is best?

hard

A. Run KMeans first, then apply t-SNE on original data, color points by cluster

B. Apply t-SNE first, then run KMeans on the 2D t-SNE output

C. Use t-SNE only, no clustering needed for visualization

D. Run KMeans on original data and use PCA instead of t-SNE

Solution

1. Step 1: Understand the goal

   You want to visualize data and show meaningful clusters clearly on the 2D plot.

2. Step 2: Choose correct order

   Running KMeans first on high-dimensional data finds accurate clusters, then t-SNE visualizes them by coloring points by cluster labels.

3. Step 3: Why not other options?

   Clustering on t-SNE output (B) is suboptimal as t-SNE distorts distances and is for visualization only, not modeling.

4. Final Answer:

   Run KMeans first, then apply t-SNE on original data, color points by cluster -> Option A

5. Quick Check:

   Cluster high-dim first, visualize after [OK]

Hint: Cluster original data first, then t-SNE visualize [OK]

Common Mistakes:

• Clustering t-SNE output causing distorted clusters
• Skipping clustering and missing group info
• Using PCA instead of t-SNE unnecessarily