t-SNE for visualization in ML Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is t-SNE used for in machine learning?

t-SNE is used to reduce high-dimensional data to two or three dimensions to help visualize complex data patterns in a simple, easy-to-understand way.

intermediate

How does t-SNE preserve data structure during visualization?

t-SNE preserves local relationships by keeping similar points close together in the low-dimensional space, making clusters visible while allowing some distortion of global structure.

intermediate

What is the main difference between PCA and t-SNE?

PCA is a linear method that preserves global variance, while t-SNE is a nonlinear method focused on preserving local similarities for better cluster visualization.

advanced

What role does the 'perplexity' parameter play in t-SNE?

Perplexity controls the balance between local and global aspects of the data; it roughly sets how many neighbors each point influences during the mapping.

advanced

Why should t-SNE results be interpreted carefully?

Because t-SNE can distort global distances and is sensitive to parameters, its plots show clusters well but should not be used to infer exact distances or relationships between clusters.

What is the primary goal of t-SNE?

A Increase the number of features in data

B Visualize high-dimensional data in 2D or 3D

C Train a classification model

D Generate synthetic data

t-SNE reduces data dimensions to 2 or 3 to help visualize complex data.

Which aspect does t-SNE focus on preserving?

A Local similarities between nearby points

B Global distances between all points

C Exact numeric values of features

D Data labels

t-SNE preserves local similarities to show clusters clearly.

What does the 'perplexity' parameter affect in t-SNE?

A Number of output dimensions

B Number of iterations

C Learning rate speed

D Balance between local and global data structure

Perplexity controls how many neighbors influence each point, balancing local/global structure.

Why is t-SNE not suitable for very large datasets without adjustments?

A It is computationally expensive and slow

B It increases data dimensionality

C It only works with images

D It requires labeled data

t-SNE can be slow and costly on large datasets without special techniques.

Which method is a linear alternative to t-SNE?

A Random Forest

B K-means

C PCA

D Neural Networks

PCA is a linear dimensionality reduction method often compared to t-SNE.

Explain how t-SNE helps visualize complex data and what makes it different from other dimensionality reduction methods.

Think about how t-SNE shows clusters clearly by focusing on neighbors.

Describe the importance of the 'perplexity' parameter in t-SNE and how changing it might affect the visualization.

Consider how many neighbors each point 'sees' during mapping.

Practice

1. What is the main purpose of using t-SNE in machine learning?

easy

A. To increase the number of features in the dataset

B. To train a predictive model for classification

C. To visualize high-dimensional data in 2D or 3D to find patterns

D. To clean and preprocess data by removing missing values

Solution

1. Step 1: Understand t-SNE's function

   t-SNE is a tool that reduces many features into 2 or 3 dimensions for easy visualization.

2. Step 2: Identify its main use

   It helps us see groups or clusters in complex data, not to train models or clean data.

3. Final Answer:

   To visualize high-dimensional data in 2D or 3D to find patterns -> Option C

4. Quick Check:

   t-SNE = visualization tool [OK]

Hint: t-SNE = visualize complex data simply [OK]

Common Mistakes:

• Thinking t-SNE trains prediction models
• Confusing t-SNE with data cleaning methods
• Assuming t-SNE increases feature count

2. Which of the following is the correct way to import t-SNE from scikit-learn in Python?

easy

A. from sklearn.manifold import TSNE

B. import tsne from sklearn

C. from sklearn.decomposition import TSNE

D. import TSNE from sklearn.manifold

Solution

1. Step 1: Recall correct import syntax

   scikit-learn's t-SNE is in the manifold module and imported as TSNE.

2. Step 2: Check each option

   from sklearn.manifold import TSNE uses correct Python import syntax and correct module. Others have wrong syntax or module.

3. Final Answer:

   from sklearn.manifold import TSNE -> Option A

4. Quick Check:

   Correct import = from sklearn.manifold import TSNE [OK]

Hint: t-SNE is in sklearn.manifold, import as TSNE [OK]

Common Mistakes:

• Using wrong module like sklearn.decomposition
• Incorrect import syntax causing errors
• Confusing lowercase and uppercase in TSNE

3. What will be the shape of the output from the following code snippet?

from sklearn.manifold import TSNE
import numpy as np
X = np.random.rand(100, 50)
tsne = TSNE(n_components=2, random_state=42)
X_embedded = tsne.fit_transform(X)
print(X_embedded.shape)

medium

A. (50, 2)

B. (2, 100)

C. (100, 50)

D. (100, 2)

Solution

1. Step 1: Understand input and t-SNE output

   Input X has 100 samples and 50 features. t-SNE reduces features to 2 dimensions.

2. Step 2: Determine output shape

   Output shape is (number of samples, n_components) = (100, 2).

3. Final Answer:

   (100, 2) -> Option D

4. Quick Check:

   Output shape = (samples, components) [OK]

Hint: Output shape = (samples, n_components) [OK]

Common Mistakes:

• Confusing features with samples in output shape
• Swapping rows and columns in shape
• Assuming output shape matches input shape

4. You run t-SNE on your dataset but get a ValueError: 'perplexity must be less than n_samples'. What is the likely cause and fix?

medium

A. Input data is not scaled; apply normalization

B. Perplexity is set too high; reduce it below number of samples

C. Random state is not set; set random_state parameter

D. Data contains missing values; remove or fill them

Solution

1. Step 1: Understand the error message

   The error says perplexity must be less than number of samples, so perplexity is too large.

2. Step 2: Fix by adjusting perplexity

   Reduce perplexity parameter to a value smaller than the number of samples in your data.

3. Final Answer:

   Perplexity is set too high; reduce it below number of samples -> Option B

4. Quick Check:

   Perplexity < samples [OK]

Hint: Keep perplexity less than sample count [OK]

Common Mistakes:

• Ignoring perplexity limits and increasing it
• Trying to fix by scaling data instead
• Changing unrelated parameters like random_state

5. You have a dataset with 1000 samples and 100 features. You want to visualize it with t-SNE but also keep track of clusters found by KMeans. Which approach is best?

hard

A. Run KMeans first, then apply t-SNE on original data, color points by cluster

B. Apply t-SNE first, then run KMeans on the 2D t-SNE output

C. Use t-SNE only, no clustering needed for visualization

D. Run KMeans on original data and use PCA instead of t-SNE

Solution

1. Step 1: Understand the goal

   You want to visualize data and show meaningful clusters clearly on the 2D plot.

2. Step 2: Choose correct order

   Running KMeans first on high-dimensional data finds accurate clusters, then t-SNE visualizes them by coloring points by cluster labels.

3. Step 3: Why not other options?

   Clustering on t-SNE output (B) is suboptimal as t-SNE distorts distances and is for visualization only, not modeling.

4. Final Answer:

   Run KMeans first, then apply t-SNE on original data, color points by cluster -> Option A

5. Quick Check:

   Cluster high-dim first, visualize after [OK]

Hint: Cluster original data first, then t-SNE visualize [OK]

Common Mistakes:

• Clustering t-SNE output causing distorted clusters
• Skipping clustering and missing group info
• Using PCA instead of t-SNE unnecessarily