t-SNE for visualization in ML Python - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Understanding t-SNE's Purpose

What is the main goal of using t-SNE in data analysis?

A To perform linear regression on high-dimensional data

B To increase the number of features in the dataset for better model training

C To reduce high-dimensional data to a lower dimension for visualization while preserving local structure

D To cluster data points into predefined groups based on labels

💡 Hint

Think about what t-SNE does to data dimensions and what it tries to keep intact.

t-SNE reduces data dimensions to 2 or 3 for visualization, focusing on preserving local neighbor relationships.

❓ Predict Output

intermediate

t-SNE Output Shape

Given the following Python code using sklearn's t-SNE, what is the shape of tsne_result?

ML Python

from sklearn.manifold import TSNE
import numpy as np

X = np.random.rand(100, 50)  # 100 samples, 50 features
model = TSNE(n_components=2, random_state=42)
tsne_result = model.fit_transform(X)
print(tsne_result.shape)

A (100, 2)

B (50, 2)

C (2, 100)

D (100, 50)

💡 Hint

Remember, t-SNE reduces features but keeps the number of samples.

t-SNE transforms 100 samples from 50 features to 2 features, so the output shape is (100, 2).

❓ Hyperparameter

advanced

Effect of Perplexity in t-SNE

Which statement best describes the effect of increasing the perplexity parameter in t-SNE?

A Higher perplexity reduces the number of iterations needed for convergence

B Higher perplexity decreases the number of output dimensions

C Higher perplexity increases the learning rate automatically

D Higher perplexity considers more neighbors, leading to a more global view of the data structure

💡 Hint

Think about how perplexity relates to neighborhood size in t-SNE.

Perplexity controls the balance between local and global aspects by setting how many neighbors each point considers; higher values mean more neighbors.

❓ Metrics

advanced

Evaluating t-SNE Visualization Quality

Which metric is commonly used to evaluate how well t-SNE preserves local structure in the reduced space?

A K-nearest neighbor preservation score

B Mean squared error between original and reduced data

C Silhouette score of clusters in original high-dimensional space

D Accuracy of a classification model trained on reduced data

💡 Hint

Consider metrics that measure neighborhood consistency after reduction.

K-nearest neighbor preservation score measures how many neighbors remain the same after dimensionality reduction, reflecting local structure preservation.

🔧 Debug

expert

Identifying t-SNE Runtime Error

What error will this code raise and why?

from sklearn.manifold import TSNE
import numpy as np

X = np.random.rand(10, 5)
model = TSNE(n_components=3, random_state=0)
result = model.fit_transform(X)
print(result.shape)

A ValueError because n_components cannot be greater than 2 for t-SNE

B No error, output shape will be (10, 3)

C TypeError because input data X is not a pandas DataFrame

D RuntimeWarning due to random_state not being set

💡 Hint

Check the allowed output dimensions for t-SNE in sklearn.

No error: sklearn's TSNE supports n_components=1, 2, 3 (and higher with warnings for >3). The output shape is (10, 3).

Practice

1. What is the main purpose of using t-SNE in machine learning?

easy

A. To increase the number of features in the dataset

B. To train a predictive model for classification

C. To visualize high-dimensional data in 2D or 3D to find patterns

D. To clean and preprocess data by removing missing values

Solution

1. Step 1: Understand t-SNE's function

   t-SNE is a tool that reduces many features into 2 or 3 dimensions for easy visualization.

2. Step 2: Identify its main use

   It helps us see groups or clusters in complex data, not to train models or clean data.

3. Final Answer:

   To visualize high-dimensional data in 2D or 3D to find patterns -> Option C

4. Quick Check:

   t-SNE = visualization tool [OK]

Hint: t-SNE = visualize complex data simply [OK]

Common Mistakes:

• Thinking t-SNE trains prediction models
• Confusing t-SNE with data cleaning methods
• Assuming t-SNE increases feature count

2. Which of the following is the correct way to import t-SNE from scikit-learn in Python?

easy

A. from sklearn.manifold import TSNE

B. import tsne from sklearn

C. from sklearn.decomposition import TSNE

D. import TSNE from sklearn.manifold

Solution

1. Step 1: Recall correct import syntax

   scikit-learn's t-SNE is in the manifold module and imported as TSNE.

2. Step 2: Check each option

   from sklearn.manifold import TSNE uses correct Python import syntax and correct module. Others have wrong syntax or module.

3. Final Answer:

   from sklearn.manifold import TSNE -> Option A

4. Quick Check:

   Correct import = from sklearn.manifold import TSNE [OK]

Hint: t-SNE is in sklearn.manifold, import as TSNE [OK]

Common Mistakes:

• Using wrong module like sklearn.decomposition
• Incorrect import syntax causing errors
• Confusing lowercase and uppercase in TSNE

3. What will be the shape of the output from the following code snippet?

from sklearn.manifold import TSNE
import numpy as np
X = np.random.rand(100, 50)
tsne = TSNE(n_components=2, random_state=42)
X_embedded = tsne.fit_transform(X)
print(X_embedded.shape)

medium

A. (50, 2)

B. (2, 100)

C. (100, 50)

D. (100, 2)

Solution

1. Step 1: Understand input and t-SNE output

   Input X has 100 samples and 50 features. t-SNE reduces features to 2 dimensions.

2. Step 2: Determine output shape

   Output shape is (number of samples, n_components) = (100, 2).

3. Final Answer:

   (100, 2) -> Option D

4. Quick Check:

   Output shape = (samples, components) [OK]

Hint: Output shape = (samples, n_components) [OK]

Common Mistakes:

• Confusing features with samples in output shape
• Swapping rows and columns in shape
• Assuming output shape matches input shape

4. You run t-SNE on your dataset but get a ValueError: 'perplexity must be less than n_samples'. What is the likely cause and fix?

medium

A. Input data is not scaled; apply normalization

B. Perplexity is set too high; reduce it below number of samples

C. Random state is not set; set random_state parameter

D. Data contains missing values; remove or fill them

Solution

1. Step 1: Understand the error message

   The error says perplexity must be less than number of samples, so perplexity is too large.

2. Step 2: Fix by adjusting perplexity

   Reduce perplexity parameter to a value smaller than the number of samples in your data.

3. Final Answer:

   Perplexity is set too high; reduce it below number of samples -> Option B

4. Quick Check:

   Perplexity < samples [OK]

Hint: Keep perplexity less than sample count [OK]

Common Mistakes:

• Ignoring perplexity limits and increasing it
• Trying to fix by scaling data instead
• Changing unrelated parameters like random_state

5. You have a dataset with 1000 samples and 100 features. You want to visualize it with t-SNE but also keep track of clusters found by KMeans. Which approach is best?

hard

A. Run KMeans first, then apply t-SNE on original data, color points by cluster

B. Apply t-SNE first, then run KMeans on the 2D t-SNE output

C. Use t-SNE only, no clustering needed for visualization

D. Run KMeans on original data and use PCA instead of t-SNE

Solution

1. Step 1: Understand the goal

   You want to visualize data and show meaningful clusters clearly on the 2D plot.

2. Step 2: Choose correct order

   Running KMeans first on high-dimensional data finds accurate clusters, then t-SNE visualizes them by coloring points by cluster labels.

3. Step 3: Why not other options?

   Clustering on t-SNE output (B) is suboptimal as t-SNE distorts distances and is for visualization only, not modeling.

4. Final Answer:

   Run KMeans first, then apply t-SNE on original data, color points by cluster -> Option A

5. Quick Check:

   Cluster high-dim first, visualize after [OK]

Hint: Cluster original data first, then t-SNE visualize [OK]

Common Mistakes:

• Clustering t-SNE output causing distorted clusters
• Skipping clustering and missing group info
• Using PCA instead of t-SNE unnecessarily