Support Vector Machine (SVM) in ML Python - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

What is the main goal of a Support Vector Machine?

In simple terms, what does a Support Vector Machine try to do when it learns from data?

A It tries to group data points into clusters without using labels.

B It tries to find the line or boundary that best separates different groups with the widest gap.

C It tries to reduce the number of features by combining them.

D It tries to memorize all the training data points exactly to predict future data.

💡 Hint

Think about drawing a line that keeps groups apart as much as possible.

SVM finds the boundary (called hyperplane) that separates classes with the largest margin, helping it generalize well.

❓ Predict Output

intermediate

What is the output of this SVM prediction code?

Given this Python code using sklearn's SVM, what will be printed?

ML Python

from sklearn import svm
X = [[0, 0], [1, 1]]
y = [0, 1]
clf = svm.SVC(kernel='linear')
clf.fit(X, y)
pred = clf.predict([[2, 2]])
print(pred[0])

A 1

B 0

C [1]

D Error: kernel not supported

💡 Hint

The point [2, 2] is closer to which training group?

The model learns to separate points [0,0] as class 0 and [1,1] as class 1. The new point [2,2] is closer to class 1 side.

❓ Hyperparameter

advanced

Which SVM hyperparameter controls the trade-off between margin size and classification error?

In SVM, which parameter lets you decide how much you want to avoid misclassifying training points versus having a wider margin?

A C

B Gamma

C Kernel

D Degree

💡 Hint

This parameter is often called the regularization parameter.

The parameter C controls the penalty for misclassification. A small C allows more errors but a wider margin; a large C tries to classify all points correctly.

❓ Metrics

advanced

Which metric is most suitable to evaluate an SVM classifier on imbalanced data?

If your SVM model predicts classes but one class is much rarer than the other, which metric gives a better sense of performance?

A Recall

B Accuracy

C F1 Score

D Precision

💡 Hint

Think about a metric that balances precision and recall.

F1 Score combines precision and recall, making it better for imbalanced data than accuracy alone.

🔧 Debug

expert

What error does this SVM code raise?

Consider this code snippet. What error will it raise when run?

ML Python

from sklearn import svm
X = [[0, 0], [1, 1], [2, 2]]
y = [0, 1]
clf = svm.SVC(kernel='linear')
clf.fit(X, y)

A IndexError: list index out of range

B TypeError: kernel must be a string

C No error, model fits successfully

D ValueError: Found input variables with inconsistent numbers of samples

💡 Hint

Check if the number of labels matches the number of data points.

The labels list y has 2 elements but X has 3 samples, causing a ValueError about inconsistent sample sizes.

Practice

1. What is the main goal of a Support Vector Machine (SVM) in machine learning?

easy

A. To cluster data points into groups without labels

B. To reduce the number of features in the dataset

C. To find the best boundary that separates different classes

D. To generate random predictions for data points

Solution

1. Step 1: Understand SVM's purpose

   SVM aims to separate data points into classes by drawing a boundary.

2. Step 2: Identify the best boundary

   SVM finds the boundary (called hyperplane) that maximizes the margin between classes.

3. Final Answer:

   To find the best boundary that separates different classes -> Option C

4. Quick Check:

   SVM goal = best separating boundary [OK]

Hint: SVM separates classes with the widest margin [OK]

Common Mistakes:

• Confusing SVM with clustering methods
• Thinking SVM reduces features
• Believing SVM makes random predictions

2. Which of the following is the correct way to import the SVM classifier from scikit-learn in Python?

easy

A. import svm from sklearn

B. from sklearn.svm import SVC

C. from sklearn import svm.SVC

D. import SVC from sklearn.svm

Solution

1. Step 1: Recall scikit-learn import syntax

   Correct import uses 'from module import class' format.

2. Step 2: Match correct syntax for SVM

   The SVM classifier is called SVC and is imported from sklearn.svm as 'from sklearn.svm import SVC'.

3. Final Answer:

   from sklearn.svm import SVC -> Option B

4. Quick Check:

   Correct import = from sklearn.svm import SVC [OK]

Hint: Use 'from sklearn.svm import SVC' to import SVM [OK]

Common Mistakes:

• Using wrong import order
• Trying to import class directly without module
• Using invalid syntax like 'import svm from sklearn'

3. What will be the output of the following Python code using SVM?

from sklearn.svm import SVC
import numpy as np

X = np.array([[0, 0], [1, 1]])
y = [0, 1]
model = SVC(kernel='linear')
model.fit(X, y)
pred = model.predict([[2, 2]])
print(pred)

medium

A. [0]

B. Error

C. [2]

D. [1]

Solution

1. Step 1: Understand training data and labels

   Training points: [0,0] labeled 0 and [1,1] labeled 1.

2. Step 2: Predict label for [2,2]

   [2,2] is closer to class 1 side since it lies beyond [1,1]. So prediction is 1.

3. Final Answer:

   [1] -> Option D

4. Quick Check:

   Point [2,2] predicted class = 1 [OK]

Hint: Points near class 1 get label 1 [OK]

Common Mistakes:

• Predicting label 0 for point far from class 0
• Expecting error due to small data
• Confusing kernel effect on prediction

4. Identify the error in this SVM code snippet:

from sklearn.svm import SVC
X = [[1, 2], [2, 3], [3, 4]]
y = [0, 1]
model = SVC()
model.fit(X, y)

medium

A. Mismatch in number of samples and labels

B. Wrong import statement

C. Kernel parameter missing

D. Predict method not called

Solution

1. Step 1: Check data and label lengths

   X has 3 samples but y has only 2 labels, causing mismatch.

2. Step 2: Understand fit requirements

   fit() requires equal number of samples and labels to train properly.

3. Final Answer:

   Mismatch in number of samples and labels -> Option A

4. Quick Check:

   Samples count != labels count causes error [OK]

Hint: Samples and labels must match in length [OK]

Common Mistakes:

• Ignoring length mismatch
• Thinking kernel is mandatory
• Expecting error without calling predict

5. You have a dataset with two classes that are not linearly separable. Which SVM kernel should you choose to improve classification?

hard

A. RBF (Radial Basis Function) kernel

B. Polynomial kernel

C. Linear kernel

D. Sigmoid kernel

Solution

1. Step 1: Understand data separability

   Non-linearly separable data means a straight line can't separate classes well.

2. Step 2: Choose kernel for complex boundaries

   RBF kernel maps data into higher dimension to separate complex shapes effectively.

3. Final Answer:

   RBF (Radial Basis Function) kernel -> Option A

4. Quick Check:

   Non-linear data needs RBF kernel [OK]

Hint: Use RBF kernel for non-linear data [OK]

Common Mistakes:

• Choosing linear kernel for non-linear data
• Confusing polynomial and RBF kernels
• Ignoring kernel choice impact