Simple neural network with scikit-learn in ML Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a simple neural network in scikit-learn?

A simple neural network in scikit-learn is a model called MLPClassifier or MLPRegressor that learns patterns from data using layers of connected nodes called neurons.

beginner

Which scikit-learn class is used to create a simple neural network for classification?

The class MLPClassifier is used to create a simple neural network for classification tasks in scikit-learn.

intermediate

What does the 'hidden_layer_sizes' parameter control in MLPClassifier?

The 'hidden_layer_sizes' parameter controls the number and size of hidden layers in the neural network. For example, (5,) means one hidden layer with 5 neurons.

beginner

How do you measure the accuracy of a neural network model in scikit-learn?

You can measure accuracy by using the score() method on test data, which returns the fraction of correct predictions.

intermediate

What is the role of the activation function in a neural network?

The activation function decides if a neuron should be activated or not, helping the network learn complex patterns by adding non-linearity.

Which scikit-learn class is used to build a simple neural network for classification?

A MLPClassifier

B LinearRegression

C KNeighborsClassifier

D DecisionTreeClassifier

MLPClassifier is the scikit-learn class designed for neural network classification tasks.

What does the 'hidden_layer_sizes' parameter specify?

A Number of input features

B Number of output classes

C Number and size of hidden layers

D Learning rate

'hidden_layer_sizes' sets how many hidden layers and how many neurons each has.

Which method gives the accuracy of a trained neural network model in scikit-learn?

A score()

B fit()

C predict()

D transform()

The score() method returns the accuracy of the model on given data.

What is the purpose of the activation function in a neural network?

A To initialize weights

B To add non-linearity so the network can learn complex patterns

C To split data into batches

D To calculate loss

Activation functions add non-linearity, enabling the network to learn complex relationships.

Which of these is NOT a typical step when using MLPClassifier?

A Create the model with parameters

B Train the model with fit()

C Evaluate with score()

D Manually update weights after each prediction

Weights are updated automatically during training; manual updates are not needed.

Explain how to create, train, and evaluate a simple neural network using scikit-learn's MLPClassifier.

Think about the typical steps: setup, train, test.

Describe the role of hidden layers and activation functions in a simple neural network.

Consider how the network learns beyond simple straight lines.

Practice

1. What is the main purpose of using MLPClassifier in scikit-learn?

easy

A. To perform data scaling and normalization

B. To create and train a simple neural network for classification tasks

C. To visualize data distributions

D. To split data into training and testing sets

Solution

1. Step 1: Understand the role of MLPClassifier

   MLPClassifier is a tool in scikit-learn designed to build and train neural networks for classification problems.

2. Step 2: Compare options with MLPClassifier's purpose

   The other options describe tasks like scaling, visualization, and data splitting, which are not the main function of MLPClassifier.

3. Final Answer:

   To create and train a simple neural network for classification tasks -> Option B

4. Quick Check:

   MLPClassifier = neural network classifier [OK]

Hint: MLPClassifier builds neural nets for classification [OK]

Common Mistakes:

• Confusing MLPClassifier with data preprocessing tools
• Thinking it is for regression only
• Assuming it splits data automatically

2. Which of the following is the correct way to import the MLPClassifier from scikit-learn?

easy

A. import neural_network.MLPClassifier from sklearn

B. import MLPClassifier from sklearn.network

C. from sklearn.ml import MLPClassifier

D. from sklearn.neural_network import MLPClassifier

Solution

1. Step 1: Recall the correct module path for MLPClassifier

   MLPClassifier is located in the sklearn.neural_network module.

2. Step 2: Check each import statement for syntax and correctness

   The other options have incorrect module names or import syntax.

3. Final Answer:

   from sklearn.neural_network import MLPClassifier -> Option D

4. Quick Check:

   Correct import = from sklearn.neural_network import MLPClassifier [OK]

Hint: MLPClassifier is in sklearn.neural_network module [OK]

Common Mistakes:

• Using wrong module names like sklearn.ml
• Incorrect import syntax
• Confusing neural_network with network

3. What will be the output of the following code snippet?

from sklearn.neural_network import MLPClassifier
X = [[0., 0.], [1., 1.]]
y = [0, 1]
clf = MLPClassifier(hidden_layer_sizes=(2,), max_iter=1000, random_state=1)
clf.fit(X, y)
pred = clf.predict([[2., 2.]])
print(pred)

medium

A. [0]

B. Error due to wrong input shape

C. [1]

D. [2]

Solution

1. Step 1: Understand the training data and labels

   The model is trained on two points: [0., 0.] labeled 0 and [1., 1.] labeled 1.

2. Step 2: Predict the label for input [2., 2.]

   Since [2., 2.] is closer to [1., 1.] which has label 1, the model predicts 1.

3. Final Answer:

   [1] -> Option C

4. Quick Check:

   Input near class 1 predicts 1 [OK]

Hint: Prediction matches closest trained label [OK]

Common Mistakes:

• Assuming output is 0 by default
• Confusing input shape errors
• Ignoring random_state effect

4. Identify the error in the following code snippet:

from sklearn.neural_network import MLPClassifier
X = [[0, 0], [1, 1]]
y = [0, 1]
clf = MLPClassifier(hidden_layer_sizes=2, max_iter=500)
clf.fit(X, y)

medium

A. hidden_layer_sizes should be a tuple, not an integer

B. max_iter value is too low

C. X and y have mismatched lengths

D. MLPClassifier requires data scaling before fitting

Solution

1. Step 1: Check the hidden_layer_sizes parameter

   hidden_layer_sizes expects a tuple indicating the number of neurons per hidden layer, e.g., (2,), not an integer.

2. Step 2: Verify other parameters and data

   max_iter=500 is valid, X and y lengths match, and scaling is recommended but not mandatory.

3. Final Answer:

   hidden_layer_sizes should be a tuple, not an integer -> Option A

4. Quick Check:

   hidden_layer_sizes = tuple [OK]

Hint: hidden_layer_sizes must be tuple like (2,) [OK]

Common Mistakes:

• Passing integer instead of tuple for hidden_layer_sizes
• Assuming max_iter causes error
• Thinking scaling is mandatory for fit

5. You want to improve your MLPClassifier model's accuracy on a complex dataset. Which of these changes is most likely to help?

hard

A. Increase the number of neurons in hidden layers and train longer

B. Reduce the number of hidden layers to zero

C. Remove the activation function to speed up training

D. Use fewer training samples to avoid overfitting

Solution

1. Step 1: Understand model complexity and training

   Increasing neurons and training longer allows the model to learn more complex patterns.

2. Step 2: Evaluate other options

   Reducing hidden layers to zero removes learning capacity, removing activation breaks non-linearity, and fewer samples usually reduce accuracy.

3. Final Answer:

   Increase the number of neurons in hidden layers and train longer -> Option A

4. Quick Check:

   More neurons + training = better learning [OK]

Hint: More neurons and training improve complex learning [OK]

Common Mistakes:

• Thinking fewer layers always improve accuracy
• Removing activation functions to simplify
• Using less data to prevent overfitting blindly