Simple neural network with scikit-learn in ML Python

Introduction

A simple neural network helps computers learn patterns from data to make predictions. Using scikit-learn makes it easy to create and train these networks without deep math.

When you want to classify handwritten digits like 0-9.

When predicting if an email is spam or not based on its words.

When recognizing simple patterns in small datasets.

When you want a quick model to test ideas before using complex tools.

Syntax

ML Python

from sklearn.neural_network import MLPClassifier

model = MLPClassifier(hidden_layer_sizes=(number_of_neurons,), activation='activation_function', max_iter=number_of_iterations)
model.fit(X_train, y_train)
predictions = model.predict(X_test)

hidden_layer_sizes sets how many neurons are in each hidden layer. For example, (5,) means one hidden layer with 5 neurons.

activation controls how neurons decide to pass signals. Common options: 'relu' or 'logistic'.

Examples

This creates a neural network with one hidden layer of 5 neurons using the ReLU activation function.

ML Python

from sklearn.neural_network import MLPClassifier

model = MLPClassifier(hidden_layer_sizes=(5,), activation='relu', max_iter=200)
model.fit(X_train, y_train)
predictions = model.predict(X_test)

This creates a neural network with two hidden layers: first with 10 neurons, second with 5 neurons, using the logistic activation.

ML Python

from sklearn.neural_network import MLPClassifier

model = MLPClassifier(hidden_layer_sizes=(10, 5), activation='logistic', max_iter=300)
model.fit(X_train, y_train)
predictions = model.predict(X_test)

Sample Model

This program trains a simple neural network on the iris flower dataset to classify flower types. It prints the accuracy and predictions on test data.

ML Python

from sklearn.datasets import load_iris
from sklearn.model_selection import train_test_split
from sklearn.neural_network import MLPClassifier
from sklearn.metrics import accuracy_score

# Load iris flower data
iris = load_iris()
X = iris.data
y = iris.target

# Split data into training and testing sets
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.3, random_state=42)

# Create a simple neural network with one hidden layer of 5 neurons
model = MLPClassifier(hidden_layer_sizes=(5,), activation='relu', max_iter=500, random_state=42)

# Train the model
model.fit(X_train, y_train)

# Predict on test data
predictions = model.predict(X_test)

# Calculate accuracy
accuracy = accuracy_score(y_test, predictions)

print(f"Test Accuracy: {accuracy:.2f}")
print(f"Predictions: {predictions}")

Important Notes

Neural networks may need more iterations (max_iter) to learn well.

Set random_state for reproducible results.

MLPClassifier does not scale data automatically; scaling inputs yourself can improve results.

Summary

A simple neural network learns patterns to classify data.

Use MLPClassifier from scikit-learn to build and train it easily.

Adjust hidden layers and neurons to improve learning.

Practice

1. What is the main purpose of using MLPClassifier in scikit-learn?

easy

A. To perform data scaling and normalization

B. To create and train a simple neural network for classification tasks

C. To visualize data distributions

D. To split data into training and testing sets

Solution

1. Step 1: Understand the role of MLPClassifier

   MLPClassifier is a tool in scikit-learn designed to build and train neural networks for classification problems.

2. Step 2: Compare options with MLPClassifier's purpose

   The other options describe tasks like scaling, visualization, and data splitting, which are not the main function of MLPClassifier.

3. Final Answer:

   To create and train a simple neural network for classification tasks -> Option B

4. Quick Check:

   MLPClassifier = neural network classifier [OK]

Hint: MLPClassifier builds neural nets for classification [OK]

Common Mistakes:

• Confusing MLPClassifier with data preprocessing tools
• Thinking it is for regression only
• Assuming it splits data automatically

2. Which of the following is the correct way to import the MLPClassifier from scikit-learn?

easy

A. import neural_network.MLPClassifier from sklearn

B. import MLPClassifier from sklearn.network

C. from sklearn.ml import MLPClassifier

D. from sklearn.neural_network import MLPClassifier

Solution

1. Step 1: Recall the correct module path for MLPClassifier

   MLPClassifier is located in the sklearn.neural_network module.

2. Step 2: Check each import statement for syntax and correctness

   The other options have incorrect module names or import syntax.

3. Final Answer:

   from sklearn.neural_network import MLPClassifier -> Option D

4. Quick Check:

   Correct import = from sklearn.neural_network import MLPClassifier [OK]

Hint: MLPClassifier is in sklearn.neural_network module [OK]

Common Mistakes:

• Using wrong module names like sklearn.ml
• Incorrect import syntax
• Confusing neural_network with network

3. What will be the output of the following code snippet?

from sklearn.neural_network import MLPClassifier
X = [[0., 0.], [1., 1.]]
y = [0, 1]
clf = MLPClassifier(hidden_layer_sizes=(2,), max_iter=1000, random_state=1)
clf.fit(X, y)
pred = clf.predict([[2., 2.]])
print(pred)

medium

A. [0]

B. Error due to wrong input shape

C. [1]

D. [2]

Solution

1. Step 1: Understand the training data and labels

   The model is trained on two points: [0., 0.] labeled 0 and [1., 1.] labeled 1.

2. Step 2: Predict the label for input [2., 2.]

   Since [2., 2.] is closer to [1., 1.] which has label 1, the model predicts 1.

3. Final Answer:

   [1] -> Option C

4. Quick Check:

   Input near class 1 predicts 1 [OK]

Hint: Prediction matches closest trained label [OK]

Common Mistakes:

• Assuming output is 0 by default
• Confusing input shape errors
• Ignoring random_state effect

4. Identify the error in the following code snippet:

from sklearn.neural_network import MLPClassifier
X = [[0, 0], [1, 1]]
y = [0, 1]
clf = MLPClassifier(hidden_layer_sizes=2, max_iter=500)
clf.fit(X, y)

medium

A. hidden_layer_sizes should be a tuple, not an integer

B. max_iter value is too low

C. X and y have mismatched lengths

D. MLPClassifier requires data scaling before fitting

Solution

1. Step 1: Check the hidden_layer_sizes parameter

   hidden_layer_sizes expects a tuple indicating the number of neurons per hidden layer, e.g., (2,), not an integer.

2. Step 2: Verify other parameters and data

   max_iter=500 is valid, X and y lengths match, and scaling is recommended but not mandatory.

3. Final Answer:

   hidden_layer_sizes should be a tuple, not an integer -> Option A

4. Quick Check:

   hidden_layer_sizes = tuple [OK]

Hint: hidden_layer_sizes must be tuple like (2,) [OK]

Common Mistakes:

• Passing integer instead of tuple for hidden_layer_sizes
• Assuming max_iter causes error
• Thinking scaling is mandatory for fit

5. You want to improve your MLPClassifier model's accuracy on a complex dataset. Which of these changes is most likely to help?

hard

A. Increase the number of neurons in hidden layers and train longer

B. Reduce the number of hidden layers to zero

C. Remove the activation function to speed up training

D. Use fewer training samples to avoid overfitting

Solution

1. Step 1: Understand model complexity and training

   Increasing neurons and training longer allows the model to learn more complex patterns.

2. Step 2: Evaluate other options

   Reducing hidden layers to zero removes learning capacity, removing activation breaks non-linearity, and fewer samples usually reduce accuracy.

3. Final Answer:

   Increase the number of neurons in hidden layers and train longer -> Option A

4. Quick Check:

   More neurons + training = better learning [OK]

Hint: More neurons and training improve complex learning [OK]

Common Mistakes:

• Thinking fewer layers always improve accuracy
• Removing activation functions to simplify
• Using less data to prevent overfitting blindly