Types of ML (supervised, unsupervised, reinforcement) in ML Python - Model Pipeline Trace

Model Pipeline - Types of ML (supervised, unsupervised, reinforcement)

This pipeline shows three main types of machine learning: supervised, unsupervised, and reinforcement learning. Each type learns from data differently to solve problems.

Data Flow - 3 Stages

1Supervised Learning Data

1000 rows x 6 columns→Input labeled data with features and target labels→1000 rows x 6 columns

Features: age, income, education; Label: loan approval (yes/no)

↓

2Unsupervised Learning Data

1000 rows x 5 columns→Input unlabeled data with features only→1000 rows x 5 columns

Features: customer purchase history without labels

↓

3Reinforcement Learning Environment

State space: 10 features→Agent interacts with environment, receives rewards→State transitions and rewards

Robot senses 10 sensor readings, takes actions, gets reward feedback

Training Trace - Epoch by Epoch

Loss
0.7 | *       
0.6 | **      
0.5 | ***     
0.4 | ****    
0.3 |         
    +---------
     1 2 3 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.65	0.60	Model starts learning patterns from labeled data
2	0.50	0.72	Loss decreases, accuracy improves as model fits data better
3	0.40	0.80	Model converges, showing good learning progress

Prediction Trace - 3 Layers

Layer 1: Input features

Layer 2: Model prediction (Supervised)

Layer 3: Decision threshold

Model Quiz - 3 Questions

Which type of learning uses labeled data with known answers?

A Unsupervised learning

B Reinforcement learning

C Supervised learning

D None of the above

Key Insight

Understanding the three main types of machine learning helps choose the right approach: supervised for labeled data, unsupervised for finding hidden patterns without labels, and reinforcement for learning from interaction and rewards.

Practice

1. Which type of machine learning uses labeled data to teach the model?

easy

A. Supervised learning

B. Unsupervised learning

C. Reinforcement learning

D. Deep learning

Solution

1. Step 1: Understand labeled data meaning

   Labeled data means each example has a known answer or outcome.

2. Step 2: Match learning type with labeled data

   Supervised learning uses labeled data to train models to predict outcomes.

3. Final Answer:

   Supervised learning -> Option A

4. Quick Check:

   Supervised = labeled data [OK]

Hint: Labeled data means supervised learning [OK]

Common Mistakes:

• Confusing unsupervised with supervised
• Thinking reinforcement uses labeled data
• Mixing deep learning as a type here

2. Which of the following is the correct description of unsupervised learning?

easy

A. Learning from labeled data to predict outcomes

B. Finding patterns in data without labels

C. Learning actions to maximize rewards

D. Training deep neural networks

Solution

1. Step 1: Recall unsupervised learning definition

   Unsupervised learning finds hidden patterns or groups in data without labels.

2. Step 2: Match options with definition

   Finding patterns in data without labels correctly states it finds patterns without labels.

3. Final Answer:

   Finding patterns in data without labels -> Option B

4. Quick Check:

   Unsupervised = no labels [OK]

Hint: No labels means unsupervised learning [OK]

Common Mistakes:

• Choosing supervised for unlabeled data
• Confusing reinforcement with unsupervised
• Thinking deep learning is a type of ML here

3. Consider this Python code snippet for a reinforcement learning agent:

actions = ['left', 'right', 'up', 'down']
rewards = {'left': -1, 'right': 1, 'up': 0, 'down': 0}
current_action = 'right'
reward = rewards[current_action]
print(reward)

What will be the output?

medium

A. 0

B. -1

C. null

D. 1

Solution

1. Step 1: Identify the current action and reward mapping

   The current_action is 'right'. The rewards dictionary maps 'right' to 1.

2. Step 2: Print the reward for 'right'

   reward = rewards['right'] equals 1, so print outputs 1.

3. Final Answer:

   1 -> Option D

4. Quick Check:

   Reward for 'right' = 1 [OK]

Hint: Check dictionary key for current action [OK]

Common Mistakes:

• Confusing keys and values in dictionary
• Printing variable before assignment
• Assuming default reward 0

4. The following code is intended to perform supervised learning but has an error:

data = [([1, 2], 0), ([3, 4], 1), ([5, 6], 0)]
features, labels = zip(*data)
model = SomeModel()
model.train(features, labels)

What is the likely error?

medium

A. Features and labels are not separated correctly

B. Data format is incorrect for supervised learning

C. Model class SomeModel is undefined

D. train method should be fit instead

Solution

1. Step 1: Check variable unpacking

   features and labels are correctly unpacked from data using zip(*data).

2. Step 2: Identify model usage error

   SomeModel is not defined anywhere, so creating model = SomeModel() causes an error.

3. Final Answer:

   Model class SomeModel is undefined -> Option C

4. Quick Check:

   Undefined class causes error [OK]

Hint: Undefined classes cause errors at instantiation [OK]

Common Mistakes:

• Assuming train method is wrong without context
• Thinking data unpacking is incorrect
• Ignoring missing model definition

5. You want to build a system that learns to play a game by trying moves and getting points as feedback. Which type of machine learning should you use?

hard

A. Reinforcement learning

B. Supervised learning

C. Unsupervised learning

D. Clustering

Solution

1. Step 1: Understand the problem context

   The system learns by trying moves and receiving points (rewards) as feedback.

2. Step 2: Match learning type to feedback-based learning

   Reinforcement learning fits because it learns actions to maximize rewards from feedback.

3. Final Answer:

   Reinforcement learning -> Option A

4. Quick Check:

   Learning from rewards = Reinforcement [OK]

Hint: Learning from rewards means reinforcement learning [OK]

Common Mistakes:

• Choosing supervised because of 'learning'
• Confusing clustering with reinforcement
• Ignoring feedback as reward signal