Why computer vision teaches machines to see - Experiment to Prove It

Experiment - Why computer vision teaches machines to see

Problem:We want a computer to recognize objects in pictures, like how we see and understand images.

Current Metrics:Training accuracy: 98%, Validation accuracy: 70%

Issue:The model is overfitting. It learns the training images too well but does not do well on new images.

Your Task

Reduce overfitting so validation accuracy improves to at least 85%, while keeping training accuracy below 92%.

Keep the same dataset and model architecture (a simple CNN).

Only change training settings or add regularization techniques.

Hint 1

Hint 2

Hint 3

Solution

Computer Vision

import tensorflow as tf
from tensorflow.keras import layers, models
from tensorflow.keras.preprocessing.image import ImageDataGenerator

# Load example dataset (CIFAR-10)
(X_train, y_train), (X_test, y_test) = tf.keras.datasets.cifar10.load_data()

# Normalize pixel values
X_train, X_test = X_train / 255.0, X_test / 255.0

# Data augmentation
datagen = ImageDataGenerator(
    rotation_range=15,
    width_shift_range=0.1,
    height_shift_range=0.1,
    horizontal_flip=True
)
datagen.fit(X_train)

# Build CNN model with dropout
model = models.Sequential([
    layers.Conv2D(32, (3,3), activation='relu', input_shape=(32,32,3)),
    layers.MaxPooling2D((2,2)),
    layers.Dropout(0.25),
    layers.Conv2D(64, (3,3), activation='relu'),
    layers.MaxPooling2D((2,2)),
    layers.Dropout(0.25),
    layers.Flatten(),
    layers.Dense(128, activation='relu'),
    layers.Dropout(0.5),
    layers.Dense(10, activation='softmax')
])

model.compile(optimizer='adam', loss='sparse_categorical_crossentropy', metrics=['accuracy'])

# Train with data augmentation and early stopping
early_stop = tf.keras.callbacks.EarlyStopping(monitor='val_loss', patience=5, restore_best_weights=True)

history = model.fit(datagen.flow(X_train, y_train, batch_size=64), epochs=50, validation_data=(X_test, y_test), callbacks=[early_stop])

Added dropout layers after convolution and dense layers to reduce overfitting.

Used data augmentation to create more varied training images.

Added early stopping to stop training when validation loss stops improving.

Results Interpretation

Before: Training accuracy 98%, Validation accuracy 70% (overfitting)

After: Training accuracy 90%, Validation accuracy 86% (better generalization)

Adding dropout and data augmentation helps the model learn general patterns, not just memorize training images. This improves how well the model 'sees' new images.

Bonus Experiment

Try using a smaller learning rate and batch size to see if validation accuracy improves further.

💡 Hint

Lower learning rates can help the model learn more carefully, and smaller batches add noise that can reduce overfitting.

Practice

1. What is the main goal of computer vision in machines?

easy

A. To store large amounts of data

B. To help machines understand and interpret images and videos

C. To make machines run faster

D. To improve battery life of devices

Solution

1. Step 1: Understand the purpose of computer vision

   Computer vision is about teaching machines to see and understand visual data like images and videos.

2. Step 2: Identify the correct goal

   The goal is not about speed, storage, or battery but about interpreting visual information.

3. Final Answer:

   To help machines understand and interpret images and videos -> Option B

4. Quick Check:

   Computer vision = understanding images/videos [OK]

Hint: Think: What does 'vision' mean for machines? [OK]

Common Mistakes:

• Confusing computer vision with hardware improvements
• Thinking it only stores data
• Mixing vision with battery or speed

2. Which of the following is the correct way to represent an image as data for a machine to process?

easy

A. A single number

B. A list of text descriptions

C. A matrix of pixel values

D. A sound wave

Solution

1. Step 1: Recall how images are stored digitally

   Images are stored as grids of pixels, each with color or brightness values, forming a matrix.

2. Step 2: Match the correct representation

   Only a matrix of pixel values correctly represents image data for machines.

3. Final Answer:

   A matrix of pixel values -> Option C

4. Quick Check:

   Image data = pixel matrix [OK]

Hint: Images = grids of pixels, not text or sound [OK]

Common Mistakes:

• Choosing text descriptions instead of pixel data
• Thinking images are single numbers
• Confusing images with sounds

3. Given the following Python code snippet for edge detection, what will be the output shape of edges if the input image shape is (100, 100)?

import cv2
image = cv2.imread('photo.jpg', 0)
edges = cv2.Canny(image, 100, 200)
print(edges.shape)

medium

A. (50, 50)

B. (98, 98)

C. (102, 102)

D. (100, 100)

Solution

1. Step 1: Understand Canny edge detection output size

   Canny edge detection returns an image of the same size as the input image.

2. Step 2: Check input image shape

   The input image shape is (100, 100), so the output edges will also have shape (100, 100).

3. Final Answer:

   (100, 100) -> Option D

4. Quick Check:

   Canny output shape = input shape [OK]

Hint: Edge detection keeps image size same [OK]

Common Mistakes:

• Assuming edges shrink image size
• Thinking edges enlarge image
• Confusing shape with number of edges

4. The following code is intended to convert an image to grayscale using OpenCV. What is the error?

import cv2
image = cv2.imread('photo.jpg')
gray = cv2.cvtColor(image, cv2.COLOR_BGR2GRAY)
cv2.imshow('Gray Image', gray)
cv2.waitKey(0)
cv2.destroyAllWindows()

medium

A. No error, code works correctly

B. cv2.imread should include flag cv2.IMREAD_GRAYSCALE

C. cv2.cvtColor is used incorrectly

D. Missing image file path

Solution

1. Step 1: Check image reading method

   cv2.imread reads the image in color by default, which is fine for conversion.

2. Step 2: Verify color conversion usage

   cv2.cvtColor with cv2.COLOR_BGR2GRAY correctly converts color image to grayscale.

3. Step 3: Confirm display functions

   cv2.imshow, cv2.waitKey, and cv2.destroyAllWindows are used properly to show the image.

4. Final Answer:

   No error, code works correctly -> Option A

5. Quick Check:

   Correct grayscale conversion code [OK]

Hint: cv2.cvtColor with COLOR_BGR2GRAY is standard [OK]

Common Mistakes:

• Thinking cv2.imread needs grayscale flag always
• Misusing cv2.cvtColor parameters
• Forgetting to call cv2.waitKey

5. You want to teach a machine to recognize handwritten digits using computer vision. Which combination of steps is best to prepare the images before training a model?

hard

A. Convert images to grayscale, normalize pixel values, and detect edges

B. Convert images to color, increase brightness, and add noise

C. Resize images to large size, convert to text, and shuffle pixels

D. Use raw images without any processing

Solution

1. Step 1: Identify useful preprocessing steps for digit recognition

   Converting to grayscale simplifies data, normalizing scales pixel values, and edge detection highlights important features.

2. Step 2: Evaluate other options

   Color conversion and noise addition can confuse the model; resizing too large or converting to text is not helpful; raw images may have noise and irrelevant info.

3. Final Answer:

   Convert images to grayscale, normalize pixel values, and detect edges -> Option A

4. Quick Check:

   Preprocessing = grayscale + normalize + edges [OK]

Hint: Simplify images and highlight features before training [OK]

Common Mistakes:

• Using color images unnecessarily
• Adding noise that confuses model
• Skipping normalization
• Ignoring edge detection benefits