CV applications (autonomous driving, medical, retail) in Computer Vision

Introduction

Computer vision helps computers see and understand images or videos. This makes machines smarter and able to help in many areas.

To help cars drive themselves safely by recognizing roads, signs, and obstacles.

To assist doctors by analyzing medical images like X-rays or MRIs for faster diagnosis.

To improve shopping by recognizing products on shelves or tracking customer behavior in stores.

Syntax

Computer Vision

No fixed syntax since applications vary, but common steps include:
1. Collect images or video data
2. Use a computer vision model (like CNN) to analyze data
3. Get predictions or detections from the model
4. Use results to make decisions or actions

Models like Convolutional Neural Networks (CNNs) are often used for image tasks.

Data quality and labeling are very important for good results.

Examples

This predicts objects like cars, pedestrians, and traffic signs in a road image.

Computer Vision

# Example: Detecting objects in a driving scene
model.predict(image_of_road)

This predicts if an X-ray shows signs of disease or is normal.

Computer Vision

# Example: Classifying medical images
model.predict(xray_image)

This detects and counts different products to help manage inventory.

Computer Vision

# Example: Counting products on a shelf
model.detect(products_shelf_image)

Sample Model

This program uses a ready-made computer vision model to classify an image. It shows the top 3 guesses with their confidence. This is similar to how CV helps recognize objects in driving, medical, or retail images.

Computer Vision

import cv2
import numpy as np
from tensorflow.keras.applications.mobilenet_v2 import MobileNetV2, preprocess_input, decode_predictions

# Load a pre-trained model for image classification
model = MobileNetV2(weights='imagenet')

# Load an example image (replace with your own image path)
image_path = 'elephant.jpg'
image = cv2.imread(image_path)
image_resized = cv2.resize(image, (224, 224))
image_rgb = cv2.cvtColor(image_resized, cv2.COLOR_BGR2RGB)
image_array = np.expand_dims(image_rgb, axis=0)
image_preprocessed = preprocess_input(image_array)

# Predict the image class
predictions = model.predict(image_preprocessed)
results = decode_predictions(predictions, top=3)[0]

# Print top 3 predictions
for i, (imagenetID, label, prob) in enumerate(results):
    print(f"{i+1}. {label}: {prob*100:.2f}%")

Important Notes

Real-world CV applications often need custom models trained on specific data.

Good lighting and clear images improve model accuracy.

Ethical use and privacy are important when using CV in sensitive areas like medical or retail.

Summary

Computer vision helps machines understand images to assist in many fields.

It is used in autonomous driving to see the road, in medicine to analyze scans, and in retail to track products.

Pre-trained models can quickly show how CV works, but real tasks often need custom training.

Practice

1. Which of the following is a common use of computer vision in autonomous driving?

easy

A. Detecting pedestrians and other vehicles on the road

B. Managing inventory in a warehouse

C. Analyzing blood samples in a lab

D. Recommending products to online shoppers

Solution

1. Step 1: Understand autonomous driving needs

   Autonomous cars need to see and understand their surroundings to drive safely.

2. Step 2: Match computer vision tasks to driving

   Detecting pedestrians and vehicles helps the car avoid accidents and navigate roads.

3. Final Answer:

   Detecting pedestrians and other vehicles on the road -> Option A

4. Quick Check:

   Autonomous driving = detecting road objects [OK]

Hint: Autonomous driving means seeing road and traffic [OK]

Common Mistakes:

• Confusing retail or medical uses with driving
• Thinking CV only works for product tracking
• Mixing up lab analysis with driving tasks

2. Which Python library is commonly used for image processing in computer vision tasks?

easy

A. NumPy

B. Pandas

C. OpenCV

D. Matplotlib

Solution

1. Step 1: Identify libraries for image processing

   OpenCV is designed specifically for computer vision and image tasks.

2. Step 2: Compare other libraries

   NumPy handles arrays, Pandas handles tables, Matplotlib is for plotting, but OpenCV processes images.

3. Final Answer:

   OpenCV -> Option C

4. Quick Check:

   Image processing library = OpenCV [OK]

Hint: OpenCV is the go-to for CV image tasks [OK]

Common Mistakes:

• Choosing NumPy for image processing only
• Confusing Pandas with image libraries
• Picking Matplotlib which is for plotting

3. What will the following Python code output when using a pre-trained model to classify an image in a retail store?

import cv2
model = cv2.dnn.readNetFromONNX('product_classifier.onnx')
image = cv2.imread('shelf.jpg')
blob = cv2.dnn.blobFromImage(image, 1/255.0, (224,224), swapRB=True)
model.setInput(blob)
predictions = model.forward()
print(predictions.argmax())

medium

A. The raw image pixels as a list

B. The size of the input image

C. An error because the model file is missing

D. The index of the most likely product class detected

Solution

1. Step 1: Understand the code flow

   The code loads a model, prepares the image, runs prediction, and prints the class with highest score.

2. Step 2: Interpret the output

   predictions.argmax() returns the index of the class with the highest confidence, meaning the predicted product.

3. Final Answer:

   The index of the most likely product class detected -> Option D

4. Quick Check:

   Model prediction = class index [OK]

Hint: argmax gives highest scoring class index [OK]

Common Mistakes:

• Thinking it prints raw pixels
• Assuming it prints image size
• Expecting an error without checking file presence

4. A medical imaging model is not detecting tumors correctly. The code snippet is:

image = cv2.imread('scan.png')
blob = cv2.dnn.blobFromImage(image, scalefactor=1.0, size=(224,224))
model.setInput(blob)
pred = model.forward()

What is the likely issue causing poor detection?

medium

A. The image is not resized before blob creation

B. The scalefactor should normalize pixel values (e.g., 1/255.0)

C. The model input is missing color channel swap

D. The model file is not loaded

Solution

1. Step 1: Check image preprocessing

   Pixel values usually need normalization (scaling to 0-1) for good model input.

2. Step 2: Identify scalefactor problem

   Using scalefactor=1.0 keeps pixel values 0-255, which can confuse the model expecting 0-1.

3. Final Answer:

   The scalefactor should normalize pixel values (e.g., 1/255.0) -> Option B

4. Quick Check:

   Normalize pixels for model input [OK]

Hint: Normalize pixels with scalefactor 1/255.0 [OK]

Common Mistakes:

• Ignoring pixel normalization
• Assuming resizing alone fixes issues
• Forgetting color channel order matters

5. In an autonomous driving system, how can computer vision help improve safety during night driving?

hard

A. By using infrared cameras to detect pedestrians in low light

B. By increasing the car's speed automatically

C. By disabling sensors to save power

D. By only relying on GPS data

Solution

1. Step 1: Understand night driving challenges

   Low light makes it hard for normal cameras to see pedestrians and obstacles.

2. Step 2: Identify CV solution for low light

   Infrared cameras capture heat signatures, helping detect people even in darkness.

3. Final Answer:

   By using infrared cameras to detect pedestrians in low light -> Option A

4. Quick Check:

   Infrared helps see in dark [OK]

Hint: Infrared cameras detect heat at night [OK]

Common Mistakes:

• Thinking speed increase improves safety
• Disabling sensors reduces safety
• Relying only on GPS ignores vision needs