Custom detection dataset in PyTorch

Introduction

We create a custom detection dataset to teach a computer how to find objects in pictures that are special to us. This helps the computer learn from our own photos and labels.

When you have your own photos and want to find specific objects in them.

When public datasets don't have the objects you care about.

When you want to train a model to detect items in a new environment, like your home or workplace.

When you want to improve detection accuracy by using your own labeled images.

When you want to test how well a detection model works on your own data.

Syntax

PyTorch

class CustomDetectionDataset(torch.utils.data.Dataset):
    def __init__(self, image_paths, annotations, transforms=None):
        self.image_paths = image_paths
        self.annotations = annotations
        self.transforms = transforms

    def __len__(self):
        return len(self.image_paths)

    def __getitem__(self, idx):
        image = Image.open(self.image_paths[idx]).convert("RGB")
        boxes = self.annotations[idx]['boxes']  # list of [xmin, ymin, xmax, ymax]
        labels = self.annotations[idx]['labels']  # list of labels

        target = {}
        target['boxes'] = torch.tensor(boxes, dtype=torch.float32)
        target['labels'] = torch.tensor(labels, dtype=torch.int64)

        if self.transforms:
            image, target = self.transforms(image, target)

        return image, target

The __getitem__ method returns one image and its labels at a time.

Annotations must include bounding boxes and labels for each object.

Examples

Create the dataset with lists of image file paths and their annotations.

PyTorch

dataset = CustomDetectionDataset(image_paths, annotations)

Get the first image and its target data (boxes and labels).

PyTorch

image, target = dataset[0]
print(image.size, target)

Add image transformations like resizing or flipping during dataset loading.

PyTorch

from torchvision import transforms
transform = transforms.Compose([...])
dataset = CustomDetectionDataset(image_paths, annotations, transforms=transform)

Sample Model

This code creates a simple dataset with two images and their bounding boxes and labels. It then prints the first image type and its target data.

PyTorch

import torch
from torch.utils.data import Dataset
from PIL import Image

class CustomDetectionDataset(Dataset):
    def __init__(self, image_paths, annotations, transforms=None):
        self.image_paths = image_paths
        self.annotations = annotations
        self.transforms = transforms

    def __len__(self):
        return len(self.image_paths)

    def __getitem__(self, idx):
        image = Image.open(self.image_paths[idx]).convert("RGB")
        boxes = self.annotations[idx]['boxes']
        labels = self.annotations[idx]['labels']

        target = {}
        target['boxes'] = torch.tensor(boxes, dtype=torch.float32)
        target['labels'] = torch.tensor(labels, dtype=torch.int64)

        if self.transforms:
            image, target = self.transforms(image, target)

        return image, target

# Sample data
image_paths = ["image1.jpg", "image2.jpg"]
annotations = [
    {"boxes": [[10, 20, 50, 60]], "labels": [1]},
    {"boxes": [[15, 25, 55, 65], [30, 40, 70, 80]], "labels": [2, 3]}
]

# Create dataset
dataset = CustomDetectionDataset(image_paths, annotations)

# Access first item
image, target = dataset[0]
print(f"Image type: {type(image)}")
print(f"Boxes: {target['boxes']}")
print(f"Labels: {target['labels']}")

Important Notes

Make sure bounding boxes are in the format [xmin, ymin, xmax, ymax].

Labels should be integers representing object classes.

Use transforms carefully to keep boxes and labels aligned with images.

Summary

A custom detection dataset helps train models on your own images and labels.

It returns images and their bounding boxes with labels for each object.

Transforms can be added to change images and targets during loading.

Practice

1. What is the main purpose of creating a Custom detection dataset in PyTorch?

easy

A. To perform image classification without labels

B. To convert images to grayscale only

C. To generate random images for testing

D. To load images and their bounding boxes with labels for training detection models

Solution

1. Step 1: Understand dataset role in detection

   A detection dataset provides images along with bounding boxes and labels for each object to train detection models.

2. Step 2: Identify correct purpose

   Classification without labels, random image generation, and grayscale conversion do not provide bounding boxes or labels needed for detection tasks.

3. Final Answer:

   To load images and their bounding boxes with labels for training detection models -> Option D

4. Quick Check:

   Detection dataset = images + bounding boxes + labels [OK]

Hint: Detection datasets always include bounding boxes and labels [OK]

Common Mistakes:

• Thinking detection datasets only have images
• Confusing detection with classification datasets
• Ignoring bounding boxes in dataset

2. Which of the following is the correct way to define the __getitem__ method in a custom detection dataset class?

easy

A. def __getitem__(self): return image, label

B. def __getitem__(self, idx): return image, label

C. def __getitem__(self, idx): return image, bounding_boxes, labels

D. def getitem(self, idx): return image, bounding_boxes

Solution

1. Step 1: Recall __getitem__ signature

   The method must accept an index parameter and return image, bounding boxes, and labels for detection.

2. Step 2: Check options for correct syntax and return values

   def __getitem__(self, idx): return image, bounding_boxes, labels correctly uses def __getitem__(self, idx): and returns image, bounding boxes, and labels. Others miss parameters or return incomplete data.

3. Final Answer:

   def __getitem__(self, idx): return image, bounding_boxes, labels -> Option C

4. Quick Check:

   __getitem__ needs idx and returns image + boxes + labels [OK]

Hint: __getitem__ always takes index and returns image with boxes and labels [OK]

Common Mistakes:

• Omitting the idx parameter
• Returning only image and label without boxes
• Using wrong method name without underscores

3. Given this snippet from a custom detection dataset, what will be the output type of dataset[0]?

class CustomDataset(torch.utils.data.Dataset):
    def __getitem__(self, idx):
        image = self.images[idx]
        boxes = self.boxes[idx]
        labels = self.labels[idx]
        target = {"boxes": boxes, "labels": labels}
        return image, target

medium

A. A tuple containing an image tensor and a dictionary with boxes and labels

B. A list containing image, boxes, and labels separately

C. Only the image tensor

D. A dictionary with keys 'image' and 'target'

Solution

1. Step 1: Analyze return statement

   The method returns image, target where target is a dictionary with keys 'boxes' and 'labels'.

2. Step 2: Determine output type

   Returning two items separated by comma means a tuple is returned: (image, target dictionary).

3. Final Answer:

   A tuple containing an image tensor and a dictionary with boxes and labels -> Option A

4. Quick Check:

   Return image, target dict = tuple [OK]

Hint: Comma-separated returns form a tuple in Python [OK]

Common Mistakes:

• Thinking return is a list instead of tuple
• Assuming only image is returned
• Confusing dictionary keys with return structure

4. You wrote this __getitem__ method but get an error when loading data:

def __getitem__(self, idx):
    image = self.images[idx]
    boxes = self.boxes[idx]
    labels = self.labels[idx]
    target = {"boxes": boxes, "labels": labels}
    return image, target

What is the most likely cause of the error?

medium

A. Missing return statement

B. boxes and labels are not converted to tensors

C. image is not normalized

D. Incorrect method name without underscores

Solution

1. Step 1: Check common dataset errors

   Detection models expect bounding boxes and labels as tensors, not raw lists or arrays.

2. Step 2: Identify missing tensor conversion

   If boxes and labels are not converted to tensors, PyTorch will raise errors during training or data loading.

3. Final Answer:

   boxes and labels are not converted to tensors -> Option B

4. Quick Check:

   Boxes and labels must be tensors [OK]

Hint: Always convert boxes and labels to tensors before returning [OK]

Common Mistakes:

• Forgetting to convert boxes and labels to torch tensors
• Assuming image normalization fixes tensor errors
• Using wrong method name causing attribute errors

5. You want to add a transform that flips images horizontally and adjusts bounding boxes accordingly in your custom detection dataset. Which approach is best?

hard

A. Apply the horizontal flip transform to both image and bounding boxes inside __getitem__

B. Flip bounding boxes but not the image

C. Apply the transform only after training the model

D. Apply the horizontal flip transform only to the image inside __getitem__, leave boxes unchanged

Solution

1. Step 1: Understand transform requirements

   When flipping images, bounding boxes must be adjusted to match the new image layout.

2. Step 2: Apply transform to both image and boxes

   Applying the transform only to the image or only to boxes causes mismatch and incorrect training data.

3. Final Answer:

   Apply the horizontal flip transform to both image and bounding boxes inside __getitem__ -> Option A

4. Quick Check:

   Flip image and boxes together for correct data [OK]

Hint: Transform image and boxes together to keep alignment [OK]

Common Mistakes:

• Flipping only image or only boxes
• Applying transforms after training
• Ignoring bounding box coordinate updates