Point cloud processing in Computer Vision - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Understanding Point Cloud Normal Estimation

Which method is commonly used to estimate normals in a point cloud for surface reconstruction?

A Applying k-means clustering to segment the point cloud

B Applying Fourier transform on the entire point cloud

C Using histogram equalization on point intensities

D Using Principal Component Analysis (PCA) on the local neighborhood of each point

💡 Hint

Think about how to find the main direction of variation in a small group of points.

PCA finds the main directions of variance in a local neighborhood, which helps estimate the surface normal as the direction with least variance.

❓ Predict Output

intermediate

Output of Point Cloud Downsampling Code

What is the number of points after running this voxel grid downsampling code on a point cloud with 10000 points and voxel size 0.1?

Computer Vision

import open3d as o3d
pcd = o3d.geometry.PointCloud()
pcd.points = o3d.utility.Vector3dVector([[x*0.05, y*0.05, z*0.05] for x in range(20) for y in range(20) for z in range(25)])
downsampled = pcd.voxel_down_sample(voxel_size=0.1)
num_points = len(downsampled.points)
print(num_points)

A 4000

B 5000

C 2000

D 10000

💡 Hint

Consider how many voxels fit in the bounding box when voxel size is 0.1 and points are spaced by 0.05.

The original points are spaced 0.05 apart, so each voxel of size 0.1 contains roughly 8 points. The total voxels are about 2000, so downsampled points are 2000.

❓ Model Choice

advanced

Choosing a Model for Point Cloud Classification

You want to classify objects from raw 3D point clouds with varying point counts and no fixed grid. Which model architecture is best suited?

A 3D Convolutional Neural Network on voxelized grid

B PointNet architecture using symmetric functions on points

C Fully connected network on flattened point coordinates

D Recurrent Neural Network processing points sequentially

💡 Hint

Think about models that handle unordered sets and varying input sizes.

PointNet uses symmetric functions like max pooling to handle unordered point sets and varying sizes, making it ideal for raw point cloud classification.

❓ Metrics

advanced

Evaluating Point Cloud Segmentation Quality

Which metric best measures the quality of semantic segmentation on a point cloud where each point is assigned a class label?

A Mean Intersection over Union (mIoU) over all classes

B Root Mean Square Error (RMSE) of point coordinates

C Silhouette score of clustered points

D Accuracy of predicted bounding box coordinates

💡 Hint

Consider a metric that compares predicted and true class labels per point across classes.

mIoU measures overlap between predicted and true class regions per class, averaged over all classes, making it suitable for semantic segmentation evaluation.

🔧 Debug

expert

Debugging Point Cloud Registration Code

Given this code snippet for point cloud registration, what error will it raise?

Computer Vision

import open3d as o3d
import numpy as np
source = o3d.io.read_point_cloud('source.pcd')
target = o3d.io.read_point_cloud('target.pcd')
threshold = 0.02
trans_init = np.eye(4)
reg_p2p = o3d.pipelines.registration.registration_icp(
    source, target, threshold, trans_init,
    o3d.pipelines.registration.TransformationEstimationPointToPoint())
print(reg_p2p.transformation)

A NameError: name 'np' is not defined

B FileNotFoundError: source.pcd not found

C TypeError: registration_icp() missing required positional argument

D AttributeError: 'PointCloud' object has no attribute 'read_point_cloud'

💡 Hint

Check if all necessary libraries are imported before use.

The code uses 'np.eye(4)' but numpy (np) is not imported, causing a NameError.

Practice

1. What is the main purpose of point cloud processing in computer vision?

easy

A. To process 2D images for color correction

B. To generate text from speech

C. To compress video files efficiently

D. To analyze and understand 3D shapes and scenes

Solution

1. Step 1: Understand the nature of point clouds

   Point clouds are sets of 3D points representing shapes or scenes in space.

2. Step 2: Identify the goal of processing these points

   The goal is to analyze and understand the 3D structure they represent, such as objects or environments.

3. Final Answer:

   To analyze and understand 3D shapes and scenes -> Option D

4. Quick Check:

   Point cloud processing = 3D shape understanding [OK]

Hint: Point clouds = 3D points for shapes, not 2D images [OK]

Common Mistakes:

• Confusing point clouds with 2D image processing
• Thinking point clouds are for video compression
• Mixing point cloud tasks with speech recognition

2. Which Python library is commonly used for point cloud processing and visualization?

easy

A. OpenCV

B. Open3D

C. TensorFlow

D. Matplotlib

Solution

1. Step 1: Recall libraries for 3D point cloud tasks

   Open3D is designed specifically for 3D data like point clouds, meshes, and visualization.

2. Step 2: Compare with other options

   OpenCV is mainly for 2D images, TensorFlow is for general ML, and Matplotlib is for plotting 2D graphs.

3. Final Answer:

   Open3D -> Option B

4. Quick Check:

   Point cloud library = Open3D [OK]

Hint: Open3D is for 3D points; OpenCV is for 2D images [OK]

Common Mistakes:

• Choosing OpenCV for 3D point clouds
• Confusing TensorFlow as a visualization tool
• Picking Matplotlib for 3D point cloud processing

3. What will be the output shape of the point cloud after downsampling with voxel size 0.05 using Open3D?

medium

A. A point cloud with increased number of points

B. A point cloud with the same number of points but shifted coordinates

C. A point cloud with fewer points clustered within 0.05 units

D. An error because voxel size must be an integer

Solution

1. Step 1: Understand voxel downsampling

   Downsampling groups points within each voxel (cube) of size 0.05 and replaces them with one point, reducing total points.

2. Step 2: Analyze the effect on point cloud size

   The output has fewer points clustered spatially, not the same or more points, and voxel size can be float.

3. Final Answer:

   A point cloud with fewer points clustered within 0.05 units -> Option C

4. Quick Check:

   Downsampling reduces points by voxel clustering [OK]

Hint: Downsampling reduces points by grouping nearby ones [OK]

Common Mistakes:

• Thinking downsampling keeps same number of points
• Assuming voxel size must be integer
• Believing downsampling increases points

4. Given this code snippet, what is the error?

import open3d as o3d
pcd = o3d.io.read_point_cloud("cloud.ply")
pcd.estimate_normals()
pcd.voxel_down_sample(voxel_size=0.1)
print(len(pcd.points))

medium

A. voxel_down_sample() does not modify pcd in place

B. len(pcd.points) is invalid syntax

C. read_point_cloud() requires a numpy array, not a file path

D. estimate_normals() must be called after downsampling

Solution

1. Step 1: Check voxel_down_sample behavior

   voxel_down_sample() returns a new downsampled point cloud; it does not change the original pcd.

2. Step 2: Identify the error in code usage

   The code calls voxel_down_sample but ignores the returned point cloud, so pcd remains unchanged.

3. Final Answer:

   voxel_down_sample() does not modify pcd in place -> Option A

4. Quick Check:

   Downsampling returns new cloud, must assign it [OK]

Hint: voxel_down_sample returns new cloud; assign it [OK]

Common Mistakes:

• Assuming voxel_down_sample modifies original point cloud
• Calling estimate_normals before downsampling is allowed
• Thinking read_point_cloud needs numpy array

5. You want to classify objects in a point cloud scene. Which combination of steps is best to prepare the data before training a model?

hard

A. Load point cloud, downsample, estimate normals, extract features

B. Load point cloud, convert to 2D image, apply CNN

C. Load point cloud, increase point density, skip normals, train directly

D. Load point cloud, randomly shuffle points, train without features

Solution

1. Step 1: Identify common preprocessing steps for point cloud classification

   Typical steps include loading, downsampling to reduce size, estimating normals for surface info, and extracting features for model input.

2. Step 2: Evaluate options for best practice

   Load point cloud, downsample, estimate normals, extract features follows standard pipeline; B loses 3D info by converting to 2D; C ignores normals and increases data unnecessarily; D shuffles points losing structure.

3. Final Answer:

   Load point cloud, downsample, estimate normals, extract features -> Option A

4. Quick Check:

   Preprocessing pipeline = load, downsample, normals, features [OK]

Hint: Preprocess: downsample + normals before training [OK]

Common Mistakes:

• Converting 3D points to 2D images loses depth info
• Skipping normals loses surface orientation data
• Random shuffling breaks spatial structure