Optical flow for indoor positioning in Drone Programming - Step-by-Step Execution

Concept Flow - Optical flow for indoor positioning

Start Camera Capture

↓

Capture Consecutive Frames

↓

Calculate Optical Flow Vectors

↓

Estimate Movement from Flow

↓

Update Drone Position

↓

Repeat for Next Frames

↓

End

The drone captures video frames, calculates optical flow between frames to estimate movement, and updates its indoor position continuously.

Execution Sample

Drone Programming

frame1 = capture_frame()
frame2 = capture_frame()
flow = calc_optical_flow(frame1, frame2)
dx, dy = estimate_movement(flow)
position.x += dx
position.y += dy

This code captures two frames, calculates optical flow, estimates movement, and updates the drone's position.

Execution Table

Step	Action	Input	Output	Position (x,y)
1	Capture first frame	Camera sensor	frame1 image	(0,0) initial
2	Capture second frame	Camera sensor	frame2 image	(0,0) initial
3	Calculate optical flow	frame1, frame2	flow vectors	(0,0) initial
4	Estimate movement	flow vectors	dx=0.5, dy=0.3	(0,0) initial
5	Update position	dx=0.5, dy=0.3	position updated	(0.5,0.3)
6	Repeat with new frames	Next frames	New flow vectors	(0.5,0.3)

💡 Process repeats continuously for real-time indoor positioning.

Variable Tracker

Variable	Start	After Step 4	After Step 5	After Step 6
frame1	None	Captured image	Captured image	Updated image
frame2	None	Captured image	Captured image	Updated image
flow	None	Calculated vectors	Calculated vectors	New vectors
dx	0	0.5	0.5	Updated
dy	0	0.3	0.3	Updated
position.x	0	0	0.5	Updated
position.y	0	0	0.3	Updated

Key Moments - 3 Insights

Why do we need two frames to calculate optical flow?

Optical flow measures movement by comparing changes between two consecutive frames, as shown in execution_table steps 1-3.

How does the drone update its position from optical flow?

The flow vectors estimate movement (dx, dy), which are added to the current position in step 5 to update location.

What happens if the frames are identical?

If frames are identical, optical flow vectors will be zero, so no position change occurs, as no movement is detected.

Visual Quiz - 3 Questions

Look at the execution_table, what is the position after step 5?

A (1.0, 0.6)

B (0, 0)

C (0.5, 0.3)

D (0.3, 0.5)

💡 Hint

Check the 'Position (x,y)' column at step 5 in the execution_table.

At which step are the optical flow vectors calculated?

A Step 2

B Step 3

C Step 4

D Step 5

💡 Hint

Look at the 'Action' column in execution_table for when flow vectors are produced.

If the drone does not move, what would dx and dy be at step 4?

A dx=0, dy=0

B dx=0.5, dy=0.3

C dx=1, dy=1

D dx=-0.5, dy=-0.3

💡 Hint

Refer to key_moments about identical frames causing zero movement.

Concept Snapshot

Optical flow uses two camera frames to detect movement.
Calculate flow vectors between frames.
Estimate dx, dy movement from flow.
Update drone position by adding dx, dy.
Repeat continuously for indoor positioning.

Full Transcript

This visual execution shows how a drone uses optical flow for indoor positioning. First, the drone captures two consecutive camera frames. Then, it calculates optical flow vectors that represent pixel movement between these frames. Using these vectors, the drone estimates its movement in x and y directions (dx, dy). The drone updates its position by adding these movements to its current coordinates. This process repeats continuously to track the drone's position indoors without GPS. The execution table traces each step, showing how variables like frames, flow, and position change. Key moments clarify why two frames are needed and how position updates happen. The quiz tests understanding of position updates and flow calculation steps.

Practice

1. What is the main purpose of using optical flow in indoor drone positioning?

easy

A. To track the drone's movement by analyzing camera images

B. To connect the drone to GPS satellites

C. To control the drone's battery usage

D. To measure the drone's altitude using sound waves

Solution

1. Step 1: Understand optical flow concept

   Optical flow uses camera images to detect movement by comparing changes between frames.

2. Step 2: Identify its use in indoor positioning

   Since GPS doesn't work well indoors, optical flow helps track position by visual movement detection.

3. Final Answer:

   To track the drone's movement by analyzing camera images -> Option A

4. Quick Check:

   Optical flow = movement tracking indoors [OK]

Hint: Optical flow tracks movement visually, not with GPS indoors [OK]

Common Mistakes:

• Confusing optical flow with GPS tracking
• Thinking optical flow measures altitude
• Assuming optical flow controls battery

2. Which of the following is the correct Python syntax to calculate optical flow using OpenCV's calcOpticalFlowPyrLK function?

easy

A. flow = cv2.calcOpticalFlowPyrLK(prev_img, next_img, prev_pts, None)

B. flow = cv2.calcOpticalFlowPyrLK(prev_pts, prev_img, next_img, None)

C. flow = cv2.calcOpticalFlowPyrLK(next_img, prev_img, None, prev_pts)

D. flow = cv2.calcOpticalFlowPyrLK(None, prev_img, prev_pts, next_img)

Solution

1. Step 1: Recall function parameter order

   The function calcOpticalFlowPyrLK expects parameters in order: previous image, next image, previous points, and next points (usually None to compute).

2. Step 2: Match parameters to options

   flow = cv2.calcOpticalFlowPyrLK(prev_img, next_img, prev_pts, None) matches this order correctly; others mix parameter positions incorrectly.

3. Final Answer:

   flow = cv2.calcOpticalFlowPyrLK(prev_img, next_img, prev_pts, None) -> Option A

4. Quick Check:

   Correct parameter order = flow = cv2.calcOpticalFlowPyrLK(prev_img, next_img, prev_pts, None) [OK]

Hint: Remember: prev_img, next_img, prev_pts, None order [OK]

Common Mistakes:

• Swapping image and points parameters
• Passing None in wrong position
• Confusing previous and next images

3. Given the following Python snippet for updating drone position using optical flow displacement:

dx, dy = 5, -3
position = [10, 10]
position[0] += dx
position[1] += dy
print(position)

What will be the output?

medium

A. [15, -3]

B. [5, 13]

C. [10, 10]

D. [15, 7]

Solution

1. Step 1: Understand position update

   Initial position is [10, 10]. Adding dx=5 to x gives 15. Adding dy=-3 to y gives 7.

2. Step 2: Calculate final position

   Updated position is [15, 7].

3. Final Answer:

   [15, 7] -> Option D

4. Quick Check:

   10+5=15 and 10-3=7 [OK]

Hint: Add dx to x and dy to y for new position [OK]

Common Mistakes:

• Mixing x and y updates
• Forgetting to add dy as negative
• Printing initial position instead of updated

4. Identify the error in this Python code snippet for calculating optical flow displacement:

prev_pts = np.array([[100, 150]], dtype=np.float32)
next_pts = np.array([[105, 145]], dtype=np.float32)
dx = next_pts[0][0] - prev_pts[0]
dy = next_pts[0][1] - prev_pts[1]

medium

A. Wrong data type for numpy arrays

B. Missing import statement for numpy

C. Incorrect indexing of prev_pts causing IndexError

D. Using subtraction instead of addition

Solution

1. Step 1: Check indexing of prev_pts

   prev_pts is a 2D array; prev_pts[0] is [100, 150], but prev_pts[1] does not exist (index error).

2. Step 2: Identify cause of error

   Accessing prev_pts[1] causes an IndexError; correct indexing should be prev_pts[0][1].

3. Final Answer:

   Incorrect indexing of prev_pts causing IndexError -> Option C

4. Quick Check:

   Indexing 2D arrays needs two indices [OK]

Hint: Use two indices for 2D arrays like prev_pts[0][1] [OK]

Common Mistakes:

• Using single index on 2D numpy arrays
• Confusing dx and dy calculations
• Ignoring numpy import errors

5. You want to improve indoor drone positioning by combining optical flow displacement with altitude data from a barometer. Which approach best integrates these two data sources in Python?

hard

A. Store altitude as a separate variable and never update position

B. Create a dictionary with keys 'x', 'y', 'altitude' updated each frame

C. Use optical flow data only and ignore altitude for simplicity

D. Replace optical flow with barometer readings entirely

Solution

1. Step 1: Understand data integration needs

   Combining horizontal movement (optical flow) and vertical position (altitude) requires a unified data structure.

2. Step 2: Choose appropriate data structure

   A dictionary with keys 'x', 'y', and 'altitude' allows updating all position components together each frame.

3. Final Answer:

   Create a dictionary with keys 'x', 'y', 'altitude' updated each frame -> Option B

4. Quick Check:

   Combine data in one structure for full 3D position [OK]

Hint: Use one dictionary to track x, y, and altitude together [OK]

Common Mistakes:

• Ignoring altitude data
• Keeping altitude separate without integration
• Replacing optical flow instead of combining