Table extraction from images in Computer Vision - Interactive Code Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to load an image using OpenCV for table extraction.

Computer Vision

import cv2
image = cv2.[1]('table_image.png')

Drag options to blanks, or click blank then click option'

Aimshow

Bimread

Cimwrite

Dresize

Attempts:

3 left

💡 Hint

Common Mistakes

Using cv2.imshow() instead of cv2.imread() to load the image.

Trying to use cv2.imwrite() which saves an image, not loads it.

The function cv2.imread() loads an image from a file into memory, which is the first step in processing an image for table extraction.

2fill in blank

medium

Complete the code to convert the loaded image to grayscale for easier table detection.

Computer Vision

gray_image = cv2.cvtColor(image, [1])

Drag options to blanks, or click blank then click option'

Acv2.COLOR_BGR2GRAY

Bcv2.COLOR_BGR2RGB

Ccv2.COLOR_GRAY2BGR

Dcv2.COLOR_RGB2BGR

Attempts:

3 left

💡 Hint

Common Mistakes

Using cv2.COLOR_BGR2RGB which changes color space but not to grayscale.

Using cv2.COLOR_GRAY2BGR which converts grayscale to color, opposite of what is needed.

Converting the image to grayscale using cv2.COLOR_BGR2GRAY simplifies the image and helps in detecting table structures.

3fill in blank

hard

Fix the error in the code to detect edges using Canny edge detection for table boundary detection.

Computer Vision

edges = cv2.Canny(gray_image, [1], 150)

Drag options to blanks, or click blank then click option'

A50

B200

C300

D10

Attempts:

3 left

💡 Hint

Common Mistakes

Setting the first threshold higher than the second, which causes poor edge detection.

Using very low values that cause too many edges.

The first threshold in Canny edge detection is usually lower than the second. Using 50 and 150 is a common pair for detecting edges effectively.

4fill in blank

hard

Fill both blanks to apply dilation and find contours for table structure extraction.

Computer Vision

kernel = cv2.getStructuringElement(cv2.MORPH_RECT, ([1], [2]))
dilated = cv2.dilate(edges, kernel, iterations=1)

Drag options to blanks, or click blank then click option'

A15

B5

C10

D20

Attempts:

3 left

💡 Hint

Common Mistakes

Using very large kernel sizes that over-dilate and merge unrelated edges.

Using kernel sizes that are too small to connect table lines.

A rectangular kernel of size (5, 10) is commonly used to dilate edges vertically and horizontally to connect table lines.

5fill in blank

hard

Fill all three blanks to extract bounding boxes of detected table cells from contours.

Computer Vision

contours, _ = cv2.findContours(dilated, cv2.RETR_EXTERNAL, [1])
bounding_boxes = [cv2.boundingRect(c) for c in contours if cv2.contourArea(c) > [2]]
sorted_boxes = sorted(bounding_boxes, key=lambda b: (b[[3]], b[0]))

Drag options to blanks, or click blank then click option'

Acv2.CHAIN_APPROX_SIMPLE

B1000

C1

Dcv2.CHAIN_APPROX_NONE

Attempts:

3 left

💡 Hint

Common Mistakes

Using CHAIN_APPROX_NONE which is slower and unnecessary here.

Not filtering small contours causing noise in bounding boxes.

Sorting by x before y which disrupts reading order.

cv2.CHAIN_APPROX_SIMPLE compresses contour points, 1000 filters out small contours, and sorting by b[1] (y-coordinate) then b[0] (x-coordinate) orders boxes top to bottom, left to right.

Practice

1. What is the main goal of table extraction from images in computer vision?

easy

A. Create new tables from scratch

B. Convert images of tables into editable and structured data

C. Enhance the colors of table images

D. Compress table images to save space

Solution

1. Step 1: Understand the purpose of table extraction

   Table extraction aims to transform images containing tables into a format that can be edited and analyzed, such as spreadsheets.

2. Step 2: Compare options to the goal

   Options A, B, and D do not relate to converting image content into editable data, but C does.

3. Final Answer:

   Convert images of tables into editable and structured data -> Option B

4. Quick Check:

   Table extraction = Editable data from images [OK]

Hint: Focus on converting images to editable data [OK]

Common Mistakes:

• Confusing image enhancement with data extraction
• Thinking table extraction creates tables from nothing
• Assuming compression is the goal

2. Which of the following is the correct step to start table extraction from an image using Python libraries?

easy

A. Use OCR to read text directly without detecting table structure

B. Resize the image to a smaller size and save it

C. Detect table boundaries and cells before applying OCR

D. Apply color filters to change table colors

Solution

1. Step 1: Identify the correct workflow for table extraction

   First, detecting the table structure (boundaries and cells) is essential to know where text is located.

2. Step 2: Understand the role of OCR

   OCR reads text inside detected cells after structure detection, so applying OCR first is incorrect.

3. Final Answer:

   Detect table boundaries and cells before applying OCR -> Option C

4. Quick Check:

   Detect structure first, then OCR [OK]

Hint: Detect table layout before reading text [OK]

Common Mistakes:

• Applying OCR before detecting table cells
• Focusing on image color changes instead of structure
• Skipping structure detection

3. Given the following Python snippet using OpenCV and pytesseract for table extraction, what will be the output type of cells_text?

import cv2
import pytesseract

image = cv2.imread('table.png', 0)
_, thresh = cv2.threshold(image, 128, 255, cv2.THRESH_BINARY_INV)
contours, _ = cv2.findContours(thresh, cv2.RETR_EXTERNAL, cv2.CHAIN_APPROX_SIMPLE)
cells_text = []
for cnt in contours:
    x, y, w, h = cv2.boundingRect(cnt)
    cell_img = image[y:y+h, x:x+w]
    text = pytesseract.image_to_string(cell_img, config='--psm 6')
    cells_text.append(text.strip())
print(type(cells_text))

medium

A.

B.

C.

D.

Solution

1. Step 1: Analyze the code snippet

   The variable cells_text is initialized as an empty list and text from each detected cell is appended to it.

2. Step 2: Determine the type of cells_text

   Since cells_text collects multiple strings in a list, its type remains list.

3. Final Answer:

   <class 'list'> -> Option A

4. Quick Check:

   Appending text to list = list type [OK]

Hint: Check variable initialization and append usage [OK]

Common Mistakes:

• Confusing the output of print(type())
• Assuming OCR returns a dict or int
• Ignoring the list append operation

4. You run a table extraction pipeline but notice that some table cells are merged incorrectly, causing wrong text grouping. What is the most likely cause?

medium

A. Incorrect contour detection merging nearby cells

B. OCR engine misreading characters inside cells

C. Image color enhancement applied before extraction

D. Saving the output file in wrong format

Solution

1. Step 1: Identify the problem source

   Merged cells usually happen when contour detection groups multiple cells as one shape.

2. Step 2: Rule out other options

   OCR misreading affects text accuracy but not cell merging. Color enhancement and file format do not cause merging issues.

3. Final Answer:

   Incorrect contour detection merging nearby cells -> Option A

4. Quick Check:

   Cell merging = contour detection error [OK]

Hint: Check contour detection for cell boundaries [OK]

Common Mistakes:

• Blaming OCR for cell merging
• Ignoring image preprocessing effects
• Assuming file format affects cell detection

5. You want to extract tables from scanned invoices with varying layouts. Which approach best improves accuracy of table extraction?

hard

A. Apply fixed thresholding and contour detection without training

B. Manually crop each table region before extraction

C. Use only OCR on the full invoice image without detecting tables

D. Train a deep learning model to detect table structures and cells before OCR

Solution

1. Step 1: Understand the challenge of varying layouts

   Invoices have different table styles, so fixed rules may fail to detect tables accurately.

2. Step 2: Evaluate approaches for adaptability

   Training a deep learning model can learn diverse table structures and generalize better than fixed methods or manual cropping.

3. Final Answer:

   Train a deep learning model to detect table structures and cells before OCR -> Option D

4. Quick Check:

   Varying layouts = train model for detection [OK]

Hint: Use learning models for diverse table layouts [OK]

Common Mistakes:

• Relying on fixed thresholding for all layouts
• Skipping table detection and using only OCR
• Manual cropping is not scalable