Text detection in images in Computer Vision - Model Metrics & Evaluation

Metrics & Evaluation - Text detection in images

Which metric matters for text detection in images and WHY

For text detection in images, the main goal is to find all text areas correctly without too many false alarms. So, Recall is very important because it tells us how many real text parts the model found out of all the text parts that exist. Missing text means bad results.

Precision is also important because it shows how many detected text parts are actually text. Too many false detections confuse users.

The F1 score balances precision and recall, giving a single number to check overall quality.

Sometimes, Intersection over Union (IoU) is used to measure how well the detected boxes match the real text boxes.

Confusion matrix for text detection

Detected Text   | Actual Text   | Count
-------------------------------------
True Positive (TP)  | Text detected correctly       | 80
False Positive (FP) | Non-text detected as text     | 15
False Negative (FN) | Text missed by detector       | 20
True Negative (TN)  | Non-text correctly ignored    | Not usually counted in detection tasks

Total text regions = TP + FN = 100
Total detected text regions = TP + FP = 95

Precision = TP / (TP + FP) = 80 / (80 + 15) = 0.842

Recall = TP / (TP + FN) = 80 / (80 + 20) = 0.8

F1 score = 2 * (Precision * Recall) / (Precision + Recall) ≈ 0.82

Precision vs Recall tradeoff with examples

If the model tries to find every text area, it may detect many false text parts, increasing recall but lowering precision.

If the model is very strict, it finds fewer false texts but may miss some real text, increasing precision but lowering recall.

Example: In reading signs for a navigation app, missing text (low recall) is worse because the app may not give directions. So recall is more important.

In a document scanner, false text detections (low precision) may cause extra work cleaning results, so precision matters more.

What good vs bad metric values look like for text detection

Good: Precision and recall both above 0.85 means the model finds most text and makes few mistakes.

Bad: Precision below 0.5 means many false detections, confusing users.

Recall below 0.5 means the model misses too much text, making it unreliable.

F1 score below 0.6 usually means the model needs improvement.

Common pitfalls in metrics for text detection

• Ignoring IoU: Counting a detected box as correct without checking overlap can inflate metrics.
• Accuracy paradox: Since most image areas are non-text, accuracy can be high even if detection is poor.
• Data leakage: Testing on images very similar to training can give unrealistically high scores.
• Overfitting: Model performs well on training images but poorly on new images, misleading metrics.

Self-check question

Your text detection model has 98% accuracy but only 12% recall on text regions. Is it good for production? Why or why not?

Answer: No, it is not good. The high accuracy is misleading because most image pixels are non-text, so the model guesses non-text well. But 12% recall means it misses 88% of text, which is unacceptable for text detection.

Key Result

Recall and precision are key metrics; high recall ensures most text is found, high precision avoids false detections.

Practice

1. What is the main goal of text detection in images?

easy

A. To find where text appears in an image

B. To translate text from one language to another

C. To change the font style of text in images

D. To remove text from images

Solution

1. Step 1: Understand the purpose of text detection

   Text detection means locating the areas in an image that contain text.

2. Step 2: Differentiate from other text-related tasks

   Tasks like translation or font change happen after detecting text, not during detection.

3. Final Answer:

   To find where text appears in an image -> Option A

4. Quick Check:

   Text detection = locating text [OK]

Hint: Text detection means locating text areas in images [OK]

Common Mistakes:

• Confusing detection with translation
• Thinking detection changes text style
• Assuming detection removes text

2. Which Python library is commonly used for text detection and recognition in images?

easy

A. pytesseract

B. matplotlib

C. numpy

D. scikit-learn

Solution

1. Step 1: Identify libraries related to text detection

   pytesseract is a Python wrapper for Tesseract OCR, used for detecting and reading text.

2. Step 2: Exclude unrelated libraries

   matplotlib is for plotting, numpy for arrays, scikit-learn for general ML, not specific to text detection.

3. Final Answer:

   pytesseract -> Option A

4. Quick Check:

   pytesseract = text detection tool [OK]

Hint: pytesseract is the go-to for OCR in Python [OK]

Common Mistakes:

• Choosing matplotlib for text detection
• Confusing numpy with OCR tools
• Selecting scikit-learn for image text reading

3. What will the following Python code output if image_path contains a clear text image?

import pytesseract
from PIL import Image
img = Image.open(image_path)
text = pytesseract.image_to_string(img)
print(text.strip())

medium

A. An error because pytesseract cannot open images

B. The text content found in the image

C. The image object details printed

D. An empty string always

Solution

1. Step 1: Understand the code flow

   The code opens an image, uses pytesseract to extract text, then prints the text without extra spaces.

2. Step 2: Predict output for a clear text image

   Since the image has clear text, pytesseract returns that text as a string, which is printed.

3. Final Answer:

   The text content found in the image -> Option B

4. Quick Check:

   pytesseract extracts text string [OK]

Hint: pytesseract.image_to_string returns detected text [OK]

Common Mistakes:

• Expecting an error from pytesseract
• Thinking it prints image object info
• Assuming output is always empty

4. Identify the error in this code snippet for detecting text in an image:

import pytesseract
img = 'image.jpg'
text = pytesseract.image_to_string(img)
print(text)

medium

A. Using print instead of return

B. Missing import for PIL Image

C. No error, code runs fine

D. Passing a string filename instead of an image object

Solution

1. Step 1: Check input type for pytesseract.image_to_string

   This function accepts both a PIL Image object and a filename string as input.

2. Step 2: Verify the code

   The code passes a string filename ('image.jpg'), which is valid, so no error occurs and it will extract text if the file exists.

3. Final Answer:

   No error, code runs fine -> Option C

4. Quick Check:

   image_to_string accepts string path [OK]

Hint: pytesseract.image_to_string accepts filename paths directly [OK]

Common Mistakes:

• Thinking print should be return
• Assuming PIL Image import is required
• Believing only image objects are accepted

5. You want to detect text in a photo with multiple languages. Which approach is best to improve accuracy?

hard

A. Use only English language setting

B. Convert image to grayscale only

C. Resize image to a smaller size

D. Specify all target languages in pytesseract's config parameter

Solution

1. Step 1: Understand multi-language text detection

   pytesseract supports multiple languages by specifying them in the config parameter.

2. Step 2: Evaluate other options

   Grayscale conversion helps but doesn't handle languages; resizing smaller reduces detail; English-only misses other languages.

3. Final Answer:

   Specify all target languages in pytesseract's config parameter -> Option D

4. Quick Check:

   Multi-language config improves detection [OK]

Hint: Use config to set multiple languages in pytesseract [OK]

Common Mistakes:

• Ignoring language settings
• Reducing image size too much
• Assuming grayscale alone solves language issues