Image understanding and description in Prompt Engineering / GenAI - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is image understanding in AI?

Image understanding is when a computer looks at a picture and figures out what is in it, like objects, people, or actions.

beginner

What does image description mean in AI?

Image description means creating a short sentence or phrase that explains what is happening in a picture.

intermediate

Name a common AI model used for image description.

A common model is the 'Encoder-Decoder' model, where the encoder looks at the image and the decoder writes a description.

intermediate

Why do AI models use both CNN and RNN for image description?

CNNs help the AI understand the image by finding patterns, and RNNs help create sentences by remembering words in order.

intermediate

What is a common metric to check how good an image description model is?

BLEU score is often used; it compares the AI's description to human-written ones to see how similar they are.

What does a CNN do in image understanding?

A Finds patterns and features in images

B Generates sentences describing images

C Stores previous words in a sentence

D Translates text from one language to another

CNNs are designed to find patterns like edges and shapes in images.

Which model part creates the sentence in image description?

A Convolutional layer

B Encoder

C Decoder

D Pooling layer

The decoder takes image features and generates the description sentence.

What is the main goal of image description AI?

A To classify images into categories

B To generate a text summary of the image content

C To detect faces in images

D To improve image resolution

Image description AI creates text that explains what is in the image.

Which metric compares AI-generated captions to human captions?

A Accuracy

B Recall

C Mean Squared Error

D BLEU score

BLEU score measures how close the AI's captions are to human ones.

Why is RNN useful in image description models?

A It remembers the order of words to form sentences

B It processes images pixel by pixel

C It detects objects in images

D It compresses image data

RNNs help generate sentences by keeping track of word order.

Explain how an AI model can understand an image and describe it in words.

Think about how the model first looks at the image and then writes a sentence.

What are common ways to check if an image description AI is working well?

Consider how we measure similarity between AI and human descriptions.