T5 for text-to-text tasks in NLP - Cheat Sheet & Quick Revision

Recall & Review

beginner

What does T5 stand for in the context of NLP?

T5 stands for "Text-To-Text Transfer Transformer." It is a model that treats every NLP problem as a text-to-text task.

beginner

How does T5 handle different NLP tasks like translation, summarization, and question answering?

T5 converts all tasks into a text input and text output format. For example, it adds a task-specific prefix like "translate English to German:" before the input text, then generates the output text accordingly.

intermediate

What is the main architecture behind T5?

T5 uses the Transformer architecture with an encoder-decoder setup. The encoder reads the input text, and the decoder generates the output text step-by-step.

intermediate

Why is treating all NLP tasks as text-to-text beneficial?

It simplifies the model design because one model can handle many tasks without changing its structure. It also allows easy transfer learning and consistent training.

intermediate

What metric is commonly used to evaluate T5 on summarization tasks?

ROUGE (Recall-Oriented Understudy for Gisting Evaluation) scores are commonly used to measure how well T5 summarizes text by comparing overlap with reference summaries.

What type of model architecture does T5 use?

A Encoder-decoder Transformer

B Recurrent Neural Network

C Convolutional Neural Network

D Feedforward Neural Network

T5 uses an encoder-decoder Transformer architecture to process input and generate output text.

How does T5 treat different NLP tasks?

A As numeric vector regression tasks

B As text-to-text problems with task-specific prefixes

C As separate models for each task

D As image classification problems

T5 converts all tasks into text-to-text format by adding prefixes that specify the task.

Which of these is NOT a typical task for T5?

A Text summarization

B Machine translation

C Image segmentation

D Question answering

T5 is designed for text tasks, so image segmentation is outside its scope.

What does the prefix in T5 input text do?

A Specifies the task to perform

B Encrypts the input

C Adds noise to the input

D Changes the model architecture

The prefix tells T5 what task to perform on the input text.

Which evaluation metric is commonly used for T5 summarization outputs?

A Mean Squared Error

B BLEU

C Accuracy

D ROUGE

ROUGE measures overlap between generated and reference summaries, commonly used for summarization.

Explain how T5 converts different NLP tasks into a unified text-to-text format.

Think about how T5 tells the model what to do using text.

Describe the main components of the T5 model architecture and their roles.

Focus on how input is read and output is created.