Bidirectional LSTM in NLP - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a Bidirectional LSTM?

A Bidirectional LSTM is a type of neural network that reads data in two directions: forward and backward. This helps it understand context from both past and future in a sequence.

beginner

Why use Bidirectional LSTM instead of a regular LSTM?

Because it looks at the sequence from both directions, it can capture more context and improve understanding, especially in language tasks where future words help understand the current word.

intermediate

How does a Bidirectional LSTM process input sequences?

It has two LSTM layers: one processes the sequence from start to end, the other from end to start. Their outputs are combined to form a richer representation.

beginner

What are common applications of Bidirectional LSTMs?

They are used in tasks like speech recognition, language translation, and text classification where understanding context from both past and future words is important.

intermediate

How do you combine outputs from forward and backward LSTMs in a Bidirectional LSTM?

The outputs can be concatenated, added, or averaged to create a single output vector that contains information from both directions.

What does a Bidirectional LSTM do differently from a standard LSTM?

A Only processes data backward

B Uses convolutional layers instead of recurrent layers

C Processes data in both forward and backward directions

D Does not use gates

A Bidirectional LSTM processes sequences in both forward and backward directions to capture context from past and future.

Why is context from future words useful in language tasks?

A It helps understand the meaning of current words better

B It speeds up training

C It reduces the size of the model

D It prevents overfitting

Knowing future words helps the model understand the current word's meaning more accurately.

How are outputs from forward and backward LSTMs usually combined?

A Ignoring one direction

B Multiplying weights only

C Using only the forward output

D Concatenation, addition, or averaging

Outputs from both directions are combined by concatenation, addition, or averaging to form a richer representation.

Which of these is NOT a typical use case for Bidirectional LSTMs?

A Image classification

B Speech recognition

C Language translation

D Text classification

Bidirectional LSTMs are mainly used for sequence data like text or speech, not for image classification.

What type of neural network is an LSTM?

A Convolutional Neural Network

B Recurrent Neural Network

C Feedforward Neural Network

D Generative Adversarial Network

LSTM is a type of Recurrent Neural Network designed to handle sequences and remember long-term dependencies.

Explain how a Bidirectional LSTM processes a sentence and why this is helpful.

Think about reading a sentence from left to right and right to left.

Describe a real-life example where using a Bidirectional LSTM would improve results compared to a regular LSTM.

Consider how knowing the next word in a sentence helps understand the current word.