Translation with Hugging Face in NLP - Model Pipeline Trace

Model Pipeline - Translation with Hugging Face

This pipeline translates text from one language to another using a Hugging Face transformer model. It takes input sentences, processes them, and outputs translated sentences.

Data Flow - 4 Stages

1Input Text

5 sentences x 1 column→Raw text input in source language→5 sentences x 1 column

["Hello, how are you?", "Good morning", "I love machine learning", "What is your name?", "See you later"]

↓

2Tokenization

5 sentences x 1 column→Convert sentences to token IDs using tokenizer→5 sequences x 20 tokens (max length)

[[101, 7592, 1010, 2129, 2024, 2017, 102], [...], ...]

↓

3Model Translation

5 sequences x 20 tokens→Transformer model generates translated token IDs→5 sequences x 22 tokens

[[101, 8667, 117, 1139, 102], [...], ...]

↓

4Detokenization

5 sequences x 22 tokens→Convert token IDs back to translated text→5 sentences x 1 column

["Bonjour, comment ça va ?", "Bonjour", "J'aime l'apprentissage automatique", "Comment tu t'appelles ?", "À plus tard"]

Training Trace - Epoch by Epoch

Loss
5.0 |****
4.0 |*** 
3.0 |**  
2.0 |*   
1.0 |*   
0.0 +----
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	4.5	0.25	Initial training with high loss and low accuracy
2	3.2	0.45	Loss decreased, accuracy improved
3	2.1	0.65	Model learning better translations
4	1.3	0.80	Good convergence, translations improving
5	0.8	0.90	Low loss and high accuracy, training stable

Prediction Trace - 4 Layers

Layer 1: Input Text

Layer 2: Tokenization

Layer 3: Model Translation

Layer 4: Detokenization

Model Quiz - 3 Questions

What happens during the tokenization stage?

A Text is converted into token IDs

B Model generates translated text

C Token IDs are converted back to text

D Loss is calculated

Key Insight

This visualization shows how a transformer model translates text by converting sentences into tokens, processing them, and converting back to text. Training improves the model by reducing loss and increasing accuracy, resulting in better translations.