When to fine-tune vs prompt engineer in Prompt Engineering / GenAI - Quick Revision & Key Differences

Recall & Review

beginner

What is fine-tuning in the context of AI models?

Fine-tuning means adjusting a pre-trained AI model by training it a bit more on a specific task or data to make it better at that task.

beginner

What does prompt engineering involve?

Prompt engineering is about carefully writing or designing the input text (prompt) to guide an AI model to give the best possible answer without changing the model itself.

intermediate

When should you choose fine-tuning over prompt engineering?

Choose fine-tuning when you need the model to deeply understand a special task or data that is very different from what it learned before, or when prompt engineering can't get good enough results.

intermediate

What are the benefits of prompt engineering compared to fine-tuning?

Prompt engineering is faster, cheaper, and doesn't need extra training. It works well when you want quick changes or when the task is similar to what the model already knows.

intermediate

Give an example scenario where fine-tuning is preferred.

If you want an AI to understand medical reports in a special format that it hasn’t seen before, fine-tuning with medical data helps the model learn those details better than just changing the prompt.

Which method involves changing the input text to guide the AI model's output?

A Prompt engineering

B Fine-tuning

C Model architecture redesign

D Data cleaning

Prompt engineering means crafting the input prompt to get better answers without changing the model.

When is fine-tuning usually necessary?

A When you have no data for training

B When you want to quickly test different prompts

C When the task is very different from the model's original training

D When you want to reduce model size

Fine-tuning helps the model learn new, specific tasks that differ from its original training.

What is a key advantage of prompt engineering over fine-tuning?

A It changes the model weights

B It requires no extra training

C It needs large datasets

D It takes longer to implement

Prompt engineering works by changing inputs, so no extra training is needed.

Which approach is better for adapting a model to a very specialized domain with unique data?

A Fine-tuning

B Prompt engineering

C Using default prompts

D Random guessing

Fine-tuning adjusts the model to understand specialized data better.

If you want to quickly improve AI responses without retraining, what should you do?

A Collect more data

B Fine-tune the model

C Change the model architecture

D Use prompt engineering

Prompt engineering allows quick improvements by changing the input prompts.

Explain the main differences between fine-tuning and prompt engineering.

Think about what changes: the model or the input?

Describe a situation where fine-tuning is necessary and why prompt engineering would not be enough.

Consider tasks very different from the model's original training.

Practice

1. What is the main difference between fine-tuning a model and prompt engineering?

easy

A. Fine-tuning is faster than prompt engineering.

B. Fine-tuning changes the prompt format, while prompt engineering changes the model's weights.

C. Fine-tuning changes the model's knowledge, while prompt engineering changes how you ask questions.

D. Prompt engineering requires retraining the model.

Solution

1. Step 1: Understand fine-tuning

   Fine-tuning means adjusting the model's internal settings (weights) to better fit specific data or tasks.

2. Step 2: Understand prompt engineering

   Prompt engineering means changing the way you ask the model questions without changing the model itself.

3. Final Answer:

   Fine-tuning changes the model's knowledge, while prompt engineering changes how you ask questions. -> Option C

4. Quick Check:

   Fine-tune = model change, prompt engineer = question change [OK]

Hint: Fine-tune = model change; prompt engineer = question change [OK]

Common Mistakes:

• Confusing prompt engineering with model retraining
• Thinking fine-tuning only changes prompts
• Believing prompt engineering is slower than fine-tuning

2. Which of the following is a correct way to describe prompt engineering?

easy

A. Adjusting the input text to get better model responses.

B. Changing the model's training data to improve accuracy.

C. Rebuilding the model architecture from scratch.

D. Adding new layers to the model for customization.

Solution

1. Step 1: Identify prompt engineering meaning

   Prompt engineering means changing how you write or format the input text to guide the model's answers.

2. Step 2: Check options

   Only Adjusting the input text to get better model responses. describes adjusting input text, which matches prompt engineering.

3. Final Answer:

   Adjusting the input text to get better model responses. -> Option A

4. Quick Check:

   Prompt engineering = input text change [OK]

Hint: Prompt engineering means changing input text, not model structure [OK]

Common Mistakes:

• Mixing prompt engineering with model retraining
• Thinking prompt engineering changes model layers
• Confusing prompt engineering with data augmentation

3. Consider you want to improve a model's answers for a very specific medical dataset. Which approach will likely give better results?

medium

A. Only use prompt engineering to rewrite questions.

B. Use random prompts without changes.

C. Ignore the dataset and use the base model.

D. Fine-tune the model with the medical dataset.

Solution

1. Step 1: Understand the task

   Improving answers for a specific medical dataset requires the model to learn new, specialized knowledge.

2. Step 2: Choose the best method

   Fine-tuning the model with the medical data updates its knowledge, making it better for this task.

3. Final Answer:

   Fine-tune the model with the medical dataset. -> Option D

4. Quick Check:

   Specific data needs fine-tuning [OK]

Hint: Use fine-tuning for specialized data, not just prompt changes [OK]

Common Mistakes:

• Thinking prompt engineering alone fixes specialized knowledge
• Ignoring fine-tuning for domain-specific tasks
• Assuming base model works best without adaptation

4. You tried prompt engineering but the model still gives poor answers for your task. What is the most likely fix?

medium

A. Fine-tune the model with relevant data.

B. Change the model architecture.

C. Use shorter prompts.

D. Restart the model server.

Solution

1. Step 1: Analyze the problem

   If prompt engineering fails to improve answers, the model likely lacks task-specific knowledge.

2. Step 2: Choose the fix

   Fine-tuning with relevant data updates the model's knowledge to improve answers.

3. Final Answer:

   Fine-tune the model with relevant data. -> Option A

4. Quick Check:

   Poor answers + prompt fail = fine-tune needed [OK]

Hint: If prompts fail, fine-tune with data [OK]

Common Mistakes:

• Trying unrelated fixes like changing architecture
• Assuming shorter prompts fix knowledge gaps
• Restarting server won't improve model knowledge

5. You have a chatbot that answers general questions well but struggles with your company's product details. You want to improve it quickly without retraining. What should you do?

hard

A. Ignore product details and focus on general answers.

B. Use prompt engineering to add product info in the questions.

C. Replace the chatbot with a new model.

D. Fine-tune the entire model with product manuals.

Solution

1. Step 1: Identify constraints

   You want a quick improvement without retraining the model.

2. Step 2: Choose the best approach

   Prompt engineering lets you add product info in questions to guide the model without retraining.

3. Final Answer:

   Use prompt engineering to add product info in the questions. -> Option B

4. Quick Check:

   Quick fix without retrain = prompt engineering [OK]

Hint: Quick fix without retrain? Use prompt engineering [OK]

Common Mistakes:

• Thinking fine-tuning is always fastest
• Replacing model unnecessarily
• Ignoring product info causes poor answers