OpenAI fine-tuning API in Prompt Engineering / GenAI - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Understanding fine-tuning data format

Which of the following best describes the required format for training data when using the OpenAI fine-tuning API?

A A plain text file with prompts and completions separated by a blank line.

B A CSV file with columns 'input' and 'output' containing raw text data.

C A JSONL file where each line is a JSON object with keys 'prompt' and 'completion', both as strings.

D An XML file with nested tags for prompts and completions.

💡 Hint

Think about the file format that supports line-by-line JSON objects.

The OpenAI fine-tuning API requires training data in JSONL format, where each line is a JSON object with 'prompt' and 'completion' keys as strings.

❓ Model Choice

intermediate

Choosing the base model for fine-tuning

You want to fine-tune a model for a task requiring understanding of complex instructions and generating detailed text. Which base model should you choose from OpenAI's options?

A curie

B ada

C babbage

D davinci

💡 Hint

Consider the model with the highest capability for complex tasks.

The 'davinci' model is the most capable among OpenAI's base models, suitable for complex instructions and detailed text generation.

❓ Hyperparameter

advanced

Effect of 'n_epochs' in fine-tuning

What is the effect of increasing the 'n_epochs' parameter during OpenAI fine-tuning?

A The model trains for more passes over the training data, potentially improving fit but risking overfitting.

B The model uses more layers internally to increase capacity.

C The learning rate is automatically increased to speed up training.

D The batch size is reduced to improve gradient estimation.

💡 Hint

Think about what 'epochs' means in machine learning training.

'n_epochs' controls how many times the model sees the entire training dataset. More epochs can improve learning but may cause overfitting.

❓ Metrics

advanced

Evaluating fine-tuned model performance

After fine-tuning a model with OpenAI's API, which metric is most appropriate to evaluate its performance on a text generation task?

A Perplexity on a held-out validation set

B Accuracy of classification labels

C Mean squared error between input and output

D Confusion matrix of predicted classes

💡 Hint

Consider metrics used for language models generating text.

Perplexity measures how well a language model predicts a sample and is commonly used for text generation evaluation.

🔧 Debug

expert

Diagnosing fine-tuning failure due to data formatting

You submitted a JSONL file for fine-tuning but received an error: 'Invalid JSONL format'. Which of the following issues would cause this error?

A The file uses UTF-8 encoding

B One line in the file is missing a closing brace '}'

C Each line contains a valid JSON object with 'prompt' and 'completion'

D The file has Unix-style line endings '\n'

💡 Hint

Invalid JSON means a syntax problem in the JSON structure.

Missing a closing brace causes invalid JSON syntax, leading to JSONL format errors during fine-tuning.

Practice

1. What is the main purpose of using the OpenAI fine-tuning API?

easy

A. To customize a base AI model with your own training data

B. To create a new AI model from scratch without any data

C. To delete existing AI models permanently

D. To convert AI models into images

Solution

1. Step 1: Understand fine-tuning concept

   Fine-tuning means adjusting a pre-trained AI model using your own data to make it better for your specific task.

2. Step 2: Identify the API's role

   The OpenAI fine-tuning API helps you upload your data and create a customized version of an existing model.

3. Final Answer:

   To customize a base AI model with your own training data -> Option A

4. Quick Check:

   Fine-tuning = Customize model with your data [OK]

Hint: Fine-tuning means customizing existing models with your data [OK]

Common Mistakes:

• Thinking fine-tuning creates models from scratch
• Confusing fine-tuning with deleting models
• Assuming fine-tuning changes model type (like image conversion)

2. Which of the following is the correct way to start a fine-tuning job using the OpenAI API in Python?

easy

A. openai.createFineTune(training='file-abc123')

B. openai.FineTune.create(training_file='file-abc123')

C. openai.fine_tune.start(file='file-abc123')

D. openai.finetune.upload(file='file-abc123')

Solution

1. Step 1: Recall OpenAI fine-tuning syntax

   The official OpenAI Python client uses openai.FineTune.create() to start fine-tuning jobs.

2. Step 2: Check parameter names

   The parameter for training data file is training_file, matching openai.FineTune.create(training_file='file-abc123') exactly.

3. Final Answer:

   openai.FineTune.create(training_file='file-abc123') -> Option B

4. Quick Check:

   Correct method and parameter = openai.FineTune.create(training_file='file-abc123') [OK]

Hint: Use openai.FineTune.create with training_file parameter [OK]

Common Mistakes:

• Using incorrect method names like fine_tune.start
• Wrong parameter names like 'file' instead of 'training_file'
• Mixing upload and create methods

3. Given this Python code snippet using OpenAI API, what will be the output?

response = openai.FineTune.create(training_file='file-xyz789')
print(response['status'])

medium

A. 'pending'

B. 'completed'

C. 'error'

D. 'unknown'

Solution

1. Step 1: Understand fine-tuning job lifecycle

   When a fine-tuning job is created, its initial status is usually 'pending' as it waits to start processing.

2. Step 2: Analyze code output

   The code prints the 'status' field from the response, which will be 'pending' immediately after creation.

3. Final Answer:

   'pending' -> Option A

4. Quick Check:

   New fine-tune job status = 'pending' [OK]

Hint: New fine-tune jobs start with status 'pending' [OK]

Common Mistakes:

• Assuming status is 'completed' right after creation
• Expecting 'error' without any failure
• Confusing status with model name

4. You wrote this code to fine-tune a model but get an error:

openai.FineTune.create(training_file='file-123')

What is the most likely cause of the error?

medium

A. The API key is missing from the code

B. The method name should be 'fine_tune.create' instead

C. You must specify the model parameter in create()

D. The training file ID 'file-123' is invalid or not uploaded

Solution

1. Step 1: Check common fine-tuning errors

   Errors often happen if the training file ID is wrong or the file was not uploaded properly.

2. Step 2: Validate method and parameters

   The method name and parameters are correct; model parameter is optional for fine-tuning base models.

3. Step 3: Consider API key

   Missing API key causes authentication errors, not file ID errors.

4. Final Answer:

   The training file ID 'file-123' is invalid or not uploaded -> Option D

5. Quick Check:

   Invalid file ID causes error [OK]

Hint: Check if training file ID is correct and uploaded [OK]

Common Mistakes:

• Using wrong method name with underscores
• Forgetting to upload training file before fine-tuning
• Assuming model parameter is always required

5. You want to fine-tune a model to improve chatbot responses for customer support. Which steps should you follow using the OpenAI fine-tuning API?

hard

A. Train a model locally without using OpenAI API

B. Directly call chat completions with the base model without uploading data

C. Upload a JSONL training file, create a fine-tune job with it, then use the new model for chat

D. Upload any text file and call openai.ChatCompletion.create without fine-tuning

Solution

1. Step 1: Prepare training data

   Fine-tuning requires a JSONL file with prompt-completion pairs relevant to customer support.

2. Step 2: Use OpenAI API to create fine-tune job

   Upload the file, then call openai.FineTune.create() with the training file ID.

3. Step 3: Use the fine-tuned model

   After training completes, use the new model for chat completions to get improved responses.

4. Final Answer:

   Upload a JSONL training file, create a fine-tune job with it, then use the new model for chat -> Option C

5. Quick Check:

   Fine-tune with data, then use new model [OK]

Hint: Upload data, fine-tune, then use new model for better chat [OK]

Common Mistakes:

• Skipping data upload and fine-tuning steps
• Trying to train models locally without OpenAI API
• Using base model without fine-tuning for custom tasks