Challenge - 5 Problems

🎖️

Code Generation Agent Master

Get all challenges correct to earn this badge!

Test your skills under time pressure!

🧠 conceptual

intermediate

2:00remaining

Key components of a code generation agent

Which of the following is NOT typically a core component of a code generation agent?

AA hardware driver to control physical devices

BA code synthesis engine to generate code snippets

CA feedback loop to refine generated code based on testing

DA natural language understanding module to interpret user requests

Attempts:

2 left

❓ model choice

intermediate

2:00remaining

Choosing a model architecture for code generation

Which model architecture is most suitable for generating code from natural language prompts?

AConvolutional Neural Network (CNN)

BTransformer-based language model

CRecurrent Neural Network (RNN) with attention

DK-Nearest Neighbors (KNN)

Attempts:

2 left

❓ hyperparameter

advanced

2:00remaining

Impact of temperature in code generation sampling

In a code generation agent using a language model, what is the effect of increasing the temperature parameter during sampling?

AThe model runs faster but with lower accuracy

BThe generated code becomes more deterministic and repetitive

CThe generated code becomes more random and diverse

DThe model ignores the input prompt

Attempts:

2 left

❓ metrics

advanced

2:00remaining

Evaluating code generation quality

Which metric best measures how well a code generation agent produces syntactically correct and functional code?

ACode execution success rate on test cases

BBLEU score comparing generated code to reference code

CPerplexity of the language model on training data

DTraining loss value after model convergence

Attempts:

2 left

🔧 debug

expert

3:00remaining

Identifying the cause of poor code generation output

A code generation agent frequently produces code with syntax errors despite training on clean data. Which is the MOST likely cause?

AThe optimizer learning rate is too low

BThe model uses a transformer architecture instead of an RNN

CThe temperature parameter is set to zero during sampling

DThe training dataset contains many incomplete or truncated code snippets

Attempts:

2 left