Multi-step reasoning in Prompt Engineering / GenAI - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Understanding Multi-step Reasoning in AI

Which of the following best describes multi-step reasoning in AI?

A AI performing a sequence of logical steps to reach a conclusion

B AI randomly guessing answers without following any process

C AI only memorizing data without any reasoning

D AI making a single decision based on one input without intermediate steps

💡 Hint

Think about how humans solve problems step-by-step.

Multi-step reasoning means the AI breaks down a problem into smaller steps and solves each step logically to reach a final answer.

❓ Predict Output

intermediate

Output of Multi-step Reasoning Code

What is the output of the following Python code simulating multi-step reasoning?

Prompt Engineering / GenAI

def multi_step_reasoning(x):
    step1 = x + 2
    step2 = step1 * 3
    step3 = step2 - 4
    return step3

result = multi_step_reasoning(5)
print(result)

A 19

B 23

C 21

D 17

💡 Hint

Calculate each step carefully: add 2, multiply by 3, then subtract 4.

Step 1: 5 + 2 = 7
Step 2: 7 * 3 = 21
Step 3: 21 - 4 = 17
Output is 17.

❓ Model Choice

advanced

Choosing a Model for Multi-step Reasoning Tasks

You want to build an AI that solves math word problems requiring multiple logical steps. Which model type is best suited?

A A transformer-based language model with attention mechanisms

B A convolutional neural network (CNN) for image recognition

C A simple linear regression model

D A k-nearest neighbors (KNN) classifier

💡 Hint

Think about models good at understanding sequences and context.

Transformer models with attention can handle sequences and context well, making them suitable for multi-step reasoning in language tasks.

❓ Hyperparameter

advanced

Hyperparameter Impact on Multi-step Reasoning Models

Which hyperparameter adjustment is most likely to improve a model's ability to perform multi-step reasoning?

A Reducing the number of layers in a deep neural network

B Increasing the model's attention heads in a transformer architecture

C Using a higher learning rate without any decay

D Decreasing the batch size during training

💡 Hint

More attention heads help the model focus on different parts of the input simultaneously.

Increasing attention heads allows the model to capture more complex relationships, aiding multi-step reasoning.

🔧 Debug

expert

Debugging Multi-step Reasoning Model Output

A multi-step reasoning model outputs the same answer for all inputs. What is the most likely cause?

A The model is overfitting the training data

B The loss function is not decreasing during training

C The model's output layer weights are not updating due to a frozen layer

D The input data is too diverse and complex

💡 Hint

Think about why the model might produce constant outputs regardless of input.

If the output layer weights are frozen, the model cannot learn to differentiate inputs, causing constant outputs.

Practice

1.

What does multi-step reasoning help an AI model do?

easy

A. Solve problems by breaking them into smaller steps

B. Answer questions with a single fact only

C. Ignore the order of information

D. Randomly guess answers without logic

Solution

1. Step 1: Understand the meaning of multi-step reasoning

   Multi-step reasoning means solving problems step-by-step, using several facts or actions in order.

2. Step 2: Match the meaning to the options

   Solve problems by breaking them into smaller steps says breaking problems into smaller steps, which matches the meaning exactly.

3. Final Answer:

   Solve problems by breaking them into smaller steps -> Option A

4. Quick Check:

   Multi-step reasoning = step-by-step solving [OK]

Hint: Think: Does the option show step-by-step solving? [OK]

Common Mistakes:

• Choosing options that ignore order
• Picking answers about guessing
• Confusing single fact with multiple steps

2.

Which of the following is the correct syntax to start a multi-step reasoning process in Python?

def reasoning_process():
    step1 = 'Gather data'
    step2 = 'Analyze data'
    # What comes next?

easy

A. print(step1, step2)

B. step3 = 'Make decision'

C. return step1 + step2

D. step1 = step2

Solution

1. Step 1: Understand the code context

   The function defines step1 and step2 as strings describing reasoning steps.

2. Step 2: Identify the next step in multi-step reasoning

   step3 = 'Make decision' adds a new step3, continuing the reasoning process logically.

3. Final Answer:

   step3 = 'Make decision' -> Option B

4. Quick Check:

   Next step in reasoning = add new step variable [OK]

Hint: Look for option that adds a new step logically [OK]

Common Mistakes:

• Choosing return too early
• Using print instead of continuing steps
• Overwriting previous steps

3.

What will be the output of this Python code that simulates multi-step reasoning?

def multi_step():
    step1 = 5
    step2 = step1 * 2
    step3 = step2 - 3
    return step3

print(multi_step())

medium

A. 5

B. 10

C. 7

D. None

Solution

1. Step 1: Calculate step2 from step1

   step1 = 5, so step2 = 5 * 2 = 10.

2. Step 2: Calculate step3 from step2

   step3 = 10 - 3 = 7, which is returned and printed.

3. Final Answer:

   7 -> Option C

4. Quick Check:

   5*2-3 = 7 [OK]

Hint: Calculate each step in order, then return last value [OK]

Common Mistakes:

• Returning step2 instead of step3
• Miscomputing multiplication or subtraction
• Confusing return with print output

4.

Find the error in this multi-step reasoning function and choose the fix:

def reasoning():
    step1 = 10
    step2 = step1 / 0
    step3 = step2 + 5
    return step3

medium

A. Add try-except block to handle error

B. Change division by zero to division by 1

C. Return step1 instead of step3

D. Remove step3 calculation

Solution

1. Step 1: Identify the error in the code

   Division by zero in step2 causes a runtime error (ZeroDivisionError).

2. Step 2: Choose the best fix to handle the error

   Adding a try-except block safely handles the error without stopping the program.

3. Final Answer:

   Add try-except block to handle error -> Option A

4. Quick Check:

   Division by zero needs error handling [OK]

Hint: Look for division by zero and handle with try-except [OK]

Common Mistakes:

• Ignoring the division by zero error
• Removing steps instead of fixing error
• Returning wrong variable

5.

You want to build an AI that answers questions by reasoning through three steps: understanding the question, searching facts, and giving an answer. Which approach best models this multi-step reasoning?

hard

A. Use a single neural network layer to predict answers directly

B. Randomly select an answer from a database without processing

C. Train a model only on final answers without intermediate steps

D. Chain three separate models: one for understanding, one for searching, one for answering

Solution

1. Step 1: Understand the multi-step reasoning requirement

   The AI must perform three ordered steps: understand, search, answer.

2. Step 2: Match the approach that models these steps clearly

   Chain three separate models: one for understanding, one for searching, one for answering chains three models, each handling one step, matching the multi-step reasoning process.

3. Final Answer:

   Chain three separate models: one for understanding, one for searching, one for answering -> Option D

4. Quick Check:

   Multi-step reasoning = chain models for each step [OK]

Hint: Choose option that splits tasks into ordered steps [OK]

Common Mistakes:

• Using one model for all steps ignoring order
• Random guessing without reasoning
• Skipping intermediate reasoning steps