Why you must fact-check AI responses in AI for Everyone - Performance Analysis

Time Complexity: Why you must fact-check AI responses

O(n)

Understanding Time Complexity

When using AI to get answers, it is important to understand how the time it takes to check facts grows as the amount of information increases.

We want to know how much effort is needed to verify AI responses as they get longer or more complex.

Scenario Under Consideration

Analyze the time complexity of the following fact-checking process.

function factCheck(aiResponse) {
  for (const statement of aiResponse.statements) {
    if (!verify(statement)) {
      return false;
    }
  }
  return true;
}

function verify(statement) {
  // Check statement against trusted sources
  // Returns true if verified, false otherwise
}
    

This code checks each statement in an AI response one by one to see if it is true by comparing it to trusted sources.

Identify Repeating Operations

• Primary operation: Looping through each statement in the AI response.
• How many times: Once for every statement in the response.

How Execution Grows With Input

As the number of statements grows, the time to check all of them grows in a similar way.

Input Size (n)	Approx. Operations
10	10 checks
100	100 checks
1000	1000 checks

Pattern observation: The time grows directly with the number of statements; doubling statements doubles the work.

Final Time Complexity

Time Complexity: O(n)

This means the time to fact-check grows in a straight line with the number of statements to verify.

Common Mistake

[X] Wrong: "Fact-checking AI responses is instant no matter how long the response is."

[OK] Correct: Each statement needs to be checked, so longer responses take more time to verify.

Interview Connect

Understanding how time grows with input size helps you explain why verifying AI answers takes effort and how to manage it efficiently.

Self-Check

"What if the verify function itself checks multiple sources for each statement? How would that affect the time complexity?"

Practice

1. Why is it important to fact-check answers given by AI?

easy

A. Because AI always gives the most recent news updates.

B. Because AI can sometimes provide incorrect or outdated information.

C. Because AI never makes mistakes.

D. Because AI answers are always opinions, not facts.

Solution

1. Step 1: Understand AI's nature

   AI generates answers based on patterns in data but can include errors or outdated facts.

2. Step 2: Importance of verification

   Fact-checking ensures the information is accurate and trustworthy by comparing with reliable sources.

3. Final Answer:

   Because AI can sometimes provide incorrect or outdated information. -> Option B

4. Quick Check:

   AI answers may be wrong = A [OK]

Hint: Remember AI can err; always verify facts [OK]

Common Mistakes:

• Assuming AI is always correct
• Believing AI updates instantly
• Ignoring the need for trusted sources

2. Which of the following is the correct way to fact-check an AI response?

easy

A. Ignore the AI answer and guess the information yourself.

B. Trust the AI answer without checking.

C. Ask the AI the same question repeatedly until the answer changes.

D. Compare the AI answer with information from trusted websites or books.

Solution

1. Step 1: Identify proper fact-checking method

   Fact-checking means verifying information by consulting reliable and trusted sources.

2. Step 2: Evaluate options

   Only Compare the AI answer with information from trusted websites or books. describes comparing AI answers with trusted websites or books, which is correct.

3. Final Answer:

   Compare the AI answer with information from trusted websites or books. -> Option D

4. Quick Check:

   Fact-check by trusted sources = A [OK]

Hint: Always verify AI info with trusted sources [OK]

Common Mistakes:

• Blindly trusting AI answers
• Repeating questions hoping for different answers
• Ignoring reliable sources

3. An AI gives this answer: "The capital of Australia is Sydney." What should you do next?

medium

A. Check a trusted source to confirm the capital of Australia.

B. Ignore the question because AI answers are always wrong.

C. Assume the capital is Canberra because it sounds right.

D. Accept the answer as correct because AI is reliable.

Solution

1. Step 1: Recognize possible error in AI answer

   The AI says Sydney is the capital, but this is a common mistake; the actual capital is Canberra.

2. Step 2: Verify with trusted sources

   To be sure, check a reliable source like an official government website or encyclopedia.

3. Final Answer:

   Check a trusted source to confirm the capital of Australia. -> Option A

4. Quick Check:

   Verify AI facts with trusted sources = D [OK]

Hint: Double-check surprising AI facts with trusted sources [OK]

Common Mistakes:

• Believing AI without verification
• Guessing answers based on intuition
• Ignoring fact-checking altogether

4. You asked an AI for the latest COVID-19 statistics, but the data seems outdated. What is the best way to fix this?

medium

A. Ignore the outdated data and share it anyway.

B. Refresh the AI chat and ask again without checking other sources.

C. Check official health websites or news sources for the latest statistics.

D. Assume the AI will update automatically after some time.

Solution

1. Step 1: Identify the problem with AI data

   AI responses may not have real-time updates, so data can be outdated.

2. Step 2: Find reliable, current sources

   Official health websites or trusted news outlets provide the latest verified statistics.

3. Final Answer:

   Check official health websites or news sources for the latest statistics. -> Option C

4. Quick Check:

   Use trusted sources for current data = B [OK]

Hint: Use official sites for up-to-date info, not just AI [OK]

Common Mistakes:

• Sharing outdated info without checking
• Relying only on AI refresh
• Assuming AI updates instantly

5. You want to use AI to help write a research report. How can you ensure the information is accurate and trustworthy?

hard

A. Use AI answers as a starting point, then verify all facts with trusted sources before including them.

B. Copy all AI answers directly into your report without checking.

C. Only use AI answers if they sound believable to you.

D. Avoid using AI entirely because it is always wrong.

Solution

1. Step 1: Understand AI's role in research

   AI can provide helpful information but may include errors or outdated facts.

2. Step 2: Combine AI with fact-checking

   Use AI as a tool to gather ideas, then verify every fact with trusted sources before using it in your report.

3. Final Answer:

   Use AI answers as a starting point, then verify all facts with trusted sources before including them. -> Option A

4. Quick Check:

   Verify AI info before use = C [OK]

Hint: Always fact-check AI info before using in reports [OK]

Common Mistakes:

• Copying AI answers without verification
• Trusting AI based on intuition
• Avoiding AI completely without reason