Bird
0
0

What is wrong with this robots.txt content?

medium📝 Analysis Q7 of 15
SEO Fundamentals - Technical SEO Basics
What is wrong with this robots.txt content?
User-agent: Googlebot
Disallow: /secret/
User-agent: Googlebot
Allow: /secret/public/
AAllow cannot override Disallow
BDisallow paths cannot contain subfolders
CUser-agent names are case-sensitive
DDuplicate User-agent sections should be combined
Step-by-Step Solution
Solution:
  1. Step 1: Check User-agent declarations

    Multiple blocks for the same User-agent should be combined into one block for clarity and proper parsing.
  2. Step 2: Confirm Allow overrides Disallow

    Allow can override Disallow for subpaths, so no error there.
  3. Final Answer:

    Duplicate User-agent sections should be combined -> Option D
  4. Quick Check:

    Combine rules for same User-agent [OK]
Quick Trick: Combine multiple blocks for same User-agent [OK]
Common Mistakes:
  • Splitting rules for same User-agent
  • Believing Allow cannot override Disallow

Want More Practice?

15+ quiz questions · All difficulty levels · Free

Free Signup - Practice All Questions
More SEO Fundamentals Quizzes