How should you write a robots.txt file to allow Googlebot full access except blocking the /admin/ directory, while denying all other crawlers access to the entire site?

hard📝 Application Q9 of 15

SEO Fundamentals - Technical SEO Basics

How should you write a robots.txt file to allow Googlebot full access except blocking the /admin/ directory, while denying all other crawlers access to the entire site?

AUser-agent: Googlebot Allow: /admin/ User-agent: * Disallow: /admin/

BUser-agent: * Disallow: /admin/ User-agent: Googlebot Allow: /

CUser-agent: Googlebot Disallow: /admin/ User-agent: * Disallow: /

DUser-agent: * Disallow: / User-agent: Googlebot Disallow: /admin/

Step-by-Step Solution

Solution:

Step 1: Allow Googlebot except /admin/
Specify Googlebot with Disallow: /admin/ to block only that folder.
Step 2: Block all other crawlers
Use wildcard User-agent: * with Disallow: / to block entire site.
Step 3: Order matters
Specific user-agent rules should come before wildcard rules.
Final Answer:
User-agent: Googlebot
Disallow: /admin/
User-agent: *
Disallow: / -> Option C
Quick Check:
Specific rules override wildcard; order is important [OK]

Quick Trick: Place specific user-agent rules before wildcard rules [OK]

Common Mistakes:

Reversing order of user-agent blocks
Using Allow incorrectly to override Disallow
Blocking Googlebot entirely by mistake

Master "Technical SEO Basics" in SEO Fundamentals

9 interactive learning modes - each teaches the same concept differently

Learn Why Deep Visual Try Challenge Project Recall Time

Want More Practice?

15+ quiz questions · All difficulty levels · Free

Free Signup - Practice All Questions

More SEO Fundamentals Quizzes

How should you write a robots.txt file to allow Googlebot full access except blocking the /admin/ directory, while denying all other crawlers access to the entire site?

Step 1: Allow Googlebot except /admin/

Step 2: Block all other crawlers

Step 3: Order matters

Final Answer:

Quick Check:

Want More Practice?