Faceted navigation and crawl issues in SEO Fundamentals - Mini Project: Build & Apply

Understanding Faceted Navigation and Crawl Issues

📖 Scenario: You manage an online store with many products. Customers can filter products by color, size, and brand using faceted navigation. You want to make sure search engines can crawl your site efficiently without indexing duplicate or unnecessary pages.

🎯 Goal: Build a simple example showing how faceted navigation URLs can be structured and how to control search engine crawling to avoid crawl issues.

📋 What You'll Learn

Create a dictionary called facets with keys 'color', 'size', and 'brand' and their example values

Create a variable called base_url with the main product page URL

Generate a list called facet_urls that combines base_url with each facet filter as a query parameter

Add a robots meta tag string called robots_tag to instruct search engines not to index faceted URLs

💡 Why This Matters

🌍 Real World

Online stores and large websites use faceted navigation to help users filter products or content. Managing how search engines crawl these filters is important to avoid duplicate content and wasted crawl budget.

💼 Career

SEO specialists and webmasters must understand faceted navigation and crawl control to optimize site visibility and search engine rankings.

1

Create the Facet Filters Data

Create a dictionary called facets with these exact entries: 'color': 'red', 'size': 'medium', and 'brand': 'acme'.

SEO Fundamentals

# Create the facets dictionary with color, size, and brand
# Your code here

Need a hint?

Use curly braces to create a dictionary with keys and values.

2

Set the Base URL

Create a variable called base_url and set it to the string 'https://www.example.com/products'.

SEO Fundamentals

facets = {'color': 'red', 'size': 'medium', 'brand': 'acme'}
# Create the base_url variable with the main product page URL
# Your code here

Need a hint?

Assign the URL string to the variable base_url.

3

Generate Faceted URLs

Create a list called facet_urls that contains URLs combining base_url with each facet filter as a query parameter. Use the format base_url + '?key=value' for each facet in facets. Use a for loop with variables key and value to iterate over facets.items().

SEO Fundamentals

facets = {'color': 'red', 'size': 'medium', 'brand': 'acme'}
base_url = 'https://www.example.com/products'
# Create the facet_urls list combining base_url with each facet filter
# Your code here

Need a hint?

Use a list comprehension with an f-string to build each URL.

4

Add Robots Meta Tag to Control Crawling

Create a string variable called robots_tag and set it to the exact value '<meta name="robots" content="noindex, follow">' to instruct search engines not to index faceted URLs but still follow links.

SEO Fundamentals

facets = {'color': 'red', 'size': 'medium', 'brand': 'acme'}
base_url = 'https://www.example.com/products'
facet_urls = [f"{base_url}?{key}={value}" for key, value in facets.items()]
# Add the robots meta tag string to control crawling
# Your code here

Need a hint?

This meta tag tells search engines not to index the page but to follow links on it.