Standard analyzer in Elasticsearch - Mini Project: Build & Apply

Standard analyzer

📖 Scenario: You are building a simple search feature for a small library. You want to analyze the text of book titles so that searches work well by breaking text into words and lowering case.

🎯 Goal: Create an Elasticsearch index with the standard analyzer applied to the title field. Then test how the analyzer breaks down a sample book title.

📋 What You'll Learn

Create an index called library with a mapping for title field using the standard analyzer

Use the _analyze API to analyze the text "The Quick Brown Fox" with the standard analyzer

Print the tokens produced by the analyzer

💡 Why This Matters

🌍 Real World

Search engines use analyzers to break down text so users can find relevant results easily.

💼 Career

Understanding analyzers is important for roles involving search, data indexing, and text processing.

1

Create the index with standard analyzer

Create an index called library with a mapping where the title field uses the standard analyzer.

Elasticsearch

# Create the index with mapping for title field
# Your code here

Need a hint?

The standard analyzer is the default for text fields, but here you specify it explicitly in the mapping.

2

Set the text to analyze

Create a JSON object called analyze_request with the keys analyzer set to standard and text set to "The Quick Brown Fox".

Elasticsearch

PUT /library
{
  "mappings": {
    "properties": {
      "title": {
        "type": "text",
        "analyzer": "standard"
      }
    }
  }
}

# Create analyze_request JSON
# Your code here

Need a hint?

The analyze API expects a JSON with analyzer and text keys.

3

Analyze the text using the standard analyzer

Use the _analyze API on the library index with the JSON object containing analyzer set to standard and text set to "The Quick Brown Fox".

Elasticsearch

PUT /library
{
  "mappings": {
    "properties": {
      "title": {
        "type": "text",
        "analyzer": "standard"
      }
    }
  }
}

POST /library/_analyze
{
  "analyzer": "standard",
  "text": "The Quick Brown Fox"
}
# Your code here

Need a hint?

The _analyze API shows how the text is split into tokens by the analyzer.

4

View the tokens produced by the analyzer

Print the tokens from the response of the _analyze API call. The tokens should be the, quick, brown, and fox.

Elasticsearch

PUT /library
{
  "mappings": {
    "properties": {
      "title": {
        "type": "text",
        "analyzer": "standard"
      }
    }
  }
}

POST /library/_analyze
{
  "analyzer": "standard",
  "text": "The Quick Brown Fox"
}

# Print the tokens below
# Your code here

Need a hint?

The standard analyzer splits text into lowercase words, removing punctuation.