Why the aggregation pipeline is needed in MongoDB - See It in Action

Understanding Why the Aggregation Pipeline is Needed in MongoDB

📖 Scenario: Imagine you run a small online bookstore. You have a collection of books with details like title, author, price, and number of copies sold. You want to find out which authors sold the most books and the total revenue they generated.

🎯 Goal: Build a simple aggregation pipeline in MongoDB to calculate total copies sold and total revenue per author.

📋 What You'll Learn

Create a collection called books with sample book documents

Add a variable to hold the minimum number of copies sold to consider

Write an aggregation pipeline to group books by author and calculate total copies sold and revenue

Filter authors who sold more than the minimum copies threshold

💡 Why This Matters

🌍 Real World

Online stores and businesses often need to analyze sales data to find top sellers and revenue contributors.

💼 Career

Understanding aggregation pipelines is essential for data analysts and backend developers working with MongoDB to generate reports and insights.

1

DATA SETUP: Create the books collection with sample documents

Create a variable called books that holds a list of three book documents. Each document should have these exact fields and values: { title: 'Book A', author: 'Author 1', price: 10, copiesSold: 100 }, { title: 'Book B', author: 'Author 2', price: 15, copiesSold: 50 }, and { title: 'Book C', author: 'Author 1', price: 20, copiesSold: 70 }.

MongoDB

books = [
    # Your code here
]

Need a hint?

Use a list of dictionaries with the exact keys and values given.

2

CONFIGURATION: Set a minimum copies sold threshold

Create a variable called min_copies_sold and set it to 100. This will be the minimum total copies sold for authors to be included in the results.

MongoDB

books = [
    { 'title': 'Book A', 'author': 'Author 1', 'price': 10, 'copiesSold': 100 },
    { 'title': 'Book B', 'author': 'Author 2', 'price': 15, 'copiesSold': 50 },
    { 'title': 'Book C', 'author': 'Author 1', 'price': 20, 'copiesSold': 70 }
]

# Your code here

Need a hint?

Just assign the number 100 to the variable min_copies_sold.

3

CORE LOGIC: Write the aggregation pipeline to group by author and calculate totals

Create a variable called pipeline that holds a list of aggregation stages. The pipeline should: 1) group documents by author, 2) calculate total copies sold as totalCopies, and 3) calculate total revenue as totalRevenue (price multiplied by copies sold summed). Use $group with _id as $author, and use $sum for totals.

MongoDB

books = [
    { 'title': 'Book A', 'author': 'Author 1', 'price': 10, 'copiesSold': 100 },
    { 'title': 'Book B', 'author': 'Author 2', 'price': 15, 'copiesSold': 50 },
    { 'title': 'Book C', 'author': 'Author 1', 'price': 20, 'copiesSold': 70 }
]

min_copies_sold = 100

# Your code here

Need a hint?

Use $group with _id as $author. Use $sum to add copiesSold and price * copiesSold.

4

COMPLETION: Add a match stage to filter authors by minimum copies sold

Add a $match stage to the pipeline list that filters authors with totalCopies greater than or equal to min_copies_sold. Append this stage after the $group stage.

MongoDB

books = [
    { 'title': 'Book A', 'author': 'Author 1', 'price': 10, 'copiesSold': 100 },
    { 'title': 'Book B', 'author': 'Author 2', 'price': 15, 'copiesSold': 50 },
    { 'title': 'Book C', 'author': 'Author 1', 'price': 20, 'copiesSold': 70 }
]

min_copies_sold = 100

pipeline = [
    {
        '$group': {
            '_id': '$author',
            'totalCopies': { '$sum': '$copiesSold' },
            'totalRevenue': { '$sum': { '$multiply': [ '$price', '$copiesSold' ] } }
        }
    },
    # Your code here
]

Need a hint?

Append a $match stage that filters where totalCopies is greater than or equal to min_copies_sold.