Pipeline mental model (stages flow) in MongoDB

Introduction

A pipeline helps process data step-by-step, like an assembly line, making it easy to transform and analyze data in order.

When you want to filter data before doing calculations.

When you need to sort data and then group it by categories.

When you want to add new information to each data item based on existing fields.

When you want to combine multiple operations on data in a clear sequence.

When you want to prepare data for reports by shaping it step-by-step.

Syntax

MongoDB

db.collection.aggregate([
  { stage1 },
  { stage2 },
  ...
])

Each stage is an object that performs one operation on the data.

Stages run one after another, passing results from one to the next.

Examples

First filters sales with status 'A', then groups by item and sums amounts.

MongoDB

db.sales.aggregate([
  { $match: { status: "A" } },
  { $group: { _id: "$item", total: { $sum: "$amount" } } }
])

Sorts users by age descending, then takes the top 5.

MongoDB

db.users.aggregate([
  { $sort: { age: -1 } },
  { $limit: 5 }
])

Sample Program

This pipeline finds all shipped orders, groups them by customer summing prices, then sorts customers by total spent descending.

MongoDB

db.orders.aggregate([
  { $match: { status: "shipped" } },
  { $group: { _id: "$customer", totalSpent: { $sum: "$price" } } },
  { $sort: { totalSpent: -1 } }
])

Important Notes

Think of each stage as a step in a recipe; the output of one step is the input for the next.

You can add as many stages as needed to get the final result you want.

Order matters: changing the order of stages can change the result or performance.

Summary

A pipeline processes data in stages, one after another.

Each stage transforms or filters the data before passing it on.

Using pipelines helps organize complex data tasks clearly and efficiently.