BGP and inter-domain routing in Computer Networks - Deep Dive

Overview - BGP and inter-domain routing

What is it?

BGP, or Border Gateway Protocol, is the main system that helps different large networks on the internet talk to each other. It decides the best paths for data to travel between these networks, called domains or autonomous systems. Inter-domain routing means managing how data moves across these separate networks, not just inside one. BGP makes sure data finds the best route across the complex web of networks worldwide.

Why it matters

Without BGP, the internet would be like a city with many roads but no traffic rules or maps to guide drivers. Data would get lost or stuck, making websites slow or unreachable. BGP solves this by organizing how networks share information about routes, ensuring data flows efficiently and reliably across the globe. It keeps the internet connected and working smoothly.

Where it fits

Before learning BGP, you should understand basic networking concepts like IP addresses, routing inside a single network (intradomain routing), and how data moves in packets. After BGP, learners can explore advanced topics like network security, traffic engineering, and internet infrastructure management.

Mental Model

Core Idea

BGP is the internet's postal service that exchanges address books between large networks to find the best path for sending data across different domains.

Think of it like...

Imagine many cities (networks) each with their own postal system. BGP is like the system where these cities share their delivery routes and addresses so that a letter can travel from one city to another using the best roads and avoid traffic jams or closed streets.

┌───────────────┐       ┌───────────────┐       ┌───────────────┐
│ Autonomous    │──────▶│ Autonomous    │──────▶│ Autonomous    │
│ System A      │       │ System B      │       │ System C      │
└───────────────┘       └───────────────┘       └───────────────┘
       ▲                      ▲                      ▲
       │                      │                      │
       └─────────────BGP──────┴─────────────BGP──────┘

Each box is a network domain. BGP links them by sharing route info to find best paths.

Build-Up - 7 Steps

1

Foundation

Understanding Autonomous Systems

Concept: Introduce the idea of autonomous systems as independent networks with their own policies.

An autonomous system (AS) is a large network or group of networks managed by one organization, like an internet service provider or a big company. Each AS controls its own routing and policies. Think of it as a city with its own roads and traffic rules.

Result

Learners understand that the internet is made of many ASes, each needing to communicate with others.

Knowing that the internet is divided into independently managed networks helps explain why special protocols like BGP are needed to connect them.

2

Foundation

Basics of Routing and Path Selection

Concept: Explain how routers decide where to send data within and between networks.

Routers use routing tables to decide the next hop for data packets. Inside a network, protocols like OSPF or RIP help find paths. But between networks, a different approach is needed because each network has its own rules and preferences.

Result

Learners see the difference between routing inside a network and routing between networks.

Understanding routing basics sets the stage for why inter-domain routing requires a special protocol like BGP.

3

Intermediate

How BGP Shares Routing Information

🤔Before reading on: do you think BGP shares full network maps or just best paths? Commit to your answer.

Concept: BGP exchanges information about reachable networks and the paths to get there, not the entire network map.

BGP routers talk to each other using messages that share which IP address blocks they can reach and the path of ASes to get there. This path information helps routers avoid loops and pick the best route based on policies.

Result

Learners understand that BGP shares path vectors, not full topology, enabling scalable routing.

Knowing that BGP shares paths rather than full maps explains how it scales to the huge size of the internet.

4

Intermediate

BGP Route Selection Criteria

🤔Before reading on: do you think BGP always picks the shortest path or considers other factors? Commit to your answer.

Concept: BGP chooses routes based on multiple factors, including path length, policies, and preferences, not just shortest distance.

BGP uses attributes like AS path length, local preferences, and origin type to decide the best route. Network operators can set policies to prefer certain routes for cost, performance, or security reasons.

Result

Learners see that BGP is flexible and policy-driven, not just automatic shortest path routing.

Understanding BGP's policy-based routing reveals how networks control traffic flow beyond simple distance.

5

Intermediate

BGP Peering and Sessions

Concept: Explain how BGP routers establish connections to exchange routing info.

BGP routers form 'peering' sessions over TCP connections with routers in other ASes or within the same AS. They exchange updates about routes and keep the session alive with periodic messages.

Result

Learners grasp how BGP routers communicate reliably to maintain up-to-date routing info.

Knowing the session setup helps understand BGP's stability and how route changes propagate.

6

Advanced

Handling Route Changes and Failures

🤔Before reading on: do you think BGP instantly switches routes on failure or waits? Commit to your answer.

Concept: BGP reacts to network changes by withdrawing routes and advertising new ones, but it uses timers to avoid flapping.

When a route fails, BGP withdraws it and looks for alternatives. To prevent constant route changes (flapping), BGP uses timers and damping techniques to stabilize routing.

Result

Learners understand BGP's mechanisms to maintain stable routing despite network changes.

Knowing how BGP manages instability prevents misconceptions about internet outages and routing delays.

7

Expert

BGP Security Challenges and Solutions

🤔Before reading on: do you think BGP has built-in security to prevent route hijacking? Commit to your answer.

Concept: BGP was designed without strong security, leading to risks like route hijacking; modern solutions add protections.

BGP can be tricked into accepting false routes, causing traffic to be misdirected. Techniques like RPKI (Resource Public Key Infrastructure) and BGPsec add cryptographic validation to improve trust. Operators also use filters and monitoring to detect anomalies.

Result

Learners appreciate the security risks in BGP and the ongoing efforts to secure inter-domain routing.

Understanding BGP's security limitations highlights the importance of ongoing improvements for a safe internet.

Under the Hood

BGP works by establishing TCP connections between routers in different autonomous systems. These routers exchange route advertisements containing IP prefixes and AS path information. Each router builds a routing table based on received paths, applying policies and selecting the best route. The AS path attribute prevents routing loops by showing the sequence of ASes a route has passed through. BGP updates propagate incrementally, not flooding the network, which helps scalability.

Why designed this way?

BGP was created in the late 1980s when the internet was growing beyond a single administrative domain. Designers needed a protocol that could handle diverse policies, scale to thousands of networks, and avoid loops without requiring full network topology knowledge. Alternatives like link-state protocols were too heavy for this scale. BGP's path vector approach balances scalability, flexibility, and simplicity.

┌───────────────┐      TCP      ┌───────────────┐
│ BGP Router A  │──────────────▶│ BGP Router B  │
│ (AS 100)      │  Session     │ (AS 200)      │
└───────────────┘              └───────────────┘
       │                             │
       │ Advertises routes with AS paths
       ▼                             ▼
┌─────────────────────────────────────────────┐
│ Routing Table:                              │
│ Prefix: 192.0.2.0/24                        │
│ AS Path: 100 300 200                        │
│ Next Hop: Router B                          │
└─────────────────────────────────────────────┘

Myth Busters - 4 Common Misconceptions

Quick: Does BGP automatically find the shortest physical path for data? Commit to yes or no.

Common Belief: BGP always chooses the shortest or fastest path between networks.

Reality: BGP chooses routes based on policies and AS path length, which may not correspond to the shortest physical or fastest path.

Why it matters: Assuming shortest path can lead to confusion when traffic takes unexpected routes, affecting performance and troubleshooting.

Quick: Is BGP a secure protocol that prevents fake routes by default? Commit to yes or no.

Common Belief: BGP has built-in security to prevent route hijacking and spoofing.

Reality: BGP was not designed with strong security; it is vulnerable to attacks unless additional measures are implemented.

Why it matters: Ignoring BGP's security weaknesses can lead to serious internet outages or data interception.

Quick: Does BGP handle routing inside a single network? Commit to yes or no.

Common Belief: BGP is used for routing inside any network, including small local networks.

Reality: BGP is designed for routing between autonomous systems, not for internal routing within a single network.

Why it matters: Using BGP inside a small network is inefficient and unnecessary; other protocols are better suited.

Quick: Does BGP instantly update routes when a link fails? Commit to yes or no.

Common Belief: BGP immediately switches to new routes as soon as a failure happens.

Reality: BGP uses timers and damping to avoid rapid route changes, so updates may be delayed to maintain stability.

Why it matters: Expecting instant failover can cause misunderstanding of internet delays and outages.

Expert Zone

1

BGP route selection can be influenced by subtle policy attributes like MED (Multi-Exit Discriminator) that affect inter-AS traffic flow in complex ways.

2

Route reflectors and confederations are advanced BGP features used to scale BGP inside large autonomous systems, which can introduce subtle routing behaviors.

3

BGP convergence time varies widely and can be affected by network size, policies, and timers, impacting how quickly the internet adapts to changes.

When NOT to use

BGP is not suitable for small or simple networks where intradomain protocols like OSPF or EIGRP are more efficient. For highly dynamic or mobile networks, protocols designed for rapid topology changes like OLSR or AODV are better. Also, BGP is not designed for multicast or real-time traffic routing.

Production Patterns

In real-world networks, BGP is used with route filtering to enforce security and policy, with prefix-lists and AS-path filters. Large ISPs use route reflectors to reduce session counts. Traffic engineering uses BGP attributes to control inbound and outbound traffic. Monitoring tools detect anomalies like route leaks or hijacks.

Connections

Postal Delivery Systems

BGP's path vector routing is similar to how postal services share routing info to deliver mail across cities.

Understanding postal logistics helps grasp how BGP exchanges route paths and avoids loops.

Supply Chain Management

Both involve choosing optimal paths through multiple independent entities with their own rules and constraints.

Knowing supply chain coordination reveals parallels in managing complex, policy-driven routing decisions.

Ecosystem Networks in Biology

Like BGP connects autonomous systems, ecosystems connect independent species and habitats through resource flows.

Seeing ecosystems as networks helps appreciate the complexity and interdependence in internet routing.

Common Pitfalls

#1 Assuming BGP routes are always shortest and fastest.

Wrong approach:

Configuring BGP to ignore local preferences and rely only on AS path length.

Correct approach:

Use local preference and other attributes to influence route selection according to network goals.

Root cause:

Misunderstanding that BGP is policy-driven, not purely metric-based.

#2 Not securing BGP sessions, leading to route hijacking.

Wrong approach:

Running BGP without authentication or prefix filtering:
neighbor 192.0.2.1 remote-as 65001

Correct approach:

Configure MD5 authentication and prefix filters:
neighbor 192.0.2.1 remote-as 65001
neighbor 192.0.2.1 password MySecret
ip prefix-list ALLOWED seq 5 permit 203.0.113.0/24
neighbor 192.0.2.1 prefix-list ALLOWED in

Root cause:

Underestimating BGP security risks and lacking protective configurations.

#3 Using BGP inside small networks instead of simpler protocols.

Wrong approach:

Deploying BGP in a small office LAN with few routers.

Correct approach:

Use OSPF or static routing for small networks.

Root cause:

Confusing inter-domain routing needs with intradomain routing.

Key Takeaways

BGP is the protocol that connects independent networks on the internet by sharing routing paths and policies.

It uses path vector routing to scale across thousands of networks without needing full topology knowledge.

BGP decisions are policy-driven, not just based on shortest or fastest paths, allowing network operators control over traffic.

Security is a known weakness in BGP, requiring additional measures to protect against route hijacking.

Understanding BGP's design and operation is essential for managing and troubleshooting internet-wide routing.