Netflix architecture overview in Microservices - System Design Exercise

Design: Netflix Streaming Platform

Design covers backend microservices, data storage, content delivery, user authentication, recommendation engine, and monitoring. Does not cover content licensing or DRM details.

Functional Requirements

FR1: Support streaming video content to 200 million+ users worldwide

FR2: Allow users to browse, search, and play movies and TV shows

FR3: Personalize content recommendations based on user preferences

FR4: Handle peak traffic during popular show releases

FR5: Ensure high availability with minimal downtime

FR6: Support multiple device types (smart TVs, phones, tablets, web)

FR7: Secure user data and prevent unauthorized access

FR8: Provide analytics on user engagement and streaming quality

Non-Functional Requirements

NFR1: Scale to handle 10 million concurrent streams

NFR2: API response latency under 200ms for browsing and searching

NFR3: Streaming latency under 5 seconds from play request

NFR4: Availability target of 99.9% uptime

NFR5: Global distribution with low latency access

NFR6: Data consistency for user profiles and watch history

NFR7: Cost-effective use of cloud resources

Think Before You Design

Questions to Ask

❓ Question 1

❓ Question 2

❓ Question 3

❓ Question 4

❓ Question 5

❓ Question 6

❓ Question 7

Key Components

API Gateway

User Authentication Service

Content Management Service

Streaming Service

Recommendation Service

Search Service

User Profile Service

Content Delivery Network (CDN)

Database (SQL/NoSQL)

Cache (Redis/Memcached)

Monitoring and Logging

Design Patterns

Microservices architecture

Event-driven communication

CQRS (Command Query Responsibility Segregation)

Cache-aside pattern

Circuit breaker for fault tolerance

Load balancing

Data partitioning and replication

Reference Architecture

                +-------------------+
                |   User Devices    |
                +---------+---------+
                          |
                          v
                +-------------------+
                |    API Gateway    |
                +---------+---------+
                          |
    +---------------------+---------------------+
    |                     |                     |
    v                     v                     v
+---------+          +-----------+          +-----------+
| Auth    |          | Search    |          | Profile   |
| Service |          | Service   |          | Service   |
+----+----+          +-----+-----+          +-----+-----+
     |                     |                      |
     v                     v                      v
+-------------------------------------------------------+
|               Recommendation Service                  |
+-------------------------------------------------------+
                          |
                          v
                +-------------------+
                | Streaming Service |
                +---------+---------+
                          |
                          v
                +-------------------+
                |       CDN         |
                +-------------------+

Additional components:
- Databases for user data, content metadata, and recommendations
- Cache layers for fast data access
- Monitoring and logging infrastructure

Components

API Gateway

Nginx / Envoy

Entry point for all client requests; routes requests to appropriate microservices; handles rate limiting and authentication checks

User Authentication Service

OAuth 2.0, JWT

Manages user login, token issuance, and session validation

Search Service

Elasticsearch

Provides fast search capabilities over movie and show metadata

User Profile Service

PostgreSQL / Cassandra

Stores user preferences, watch history, and account details

Recommendation Service

Machine Learning models, Apache Kafka

Generates personalized content recommendations based on user behavior and preferences

Streaming Service

Microservices with adaptive bitrate streaming (HLS/DASH)

Handles video stream requests, manages session state, and interacts with CDN

Content Delivery Network (CDN)

Akamai / CloudFront

Delivers video content globally with low latency and high availability

Cache

Redis / Memcached

Caches frequently accessed data like user sessions, recommendations, and metadata to reduce latency

Monitoring and Logging

Prometheus, Grafana, ELK Stack

Tracks system health, performance metrics, and logs for troubleshooting

Request Flow

1. User sends request from device to API Gateway.

2. API Gateway authenticates request via Authentication Service.

3. For browsing or searching, API Gateway routes to Search Service or Profile Service.

4. User preferences and watch history fetched from Profile Service and cache.

5. Recommendation Service consumes user data and events to generate personalized lists.

6. User selects content to play; Streaming Service receives request.

7. Streaming Service coordinates with CDN to deliver video stream.

8. CDN serves video chunks to user device with minimal latency.

9. Monitoring services collect metrics and logs throughout the flow.

Database Schema

Entities: - User: user_id (PK), email, password_hash, subscription_status - Profile: profile_id (PK), user_id (FK), preferences, watch_history - Content: content_id (PK), title, genre, metadata, availability - Recommendation: user_id (FK), content_id (FK), score - SearchIndex: content_id (FK), keywords Relationships: - One User has many Profiles - Profiles link to multiple Recommendations - Content referenced in Recommendations and SearchIndex

Scaling Discussion

Bottlenecks

API Gateway becoming a single point of failure under high load

Database write and read throughput limits for user data

Recommendation Service processing delays with large user base

Streaming Service bandwidth and session management under peak load

CDN cache misses causing higher latency

Solutions

Deploy multiple API Gateway instances behind load balancers for redundancy and scale

Use database sharding and read replicas to distribute load; employ NoSQL stores for high write throughput

Implement asynchronous event processing and batch updates in Recommendation Service; use scalable ML infrastructure

Scale Streaming Service horizontally; use stateless session management and autoscaling

Optimize CDN caching strategies; pre-warm caches for popular content; use multi-CDN approach

Interview Tips

Time: Spend 10 minutes understanding requirements and clarifying scope, 20 minutes designing architecture and data flow, 10 minutes discussing scaling and trade-offs, 5 minutes summarizing.

Explain microservices and their responsibilities clearly

Highlight how CDN reduces latency for streaming

Discuss caching to improve performance and reduce DB load

Describe personalization via recommendation engine

Address fault tolerance and high availability strategies

Mention monitoring for proactive issue detection

Show awareness of trade-offs between consistency and availability