gRPC for internal communication in Microservices - Architecture Diagram

System Overview - gRPC for internal communication

This system uses gRPC for fast and efficient communication between microservices inside a data center. The goal is to enable low-latency, reliable, and scalable service-to-service calls with clear contracts.

Architecture Diagram

User
  |
  v
Load Balancer
  |
  v
API Gateway
  |
  +-------------------+-------------------+
  |                   |                   |
Service A <--------> Service B <--------> Service C
  |                   |                   |
  v                   v                   v
Database A          Database B          Database C
  ^                   ^                   ^
  |                   |                   |
Cache A             Cache B             Cache C

Components

User

client

Initiates requests to the system

Load Balancer

load_balancer

Distributes incoming requests evenly to API Gateway instances

API Gateway

api_gateway

Handles client requests, authentication, and routes to microservices

Service A

service

Microservice handling specific business logic, communicates with other services via gRPC

Service B

service

Another microservice communicating internally using gRPC

Service C

service

Additional microservice in the system communicating via gRPC

Database A

database

Stores persistent data for Service A

Database B

database

Stores persistent data for Service B

Database C

database

Stores persistent data for Service C

Cache A

cache

Caches frequently accessed data for Service A to reduce database load

Cache B

cache

Caches frequently accessed data for Service B

Cache C

cache

Caches frequently accessed data for Service C

Request Flow - 18 Hops

User → Load Balancer

Load Balancer → API Gateway

API Gateway → Service A

Service A → Cache A

Cache A → Service A

Service A → Database A

Database A → Service A

Service A → Cache A

Service A → Service B

Service B → Cache B

Cache B → Service B

Service B → Database B

Database B → Service B

Service B → Cache B

Service B → Service A

Service A → API Gateway

API Gateway → Load Balancer

Load Balancer → User

Failure Scenario

Component Fails:Database B

Impact:Service B cannot retrieve fresh data; cache may serve stale data; writes fail causing data loss

Mitigation:Use database replication for failover; cache serves stale reads; alert and retry writes later

Architecture Quiz - 3 Questions

Which component handles client authentication and routes requests to microservices?

A Service A

B Load Balancer

C API Gateway

D Cache A

Design Principle

Using gRPC for internal communication enables fast, efficient, and strongly-typed calls between microservices. Caches reduce database load and latency. The layered architecture with load balancer and API gateway ensures scalability and security.

Practice

1. What is the main advantage of using gRPC for internal communication between microservices?

easy

A. It requires no predefined message formats.

B. It provides fast, efficient, and strongly typed communication.

C. It only works with services written in the same language.

D. It uses plain text messages for easy debugging.

Solution

1. Step 1: Understand gRPC communication benefits

   gRPC uses Protocol Buffers which are compact and strongly typed, making communication fast and reliable.

2. Step 2: Compare with other options

   Options B, C, and D are incorrect because gRPC requires predefined message formats, supports multiple languages, and uses binary messages, not plain text.

3. Final Answer:

   It provides fast, efficient, and strongly typed communication. -> Option B

4. Quick Check:

   gRPC speed and typing [OK]

Hint: gRPC is fast and typed, unlike plain text or language-specific methods [OK]

Common Mistakes:

• Thinking gRPC uses plain text messages
• Assuming gRPC works only with one language
• Believing gRPC needs no message definitions

2. Which of the following is the correct way to define a gRPC service method in a .proto file?

easy

A. method GetUser returns UserResponse(UserRequest);

B. service GetUser { rpc UserRequest returns UserResponse; }

C. rpc GetUser (UserRequest) returns (UserResponse);

D. function GetUser(UserRequest): UserResponse;

Solution

1. Step 1: Recall gRPC .proto syntax

   In .proto files, service methods are defined using the syntax: rpc MethodName (RequestType) returns (ResponseType);

2. Step 2: Validate options

   rpc GetUser (UserRequest) returns (UserResponse); matches the correct syntax. Options B, C, and D do not follow the .proto syntax for defining rpc methods.

3. Final Answer:

   rpc GetUser (UserRequest) returns (UserResponse); -> Option C

4. Quick Check:

   .proto rpc syntax [OK]

Hint: Remember: rpc Method(Request) returns (Response); in .proto files [OK]

Common Mistakes:

• Using 'service' keyword incorrectly for methods
• Confusing method syntax with programming language functions
• Omitting parentheses around request and response types

3. Given the following gRPC client call in Python, what will be the output if the server returns a UserResponse with name='Alice' and age=30?

response = stub.GetUser(UserRequest(id=123))
print(f"Name: {response.name}, Age: {response.age}")

medium

A. Name: Alice, Age: 30

B. Name: 123, Age: 0

C. Name: , Age:

D. Error: stub.GetUser is not a function

Solution

1. Step 1: Understand the client call and server response

   The client calls GetUser with id=123. The server responds with UserResponse containing name='Alice' and age=30.

2. Step 2: Analyze the print statement output

   The print statement accesses response.name and response.age, so it will output the values returned by the server.

3. Final Answer:

   Name: Alice, Age: 30 -> Option A

4. Quick Check:

   Client prints server response fields [OK]

Hint: Client prints server response fields directly as returned [OK]

Common Mistakes:

• Assuming client sends back request data instead of server response
• Confusing method call syntax causing errors
• Expecting empty or default values without server response

4. A developer wrote this gRPC service definition but the client fails to connect:

service UserService {
  rpc GetUser UserRequest returns UserResponse;
}

What is the error in this definition?

medium

A. Missing parentheses around request and response types.

B. Service name should be lowercase.

C. rpc keyword should be capitalized as RPC.

D. UserRequest and UserResponse must be strings.

Solution

1. Step 1: Check gRPC method syntax in .proto

   The correct syntax requires parentheses around request and response types: rpc MethodName (RequestType) returns (ResponseType);

2. Step 2: Identify the error in the given code

   The code misses parentheses around UserRequest and UserResponse, causing client connection failure.

3. Final Answer:

   Missing parentheses around request and response types. -> Option A

4. Quick Check:

   Parentheses required in rpc method signature [OK]

Hint: Always use parentheses around request and response in rpc methods [OK]

Common Mistakes:

• Ignoring parentheses in rpc method definitions
• Thinking service names must be lowercase
• Misunderstanding rpc keyword casing rules

5. You have multiple microservices written in different languages that need to communicate internally with low latency and strict message contracts. Which approach best fits this scenario?

hard

A. Use REST APIs with JSON for all communication.

B. Use message queues with XML messages.

C. Use plain TCP sockets with custom binary protocol.

D. Use gRPC with Protocol Buffers for internal communication.

Solution

1. Step 1: Analyze requirements for low latency and strict contracts

   Low latency and strict message contracts require efficient, strongly typed communication.

2. Step 2: Evaluate communication options

   REST with JSON is flexible but slower and less strict. Plain TCP with custom protocol is complex and error-prone. Message queues add latency and XML is verbose. gRPC with Protocol Buffers is designed for efficient, strongly typed, multi-language communication.

3. Final Answer:

   Use gRPC with Protocol Buffers for internal communication. -> Option D

4. Quick Check:

   Low latency + strict contracts = gRPC [OK]

Hint: gRPC + Protobuf = fast, typed, multi-language communication [OK]

Common Mistakes:

• Choosing REST despite latency and typing needs
• Using custom protocols without standard tooling
• Ignoring message size and parsing overhead