LangServe for API deployment in LangChain - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ component_behavior

intermediate

What is the output of this LangServe API call?

Consider a LangServe API deployed with a simple chain that returns the input text reversed. What will be the response when sending the input 'hello'?

LangChain

from langchain.chains import LLMChain
from langchain.llms import OpenAI
from langchain.server import LangServe

llm = OpenAI(temperature=0)
chain = LLMChain(llm=llm, prompt_template="{input_text[::-1]}")
app = LangServe()
app.add_endpoint("/reverse", chain)

# Simulate API call with input_text='hello'

A "hello"

B "olleh"

C "HELLO"

D "error"

💡 Hint

Think about what reversing the string 'hello' produces.

The chain reverses the input text, so 'hello' becomes 'olleh'.

📝 Syntax

intermediate

Which option correctly adds a POST endpoint in LangServe?

You want to add a POST endpoint '/summarize' to your LangServe app that uses a chain named 'summary_chain'. Which code snippet is correct?

LangChain

from langchain.server import LangServe
app = LangServe()

# summary_chain is defined elsewhere

A app.add_endpoint('/summarize', summary_chain, verbs=['POST'])

B app.add_endpoint('/summarize', summary_chain, method='POST')

C app.add_endpoint('/summarize', summary_chain, methods=['POST'])

D app.add_endpoint('/summarize', summary_chain, http_methods=['POST'])

💡 Hint

Check the parameter name for HTTP methods in add_endpoint.

The correct parameter is 'methods' as a list of HTTP methods.

🔧 Debug

advanced

Why does this LangServe app raise a runtime error?

Given this code snippet, why does the LangServe app fail when calling the '/chat' endpoint? from langchain.chains import ConversationChain from langchain.llms import OpenAI from langchain.server import LangServe llm = OpenAI() chain = ConversationChain(llm=llm) app = LangServe() app.add_endpoint('/chat', chain) # The client sends JSON: {"message": "Hello"}

A The chain expects input key 'input' but client sends 'message', causing a KeyError.

B The OpenAI LLM is not initialized with temperature=0 causing instability.

C LangServe requires endpoints to be async functions, but chain is sync.

D The ConversationChain does not support JSON input format.

💡 Hint

Check the expected input key names for ConversationChain.

ConversationChain expects input with key 'input'. Sending 'message' causes a KeyError.

❓ state_output

advanced

What is the state of the LangServe app after adding two endpoints?

You add two chains as endpoints: app.add_endpoint('/translate', translate_chain) app.add_endpoint('/summarize', summarize_chain) What does app.endpoints contain?

A A set containing the endpoint paths only.

B A list containing the two chain objects in order added.

C An empty dictionary because endpoints are not stored.

D A dictionary with keys '/translate' and '/summarize' mapping to their respective chains.

💡 Hint

Think about how LangServe stores endpoints internally.

LangServe stores endpoints in a dictionary mapping paths to chains.

🧠 Conceptual

expert

Which statement best describes LangServe's role in API deployment?

Select the most accurate description of what LangServe provides for deploying LangChain chains as APIs.

A LangServe acts as a lightweight server framework that exposes LangChain chains as HTTP endpoints with minimal setup.

B LangServe is a cloud service that automatically scales LangChain chains without any local setup.

C LangServe is a GUI tool for designing LangChain chains visually before deployment.

D LangServe replaces LangChain's LLMs with custom models optimized for API use.

💡 Hint

Focus on LangServe's function in deployment and API exposure.

LangServe provides a simple server to expose LangChain chains as HTTP endpoints easily.

Practice

1. What is the main purpose of LangServe in LangChain?

easy

A. To quickly turn language models into web APIs

B. To train new language models from scratch

C. To visualize language model outputs in charts

D. To store large datasets for language models

Solution

1. Step 1: Understand LangServe's role

   LangServe is designed to make language models accessible as web APIs easily.

2. Step 2: Compare options with LangServe's function

   Only To quickly turn language models into web APIs matches this purpose; others describe unrelated tasks.

3. Final Answer:

   To quickly turn language models into web APIs -> Option A

4. Quick Check:

   LangServe = API deployment [OK]

Hint: LangServe = language model + web API [OK]

Common Mistakes:

• Confusing LangServe with model training tools
• Thinking LangServe is for data storage
• Assuming LangServe creates visualizations

2. Which of the following is the correct minimal structure for a LangServe class?

easy

A. def MyAPI(input):
return input.upper()

B. class MyAPI:
def __call__(self, input):
return input.upper()

C. class MyAPI:
def call(self, input):
return input.upper()

D. class MyAPI:
def __init__(self, input):
return input.upper()

Solution

1. Step 1: Identify required method for LangServe

   LangServe requires a class with a __call__ method to handle requests.

2. Step 2: Check each option's method name and structure

   Only class MyAPI: def __call__(self, input): return input.upper() uses __call__ correctly; others use wrong method names or invalid return in __init__.

3. Final Answer:

   class with __call__ method -> Option B

4. Quick Check:

   __call__ method = correct structure [OK]

Hint: LangServe needs __call__, not call or __init__ [OK]

Common Mistakes:

• Using call instead of __call__
• Returning values from __init__ method
• Defining a function instead of a class

3. Given this LangServe class:

class EchoAPI:
    def __call__(self, input):
        return f"Echo: {input}"

What will be the output when calling EchoAPI()('hello')?

medium

A. "hello"

B. TypeError: 'EchoAPI' object is not callable

C. "Echo: hello"

D. "EchoAPI: hello"

Solution

1. Step 1: Understand __call__ method behavior

   The __call__ method formats the input by prefixing 'Echo: ' to it.

2. Step 2: Evaluate the call EchoAPI()('hello')

   Creating EchoAPI instance and calling it with 'hello' returns 'Echo: hello'.

3. Final Answer:

   "Echo: hello" -> Option C

4. Quick Check:

   __call__ returns formatted string [OK]

Hint: Calling instance runs __call__ method [OK]

Common Mistakes:

• Expecting raw input without prefix
• Thinking instance is not callable
• Confusing class name with output

4. What is wrong with this LangServe class?

class BadAPI:
    def call(self, input):
        return input[::-1]

medium

A. The return statement should convert input to uppercase

B. The input slicing syntax is incorrect

C. The class must inherit from a base LangServe class

D. The method should be named __call__, not call

Solution

1. Step 1: Check method name required by LangServe

   LangServe expects a __call__ method to make the class callable.

2. Step 2: Analyze method name in BadAPI

   BadAPI uses call instead of __call__, so it won't work as expected.

3. Final Answer:

   The method should be named __call__, not call -> Option D

4. Quick Check:

   __call__ method required [OK]

Hint: Method must be __call__, not call [OK]

Common Mistakes:

• Using call instead of __call__
• Assuming inheritance is mandatory
• Thinking input slicing is invalid

5. You want to deploy a LangServe API that reverses input text but only if the input is a non-empty string. Which class correctly implements this?

hard

A. class ReverseAPI:
def __call__(self, input):
if input is None or input == "":
return "Empty input"
return input[::-1]

B. class ReverseAPI:
def __call__(self, input):
return input[::-1] if input != None else "Empty input"

C. class ReverseAPI:
def __call__(self, input):
if input == "":
return "Empty input"
else:
return input[::-1]

D. class ReverseAPI:
def __call__(self, input):
if input != "":
return input[::-1]
return "Empty input"

Solution

1. Step 1: Identify conditions for input validation

   We must check if input is None or empty string to handle empty input properly.

2. Step 2: Evaluate each option's condition

   class ReverseAPI: def __call__(self, input): if input is None or input == "": return "Empty input" return input[::-1] checks both None and empty string correctly before reversing input.

3. Final Answer:

   Checks both None and empty string before reversing -> Option A

4. Quick Check:

   Check None and empty string before processing [OK]

Hint: Check None and empty string explicitly [OK]

Common Mistakes:

• Only checking for empty string, missing None
• Using != None instead of is None
• Not handling empty input cases