RecursiveCharacterTextSplitter in LangChain - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ component_behavior

intermediate

How does RecursiveCharacterTextSplitter split text?

Given a long string input, how does RecursiveCharacterTextSplitter split the text when the chunk size is smaller than the input length?

LangChain

from langchain.text_splitter import RecursiveCharacterTextSplitter

text = "This is a long text that needs to be split into smaller chunks for processing."
splitter = RecursiveCharacterTextSplitter(chunk_size=20, chunk_overlap=5)
chunks = splitter.split_text(text)
print(chunks)

A ["This is a long text ", "that needs to be split ", "into smaller chunks ", "for processing."]

B ["This is a long text that needs to be split into smaller chunks for processing."]

C ["This is a long text that needs", " to be split into smaller", " chunks for processing."]

D ["This is a long text that ", "needs to be split into ", "smaller chunks for ", "processing."]

💡 Hint

Think about how the splitter uses chunk size and overlap to create smaller pieces.

RecursiveCharacterTextSplitter splits the text into chunks of the specified size with overlap. It tries to split at natural boundaries recursively, resulting in chunks like option A.

📝 Syntax

intermediate

Identify the syntax error in RecursiveCharacterTextSplitter usage

Which option contains a syntax error when creating a RecursiveCharacterTextSplitter instance?

LangChain

from langchain.text_splitter import RecursiveCharacterTextSplitter

splitter = RecursiveCharacterTextSplitter(chunk_size=100 chunk_overlap=20)

A splitter = RecursiveCharacterTextSplitter(chunk_size=100,chunk_overlap=20)

B splitter = RecursiveCharacterTextSplitter(chunk_size=100, chunk_overlap=20)

C splitter = RecursiveCharacterTextSplitter(chunk_size=100, chunk_overlap = 20)

D splitter = RecursiveCharacterTextSplitter(chunk_size=100 chunk_overlap=20)

💡 Hint

Check the commas between arguments.

Option D is missing a comma between chunk_size and chunk_overlap arguments, causing a syntax error.

❓ state_output

advanced

What is the number of chunks produced?

Using RecursiveCharacterTextSplitter with chunk_size=10 and chunk_overlap=2, how many chunks will be produced from the text "Hello world! This is LangChain."?

LangChain

from langchain.text_splitter import RecursiveCharacterTextSplitter

text = "Hello world! This is LangChain."
splitter = RecursiveCharacterTextSplitter(chunk_size=10, chunk_overlap=2)
chunks = splitter.split_text(text)
print(len(chunks))

A 3

B 4

C 6

D 5

💡 Hint

Consider chunk size and overlap to count chunks.

The text length is 31 characters. With chunk size 10 and overlap 2, chunks start every 8 characters: positions 0,8,16,24. This results in 4 chunks.

🔧 Debug

advanced

Why does this RecursiveCharacterTextSplitter code raise an error?

What error does the following code raise and why? from langchain.text_splitter import RecursiveCharacterTextSplitter splitter = RecursiveCharacterTextSplitter(chunk_size=5, chunk_overlap=10) chunks = splitter.split_text("Short text")

A ValueError: chunk_overlap cannot be larger than chunk_size

B TypeError: split_text() missing 1 required positional argument

C IndexError: string index out of range

D No error, returns chunks normally

💡 Hint

Check the relationship between chunk_size and chunk_overlap.

chunk_overlap must be less than chunk_size. Here chunk_overlap=10 is larger than chunk_size=5, causing a ValueError.

🧠 Conceptual

expert

How does RecursiveCharacterTextSplitter decide split points?

Which best describes how RecursiveCharacterTextSplitter chooses where to split text into chunks?

A It splits text strictly every chunk_size characters without considering word boundaries.

B It splits text only at whitespace characters, ignoring chunk size.

C It recursively tries to split at preferred separators like newlines or spaces, falling back to smaller separators if needed, to respect chunk size.

D It splits text randomly to create chunks of varying sizes.

💡 Hint

Think about how the splitter tries to keep chunks readable and natural.

RecursiveCharacterTextSplitter tries to split text at natural boundaries like newlines or spaces recursively, ensuring chunks do not exceed chunk_size and overlap is respected.

Practice

1. What is the main purpose of the RecursiveCharacterTextSplitter in langchain?

easy

A. To split long text into smaller chunks using multiple separators while keeping context.

B. To merge multiple texts into one large string.

C. To translate text into different languages.

D. To encrypt text for secure storage.

Solution

1. Step 1: Understand the function of RecursiveCharacterTextSplitter

   This tool is designed to break down long text into smaller pieces using various separators like paragraphs, sentences, or characters.

2. Step 2: Recognize the benefit of overlapping chunks

   It keeps some overlap between chunks to maintain context, which helps language models understand the text better.

3. Final Answer:

   To split long text into smaller chunks using multiple separators while keeping context. -> Option A

4. Quick Check:

   Splitting text with context = A [OK]

Hint: Remember: It splits text into chunks with overlap [OK]

Common Mistakes:

• Thinking it merges text instead of splitting
• Confusing it with translation or encryption tools
• Ignoring the overlap feature

2. Which of the following is the correct way to create a RecursiveCharacterTextSplitter with a chunk size of 100 and chunk overlap of 20?

easy

A. RecursiveCharacterTextSplitter(chunkSize=100, chunkOverlap=20)

B. RecursiveCharacterTextSplitter(size=100, overlap=20)

C. RecursiveCharacterTextSplitter(chunk=100, overlap=20)

D. RecursiveCharacterTextSplitter(chunk_size=100, chunk_overlap=20)

Solution

1. Step 1: Recall the parameter names for RecursiveCharacterTextSplitter

   The correct parameters are chunk_size and chunk_overlap to set chunk length and overlap.

2. Step 2: Match the correct syntax

   RecursiveCharacterTextSplitter(chunk_size=100, chunk_overlap=20) uses the exact parameter names and values correctly.

3. Final Answer:

   RecursiveCharacterTextSplitter(chunk_size=100, chunk_overlap=20) -> Option D

4. Quick Check:

   Correct parameter names = D [OK]

Hint: Use exact parameter names: chunk_size and chunk_overlap [OK]

Common Mistakes:

• Using incorrect parameter names like size or chunkSize
• Mixing camelCase and snake_case
• Omitting required parameters

3. Given the following code snippet, what will be the length of the first chunk if the text is "Hello world! This is a test." and chunk_size=12, chunk_overlap=4?

splitter = RecursiveCharacterTextSplitter(chunk_size=12, chunk_overlap=4)
chunks = splitter.split_text("Hello world! This is a test.")
print(len(chunks[0]))

medium

A. 12

B. 16

C. 8

D. 20

Solution

1. Step 1: Understand chunk size and overlap effect

   The chunk size is 12, so each chunk will be at most 12 characters long. Overlap affects next chunks, not the first chunk length.

2. Step 2: Determine first chunk length

   The first chunk will be exactly 12 characters long, as it starts from the beginning and takes up to chunk_size.

3. Final Answer:

   12 -> Option A

4. Quick Check:

   First chunk length = chunk_size = 12 [OK]

Hint: First chunk length equals chunk_size, overlap affects next chunks [OK]

Common Mistakes:

• Adding overlap to first chunk length
• Assuming first chunk is shorter than chunk_size
• Confusing chunk size with total text length

4. What is the error in the following code snippet using RecursiveCharacterTextSplitter?

splitter = RecursiveCharacterTextSplitter(chunk_size=50, chunk_overlap=60)
chunks = splitter.split_text("Some long text here...")

medium

A. Missing import statement for RecursiveCharacterTextSplitter

B. split_text method does not exist

C. chunk_overlap cannot be larger than chunk_size

D. chunk_size must be a string, not an integer

Solution

1. Step 1: Check parameter constraints

   chunk_overlap must be less than or equal to chunk_size to avoid logical errors in splitting.

2. Step 2: Identify the error in given values

   chunk_overlap=60 is greater than chunk_size=50, which is invalid and will cause an error.

3. Final Answer:

   chunk_overlap cannot be larger than chunk_size -> Option C

4. Quick Check:

   Overlap ≤ chunk size rule = B [OK]

Hint: Overlap must never exceed chunk size [OK]

Common Mistakes:

• Ignoring parameter value relationships
• Assuming method names are incorrect without checking
• Confusing data types for parameters

5. You want to split a large document into chunks of 200 characters with 50 characters overlapping, prioritizing splitting first by paragraphs, then sentences, then words. Which setup of RecursiveCharacterTextSplitter correctly achieves this?

hard

A. RecursiveCharacterTextSplitter(chunk_size=200, chunk_overlap=50, separators=[" ", ". ", "\n\n"])

B. RecursiveCharacterTextSplitter(chunk_size=200, chunk_overlap=50, separators=["\n\n", ". ", " "])

C. RecursiveCharacterTextSplitter(chunk_size=200, chunk_overlap=50, separators=[". ", "\n\n", " "])

D. RecursiveCharacterTextSplitter(chunk_size=200, chunk_overlap=50, separators=[" ", "\n\n", ". "])

Solution

1. Step 1: Understand separator priority order

   The splitter tries separators in order; to prioritize paragraphs, then sentences, then words, the list must start with paragraph separator "\n\n", then sentence ". ", then space " ".

2. Step 2: Match the correct separators list

   RecursiveCharacterTextSplitter(chunk_size=200, chunk_overlap=50, separators=["\n\n", ". ", " "]) correctly lists separators in the desired priority order.

3. Final Answer:

   RecursiveCharacterTextSplitter(chunk_size=200, chunk_overlap=50, separators=["\n\n", ". ", " "]) -> Option B

4. Quick Check:

   Separator order matches priority = A [OK]

Hint: List separators from largest to smallest text unit [OK]

Common Mistakes:

• Reversing separator order
• Using wrong separator strings
• Ignoring overlap or chunk size settings