Semantic chunking strategies in LangChain - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Understanding Semantic Chunking Purpose

What is the main advantage of using semantic chunking in LangChain when processing large documents?

A It compresses text chunks to reduce storage space.

B It groups text based on meaning, preserving context for better retrieval.

C It splits text into fixed-size chunks regardless of meaning, improving speed.

D It translates text chunks into multiple languages automatically.

💡 Hint

Think about why preserving meaning matters when splitting text.

Semantic chunking groups text by meaning, which helps maintain context and improves the quality of information retrieval in LangChain.

❓ component_behavior

intermediate

Behavior of RecursiveCharacterTextSplitter

Given the RecursiveCharacterTextSplitter in LangChain, what happens when it encounters a large text with nested sections?

LangChain

from langchain.text_splitter import RecursiveCharacterTextSplitter

text = '''Section 1\nThis is some text.\n\nSection 2\nMore detailed text here.\n\nSection 3\nFinal notes.''' 
splitter = RecursiveCharacterTextSplitter(chunk_size=50, chunk_overlap=10)
chunks = splitter.split_text(text)
print(len(chunks))

A It splits text recursively by separators like newlines and spaces, producing meaningful chunks under 50 characters.

B It splits the text into chunks of exactly 50 characters each, ignoring sections.

C It returns the entire text as one chunk because chunk_size is too large.

D It raises a TypeError because chunk_overlap cannot be set.

💡 Hint

Consider how recursive splitting works with separators.

RecursiveCharacterTextSplitter splits text by trying larger separators first (like paragraphs), then smaller ones (like newlines), ensuring chunks respect chunk_size and overlap.

📝 Syntax

advanced

Correct Usage of CharacterTextSplitter Parameters

Which option correctly initializes a CharacterTextSplitter to create chunks of 100 characters with 20 characters overlap and splits on spaces?

A CharacterTextSplitter(chunk_size=100, chunk_overlap=20, separator=' ')

B CharacterTextSplitter(chunk_size=100, chunk_overlap=20, separator='\n')

C CharacterTextSplitter(chunk_size=100, chunk_overlap=20, separator=None)

D CharacterTextSplitter(chunk_size=100, chunk_overlap=20, separator='')

💡 Hint

Check which separator splits on spaces.

Using separator=' ' splits text on spaces, which is correct for word-based chunking with specified chunk size and overlap.

🔧 Debug

advanced

Identifying Error in Custom Chunking Function

What error will this custom chunking function raise when used in LangChain, and why? ```python def custom_chunker(text): chunks = [] for i in range(0, len(text), 50): chunks.append(text[i:i+50]) return chunks splitter = RecursiveCharacterTextSplitter(chunk_size=50, chunk_overlap=10) splitter.split_text = custom_chunker chunks = splitter.split_text('Hello world! This is a test of custom chunking.') print(len(chunks)) ```

A ValueError because chunk_overlap is not handled in custom_chunker.

B AttributeError because split_text cannot be reassigned.

C No error; prints the number of chunks correctly.

D TypeError because split_text expects a method with different signature.

💡 Hint

Consider what split_text method signature is and if custom_chunker matches it.

split_text is an instance method (def split_text(self, text)), but custom_chunker takes only text. Calling splitter.split_text(text) passes self, causing TypeError: custom_chunker takes 1 argument but 2 given.

❓ state_output

expert

Output of Chunking with Overlap in LangChain

What is the output list of chunks when splitting the text 'abcdefghij' with chunk_size=4 and chunk_overlap=2 using CharacterTextSplitter with separator=None?

LangChain

from langchain.text_splitter import CharacterTextSplitter

text = 'abcdefghij'
splitter = CharacterTextSplitter(chunk_size=4, chunk_overlap=2, separator=None)
chunks = splitter.split_text(text)
print(chunks)

A ['abcd', 'cdef', 'efgh', 'fghi', 'ghij']

B ['abcd', 'bcde', 'cdef', 'defg', 'efgh', 'fghi', 'ghij']

C ['abcd', 'cdef', 'efgh', 'ghij']

D ['abcd', 'bcde', 'cdef', 'efgh', 'ghij']

💡 Hint

Remember overlap means the next chunk starts chunk_size - chunk_overlap characters after the previous chunk start.

With chunk_size=4 and chunk_overlap=2, chunks start every 2 characters: 'abcd', 'cdef', 'efgh', 'ghij'.

Practice

1. What is the main purpose of semantic chunking in langchain?

easy

A. To compress text into shorter summaries

B. To split text into meaningful parts for better understanding by language models

C. To randomly divide text into equal parts without context

D. To translate text into different languages automatically

Solution

1. Step 1: Understand semantic chunking

   Semantic chunking means dividing text into parts that keep meaning intact for better processing.

2. Step 2: Identify the purpose in langchain

   Langchain uses semantic chunking to help language models understand text better by keeping related content together.

3. Final Answer:

   To split text into meaningful parts for better understanding by language models -> Option B

4. Quick Check:

   Semantic chunking = meaningful text parts [OK]

Hint: Semantic chunking means meaningful text parts, not random splits [OK]

Common Mistakes:

• Thinking chunking is random splitting
• Confusing chunking with summarization
• Assuming chunking translates text

2. Which of the following is the correct way to set chunk size and overlap in langchain's semantic chunking?

easy

A. chunk_size=500, chunk_overlap=50

B. chunk_size='large', chunk_overlap='small'

C. chunk_size=0, chunk_overlap=1000

D. chunk_size=-100, chunk_overlap=-10

Solution

1. Step 1: Check valid chunk size and overlap values

   Chunk size and overlap should be positive integers representing text length in characters or tokens.

2. Step 2: Evaluate each option

   chunk_size=500, chunk_overlap=50 uses positive integers (500 and 50), which is valid. Options B uses strings, C and D use zero or negative numbers which are invalid.

3. Final Answer:

   chunk_size=500, chunk_overlap=50 -> Option A

4. Quick Check:

   Valid chunk size and overlap are positive numbers [OK]

Hint: Use positive integers for chunk size and overlap [OK]

Common Mistakes:

• Using strings instead of numbers
• Setting zero or negative values
• Confusing chunk size with overlap

3. Given this code snippet using langchain's semantic chunking:

text = "Hello world. This is a test. Langchain helps chunk text."
chunks = chunk_text(text, chunk_size=12, chunk_overlap=4)
print(chunks)

What is the expected output?

medium

A. SyntaxError due to invalid chunking parameters

B. ["Hello world. This", "This is a test.", "Langchain helps chunk text."]

C. ["Hello", "world.", "This", "is", "a", "test."]

D. ["Hello world.", "world. This is", "This is a test.", "a test. Langchain", "Langchain helps", "helps chunk text."]

Solution

1. Step 1: Understand chunk size and overlap effect

   Chunk size 12 means each chunk has up to 12 characters; overlap 4 means next chunk starts 4 characters before previous chunk ends.

2. Step 2: Trace chunk creation on text

   Chunks will overlap by 4 characters, producing overlapping meaningful parts like "Hello world.", "world. This is", etc.

3. Final Answer:

   ["Hello world.", "world. This is", "This is a test.", "a test. Langchain", "Langchain helps", "helps chunk text."] -> Option D

4. Quick Check:

   Chunk size 12 + overlap 4 = overlapping meaningful chunks [OK]

Hint: Overlap means next chunk starts before previous ends [OK]

Common Mistakes:

• Ignoring overlap and making chunks non-overlapping
• Splitting by words instead of characters
• Assuming syntax error without checking parameters

4. You wrote this code for semantic chunking but get an error:

chunks = chunk_text(text, chunk_size=100, chunk_overlap=150)

What is the likely cause of the error?

medium

A. chunk_overlap is larger than chunk_size, causing invalid overlap

B. chunk_size is too large for the text length

C. Missing import statement for chunk_text function

D. chunk_size and chunk_overlap must be strings, not integers

Solution

1. Step 1: Check relationship between chunk_size and chunk_overlap

   Overlap cannot be larger than chunk size because overlap defines how much chunks share content.

2. Step 2: Identify error cause

   chunk_overlap=150 is greater than chunk_size=100, which is invalid and causes error.

3. Final Answer:

   chunk_overlap is larger than chunk_size, causing invalid overlap -> Option A

4. Quick Check:

   Overlap must be ≤ chunk size [OK]

Hint: Overlap cannot exceed chunk size [OK]

Common Mistakes:

• Setting overlap larger than chunk size
• Assuming large chunk size causes error
• Confusing data types for parameters

5. You want to chunk a long document so that each chunk ends at a sentence boundary and overlaps by one sentence to keep context. Which semantic chunking strategy in langchain best fits this need?

hard

A. Use chunking with chunk_size smaller than sentence length

B. Use fixed-size chunking with chunk_size=1000 and chunk_overlap=0

C. Use a separator-based chunking with '\n\n' as separator and chunk_overlap set to one sentence

D. Use random chunking ignoring sentence boundaries

Solution

1. Step 1: Understand requirement for sentence boundary chunking

   To keep chunks ending at sentence boundaries, use a separator that matches sentence breaks like double newlines.

2. Step 2: Choose chunking strategy with overlap

   Separator-based chunking with overlap of one sentence keeps context by repeating last sentence in next chunk.

3. Final Answer:

   Use a separator-based chunking with '\n\n' as separator and chunk_overlap set to one sentence -> Option C

4. Quick Check:

   Separator chunking + overlap = sentence boundary chunks [OK]

Hint: Use separators matching sentences plus overlap for context [OK]

Common Mistakes:

• Using fixed-size chunking ignoring sentence ends
• Setting zero overlap losing context
• Choosing chunk size smaller than sentence length