Text chunking strategies in Prompt Engineering / GenAI - Interactive Code Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to split text into chunks of fixed size.

Prompt Engineering / GenAI

def chunk_text(text, size):
    return [text[i:i+[1]] for i in range(0, len(text), size)]

Drag options to blanks, or click blank then click option'

Alen

Btext

Csize

Di

Attempts:

3 left

💡 Hint

Common Mistakes

Using len instead of size causes incorrect slicing.

Using i instead of size results in wrong chunk lengths.

The chunk size is controlled by the 'size' parameter, so we slice text using size.

2fill in blank

medium

Complete the code to split text into chunks without breaking words.

Prompt Engineering / GenAI

def chunk_text_words(text, max_len):
    words = text.split()
    chunks = []
    current = ''
    for word in words:
        if len(current) + len(word) + 1 > [1]:
            chunks.append(current.strip())
            current = word + ' '
        else:
            current += word + ' '
    if current:
        chunks.append(current.strip())
    return chunks

Drag options to blanks, or click blank then click option'

Amax_len

Blen(word)

Clen(current)

Dtext

Attempts:

3 left

💡 Hint

Common Mistakes

Using len(current) instead of max_len causes wrong chunk size checks.

Comparing to len(word) alone does not limit chunk length.

We compare the length of the current chunk plus the next word to max_len to avoid breaking words.

3fill in blank

hard

Fix the error in the code to create overlapping text chunks.

Prompt Engineering / GenAI

def overlapping_chunks(text, size, overlap):
    chunks = []
    start = 0
    while start < len(text):
        end = start + size
        chunks.append(text[start:end])
        start += [1]
    return chunks

Drag options to blanks, or click blank then click option'

Asize

Bsize - overlap

Coverlap

Dsize + overlap

Attempts:

3 left

💡 Hint

Common Mistakes

Adding overlap to size causes gaps instead of overlaps.

Using overlap alone moves too little, causing repeated chunks.

To create overlapping chunks, we move the start by size minus overlap each time.

4fill in blank

hard

Fill both blanks to create a dictionary of chunk indices and their text.

Prompt Engineering / GenAI

def chunk_dict(text, chunk_size):
    return {i: text[i[1]i+[2]] for i in range(0, len(text), chunk_size)}

Drag options to blanks, or click blank then click option'

A*

B+

C-

D//

Attempts:

3 left

💡 Hint

Common Mistakes

Using '*' or '//' causes type errors in slicing.

Using '-' results in negative slice indices.

We use '+' to add chunk_size to i for slicing the chunk correctly.

5fill in blank

hard

Fill all three blanks to create a list of chunks with a minimum overlap.

Prompt Engineering / GenAI

def min_overlap_chunks(text, size, min_overlap):
    chunks = []
    i = 0
    while i < len(text):
        chunk = text[i:i+[1]]
        chunks.append(chunk)
        i += [2] if [3] < size else size
    return chunks

Drag options to blanks, or click blank then click option'

Asize

Bmin_overlap

Di

Attempts:

3 left

💡 Hint

Common Mistakes

Using i instead of size for chunk length causes wrong slices.

Not comparing min_overlap to size causes infinite loops.

We slice chunks of length size, then move i by min_overlap if it is less than size, else by size.

Practice

1. What is the main purpose of text chunking in AI models?

easy

A. To generate new text from scratch

B. To split long text into smaller, manageable pieces

C. To remove stop words from text

D. To translate text into different languages

Solution

1. Step 1: Understand the concept of text chunking

   Text chunking means breaking a long text into smaller parts so it is easier to handle.

2. Step 2: Identify the main goal in AI context

   This helps AI models process and understand large texts better by working on smaller pieces.

3. Final Answer:

   To split long text into smaller, manageable pieces -> Option B

4. Quick Check:

   Text chunking = splitting text [OK]

Hint: Chunking means breaking text into smaller parts [OK]

Common Mistakes:

• Confusing chunking with translation
• Thinking chunking removes words
• Believing chunking generates new text

2. Which of the following is a correct way to create overlapping text chunks in Python?

easy

A. chunks = [text[i:i+chunk_size] for i in range(0, len(text), overlap)]

B. chunks = [text[i:i+chunk_size] for i in range(0, len(text), chunk_size)]

C. chunks = [text[i:i+chunk_size] for i in range(0, len(text), chunk_size - overlap)]

D. chunks = [text[i:i+chunk_size] for i in range(overlap, len(text), chunk_size)]

Solution

1. Step 1: Understand overlapping chunk logic

   To create overlapping chunks, the step size must be smaller than chunk size by the overlap amount.

2. Step 2: Check the range step in options

   chunks = [text[i:i+chunk_size] for i in range(0, len(text), chunk_size - overlap)] uses chunk_size - overlap as step, correctly creating overlaps.

3. Final Answer:

   chunks = [text[i:i+chunk_size] for i in range(0, len(text), chunk_size - overlap)] -> Option C

4. Quick Check:

   Overlap step = chunk_size - overlap [OK]

Hint: Overlap step = chunk size minus overlap length [OK]

Common Mistakes:

• Using chunk_size as step (no overlap)
• Using overlap as step (too small steps)
• Starting range at overlap instead of zero

3. Given text = 'abcdefghij', chunk_size = 4, and overlap = 2, what is the output of this code?

chunks = [text[i:i+chunk_size] for i in range(0, len(text)-overlap, chunk_size - overlap)]
print(chunks)

medium

A. ['abcd', 'cdef', 'efgh', 'ghij']

B. ['abcd', 'efgh', 'ij']

C. ['abcd', 'bcde', 'cdef', 'defg']

D. ['abcd', 'bcdf', 'cdeg', 'defh']

Solution

1. Step 1: Calculate step size

   Step = chunk_size - overlap = 4 - 2 = 2.

2. Step 2: Generate chunks using step 2

   Chunks are:
   i=0: text[0:4] = 'abcd'
   i=2: text[2:6] = 'cdef'
   i=4: text[4:8] = 'efgh'
   i=6: text[6:10] = 'ghij'

3. Final Answer:

   ['abcd', 'cdef', 'efgh', 'ghij'] -> Option A

4. Quick Check:

   Chunks overlap by 2 chars = ['abcd', 'cdef', 'efgh', 'ghij'] [OK]

Hint: Step = chunk size minus overlap; slice text accordingly [OK]

Common Mistakes:

• Ignoring overlap and stepping by chunk size
• Wrong slicing indices
• Confusing overlap with chunk size

4. This code aims to chunk text with overlap but has a bug:

chunk_size = 5
overlap = 2
chunks = []
for i in range(0, len(text), chunk_size + overlap):
    chunks.append(text[i:i+chunk_size])
print(chunks)

What is the error?

medium

A. Step size should be chunk_size - overlap, not chunk_size + overlap

B. Chunk size should be increased by overlap

C. Overlap should be zero for chunking

D. The loop should start at overlap, not zero

Solution

1. Step 1: Understand step size for overlapping chunks

   To create overlap, step size must be less than chunk size by overlap amount.

2. Step 2: Identify incorrect step in code

   Code uses chunk_size + overlap which skips overlap, causing gaps.

3. Final Answer:

   Step size should be chunk_size - overlap, not chunk_size + overlap -> Option A

4. Quick Check:

   Overlap step = chunk_size - overlap [OK]

Hint: Overlap step = chunk size minus overlap, not plus [OK]

Common Mistakes:

• Adding overlap instead of subtracting
• Setting overlap to zero incorrectly
• Changing loop start index wrongly

5. You have a very long document and want to chunk it for an AI model. You want each chunk to have 100 words and overlap by 20 words to keep context. Which strategy balances chunk size and context best?

hard

A. Use chunk size 80 and step size 100 to create non-overlapping chunks

B. Use chunk size 100 and step size 100 to create overlapping chunks

C. Use chunk size 120 and step size 100 to create overlapping chunks

D. Use chunk size 100 and step size 80 (100 - 20) to create overlapping chunks

Solution

1. Step 1: Define chunk and step sizes for overlap

   Chunk size is 100 words, overlap is 20 words, so step size = 100 - 20 = 80.

2. Step 2: Choose correct step size to maintain overlap

   Step size 80 means each chunk starts 80 words after previous, overlapping 20 words.

3. Final Answer:

   Use chunk size 100 and step size 80 (100 - 20) to create overlapping chunks -> Option D

4. Quick Check:

   Step = chunk size - overlap = 80 [OK]

Hint: Step size = chunk size minus overlap for best context [OK]

Common Mistakes:

• Using step size larger than chunk size
• Setting overlap to zero accidentally
• Confusing chunk size with step size