Memory retrieval strategies in Agentic AI - Model Pipeline Trace

Model Pipeline - Memory retrieval strategies

This pipeline shows how an AI system retrieves information from memory using different strategies. It starts with a query, processes it, searches memory, ranks results, and returns the best matches.

Data Flow - 6 Stages

1Input Query

1 query string→Receive user question or prompt→1 query string

"What is supervised learning?"

↓

2Query Preprocessing

1 query string→Clean and tokenize the query text→1 list of tokens

["what", "is", "supervised", "learning"]

↓

3Feature Extraction

1 list of tokens→Convert tokens to vector representation→1 vector of size 300

[0.12, -0.05, 0.33, ..., 0.07]

↓

4Memory Search

Memory database with 10,000 entries, each vector size 300→Compute similarity between query vector and memory vectors→Top 10 similar memory entries

Entries about 'supervised learning', 'machine learning basics', etc.

↓

5Ranking and Filtering

Top 10 similar memory entries→Rank entries by similarity score and filter irrelevant ones→Top 3 most relevant entries

Entries explaining supervised learning with examples

↓

6Output Generation

Top 3 relevant entries→Generate final answer or response→1 answer string

"Supervised learning is a type of machine learning where the model learns from labeled data..."

Training Trace - Epoch by Epoch

Epochs
1 |***************...............| 0.85
2 |********************..........| 0.65
3 |************************......| 0.50
4 |****************************..| 0.38
5 |*******************************| 0.30

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.85	0.4	Initial training with random weights, loss high, accuracy low
2	0.65	0.55	Model starts learning relevant features, loss decreases, accuracy improves
3	0.5	0.68	Better retrieval ranking, model distinguishes relevant memory entries
4	0.38	0.78	Loss continues to decrease steadily, accuracy improves significantly
5	0.3	0.85	Model converges well, retrieval results are accurate and relevant

Prediction Trace - 6 Layers

Layer 1: Input Query

Layer 2: Query Preprocessing

Layer 3: Feature Extraction

Layer 4: Memory Search

Layer 5: Ranking and Filtering

Layer 6: Output Generation

Model Quiz - 3 Questions

What is the main purpose of the 'Feature Extraction' stage?

A Rank memory entries by similarity

B Convert text tokens into numeric vectors

C Clean and split the query text

D Generate the final answer string

Key Insight

Memory retrieval strategies rely on converting queries into vectors and comparing them to stored memory vectors. Training improves the model's ability to find and rank relevant information, leading to better answers.

Practice

1. What is the main purpose of memory retrieval strategies in agentic AI?

easy

A. To find stored information quickly and accurately

B. To create new data from scratch

C. To delete old information permanently

D. To slow down the AI's response time

Solution

1. Step 1: Understand the role of memory retrieval

   Memory retrieval strategies are designed to help AI find information it has stored before.

2. Step 2: Identify the main goal

   The goal is to do this quickly and accurately so the AI can respond well.

3. Final Answer:

   To find stored information quickly and accurately -> Option A

4. Quick Check:

   Memory retrieval = find info fast [OK]

Hint: Memory retrieval means finding stored info fast [OK]

Common Mistakes:

• Confusing retrieval with data creation
• Thinking retrieval deletes data
• Assuming retrieval slows AI down

2. Which of the following is the correct way to check if a memory item matches a query in Python?

easy

A. if memory_item === query:

B. if memory_item = query:

C. if memory_item == query:

D. if memory_item != query:

Solution

1. Step 1: Recall Python comparison syntax

   In Python, '==' checks if two values are equal.

2. Step 2: Identify correct equality check

   '=' is assignment, '===' is not valid in Python, '!=' means not equal.

3. Final Answer:

   if memory_item == query: -> Option C

4. Quick Check:

   Equality check in Python = '==' [OK]

Hint: Use '==' to compare values in Python [OK]

Common Mistakes:

• Using '=' instead of '==' for comparison
• Using '===' which is JavaScript syntax
• Confusing '!=' with equality check

3. Given the code below, what will be the output?

memory = ['apple', 'banana', 'cherry']
query = 'banana'
result = None
for item in memory:
    if item == query:
        result = item
        break
print(result)

medium

A. None

B. Error

C. 'apple'

D. 'banana'

Solution

1. Step 1: Loop through memory list

   The loop checks each item: 'apple', then 'banana', then 'cherry'.

2. Step 2: Check for match and break

   When 'banana' matches the query, result is set to 'banana' and loop stops.

3. Final Answer:

   'banana' -> Option D

4. Quick Check:

   Loop finds 'banana' and stops [OK]

Hint: Loop breaks on first match, returns that item [OK]

Common Mistakes:

• Assuming result stays None
• Thinking loop continues after match
• Confusing output with first list item

4. What is wrong with this memory retrieval code snippet?

memory = []
query = 'orange'
for item in memory:
    if item == query:
        print('Found')
    else:
        print('Not found')

medium

A. It prints 'Not found' multiple times incorrectly

B. It never prints anything if memory is empty

C. It causes a syntax error due to missing colon

D. It crashes because query is not defined

Solution

1. Step 1: Analyze empty memory list

   The for loop does not run at all if memory is empty.

2. Step 2: Check output behavior

   Since loop never runs, no print happens, so no indication of 'Not found'.

3. Final Answer:

   It never prints anything if memory is empty -> Option B

4. Quick Check:

   Empty list means no loop runs [OK]

Hint: Empty memory means loop skips, no output printed [OK]

Common Mistakes:

• Thinking 'Not found' prints once automatically
• Assuming syntax error without checking code
• Believing query is undefined

5. You want to improve a memory retrieval function to return 'Not found' if no match exists, even when memory is empty. Which code change achieves this best?

def retrieve(memory, query):
    for item in memory:
        if item == query:
            return item
    # What to add here?

hard

A. return 'Not found' after the loop

B. print('Not found') inside the loop

C. return None inside the loop

D. raise Exception('Not found') inside the loop

Solution

1. Step 1: Understand loop behavior

   If no item matches, loop finishes without returning.

2. Step 2: Add return after loop

   Returning 'Not found' after loop ensures function always returns a value.

3. Final Answer:

   return 'Not found' after the loop -> Option A

4. Quick Check:

   Return after loop handles no matches [OK]

Hint: Return 'Not found' after loop to handle no matches [OK]

Common Mistakes:

• Putting return inside loop causing premature exit
• Using print instead of return
• Raising exception unnecessarily