Content-based filtering in ML Python - Model Pipeline Trace

Model Pipeline - Content-based filtering

Content-based filtering recommends items by learning what features a user likes from their past choices. It compares item features to suggest similar items.

Data Flow - 5 Stages

1Raw user-item interactions

1000 rows x 3 columns→Collect user IDs, item IDs, and user ratings→1000 rows x 3 columns

UserID=5, ItemID=23, Rating=4

↓

2Item feature extraction

500 items x 10 features→Extract features like genre, keywords, or attributes for each item→500 items x 10 features

ItemID=23, Features=[Action=1, Comedy=0, Drama=0, Length=120, ...]

↓

3User profile creation

User ratings + item features→Calculate weighted average of features from items user rated highly→1000 users x 10 features

UserID=5, Profile=[Action=0.8, Comedy=0.1, Drama=0.1, Length=110, ...]

↓

4Similarity calculation

User profile (1 x 10) and all item features (500 x 10)→Compute similarity scores between user profile and each item→500 similarity scores

UserID=5 similarity to ItemID=23 = 0.85

↓

5Recommendation generation

500 similarity scores→Sort items by similarity and select top N for recommendation→Top 10 recommended items

Recommended items for UserID=5: [23, 45, 12, 78, ...]

Training Trace - Epoch by Epoch

Loss
0.5 |****
0.4 |*** 
0.3 |**  
0.2 |*   
0.1 |    
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.45	0.6	Initial model starts with moderate loss and accuracy.
2	0.35	0.7	Loss decreases and accuracy improves as user profiles better match item features.
3	0.28	0.78	Model continues to learn user preferences effectively.
4	0.22	0.83	Loss decreases steadily, accuracy rises, showing good convergence.
5	0.18	0.87	Training converges with low loss and high accuracy.

Prediction Trace - 3 Layers

Layer 1: Input user profile

Layer 2: Calculate cosine similarity

Layer 3: Sort and select top items

Model Quiz - 3 Questions

What does the user profile represent in content-based filtering?

A A weighted average of features from items the user liked

B Random features from all items

C The user's demographic information

D The most popular items overall

Key Insight

Content-based filtering learns user preferences by analyzing features of items they liked. It then recommends new items with similar features, improving recommendations as it learns more about the user.

Practice

1. What is the main idea behind content-based filtering in recommendation systems?

easy

A. It recommends items based on what other users liked.

B. It recommends items similar to what the user liked before based on item features.

C. It randomly suggests items without any user data.

D. It recommends items based on the most popular items overall.

Solution

1. Step 1: Understand content-based filtering concept

   Content-based filtering uses the features of items a user liked to find similar items.

2. Step 2: Compare with other recommendation methods

   Unlike collaborative filtering, it does not rely on other users' preferences but on item features.

3. Final Answer:

   It recommends items similar to what the user liked before based on item features. -> Option B

4. Quick Check:

   Content-based filtering = Recommend similar items [OK]

Hint: Focus on item features and user history for content-based filtering [OK]

Common Mistakes:

• Confusing content-based with collaborative filtering
• Thinking recommendations are random
• Assuming popularity drives recommendations

2. Which of the following is the correct way to represent item features for content-based filtering in Python?

easy

A. item_features = [1, 2, 3, 4]

B. item_features = ['item1', 'item2', 'item3']

C. item_features = {'item1': 'popular', 'item2': 'new'}

D. item_features = {'item1': [0.2, 0.8], 'item2': [0.5, 0.5]}

Solution

1. Step 1: Identify correct data structure for features

   Features should be numeric vectors representing item properties, stored in a dictionary keyed by item IDs.

2. Step 2: Check each option

   item_features = {'item1': [0.2, 0.8], 'item2': [0.5, 0.5]} uses a dictionary with lists of numbers, suitable for feature vectors. Others are lists or strings, not suitable for numeric features.

3. Final Answer:

   item_features = {'item1': [0.2, 0.8], 'item2': [0.5, 0.5]} -> Option D

4. Quick Check:

   Features as numeric vectors = item_features = {'item1': [0.2, 0.8], 'item2': [0.5, 0.5]} [OK]

Hint: Use dictionaries with numeric lists for item features [OK]

Common Mistakes:

• Using strings instead of numeric vectors
• Using simple lists without keys
• Confusing item labels with features

3. Given the following Python code for content-based filtering, what will be the output?

import numpy as np

item_features = {'A': np.array([1, 0]), 'B': np.array([0, 1]), 'C': np.array([1, 1])}
user_likes = np.array([1, 0])
similarities = {item: np.dot(user_likes, features) for item, features in item_features.items()}
recommended = max(similarities, key=similarities.get)
print(recommended)

medium

A. B

B. C

C. A

D. Error

Solution

1. Step 1: Calculate dot products for similarity

   Dot product with user_likes [1,0]: - A: [1,0]·[1,0] = 1 - B: [1,0]·[0,1] = 0 - C: [1,0]·[1,1] = 1

2. Step 2: Find item with max similarity

   Items A and C both have similarity 1, but max() returns the first max key, which is 'A'.

3. Final Answer:

   A -> Option C

4. Quick Check:

   Max dot product = 'A' [OK]

Hint: Dot product similarity picks highest matching feature vector [OK]

Common Mistakes:

• Assuming 'C' is chosen because it has more features
• Confusing dot product with sum
• Expecting an error due to dictionary comprehension

4. Identify the error in this content-based filtering code snippet and select the fix:

item_features = {'X': [1, 0], 'Y': [0, 1]}
user_profile = [1, 0]
similarities = {}
for item in item_features:
    similarities[item] = user_profile * item_features[item]
print(similarities)

medium

A. Replace '*' with a dot product function like numpy.dot

B. Change user_profile and item_features values to strings

C. Use '+' instead of '*' to combine lists

D. No error, code runs fine

Solution

1. Step 1: Understand the operation on lists

   Multiplying two Python lists with '*' is invalid and causes a TypeError.

2. Step 2: Correct the operation to compute similarity

   Use numpy.dot or equivalent to compute dot product between vectors for similarity.

3. Final Answer:

   Replace '*' with a dot product function like numpy.dot -> Option A

4. Quick Check:

   List multiplication invalid, use dot product [OK]

Hint: Use dot product for vector similarity, not '*' on lists [OK]

Common Mistakes:

• Trying to multiply lists directly
• Using '+' which concatenates lists, not similarity
• Ignoring error messages

5. You want to recommend movies to a user using content-based filtering. The user liked movies with genres ['Action', 'Adventure']. You have a movie database with genre tags. Which approach best personalizes recommendations?

hard

A. Calculate similarity by counting overlapping genres between user liked movies and candidate movies.

B. Recommend the most popular movies regardless of genre.

C. Recommend movies liked by other users who watched 'Action' movies.

D. Randomly select movies from the database.

Solution

1. Step 1: Understand content-based filtering with genre tags

   Content-based filtering uses item features (genres) to find similar items to what the user liked.

2. Step 2: Choose method that compares genre overlap

   Counting overlapping genres directly measures similarity between user preferences and candidate movies.

3. Final Answer:

   Calculate similarity by counting overlapping genres between user liked movies and candidate movies. -> Option A

4. Quick Check:

   Genre overlap similarity = Calculate similarity by counting overlapping genres between user liked movies and candidate movies. [OK]

Hint: Match user liked genres with movie genres for recommendations [OK]

Common Mistakes:

• Using popularity instead of user preferences
• Confusing collaborative filtering with content-based
• Random recommendations ignoring user data