Content-based filtering in ML Python

Introduction

Content-based filtering helps recommend items by looking at what you like. It finds similar things based on item features.

When you want to suggest movies similar to ones a user has watched.

When recommending books based on the genres a user prefers.

When suggesting songs that match the style of a user's favorite tracks.

When an online store wants to show products similar to what a customer viewed.

When a news app wants to recommend articles related to what a reader has read.

Syntax

ML Python

1. Collect features of items (like genre, keywords).
2. Represent items as vectors using these features.
3. For a user, find items similar to those they liked by comparing vectors.
4. Recommend the most similar items.

Features can be simple tags or complex descriptions.

Similarity is often measured using cosine similarity or distance metrics.

Examples

We compare items by counting common keywords to find similarity.

ML Python

# Example: Item features as keywords
item1 = ['action', 'adventure']
item2 = ['action', 'thriller']
# Compare similarity based on shared keywords

Text descriptions are converted into number vectors to compare items.

ML Python

# Example: Using TF-IDF vectors for item descriptions
from sklearn.feature_extraction.text import TfidfVectorizer
items = ['fast car racing', 'slow romantic movie']
vectorizer = TfidfVectorizer()
vectors = vectorizer.fit_transform(items)

Sample Model

This program shows how to recommend items similar to one the user liked using content-based filtering. It uses text descriptions and cosine similarity.

ML Python

from sklearn.feature_extraction.text import TfidfVectorizer
from sklearn.metrics.pairwise import cosine_similarity

# Sample items with descriptions
items = [
    'action adventure hero',
    'romantic comedy love',
    'action thriller spy',
    'romantic drama relationship'
]

# User liked item index 0 (action adventure hero)
user_liked_index = 0

# Convert item descriptions to vectors
vectorizer = TfidfVectorizer()
vectors = vectorizer.fit_transform(items)

# Calculate similarity of all items to the liked item
similarities = cosine_similarity(vectors[user_liked_index], vectors).flatten()

# Get indices of items sorted by similarity (excluding the liked item itself)
recommended_indices = similarities.argsort()[::-1][1:3]

# Print recommended items
print('User liked:', items[user_liked_index])
print('Recommended items:')
for i in recommended_indices:
    print(f'- {items[i]} (similarity: {similarities[i]:.2f})')

Important Notes

Content-based filtering only needs data about items, not other users.

It works well when item features are clear and descriptive.

It may recommend items similar to what the user already knows, limiting diversity.

Summary

Content-based filtering recommends items by comparing their features.

It uses item descriptions or tags to find similar items.

This method personalizes recommendations based on what the user liked before.

Practice

1. What is the main idea behind content-based filtering in recommendation systems?

easy

A. It recommends items based on what other users liked.

B. It recommends items similar to what the user liked before based on item features.

C. It randomly suggests items without any user data.

D. It recommends items based on the most popular items overall.

Solution

1. Step 1: Understand content-based filtering concept

   Content-based filtering uses the features of items a user liked to find similar items.

2. Step 2: Compare with other recommendation methods

   Unlike collaborative filtering, it does not rely on other users' preferences but on item features.

3. Final Answer:

   It recommends items similar to what the user liked before based on item features. -> Option B

4. Quick Check:

   Content-based filtering = Recommend similar items [OK]

Hint: Focus on item features and user history for content-based filtering [OK]

Common Mistakes:

• Confusing content-based with collaborative filtering
• Thinking recommendations are random
• Assuming popularity drives recommendations

2. Which of the following is the correct way to represent item features for content-based filtering in Python?

easy

A. item_features = [1, 2, 3, 4]

B. item_features = ['item1', 'item2', 'item3']

C. item_features = {'item1': 'popular', 'item2': 'new'}

D. item_features = {'item1': [0.2, 0.8], 'item2': [0.5, 0.5]}

Solution

1. Step 1: Identify correct data structure for features

   Features should be numeric vectors representing item properties, stored in a dictionary keyed by item IDs.

2. Step 2: Check each option

   item_features = {'item1': [0.2, 0.8], 'item2': [0.5, 0.5]} uses a dictionary with lists of numbers, suitable for feature vectors. Others are lists or strings, not suitable for numeric features.

3. Final Answer:

   item_features = {'item1': [0.2, 0.8], 'item2': [0.5, 0.5]} -> Option D

4. Quick Check:

   Features as numeric vectors = item_features = {'item1': [0.2, 0.8], 'item2': [0.5, 0.5]} [OK]

Hint: Use dictionaries with numeric lists for item features [OK]

Common Mistakes:

• Using strings instead of numeric vectors
• Using simple lists without keys
• Confusing item labels with features

3. Given the following Python code for content-based filtering, what will be the output?

import numpy as np

item_features = {'A': np.array([1, 0]), 'B': np.array([0, 1]), 'C': np.array([1, 1])}
user_likes = np.array([1, 0])
similarities = {item: np.dot(user_likes, features) for item, features in item_features.items()}
recommended = max(similarities, key=similarities.get)
print(recommended)

medium

A. B

B. C

C. A

D. Error

Solution

1. Step 1: Calculate dot products for similarity

   Dot product with user_likes [1,0]: - A: [1,0]·[1,0] = 1 - B: [1,0]·[0,1] = 0 - C: [1,0]·[1,1] = 1

2. Step 2: Find item with max similarity

   Items A and C both have similarity 1, but max() returns the first max key, which is 'A'.

3. Final Answer:

   A -> Option C

4. Quick Check:

   Max dot product = 'A' [OK]

Hint: Dot product similarity picks highest matching feature vector [OK]

Common Mistakes:

• Assuming 'C' is chosen because it has more features
• Confusing dot product with sum
• Expecting an error due to dictionary comprehension

4. Identify the error in this content-based filtering code snippet and select the fix:

item_features = {'X': [1, 0], 'Y': [0, 1]}
user_profile = [1, 0]
similarities = {}
for item in item_features:
    similarities[item] = user_profile * item_features[item]
print(similarities)

medium

A. Replace '*' with a dot product function like numpy.dot

B. Change user_profile and item_features values to strings

C. Use '+' instead of '*' to combine lists

D. No error, code runs fine

Solution

1. Step 1: Understand the operation on lists

   Multiplying two Python lists with '*' is invalid and causes a TypeError.

2. Step 2: Correct the operation to compute similarity

   Use numpy.dot or equivalent to compute dot product between vectors for similarity.

3. Final Answer:

   Replace '*' with a dot product function like numpy.dot -> Option A

4. Quick Check:

   List multiplication invalid, use dot product [OK]

Hint: Use dot product for vector similarity, not '*' on lists [OK]

Common Mistakes:

• Trying to multiply lists directly
• Using '+' which concatenates lists, not similarity
• Ignoring error messages

5. You want to recommend movies to a user using content-based filtering. The user liked movies with genres ['Action', 'Adventure']. You have a movie database with genre tags. Which approach best personalizes recommendations?

hard

A. Calculate similarity by counting overlapping genres between user liked movies and candidate movies.

B. Recommend the most popular movies regardless of genre.

C. Recommend movies liked by other users who watched 'Action' movies.

D. Randomly select movies from the database.

Solution

1. Step 1: Understand content-based filtering with genre tags

   Content-based filtering uses item features (genres) to find similar items to what the user liked.

2. Step 2: Choose method that compares genre overlap

   Counting overlapping genres directly measures similarity between user preferences and candidate movies.

3. Final Answer:

   Calculate similarity by counting overlapping genres between user liked movies and candidate movies. -> Option A

4. Quick Check:

   Genre overlap similarity = Calculate similarity by counting overlapping genres between user liked movies and candidate movies. [OK]

Hint: Match user liked genres with movie genres for recommendations [OK]

Common Mistakes:

• Using popularity instead of user preferences
• Confusing collaborative filtering with content-based
• Random recommendations ignoring user data