LDA with Gensim in NLP - Interactive Code Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to create a dictionary from tokenized documents.

NLP

from gensim.corpora import Dictionary

docs = [['apple', 'banana', 'apple'], ['banana', 'orange']]
dictionary = Dictionary([1])

Drag options to blanks, or click blank then click option'

A['apple', 'orange']

B['apple', 'banana']

C['banana', 'orange']

Ddocs

Attempts:

3 left

💡 Hint

Common Mistakes

Passing a single list of words instead of a list of tokenized documents.

Passing a string instead of a list.

The Dictionary class expects a list of tokenized documents to create the mapping of word IDs.

2fill in blank

medium

Complete the code to convert documents into a bag-of-words corpus using the dictionary.

NLP

corpus = [[1] for doc in docs]

Drag options to blanks, or click blank then click option'

Adictionary.doc2bow(docs)

Bdictionary.doc2bow('doc')

Cdictionary.doc2bow(doc)

Ddictionary.doc2bow(['doc'])

Attempts:

3 left

💡 Hint

Common Mistakes

Passing the whole list of documents instead of a single document.

Passing a string instead of a list of tokens.

The doc2bow method converts a tokenized document into a bag-of-words format using the dictionary.

3fill in blank

hard

Fix the error in the code to create an LDA model with 2 topics.

NLP

from gensim.models import LdaModel

lda = LdaModel(corpus=corpus, id2word=[1], num_topics=2, random_state=42)

Drag options to blanks, or click blank then click option'

Adictionary

Bcorpus

Cdocs

DLdaModel

Attempts:

3 left

💡 Hint

Common Mistakes

Passing the corpus instead of the dictionary.

Passing the list of documents instead of the dictionary.

The id2word parameter expects the dictionary object that maps word IDs to words.

4fill in blank

hard

Fill both blanks to print the top 3 words for each topic in the LDA model.

NLP

for i in range([1]):
    print(f"Topic {i}:", lda.show_topic(i, topn=[2]))

Drag options to blanks, or click blank then click option'

A2

B3

C5

D10

Attempts:

3 left

💡 Hint

Common Mistakes

Using the wrong number of topics in the range.

Requesting more or fewer top words than needed.

We created 2 topics, so the range should be 2. We want the top 3 words, so topn=3.

5fill in blank

hard

Fill all three blanks to get the topic distribution for the first document and print the dominant topic index.

NLP

doc_bow = corpus[0]
topic_dist = lda.get_document_topics([1])
dominant_topic = max(topic_dist, key=lambda x: x[[2]])[[3]]
print(f"Dominant topic index: {dominant_topic}")

Drag options to blanks, or click blank then click option'

Adoc_bow

B1

C0

Dcorpus

Attempts:

3 left

💡 Hint

Common Mistakes

Passing the whole corpus instead of a single document.

Mixing up the tuple indices for topic id and probability.

We pass the bag-of-words of the first document to get_document_topics. The topic distribution is a list of (topic_id, probability) tuples. To find the dominant topic, we use max with a key on the probability (index 1) and then get the topic id (index 0).

Practice

1. What is the main purpose of using LDA (Latent Dirichlet Allocation) with Gensim in NLP?

easy

A. To find hidden topics in a collection of documents

B. To translate text from one language to another

C. To count the frequency of words in a document

D. To generate new sentences based on input text

Solution

1. Step 1: Understand LDA's goal

   LDA is a topic modeling technique used to discover hidden topics in text data.

2. Step 2: Match with Gensim usage

   Gensim's LDA implementation helps find these hidden topics from document collections.

3. Final Answer:

   To find hidden topics in a collection of documents -> Option A

4. Quick Check:

   LDA purpose = find hidden topics [OK]

Hint: LDA = discover hidden themes in text collections [OK]

Common Mistakes:

• Confusing LDA with translation or text generation
• Thinking LDA counts word frequency only
• Assuming LDA summarizes text instead of finding topics

2. Which of the following is the correct way to create a Gensim dictionary from tokenized documents stored in texts?

easy

A. dictionary = gensim.make_dictionary(texts)

B. dictionary = gensim.Dictionary(texts)

C. dictionary = gensim.corpora.Dictionary(texts)

D. dictionary = gensim.create_dictionary(texts)

Solution

1. Step 1: Recall Gensim dictionary creation syntax

   The correct method is gensim.corpora.Dictionary() which takes tokenized texts.

2. Step 2: Check options for exact match

   Only dictionary = gensim.corpora.Dictionary(texts) uses the full correct syntax with gensim.corpora.Dictionary.

3. Final Answer:

   dictionary = gensim.corpora.Dictionary(texts) -> Option C

4. Quick Check:

   Correct dictionary syntax = dictionary = gensim.corpora.Dictionary(texts) [OK]

Hint: Use gensim.corpora.Dictionary for token lists [OK]

Common Mistakes:

• Omitting 'corpora' module in gensim
• Using non-existent functions like make_dictionary
• Confusing dictionary creation with corpus creation

3. Given the code snippet below, what will be the output of print(ldamodel.print_topics(num_topics=2))?

import gensim
from gensim import corpora
texts = [['apple', 'banana', 'apple'], ['banana', 'orange'], ['apple', 'orange', 'banana']]
dictionary = corpora.Dictionary(texts)
corpus = [dictionary.doc2bow(text) for text in texts]
ldamodel = gensim.models.LdaModel(corpus, num_topics=2, id2word=dictionary, passes=10, random_state=42)
print(ldamodel.print_topics(num_topics=2))

medium

A. Empty list because no topics were found

B. [('0', '0.5*"apple" + 0.3*"banana" + 0.2*"orange"'), ('1', '0.6*"banana" + 0.4*"orange"')]

C. SyntaxError due to missing import of LdaModel

D. A list of tuples showing topic IDs and top words with weights

Solution

1. Step 1: Understand print_topics output

   print_topics returns a list of tuples with topic IDs and top words with weights as strings.

2. Step 2: Analyze code correctness

   Code imports gensim and corpora correctly, creates dictionary and corpus, trains LDA model, so output is topic list, not error or empty.

3. Final Answer:

   A list of tuples showing topic IDs and top words with weights -> Option D

4. Quick Check:

   print_topics output = topic list [OK]

Hint: print_topics returns topic-word lists, not exact strings [OK]

Common Mistakes:

• Expecting exact word weights as fixed numbers
• Assuming missing import causes error (gensim.models is imported)
• Thinking no topics found means empty list

4. You run the following code but get an error: AttributeError: 'LdaModel' object has no attribute 'show_topics'. What is the likely cause?

ldamodel = gensim.models.LdaModel(corpus, num_topics=3, id2word=dictionary)
print(ldamodel.show_topics())

medium

A. The dictionary was not created properly

B. Using an outdated Gensim version where show_topics is not available

C. The corpus variable is empty or None

D. Missing the 'passes' parameter in LdaModel initialization

Solution

1. Step 1: Identify error meaning

   AttributeError means the method show_topics does not exist on the LdaModel object.

2. Step 2: Check common causes

   Older Gensim versions did not have show_topics method; newer versions do. Missing passes or empty corpus cause different errors.

3. Final Answer:

   Using an outdated Gensim version where show_topics is not available -> Option B

4. Quick Check:

   AttributeError on show_topics = outdated Gensim [OK]

Hint: Check Gensim version if method not found error occurs [OK]

Common Mistakes:

• Assuming missing passes causes AttributeError
• Thinking empty corpus causes this error
• Blaming dictionary creation for method missing

5. You want to improve your LDA model's topic quality using Gensim. Which combination of actions is best?

1. Increase the number of passes during training
2. Remove very common words (stopwords) before training
3. Use a very large number of topics (e.g., 100) regardless of data size
4. Filter out words that appear in too few or too many documents

hard

A. Apply steps 1, 2, and 4 to improve model quality

B. Only increase passes (step 1) is enough for better topics

C. Use a very large number of topics (step 3) for best results

D. Remove stopwords (step 2) and increase topics (step 3) only

Solution

1. Step 1: Understand passes effect

   More passes let the model learn better from data, improving topic quality.

2. Step 2: Understand preprocessing impact

   Removing stopwords and filtering rare/common words reduces noise and improves topics.

3. Step 3: Avoid too many topics

   Using too many topics without enough data causes poor, fragmented topics.

4. Final Answer:

   Apply steps 1, 2, and 4 to improve model quality -> Option A

5. Quick Check:

   Good LDA = passes + clean data + filter words [OK]

Hint: More passes + clean data + filter words = better topics [OK]

Common Mistakes:

• Thinking more topics always improves quality
• Ignoring data cleaning steps
• Believing passes alone fix poor topics