Loading web pages with WebBaseLoader in LangChain - Interactive Code Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to import the WebBaseLoader class from langchain.document_loaders.

LangChain

from langchain.document_loaders import [1]

Drag options to blanks, or click blank then click option'

AWebBaseLoader

BWebLoader

CBaseLoader

DWebPageLoader

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'WebLoader' or 'WebPageLoader' which do not exist.

Importing from the wrong module.

The class to load web pages in LangChain is WebBaseLoader. Importing it correctly allows you to use it to fetch web content.

2fill in blank

medium

Complete the code to create a WebBaseLoader instance for the URL 'https://example.com'.

LangChain

loader = WebBaseLoader([1])

Drag options to blanks, or click blank then click option'

A'example.com'

B'http://example.com'

C'https://example.com'

Dhttps://example.com

Attempts:

3 left

💡 Hint

Common Mistakes

Omitting quotes around the URL.

Using 'http://' instead of 'https://'.

The URL must be a string including the scheme 'https://'. So the correct argument is 'https://example.com'.

3fill in blank

hard

Fix the error in the code to load documents from the loader.

LangChain

docs = loader.[1]()

Drag options to blanks, or click blank then click option'

Aget_docs

Bload

Cfetch

Dload_data

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'load_data' or 'fetch' which are not valid methods.

Trying to access a property instead of calling a method.

The correct method to load documents from a WebBaseLoader instance is load(). Other method names do not exist and cause errors.

4fill in blank

hard

Fill both blanks to create a WebBaseLoader for 'https://openai.com' and load documents.

LangChain

loader = [1]([2])
docs = loader.load()

Drag options to blanks, or click blank then click option'

AWebBaseLoader

B'https://openai.com'

C'openai.com'

DWebLoader

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'WebLoader' which does not exist.

Passing URL without 'https://'.

You must use the class WebBaseLoader and pass the full URL string including 'https://'.

5fill in blank

hard

Fill all three blanks to import WebBaseLoader, create a loader for 'https://docs.python.org', and load documents.

LangChain

from langchain.document_loaders import [1]
loader = [2]([3])
docs = loader.load()

Drag options to blanks, or click blank then click option'

AWebBaseLoader

B'https://docs.python.org'

D'docs.python.org'

Attempts:

3 left

💡 Hint

Common Mistakes

Using URL without 'https://'.

Importing or instantiating wrong class names.

First, import WebBaseLoader. Then create an instance with the full URL string including 'https://'. Finally, call load() to get documents.

Practice

1. What is the main purpose of WebBaseLoader in Langchain?

easy

A. To scrape images from websites

B. To create web pages dynamically in Python

C. To load and extract text content from web pages using a URL

D. To save web pages as PDF files

Solution

1. Step 1: Understand WebBaseLoader's role

   WebBaseLoader is designed to fetch and extract text from web pages given their URLs.

2. Step 2: Compare options with this role

   Only To load and extract text content from web pages using a URL describes loading and extracting text from web pages, which matches WebBaseLoader's purpose.

3. Final Answer:

   To load and extract text content from web pages using a URL -> Option C

4. Quick Check:

   WebBaseLoader loads web page text = D [OK]

Hint: Remember: WebBaseLoader fetches text from URLs only [OK]

Common Mistakes:

• Thinking it creates or edits web pages
• Confusing it with image or file download tools
• Assuming it saves content instead of loading

2. Which of the following is the correct way to create a WebBaseLoader instance for the URL "https://example.com"?

easy

A. loader = WebBaseLoader.create("https://example.com")

B. loader = WebBaseLoader(url="https://example.com")

C. loader = WebBaseLoader.load("https://example.com")

D. loader = WebBaseLoader("https://example.com")

Solution

1. Step 1: Recall WebBaseLoader constructor usage

   WebBaseLoader is initialized by passing the URL as a positional argument, not as a named parameter.

2. Step 2: Check each option's syntax

   loader = WebBaseLoader("https://example.com") correctly passes the URL as a positional argument. loader = WebBaseLoader(url="https://example.com") incorrectly uses a named argument 'url'. Options C and D use methods that do not exist for instantiation.

3. Final Answer:

   loader = WebBaseLoader("https://example.com") -> Option D

4. Quick Check:

   Constructor takes URL as positional argument = A [OK]

Hint: Pass URL directly as first argument to WebBaseLoader [OK]

Common Mistakes:

• Using named argument 'url' instead of positional
• Calling load() or create() during instantiation
• Confusing method calls with constructor

3. Given the code below, what will print(docs[0].page_content) output?

loader = WebBaseLoader("https://example.com")
docs = loader.load()

medium

A. The plain text content extracted from https://example.com

B. The raw HTML source of https://example.com

C. An error because load() returns None

D. A list of URLs found on https://example.com

Solution

1. Step 1: Understand what load() returns

   WebBaseLoader's load() method returns a list of Document objects containing extracted plain text from the web page.

2. Step 2: Identify what docs[0].page_content holds

   The first Document's page_content attribute holds the plain text extracted from the page, not HTML or URLs.

3. Final Answer:

   The plain text content extracted from https://example.com -> Option A

4. Quick Check:

   load() returns text documents = B [OK]

Hint: load() returns text documents, not HTML or URLs [OK]

Common Mistakes:

• Expecting raw HTML instead of extracted text
• Assuming load() returns None or errors
• Thinking it returns links instead of content

4. What is wrong with this code snippet?

loader = WebBaseLoader(url="https://example.com")
docs = loader.load()

medium

A. You must call load_webpage() instead of load()

B. WebBaseLoader does not accept a named argument 'url' during initialization

C. load() method does not exist on WebBaseLoader

D. The URL must be a list, not a string

Solution

1. Step 1: Check WebBaseLoader initialization parameters

   WebBaseLoader expects the URL as a positional argument, not as a named argument 'url'.

2. Step 2: Verify method existence

   The load() method exists and is correct to call; no method named load_webpage() is required. The URL should be a string, not a list.

3. Final Answer:

   WebBaseLoader does not accept a named argument 'url' during initialization -> Option B

4. Quick Check:

   Named argument 'url' invalid = C [OK]

Hint: Pass URL positionally, not as named argument 'url' [OK]

Common Mistakes:

• Using named argument 'url' instead of positional
• Thinking load() method is missing
• Assuming URL must be a list

5. You want to load text from multiple web pages using WebBaseLoader. Which approach correctly loads texts from two URLs and combines their content into a single string?

hard

A. loader1 = WebBaseLoader("https://site1.com")
loader2 = WebBaseLoader("https://site2.com")
docs = loader1.load() + loader2.load()
combined_text = "".join(doc.page_content for doc in docs)

B. loader = WebBaseLoader(["https://site1.com", "https://site2.com"])
docs = loader.load()
combined_text = " ".join(docs.page_content)

C. docs = WebBaseLoader.load("https://site1.com", "https://site2.com")
combined_text = " ".join(doc.page_content for doc in docs)

D. loader = WebBaseLoader("https://site1.com")
combined_text = loader.load("https://site2.com")

Solution

1. Step 1: Understand WebBaseLoader usage for multiple URLs

   WebBaseLoader accepts one URL per instance. To load multiple pages, create separate loaders and load each.

2. Step 2: Combine loaded documents correctly

   loader1 = WebBaseLoader("https://site1.com") loader2 = WebBaseLoader("https://site2.com") docs = loader1.load() + loader2.load() combined_text = "".join(doc.page_content for doc in docs) creates two loaders, loads documents from each, concatenates the lists, then joins their text content into one string.

3. Step 3: Identify why other options fail

   loader = WebBaseLoader(["https://site1.com", "https://site2.com"]) docs = loader.load() combined_text = " ".join(docs.page_content) incorrectly passes a list of URLs to one loader (not supported). docs = WebBaseLoader.load("https://site1.com", "https://site2.com") combined_text = " ".join(doc.page_content for doc in docs) calls load as a class method with multiple URLs (invalid). loader = WebBaseLoader("https://site1.com") combined_text = loader.load("https://site2.com") tries to pass a URL to load() method (load() takes no arguments).

4. Final Answer:

   loader1 = WebBaseLoader("https://site1.com") loader2 = WebBaseLoader("https://site2.com") docs = loader1.load() + loader2.load() combined_text = "".join(doc.page_content for doc in docs) -> Option A

5. Quick Check:

   One loader per URL, then combine texts = A [OK]

Hint: Create one loader per URL, then merge results [OK]

Common Mistakes:

• Passing multiple URLs to one WebBaseLoader instance
• Calling load() with URL arguments
• Trying to load multiple pages with one call