Directory loader for bulk documents in LangChain - Mini Project: Build & Apply

Directory loader for bulk documents

📖 Scenario: You are building a simple tool to load many text documents from a folder all at once. This helps you quickly gather all your notes or files for processing.

🎯 Goal: Create a Python script using langchain that loads all text files from a directory using DirectoryLoader.

📋 What You'll Learn

Create a variable folder_path with the exact string "./documents"

Create a DirectoryLoader instance called loader using folder_path and the TextLoader class

Use the loader.load() method to load all documents into a variable called documents

Add a line to print the number of documents loaded using len(documents)

💡 Why This Matters

🌍 Real World

Loading many documents at once is useful for building search engines, chatbots, or data analysis tools that work with large text collections.

💼 Career

Understanding how to bulk load documents is important for roles in data science, machine learning, and software development involving text processing.

1

Set the folder path

Create a variable called folder_path and set it to the string "./documents".

LangChain

# Your code here

Need a hint?

Use quotes around the folder path string exactly as shown.

2

Create the DirectoryLoader instance

Import DirectoryLoader and TextLoader from langchain.document_loaders. Then create a variable called loader that is a DirectoryLoader using folder_path and TextLoader as the loader class.

LangChain

folder_path = "./documents"
# Your code here

Need a hint?

Use loader_cls=TextLoader as the argument to specify the loader class.

3

Load documents from the directory

Use the load() method on loader to load all documents and save them in a variable called documents.

LangChain

from langchain.document_loaders import DirectoryLoader, TextLoader

folder_path = "./documents"
loader = DirectoryLoader(folder_path, loader_cls=TextLoader)
# Your code here

Need a hint?

Call loader.load() and assign the result to documents.

4

Print the number of loaded documents

Add a line to print the number of documents loaded by printing len(documents).

LangChain

from langchain.document_loaders import DirectoryLoader, TextLoader

folder_path = "./documents"
loader = DirectoryLoader(folder_path, loader_cls=TextLoader)
documents = loader.load()
# Your code here

Need a hint?

Use print(len(documents)) to show how many documents were loaded.