Loading from databases in LangChain

Introduction

Loading data from databases lets your program use stored information easily. It helps you work with big data saved in one place.

You want to get user info saved in a database to show on a website.

You need to analyze sales data stored in a database for reports.

You want to load chat history saved in a database for a chatbot.

You need to fetch product details from a database to display in an app.

Syntax

LangChain

from langchain.document_loaders import SQLDatabaseLoader

loader = SQLDatabaseLoader(
    database_uri="sqlite:///path_to_your_database.db",
    sql_query="SELECT * FROM your_table"
)
documents = loader.load()

The SQLDatabaseLoader connects to your database using the URI.

You provide a SQL query to select the data you want to load.

Examples

This loads the name and age columns from the users table.

LangChain

from langchain.document_loaders import SQLDatabaseLoader

loader = SQLDatabaseLoader(
    database_uri="sqlite:///mydata.db",
    sql_query="SELECT name, age FROM users"
)
docs = loader.load()

This loads all pending orders from a PostgreSQL database.

LangChain

from langchain.document_loaders import SQLDatabaseLoader

loader = SQLDatabaseLoader(
    database_uri="postgresql://user:pass@localhost/dbname",
    sql_query="SELECT * FROM orders WHERE status='pending'"
)
docs = loader.load()

Sample Program

This program connects to a SQLite database file named sample.db. It runs a query to get all data from the products table. Then it prints each row's content.

LangChain

from langchain.document_loaders import SQLDatabaseLoader

# Connect to a sample SQLite database and load all rows from 'products' table
loader = SQLDatabaseLoader(
    database_uri="sqlite:///sample.db",
    sql_query="SELECT * FROM products"
)
documents = loader.load()

for doc in documents:
    print(doc.page_content)

Important Notes

Make sure your database URI is correct and accessible.

The SQL query must be valid for your database type.

Loading large data sets may take time; consider filtering with SQL.

Summary

Loading from databases lets you use stored data in your programs.

Use SQLDatabaseLoader with a database URI and SQL query.

Always check your query and connection details before loading.

Practice

1. What is the main purpose of using SQLDatabaseLoader in Langchain?

easy

A. To create a new database schema

B. To load data from a database using a SQL query

C. To save data into a database

D. To visualize database tables

Solution

1. Step 1: Understand the role of SQLDatabaseLoader

   It is designed to connect to a database and fetch data using SQL queries.

2. Step 2: Compare options with the purpose

   Only To load data from a database using a SQL query describes loading data from a database, which matches the loader's function.

3. Final Answer:

   To load data from a database using a SQL query -> Option B

4. Quick Check:

   Loading data = SQLDatabaseLoader usage [OK]

Hint: Loader means fetching data, not saving or creating [OK]

Common Mistakes:

• Confusing loading with saving data
• Thinking it creates database schemas
• Assuming it visualizes data

2. Which of the following is the correct way to initialize SQLDatabaseLoader with a database URI and a query?

easy

A. loader = SQLDatabaseLoader(query='sqlite:///mydb.db', uri='SELECT * FROM users')

B. loader = SQLDatabaseLoader('SELECT * FROM users', 'sqlite:///mydb.db')

C. loader = SQLDatabaseLoader(uri='sqlite:///mydb.db', query='SELECT * FROM users')

D. loader = SQLDatabaseLoader('mydb.db', 'SELECT * FROM users')

Solution

1. Step 1: Recall the parameter order and names

   The correct syntax uses named parameters: uri for the database URI and query for the SQL query.

2. Step 2: Match options with correct parameter usage

   Only loader = SQLDatabaseLoader(uri='sqlite:///mydb.db', query='SELECT * FROM users') correctly uses named parameters with proper values.

3. Final Answer:

   loader = SQLDatabaseLoader(uri='sqlite:///mydb.db', query='SELECT * FROM users') -> Option C

4. Quick Check:

   Named parameters uri and query = loader = SQLDatabaseLoader(uri='sqlite:///mydb.db', query='SELECT * FROM users') [OK]

Hint: Use named parameters uri and query in correct order [OK]

Common Mistakes:

• Swapping uri and query parameters
• Using positional arguments in wrong order
• Missing parameter names

3. Given the code below, what will be the output type of data after loading?

loader = SQLDatabaseLoader(uri='sqlite:///example.db', query='SELECT name FROM employees')
data = loader.load()

medium

A. A list of documents representing rows

B. A single string with all names concatenated

C. A dictionary with column names as keys

D. An integer count of rows

Solution

1. Step 1: Understand what loader.load() returns

   It returns a list of document objects, each representing a row from the query result.

2. Step 2: Compare output types

   Only A list of documents representing rows matches the expected list of documents; others describe different data types.

3. Final Answer:

   A list of documents representing rows -> Option A

4. Quick Check:

   load() returns list of documents [OK]

Hint: load() returns list of documents, not strings or dicts [OK]

Common Mistakes:

• Expecting a single string instead of list
• Thinking output is a dictionary
• Assuming it returns row count

4. Identify the error in the following code snippet for loading data from a database:

loader = SQLDatabaseLoader(uri='postgresql://user:pass@localhost/db', query='SELECT * FROM')
data = loader.load()

medium

A. The URI format is incorrect for PostgreSQL

B. The loader class name is misspelled

C. The load() method is missing parentheses

D. The SQL query is incomplete and will cause a syntax error

Solution

1. Step 1: Check the SQL query syntax

   The query 'SELECT * FROM' is incomplete because it lacks a table name, causing a syntax error.

2. Step 2: Verify other parts

   The URI format is correct, load() has parentheses, and class name is spelled correctly.

3. Final Answer:

   The SQL query is incomplete and will cause a syntax error -> Option D

4. Quick Check:

   Incomplete SQL query = syntax error [OK]

Hint: Check SQL query completeness first [OK]

Common Mistakes:

• Ignoring incomplete SQL query
• Misreading URI format
• Forgetting parentheses on load()

5. You want to load only active users from a database using Langchain's SQLDatabaseLoader. Which query and loader setup correctly filters active users assuming the table is users with a boolean column is_active?

hard

A. loader = SQLDatabaseLoader(uri='sqlite:///app.db', query='SELECT * FROM users WHERE is_active = 1')

B. loader = SQLDatabaseLoader(uri='sqlite:///app.db', query='SELECT * FROM users WHERE is_active')

C. loader = SQLDatabaseLoader(uri='sqlite:///app.db', query='SELECT * FROM users WHERE is_active = 'true'')

D. loader = SQLDatabaseLoader(uri='sqlite:///app.db', query='SELECT * FROM users WHERE active = true')

Solution

1. Step 1: Understand SQL boolean filtering in SQLite

   SQLite uses 1 for true and 0 for false in boolean columns.

2. Step 2: Evaluate each query for correctness

   loader = SQLDatabaseLoader(uri='sqlite:///app.db', query='SELECT * FROM users WHERE is_active = 1') correctly uses 'is_active = 1'. loader = SQLDatabaseLoader(uri='sqlite:///app.db', query='SELECT * FROM users WHERE is_active') is incomplete, C has wrong quotes, D uses wrong column name.

3. Final Answer:

   loader = SQLDatabaseLoader(uri='sqlite:///app.db', query='SELECT * FROM users WHERE is_active = 1') -> Option A

4. Quick Check:

   Boolean true in SQLite = 1 [OK]

Hint: Use 'is_active = 1' for true in SQLite queries [OK]

Common Mistakes:

• Using wrong column name 'active'
• Incorrect SQL syntax for boolean values
• Missing comparison operator in WHERE clause