Streams vs loading entire file in memory in Node.js - Hands-On Comparison

Streams vs Loading Entire File in Memory in Node.js

📖 Scenario: You are building a Node.js script to read a large text file. You want to compare two ways of reading the file: loading the whole file into memory at once, and reading it piece by piece using streams.This helps you understand how to handle big files efficiently without using too much memory.

🎯 Goal: Build a Node.js script that first reads a file fully into memory, then reads the same file using streams. You will see how to set up both methods step-by-step.

📋 What You'll Learn

Create a variable with the file path string

Create a variable to hold the file size limit in bytes

Read the entire file content using fs.readFileSync

Set up a readable stream using fs.createReadStream with the file path

💡 Why This Matters

🌍 Real World

Reading large files efficiently is important in real-world apps like log analyzers, video processing, or data import tools where loading the whole file at once can crash the program.

💼 Career

Understanding streams vs full file loading helps developers write scalable Node.js applications that handle big data without running out of memory.

1

Set up the file path variable

Create a variable called filePath and set it to the string './largefile.txt'.

Node.js

// Create a variable called filePath with the value './largefile.txt'
// Your code here

Need a hint?

Use const to declare the variable and assign the exact string.

2

Set a file size limit variable

Create a variable called maxFileSize and set it to 1048576 (which is 1MB in bytes).

Node.js

const filePath = './largefile.txt';
// Create a variable called maxFileSize and set it to 1048576
// Your code here

Need a hint?

Use const maxFileSize = 1048576; to set the limit.

3

Read entire file content into memory

Use fs.readFileSync with filePath to read the whole file content into a variable called fileContent. Make sure to require fs at the top.

Node.js

const filePath = './largefile.txt';
const maxFileSize = 1048576;
// Require fs module
// Read entire file content into fileContent using fs.readFileSync
// Your code here

Need a hint?

Remember to require fs first. Then use fs.readFileSync(filePath, 'utf8') to read the file as text.

4

Create a readable stream for the file

Create a variable called readStream and set it to fs.createReadStream(filePath) to read the file in chunks.

Node.js

const fs = require('fs');
const filePath = './largefile.txt';
const maxFileSize = 1048576;
const fileContent = fs.readFileSync(filePath, 'utf8');
// Create a readable stream called readStream using fs.createReadStream
// Your code here

Need a hint?

Use fs.createReadStream(filePath) to create the stream.