Buffer concatenation in Node.js

Introduction

Buffer concatenation lets you join multiple pieces of binary data into one. This helps when you want to combine small chunks of data into a bigger piece.

When receiving data in parts from a network and you want to join it before processing.

When combining multiple files or data streams into one buffer.

When building a message from smaller binary pieces before sending it.

When you want to merge image or audio data stored in buffers.

When you need to assemble chunks of data read from disk into a single buffer.

Syntax

Node.js

Buffer.concat(list[, totalLength])

list is an array of Buffer objects you want to join.

totalLength is optional and tells Node.js the final size to optimize memory.

Examples

Joins two buffers containing text into one buffer.

Node.js

const buf1 = Buffer.from('Hello, ');
const buf2 = Buffer.from('world!');
const result = Buffer.concat([buf1, buf2]);

Concatenates three buffers holding numbers as strings.

Node.js

const parts = [Buffer.from('123'), Buffer.from('456'), Buffer.from('789')];
const combined = Buffer.concat(parts);

Joins two buffers with a specified total length for efficiency.

Node.js

const bufA = Buffer.alloc(5, 'a');
const bufB = Buffer.alloc(3, 'b');
const combined = Buffer.concat([bufA, bufB], 8);

Sample Program

This program creates three buffers with text, joins them into one buffer, and prints the combined string.

Node.js

const buf1 = Buffer.from('Node.js ');
const buf2 = Buffer.from('Buffer ');
const buf3 = Buffer.from('Concatenation');

const combined = Buffer.concat([buf1, buf2, buf3]);

console.log(combined.toString());

Important Notes

Buffer.concat does not change the original buffers; it creates a new one.

If you know the total length of the final buffer, passing it helps Node.js allocate memory faster.

Always convert buffers to strings with toString() to see readable text.

Summary

Buffer.concat joins multiple buffers into one bigger buffer.

It is useful when working with data in chunks, like network or file data.

You can optionally provide the total length for better performance.

Practice

1. What does Buffer.concat do in Node.js?

easy

A. Creates a new empty Buffer

B. Splits a Buffer into smaller chunks

C. Joins multiple Buffer objects into one larger Buffer

D. Converts a Buffer to a string

Solution

1. Step 1: Understand Buffer.concat purpose

   Buffer.concat is designed to combine multiple Buffer objects into a single Buffer.

2. Step 2: Compare options with Buffer.concat behavior

   Only Joins multiple Buffer objects into one larger Buffer describes joining buffers, which matches Buffer.concat functionality.

3. Final Answer:

   Joins multiple Buffer objects into one larger Buffer -> Option C

4. Quick Check:

   Buffer.concat joins buffers = D [OK]

Hint: Remember concat means join, not split or convert [OK]

Common Mistakes:

• Confusing concat with split or slice
• Thinking it converts buffers to strings
• Assuming it creates empty buffers

2. Which of the following is the correct syntax to concatenate two buffers buf1 and buf2?

easy

A. Buffer.concat([buf1, buf2])

B. Buffer.concat(buf1, buf2)

C. Buffer.concat(buf1 + buf2)

D. Buffer.concat({buf1, buf2})

Solution

1. Step 1: Check Buffer.concat parameter type

   Buffer.concat expects an array of Buffer objects as its first argument.

2. Step 2: Match options with correct syntax

   Only Buffer.concat([buf1, buf2]) passes an array [buf1, buf2], which is correct syntax.

3. Final Answer:

   Buffer.concat([buf1, buf2]) -> Option A

4. Quick Check:

   Buffer.concat takes array of buffers = A [OK]

Hint: Always pass buffers inside an array to Buffer.concat [OK]

Common Mistakes:

• Passing buffers as separate arguments
• Using plus operator to add buffers
• Passing an object instead of array

3. What will be the output length of the following code?

const buf1 = Buffer.from('Hi');
const buf2 = Buffer.from('!');
const result = Buffer.concat([buf1, buf2]);
console.log(result.length);

medium

A. 4

B. 2

C. 1

D. 3

Solution

1. Step 1: Calculate length of each buffer

   buf1 contains 'Hi' which is 2 bytes, buf2 contains '!' which is 1 byte.

2. Step 2: Sum lengths after concatenation

   Total length = 2 + 1 = 3 bytes.

3. Final Answer:

   3 -> Option D

4. Quick Check:

   Length of 'Hi' + '!' = 3 [OK]

Hint: Add lengths of all buffers to get result length [OK]

Common Mistakes:

• Counting characters instead of bytes
• Forgetting to add all buffer lengths
• Assuming length stays same as first buffer

4. Identify the error in this code snippet:

const buf1 = Buffer.from('A');
const buf2 = Buffer.from('B');
const combined = Buffer.concat(buf1, buf2);
console.log(combined.toString());

medium

A. Buffer.concat expects an array of buffers, not separate arguments

B. Buffer.from cannot create buffers from strings

C. toString() is not a method on Buffer objects

D. Buffers cannot be concatenated

Solution

1. Step 1: Check Buffer.concat argument type

   The code passes two buffers as separate arguments, but Buffer.concat requires a single array argument.

2. Step 2: Verify other parts of code

   Buffer.from correctly creates buffers from strings, and toString() is valid on buffers.

3. Final Answer:

   Buffer.concat expects an array of buffers, not separate arguments -> Option A

4. Quick Check:

   Buffer.concat needs array argument = C [OK]

Hint: Pass buffers inside an array to Buffer.concat [OK]

Common Mistakes:

• Passing buffers as separate arguments
• Misunderstanding Buffer.from usage
• Thinking toString() is invalid on buffers

5. You have three buffers: buf1 with length 5, buf2 with length 3, and buf3 with length 7. You want to concatenate them efficiently. Which is the best way to use Buffer.concat for performance?

hard

A. Buffer.concat([buf1, buf2, buf3])

B. Buffer.concat([buf1, buf2, buf3], 15)

C. Buffer.concat([buf1, buf2, buf3], 10)

D. Buffer.concat([buf1, buf2, buf3], 20)

Solution

1. Step 1: Calculate total length of buffers

   Total length = 5 + 3 + 7 = 15 bytes.

2. Step 2: Use Buffer.concat with total length for efficiency

   Passing the exact total length as the second argument improves performance by preallocating the buffer.

3. Step 3: Compare options

   Buffer.concat([buf1, buf2, buf3], 15) correctly passes the array and the exact total length 15.

4. Final Answer:

   Buffer.concat([buf1, buf2, buf3], 15) -> Option B

5. Quick Check:

   Pass total length for better performance = B [OK]

Hint: Provide exact total length as second argument for speed [OK]

Common Mistakes:

• Not passing total length at all
• Passing incorrect total length
• Passing length smaller or larger than sum