Wire encryption for data in transit in Hadoop - Step-by-Step Execution

Concept Flow - Wire encryption for data in transit

Client sends data request

↓

Data encrypted before sending

↓

Encrypted data travels over network

↓

Server receives encrypted data

↓

Server decrypts data

↓

Server processes data securely

Data is encrypted before it travels over the network and decrypted only after it reaches the server, keeping it safe during transit.

Execution Sample

Hadoop

Configuration conf = new Configuration();
conf.setBoolean("dfs.encrypt.data.transfer", true);
FileSystem fs = FileSystem.get(conf);
fs.create(new Path("/data/file.txt"));

This code enables wire encryption in Hadoop and writes a file securely over the network.

Execution Table

Step	Action	Configuration State	Data State	Network State
1	Create Configuration object	dfs.encrypt.data.transfer = false (default)	Plain data ready	No data sent
2	Set dfs.encrypt.data.transfer to true	dfs.encrypt.data.transfer = true	Plain data ready	No data sent
3	Get FileSystem with config	dfs.encrypt.data.transfer = true	Plain data ready	No data sent
4	Create file and write data	dfs.encrypt.data.transfer = true	Data encrypted before sending	Encrypted data sent over network
5	Server receives data	dfs.encrypt.data.transfer = true	Encrypted data received	Encrypted data on network
6	Server decrypts data	dfs.encrypt.data.transfer = true	Plain data after decryption	No data on network
7	Data processed securely	dfs.encrypt.data.transfer = true	Plain data processed	No data on network

💡 Data transfer completes securely with encryption enabled, protecting data in transit.

Variable Tracker

Variable	Start	After Step 2	After Step 4	After Step 6	Final
dfs.encrypt.data.transfer	false	true	true	true	true
Data State	Plain data ready	Plain data ready	Data encrypted before sending	Plain data after decryption	Plain data processed
Network State	No data sent	No data sent	Encrypted data sent over network	Encrypted data on network	No data on network

Key Moments - 3 Insights

Why do we set dfs.encrypt.data.transfer to true before writing data?

Setting dfs.encrypt.data.transfer to true (see execution_table step 2) tells Hadoop to encrypt data before sending it over the network, ensuring data is protected during transit.

Is data encrypted on the client side or server side?

Data is encrypted on the client side before sending (step 4) and decrypted on the server side after receiving (step 6), so it is never sent as plain text over the network.

What happens if dfs.encrypt.data.transfer is false?

If false, data is sent as plain text over the network, which is less secure. This is shown in step 1 where the default is false and data is plain.

Visual Quiz - 3 Questions

Look at the execution_table at step 4, what is the state of the data?

A Data is plain and unencrypted

B Data is decrypted after receiving

C Data is encrypted before sending

D No data is sent yet

💡 Hint

Check the 'Data State' column at step 4 in the execution_table.

At which step does the server decrypt the data?

A Step 6

B Step 5

C Step 3

D Step 7

💡 Hint

Look for 'Server decrypts data' in the 'Action' column of the execution_table.

If dfs.encrypt.data.transfer was never set to true, what would be the network state at step 4?

A Encrypted data sent over network

B Plain data sent over network

C No data sent

D Data already decrypted

💡 Hint

Refer to variable_tracker for dfs.encrypt.data.transfer and network state changes.

Concept Snapshot

Wire encryption in Hadoop:
- Set dfs.encrypt.data.transfer=true in config
- Data encrypted before network transfer
- Server decrypts after receiving
- Protects data from interception
- Simple config change secures data in transit

Full Transcript

Wire encryption for data in transit in Hadoop means data is encrypted before it travels over the network and decrypted only after it reaches the server. This protects data from being read by others while moving between client and server. To enable this, you set the configuration property dfs.encrypt.data.transfer to true before writing or reading data. When this is set, Hadoop encrypts data on the client side before sending it and decrypts it on the server side after receiving. The execution steps show creating the configuration, enabling encryption, writing data which gets encrypted, sending encrypted data over the network, and finally decrypting it on the server. This simple setting helps keep data safe during transfer without changing how you write or read files.