Environmental impact of AI in Prompt Engineering / GenAI - Model Pipeline Trace

Model Pipeline - Environmental impact of AI

This pipeline shows how training a large AI model affects the environment through energy use and carbon emissions. It tracks data from raw input to model training and measures energy consumption and emissions at each step.

Data Flow - 6 Stages

1Raw Data Collection

1000000 rows x 10 columns→Gathering text and image data from the internet→1000000 rows x 10 columns

Text samples and images collected for training

↓

2Data Preprocessing

1000000 rows x 10 columns→Cleaning, filtering, and formatting data→950000 rows x 10 columns

Removed duplicates and irrelevant data

↓

3Feature Engineering

950000 rows x 10 columns→Converting raw data into numerical features→950000 rows x 512 features

Text converted to 512-dimensional vectors

↓

4Model Training

950000 rows x 512 features→Training a deep neural network with 12 layers→Model weights updated after 10 epochs

Model learns patterns from features

↓

5Energy Consumption Measurement

Model training process→Measuring electricity used by GPUs→Total energy used: 1500 kWh

Energy meter records power during training

↓

6Carbon Emission Estimation

Energy consumption data→Calculating CO2 emissions based on energy source→Estimated emissions: 750 kg CO2

Using local electricity carbon intensity

Training Trace - Epoch by Epoch

Loss
1.2 |*        
0.9 | *       
0.7 |  *      
0.55|   *     
0.45|    *    
0.38|     *   
0.33|      *  
0.29|       * 
0.26|        *
0.24|         *
     ----------------
      Epochs 1 to 10

Epoch	Loss ↓	Accuracy ↑	Observation
1	1.2	0.45	High loss and low accuracy at start
2	0.9	0.60	Loss decreases, accuracy improves
3	0.7	0.72	Model learns important features
4	0.55	0.80	Training progressing well
5	0.45	0.85	Good balance of loss and accuracy
6	0.38	0.88	Model converging
7	0.33	0.90	Stable improvement
8	0.29	0.92	Approaching best performance
9	0.26	0.93	Small improvements
10	0.24	0.94	Training complete with good accuracy

Prediction Trace - 3 Layers

Layer 1: Input Layer

Layer 2: Hidden Layers (12 layers)

Layer 3: Output Layer with Softmax

Model Quiz - 3 Questions

What happens to the data size after preprocessing?

A It decreases because irrelevant data is removed

B It increases because new features are added

C It stays the same size

D It becomes empty

Key Insight

Training large AI models uses significant energy, which leads to carbon emissions. Monitoring energy and emissions during data processing and training helps understand and reduce AI's environmental impact.

Practice

1. What is the main environmental concern related to training large AI models?

easy

A. AI models increasing water pollution

B. AI models causing deforestation directly

C. AI models producing plastic waste

D. High energy consumption leading to increased carbon emissions

Solution

1. Step 1: Understand AI training process

   Training large AI models requires a lot of computer power, which uses electricity.

2. Step 2: Link electricity use to environmental impact

   Electricity often comes from burning fossil fuels, which releases carbon emissions harming the environment.

3. Final Answer:

   High energy consumption leading to increased carbon emissions -> Option D

4. Quick Check:

   Energy use = Carbon emissions [OK]

Hint: Think about what powers computers during training [OK]

Common Mistakes:

• Confusing AI's indirect impact with direct pollution
• Thinking AI models produce physical waste
• Ignoring energy source in environmental impact

2. Which of the following is the correct way to reduce AI's environmental impact?

easy

A. Use larger models with more layers

B. Train models using renewable energy sources

C. Increase training time without optimization

D. Ignore energy consumption during model design

Solution

1. Step 1: Identify methods to reduce carbon footprint

   Using renewable energy like solar or wind reduces carbon emissions from electricity.

2. Step 2: Evaluate options for environmental friendliness

   Options A, B, and D increase energy use or ignore it, so they don't reduce impact.

3. Final Answer:

   Train models using renewable energy sources -> Option B

4. Quick Check:

   Renewable energy = Lower carbon footprint [OK]

Hint: Choose options that lower energy or use clean energy [OK]

Common Mistakes:

• Thinking bigger models always help
• Ignoring energy source in training
• Assuming longer training is better for environment

3. Consider this code snippet estimating AI model energy use:

energy_per_epoch = 50  # kWh
epochs = 10
carbon_per_kwh = 0.4  # kg CO2
carbon_footprint = energy_per_epoch * epochs * carbon_per_kwh
print(carbon_footprint)

What is the output of this code?

medium

A. 200.0

B. 500.0

C. 20.0

D. 400.0

Solution

1. Step 1: Calculate total energy used

   Energy per epoch (50 kWh) times epochs (10) equals 500 kWh total.

2. Step 2: Calculate carbon footprint

   Multiply total energy (500 kWh) by carbon per kWh (0.4 kg CO2) = 200 kg CO2.

3. Final Answer:

   200.0 -> Option A

4. Quick Check:

   50 * 10 * 0.4 = 200.0 [OK]

Hint: Multiply energy, epochs, and carbon per kWh [OK]

Common Mistakes:

• Multiplying incorrectly or missing one factor
• Confusing units or decimal points
• Mixing up variable names

4. This code tries to calculate carbon footprint but has a bug:

energy_per_epoch = 40
epochs = '10'
carbon_per_kwh = 0.3
carbon_footprint = energy_per_epoch * epochs * carbon_per_kwh
print(carbon_footprint)

What is the error and how to fix it?

medium

A. SyntaxError due to missing colon

B. NameError because carbon_per_kwh is undefined

C. TypeError because epochs is a string; convert it to int

D. No error; code runs fine

Solution

1. Step 1: Identify variable types

   epochs is a string '10', but multiplication needs a number.

2. Step 2: Fix type mismatch

   Convert epochs to integer using int(epochs) to allow multiplication.

3. Final Answer:

   TypeError because epochs is a string; convert it to int -> Option C

4. Quick Check:

   String * float causes error [OK]

Hint: Check variable types before math operations [OK]

Common Mistakes:

• Ignoring type mismatch errors
• Assuming code runs without conversion
• Confusing error types

5. You want to reduce the environmental impact of an AI project. Which combined approach is best?

hard

A. Use smaller models, train fewer epochs, and power training with renewable energy

B. Use larger models, train longer, and use coal-based electricity

C. Ignore model size, focus only on data quality

D. Train models on any energy source but optimize only accuracy

Solution

1. Step 1: Identify factors affecting environmental impact

   Model size, training time, and energy source all affect energy use and emissions.

2. Step 2: Combine best practices

   Smaller models and fewer epochs reduce energy use; renewable energy lowers carbon footprint.

3. Final Answer:

   Use smaller models, train fewer epochs, and power training with renewable energy -> Option A

4. Quick Check:

   Smaller + less training + clean energy = less impact [OK]

Hint: Combine smaller models, less training, and clean energy [OK]

Common Mistakes:

• Focusing on accuracy only
• Ignoring energy source
• Assuming bigger models are better for environment