Trigger-based retraining (schedule, drift, performance) in MLOps - Step-by-Step Execution

Process Flow - Trigger-based retraining (schedule, drift, performance)

Start Monitoring

↓

Check Schedule?

Yes→Trigger Retrain

↓

Update Model

↓

Check Data Drift?

Yes→Trigger Retrain

↓

Update Model

↓

Check Performance?

Yes→Trigger Retrain

↓

Update Model

↓

Wait for Next Cycle

↩Back to Start Monitoring

The system continuously monitors schedule, data drift, and performance to decide when to retrain the model.

Execution Sample

MLOps

IF current_time == retrain_time THEN
  retrain_model()
ELSE IF data_drift_detected THEN
  retrain_model()
ELSE IF performance_below_threshold THEN
  retrain_model()
ELSE
  wait()

This pseudocode checks three triggers: schedule, data drift, and performance to decide retraining.

Process Table

Step	Current Time	Data Drift Detected	Performance Status	Action Taken	Model Retrained
1	08:00	No	Good	Wait	No
2	12:00	Yes	Good	Trigger Retrain	Yes
3	12:05	No	Good	Wait	No
4	16:00	No	Below Threshold	Trigger Retrain	Yes
5	20:00	No	Good	Wait	No
6	00:00	No	Good	Trigger Retrain (Scheduled)	Yes
7	00:05	No	Good	Wait	No

💡 Process continues indefinitely, checking triggers each cycle.

Status Tracker

Variable	Start	After Step 1	After Step 2	After Step 3	After Step 4	After Step 5	After Step 6	After Step 7
Current Time	08:00	08:00	12:00	12:05	16:00	20:00	00:00	00:05
Data Drift Detected	No	No	Yes	No	No	No	No	No
Performance Status	Good	Good	Good	Good	Below Threshold	Good	Good	Good
Model Retrained	No	No	Yes	No	Yes	No	Yes	No

Key Moments - 3 Insights

Why does the model retrain at step 2 even though the schedule time hasn't arrived?

Because data drift was detected at step 2, triggering retraining as shown in the execution_table row 2.

At step 4, why is retraining triggered despite no data drift?

Performance dropped below the threshold at step 4, which triggers retraining according to the logic in the execution_table.

Why does the model retrain at step 6 even though data drift and performance are normal?

Because the scheduled retraining time arrived at step 6, triggering retraining regardless of other conditions.

Visual Quiz - 3 Questions

Look at the execution_table, what is the action taken at step 3?

A Trigger Retrain

B Check Data Drift

C Wait

D Update Model

💡 Hint

Refer to the 'Action Taken' column in execution_table row 3.

At which step does performance status cause retraining?

A Step 2

B Step 4

C Step 6

D Step 1

💡 Hint

Check 'Performance Status' and 'Action Taken' columns in execution_table.

If data drift was detected at step 5, what would be the action?

A Trigger Retrain

B Wait

C Ignore Drift

D Schedule Retrain

💡 Hint

Look at how data drift triggers retraining in execution_table step 2.

Concept Snapshot

Trigger-based retraining checks three main triggers:
- Scheduled time to retrain
- Data drift detection
- Performance drop below threshold
If any trigger is true, retraining starts.
Otherwise, system waits and monitors again.

Full Transcript

This visual execution shows how a machine learning system decides when to retrain a model. It checks three triggers: scheduled retraining time, data drift detection, and performance status. At each step, the system evaluates these conditions. If any condition is met, it triggers retraining. For example, at step 2, data drift causes retraining. At step 4, poor performance triggers retraining. At step 6, scheduled retraining happens regardless of other conditions. Variables like current time, data drift status, and performance status change over time and influence the retraining decision. This cycle repeats continuously to keep the model updated and accurate.

Practice

1. What is the main purpose of trigger-based retraining in machine learning operations?

easy

A. Automatically update models when data or performance changes

B. Manually retrain models on a fixed schedule

C. Store training data in a database

D. Visualize model performance metrics

Solution

1. Step 1: Understand trigger-based retraining concept

   Trigger-based retraining means models update automatically when certain conditions happen, like data changes or performance drops.

2. Step 2: Compare options to concept

   Only Automatically update models when data or performance changes describes automatic updates based on triggers, matching the concept.

3. Final Answer:

   Automatically update models when data or performance changes -> Option A

4. Quick Check:

   Trigger-based retraining = automatic updates [OK]

Hint: Triggers mean automatic updates, not manual tasks [OK]

Common Mistakes:

• Confusing manual retraining with trigger-based retraining
• Thinking triggers only store data
• Assuming triggers visualize data

2. Which SQL statement correctly creates a trigger to start retraining after new data is inserted into a table named training_data?

easy

A. CREATE retrain_trigger AFTER INSERT ON training_data CALL start_retraining();

B. INSERT TRIGGER retrain_trigger ON training_data AFTER EXEC start_retraining();"

C. TRIGGER CREATE retrain_trigger ON training_data AFTER INSERT EXEC start_retraining();

D. CREATE TRIGGER retrain_trigger AFTER INSERT ON training_data FOR EACH ROW EXECUTE PROCEDURE start_retraining();

Solution

1. Step 1: Recall correct SQL trigger syntax

   Standard SQL triggers use CREATE TRIGGER, specify timing (AFTER), event (INSERT), table, and procedure to execute.

2. Step 2: Match syntax to options

   CREATE TRIGGER retrain_trigger AFTER INSERT ON training_data FOR EACH ROW EXECUTE PROCEDURE start_retraining(); matches correct syntax: CREATE TRIGGER retrain_trigger AFTER INSERT ON training_data FOR EACH ROW EXECUTE PROCEDURE start_retraining();

3. Final Answer:

   CREATE TRIGGER retrain_trigger AFTER INSERT ON training_data FOR EACH ROW EXECUTE PROCEDURE start_retraining(); -> Option D

4. Quick Check:

   Correct trigger syntax = CREATE TRIGGER retrain_trigger AFTER INSERT ON training_data FOR EACH ROW EXECUTE PROCEDURE start_retraining(); [OK]

Hint: Look for 'CREATE TRIGGER ... EXECUTE PROCEDURE' pattern [OK]

Common Mistakes:

• Using CALL instead of EXECUTE PROCEDURE
• Wrong order of keywords
• Missing FOR EACH ROW clause

3. Given this trigger function in PostgreSQL:

CREATE OR REPLACE FUNCTION check_drift() RETURNS trigger AS $$
BEGIN
  IF NEW.error_rate > 0.1 THEN
    PERFORM start_retraining();
  END IF;
  RETURN NEW;
END;
$$ LANGUAGE plpgsql;

What happens when a new row with error_rate = 0.15 is inserted?

medium

A. The retraining procedure is called because error_rate > 0.1

B. Nothing happens because triggers don't run on INSERT

C. An error occurs due to syntax mistake

D. The row is rejected and not inserted

Solution

1. Step 1: Analyze trigger function logic

   The function checks if NEW.error_rate > 0.1; if true, it calls start_retraining().

2. Step 2: Apply condition to given data

   Since error_rate is 0.15, which is greater than 0.1, the retraining procedure is called.

3. Final Answer:

   The retraining procedure is called because error_rate > 0.1 -> Option A

4. Quick Check:

   error_rate 0.15 > 0.1 triggers retraining [OK]

Hint: Check condition in trigger function with inserted data [OK]

Common Mistakes:

• Thinking triggers don't run on INSERT
• Assuming syntax error without checking code
• Believing row insertion fails

4. You wrote this trigger to start retraining on performance drop:

CREATE TRIGGER retrain_on_drop
AFTER UPDATE ON model_metrics
FOR EACH ROW
WHEN (NEW.accuracy < OLD.accuracy)
EXECUTE PROCEDURE start_retraining();

But retraining never starts. What is the likely problem?

medium

A. Triggers cannot run AFTER UPDATE events

B. The WHEN clause is not supported in all SQL dialects

C. start_retraining() must be a procedure, not a function

D. The trigger name is invalid

Solution

1. Step 1: Understand WHEN clause support

   Not all SQL databases support the WHEN clause in triggers; some require condition checks inside the function.

2. Step 2: Identify why retraining doesn't start

   If the database ignores the WHEN clause, the condition is never checked, so retraining never triggers.

3. Final Answer:

   The WHEN clause is not supported in all SQL dialects -> Option B

4. Quick Check:

   WHEN clause support varies by SQL dialect [OK]

Hint: Check if your SQL dialect supports WHEN in triggers [OK]

Common Mistakes:

• Assuming triggers can't run AFTER UPDATE
• Confusing functions and procedures
• Thinking trigger names cause failure

5. You want to design a trigger-based retraining system that retrains a model only if both the data drift exceeds threshold and model accuracy drops below 90%. Which approach is best?

hard

A. Manually retrain the model when you notice performance issues

B. Create two separate triggers: one for drift and one for accuracy, each retraining independently

C. Create a trigger that calls a procedure checking both drift and accuracy before retraining

D. Schedule retraining daily regardless of drift or accuracy

Solution

1. Step 1: Understand combined condition requirement

   The retraining should happen only if both drift and accuracy conditions are met together.

2. Step 2: Evaluate options for combined logic

   Create a trigger that calls a procedure checking both drift and accuracy before retraining uses a single trigger calling a procedure that checks both conditions before retraining, ensuring both must be true.

3. Step 3: Why other options fail

   Create two separate triggers: one for drift and one for accuracy, each retraining independently retrains independently on each condition, not requiring both. Schedule retraining daily regardless of drift or accuracy ignores conditions. Manually retrain the model when you notice performance issues is manual, not trigger-based.

4. Final Answer:

   Create a trigger that calls a procedure checking both drift and accuracy before retraining -> Option C

5. Quick Check:

   Combined condition needs single trigger with logic [OK]

Hint: Use one trigger with combined condition check procedure [OK]

Common Mistakes:

• Using separate triggers causing unnecessary retraining
• Ignoring condition checks in triggers
• Relying on manual retraining only