Historian architecture overview in SCADA systems - Mini Project: Build & Apply

Historian Architecture Overview

📖 Scenario: You are working with a SCADA system that collects data from industrial sensors. To analyze and store this data efficiently, you need to understand the historian architecture that manages time-series data storage and retrieval.

🎯 Goal: Build a simple representation of a historian architecture using data structures to model data collection, configuration, data filtering, and output display.

📋 What You'll Learn

Create a dictionary to represent sensor data with exact timestamps and values

Add a configuration variable for a time threshold to filter recent data

Use a comprehension to filter sensor data newer than the threshold

Print the filtered data to show the final output

💡 Why This Matters

🌍 Real World

Historian architectures are used in SCADA systems to store and retrieve time-series data from sensors for monitoring and analysis.

💼 Career

Understanding historian data structures and filtering is essential for roles in industrial automation, DevOps for SCADA, and data engineering in manufacturing.

1

Create initial sensor data dictionary

Create a dictionary called sensor_data with these exact entries: '2024-06-01T10:00:00': 23.5, '2024-06-01T10:05:00': 24.0, '2024-06-01T10:10:00': 23.8, '2024-06-01T10:15:00': 24.2

SCADA systems

# Create the sensor_data dictionary with exact timestamps and values
# Your code here

Need a hint?

Use a dictionary with timestamps as keys and sensor values as floats.

2

Add time threshold configuration

Create a variable called time_threshold and set it to the string '2024-06-01T10:05:00' to filter data newer than this timestamp

SCADA systems

sensor_data = {
    '2024-06-01T10:00:00': 23.5,
    '2024-06-01T10:05:00': 24.0,
    '2024-06-01T10:10:00': 23.8,
    '2024-06-01T10:15:00': 24.2
}
# Create the time_threshold variable with the exact timestamp string
# Your code here

Need a hint?

Set the time_threshold variable to the exact timestamp string.

3

Filter sensor data newer than threshold

Create a dictionary called filtered_data using a dictionary comprehension that includes only entries from sensor_data where the timestamp key is greater than time_threshold

SCADA systems

sensor_data = {
    '2024-06-01T10:00:00': 23.5,
    '2024-06-01T10:05:00': 24.0,
    '2024-06-01T10:10:00': 23.8,
    '2024-06-01T10:15:00': 24.2
}
time_threshold = '2024-06-01T10:05:00'
# Create filtered_data dictionary with entries newer than time_threshold
# Your code here

Need a hint?

Use a dictionary comprehension with timestamp and value from sensor_data.items() and filter by timestamp > time_threshold.

4

Print the filtered sensor data

Write a print statement to display the filtered_data dictionary

SCADA systems

sensor_data = {
    '2024-06-01T10:00:00': 23.5,
    '2024-06-01T10:05:00': 24.0,
    '2024-06-01T10:10:00': 23.8,
    '2024-06-01T10:15:00': 24.2
}
time_threshold = '2024-06-01T10:05:00'
filtered_data = {timestamp: value for timestamp, value in sensor_data.items() if timestamp > time_threshold}
# Print the filtered_data dictionary
# Your code here

Need a hint?

Use print(filtered_data) to show the filtered dictionary.