Energy data sources

Suggest Edits

Low Resolution and High Resolution data sources

📘

Be aware of the granularity of your data source

Some CE-API calls are only suitable for input data with high granularity, derived via NET2GRID IoT hardware. In particular recognition of individual appliances is only supported with data sampling frequency of 1 to 10 seconds, not for 15 minutes samples.

The Customer Engagement Service is based on energy measurements from households. In general there are two ways to derive energy data from a household installation. The first is using the data that is retrieved by energy service providers from the digital meter in the household via the cellular network of local energy distribution companies. This type of data is usually called Low Resolution.

The other way to derive energy data from a household installation is to use IoT hardware, specifically tailored for this purpose. NET2GRID provides hardware that can be plugged into a large variety of smart meters and provides DIN meters and clamp solutions to install in meter cabinets. These hardware solutions use the WiFi of the customer to send the data straight to the customer Insight platform to be consumed by the CE-API. This type of data feed is called High Resolution.

The benefit of Low Resolution data is that no hardware is needed at the user side. The user only has to opt in that available Low Resolution data may be used for the energy insight service. Often energy retailers already possess large data sets of Low Resolution data.

The benefit of High Resolution data is that the data granularity of measurements is much higher, improving insights accuracy. The data is directly available and energy events detected by the hardware on the edge can be used to trigger real-time alarms. For instance, the user may be warned for using more capacity than his limit or it might trigger other software, like smart charging at the time an electric vehicle is plugged in.

Low Resolution data enables activity (category) breakdown,
whereas High Resolution data enables single appliance event detection as well.

Low Resolution data

Low Resolution data usually has a granularity of a single electricity value per 15, 30 or 60 minutes. The granularity of gas values is usually 30 to 60 minutes. Low Resolution data is often ingested in the NET2GRID platform via a daily file import from an energy retailer Meter Data Management system or national energy data hub. Low Resolution data therefore does usually provide measurements up till yesterday or the day before yesterday.

👍

File import of Low Resolution data

To implement a daily file import in NET2GRID predefined data format, reach out to receive the NET2GRID Measurements File Interface specification.

In short, as a standard way of importing Low Resolution data, measurement files for households are expected daily in an S3 bucket, providing the following information:

  • CSD (required): Cumulative (total) electricity consumed at a given timestamp, or a delta with the previous timestamp. Optionally two CSD tiers (for peak and offpeak consumption) are supported.
  • CSR (required in case of solar panels): cumulative energy fed back to the grid. CSR can also be differentiated into 2 tiers.
  • GAS: cumulative consumption of Gas. This is the gas meter reading at a given timestamp.

High Resolution data

High Resolution data usually has a granularity between 1 to 10 seconds. This range is partly determined by the threshold that determines a change in power to send a new measurement. Because the interval of these energy measurements is close to a second, it is referred to as power data. So High Resolution data provides not only electricity data (the use of power over time), but also a power pattern, that enables detection of specific electrical appliances.

👍

Onboarding NET2GRID hardware

For onboarding the NET2GRID hardware via the app using Bluetooth, reach out to receive the NET2GRID hardware onboarding guidelines

NET2GRID Energy data sources - Service Types

Service Type is an optional but important field in NET2GRID Insight Platform, specifically on installation level provisioning that specifies:

  1. The interval by which measurement data or edge events arrive to the NET2GRID Insight Platform:
    1. Near-Real-Time (RT): when getting data intraday, regardless of the data granularity or if the hardware is used
    2. Batch Reporting (BR): when getting data in batches or files in scheduled intervals (e.g., MFI, datahubs, etc.)
  2. The nature of the resolution of the data which will be based on the requirements of analytics stacks
    1. High Resolution (HR): when IDD reported with 1’-10 seconds granularity and CSD/CSR reported with 1 second-60 minutes granularity.
    2. Low Resolution (LR): when CSD/CSR is reported with 15-60 minutes granularity, IDD is not constantly reported. MDM systems refer to this resolution as “interval measurement data”.

Updated 6 days ago