Abstract FZJ-2026-03200

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
A Benchmark Arena for Real-Time Energy Forecasting

 ;  ;  ;

2026

EEM26 Conference, TrondheimTrondheim, Norway, 22 Jun 2026 - 24 Jun 20262026-06-222026-06-24

Abstract: Forecasting electricity prices, load, and renewable generation has become essential for powersystem operators, energy traders, and analysts as renewable penetration and market volatility riseacross Europe, a trend reflected in the sharp growth of related research, including more than 4,000papers published in 2024 alone1. Despite a vast body of literature and notable open-access effortssuch as Lago et al.2 (2021), the field lacks a widely accepted, continuously updated real-timebenchmark that captures the evolving conditions of modern power markets. As a result, it remainsdifficult to reliably assess state-of-the-art forecasting performance, hindering consistent andmeasurable progress, both in research and in commercial practice.Existing studies rely on static historical benchmark datasets2–4, which are useful for comparingrelative model performance. However, in a rapidly changing energy system, their results quicklybecome outdated and offer limited insight into real-time forecasting performance under currentsystem conditions. Furthermore, static benchmarks allow to rely on exogenous regressors that werenot available at the time the forecast would have been issued, thereby overlooking key real-timeforecasting constraintsi. At the same time, commercial forecasting solutions remain predominantlyclosed-source, preventing transparent quality assessment and inhibiting trust in their performanceclaims (see, e.g., Semmelmann7 (2025) or Stupperich8 (2025)).This paper introduces a benchmark arena for real-time energy forecasting. The platform providesthe first open, API-driven environment where researchers and practitioners can submit day-aheadforecasts for electricity prices, load, and renewable generation. All submissions are evaluated onceactual values are published, ensuring assessment under true real-time conditions. Standardizedmetrics are computed automatically, and a public leaderboard ranks models based on rolling-horizon performance (e.g., the best results over the last 30, 90, or 365 days). This enablessystematic comparison of forecasting solutions, quantifying real performance differences andproviding an evidence-based view of methodological progress. By continuously reflectingcontemporary market dynamics, the benchmark arena establishes a transparent, reproducible, anddynamically evolving reference for forecasting quality.


Contributing Institute(s):
  1. Jülicher Systemanalyse (ICE-2)
Research Program(s):
  1. 1111 - Effective System Transformation Pathways (POF4-111) (POF4-111)
  2. 1112 - Societally Feasible Transformation Pathways (POF4-111) (POF4-111)

Appears in the scientific report 2026
Click to display QR Code for this record

The record appears in these collections:
Document types > Presentations > Abstracts
Institute Collections > ICE > ICE-2
Workflow collections > Public records
Publications database

 Record created 2026-06-30, last modified 2026-07-01



Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)