Energy-Arena: A Dynamic Benchmark for Operational Energy Forecasting
2026-04-27 • Machine Learning
Machine Learning
AI summaryⓘ
The authors point out that energy forecasting research often struggles with comparing different models fairly because each study uses its own data and testing rules. To fix this, they created Energy-Arena, a platform that continuously evaluates forecasting models using up-to-date data and clear rules. This setup helps make sure all models are judged the same way and stops unfair advantages from using future information. The platform is open to everyone and offers live leaderboards to track performance over time.
energy forecastingbenchmarkingtime seriesevaluationleaderboardAPIoperational constraintsbacktestinginformation leakageex-ante submission
Authors
Max Kleinebrahm, Jonathan Berrisch, Philipp Eiser, Wolf Fichtner, Veit Hagenmeyer, Matthias Hertel, Nils Koster, Sebastian Lerch, Ralf Mikut, Jan Priesmann, Melanie Schienle, Benjamin Schaefer, Jann Weinand, Florian Ziel
Abstract
Energy forecasting research faces a persistent comparability gap that makes it difficult to measure consistent progress over time. Reported accuracy gains are often not directly comparable because models are evaluated under study-specific datasets, time periods, information sets, and scoring setups, while widely used benchmarks and competition datasets are typically tied to fixed historical windows. This paper introduces the Energy-Arena, a dynamic benchmarking platform for operational energy time series forecasting that provides a continuously updated reference point as energy systems evolve. The platform operates as an open, API-based submission system and standardizes challenge definitions and submission deadlines aligned with operational constraints. Performance is reported on rolling evaluation windows via persistent leaderboards. By moving from retrospective backtesting to forward-looking benchmarking, the Energy-Arena enforces standardized ex-ante submission and ex-post evaluation, thereby improving transparency by preventing information leakage and retroactive tuning. The platform is publicly available at Energy-Arena.org.