arXiv AI

EF-LLM: A Continual Learning-Based Framework for AI-Assisted Automation, Enhanced Sparse Prediction, and Hallucination Detection

EF-LLM is a continual learning framework that combines domain knowledge, temporal data, and multimodal inputs to forecast energy demand and generation. It uses updatable Low‑Rank Adaptation and a multi‑channel architecture to continuously adapt to new data, improving accuracy especially under sparse‑data conditions. The model also uniquely detects and quantifies hallucinations through multi‑task learning and semantic similarity analysis.

arXiv AI
Oct 5

Automated Feature Engineering, AutoML, and Decision-Focused Learning for Improved Energy Consumption Forecasting

The thesis presents a domain‑specific automated feature engineering pipeline, AutoEnergy, for energy consumption forecasting. AutoEnergy generates interpretable features from timestamps and lagged consumption, integrates with AutoML, and achieves 19.52%–84.72% error reductions across eighteen real‑world datasets while running 1.31–4.41 times faster than baseline methods. When combined with Decision‑Focused Learning for battery storage, it cuts operating costs by 22.9%–56.5% on a UK property dataset.

By Nasser Alkhulaifi
arXiv Machine Learning
Sep 18

Fast Training of Mixture-of-Experts for Time Series Forecasting via Expert Loss Integration

The paper introduces an adaptive Mixture-of-Experts (MoE) framework for time series forecasting that incorporates expert-specific losses to give each expert a direct learning signal independent of gating weights. The overall objective combines base forecasting loss with these expert losses, encouraging experts to specialize on different temporal segments. A partial online learning strategy is added for efficient incremental updates, and experiments on economic, tourism, and energy datasets show the method outperforms state‑of‑the‑art neural models and foundation models, with ablation studies confirming the benefit of expert loss integration.

By Btissame El Mahtout, Florian Ziel
arXiv AI
Oct 19

Accurate and Efficient Multi-Channel Time Series Forecasting via Sparse Attention Mechanism

The paper introduces Li‑Net, a new architecture for multi‑channel time series forecasting that captures both linear and non‑linear dependencies among channels. Li‑Net compresses representations across sequence and channel dimensions, processes them with a configurable non‑linear module, and reconstructs forecasts while integrating a sparse Top‑K Softmax attention mechanism within a multi‑scale projection framework. Experiments on real‑world benchmarks show that Li‑Net matches state‑of‑the‑art accuracy while using less memory and achieving faster inference, with ablation studies confirming the contribution of each component.

By Lei Gao, Hengda Bao, Jingfei Fang, Guangzheng Wu, Weihua Zhou, Yun Zhou
arXiv Machine Learning
Aug 19

TiMi: Empower Time Series Transformers with Multimodal Mixture of Experts

The paper introduces TiMi, a framework that enhances time series transformers with a Multimodal Mixture-of-Experts (MMoE) module to incorporate multimodal data, especially textual information, into forecasting. TiMi leverages large language models to generate future inferences that guide predictions, eliminating the need for explicit representation alignment. Experiments show TiMi achieves state‑of‑the‑art performance on sixteen real‑world multimodal forecasting benchmarks, outperforming advanced baselines while maintaining adaptability and interpretability.

By Jiafeng Lin, Yuxuan Wang, Huakun Luo, Jianmin Wang, Zhongyi Pei
arXiv Machine Learning
Jun 15

Trend-Aware Multi-Task Learning for Short-Term Energy Forecasting

arXiv:2511. 09789v3 Announce Type: replace Abstract: Short-term energy forecasting plays an important role in real-time operational decision-making, such as electricity market bidding and power system dispatch, where both numerical accuracy and correct directional signals are essential.

By Fulong Yao, Wanqing Zhao, Chao Zheng, Xiaofei Han
arXiv Machine Learning
Oct 5

MACTS-EM: Multi-Agent Collaborative Time Series Forecasting with Emergent Memory

MACTS-EM is a new multi‑agent framework for time series forecasting that combines domain‑specialised agents, a meta‑cognitive allocation layer, emergent memory for cross‑domain transfer, multimodal context integration, and adversarial robustness. The authors evaluate the system on financial, climate, energy, and pandemic data, reporting 8‑12% higher accuracy, 22‑27% better zero‑shot transfer, 16‑21% greater resilience to regime shifts, and 15‑18% faster recovery from distribution changes compared to existing methods. These results suggest that collaborative, agent‑based approaches can outperform traditional architectures in complex, real‑world forecasting tasks.

By Ahmad Shahi, Mamehgol Yousefi
arXiv Machine Learning
Jul 31

Bridging AI and Energy Forecasting: An Autonomous Workflow with Customized Toolkit

arXiv:2307. 07191v3 Announce Type: replace Abstract: Energy forecasting is crucial for the power grid, but fundamentally different from general time series analysis: it highly relies on covariates like meteorological factors, and its goals must align with actual power grid operations, such as risk assessment and system reliability.

By Zhixian Wang, Leandro Von Krannichfeldt, Qingsong Wen, Chaoli Zhang, Liang Sun, Shirui Pan, Yi Wang