arXiv Machine Learning By Tong Guan, Tianxiang Zhan, Shirui Pan, Ming Jin

Rethinking Agentic Model Orchestration for Time Series Forecasting

Read the original on arXiv Machine Learning →

The paper introduces FairAMO, a controlled protocol to evaluate agentic model orchestration (AMO) for time‑series forecasting by freezing candidate forecasts. Experiments on GIFT‑Eval show that while AMO can improve accuracy, its gains are limited by the quality and complementarity of the underlying TSFMs, with reductions in MASE below 6% relative to the best single model. Adding more candidates yields diminishing returns, and redundant members can negate benefits, indicating that historical evidence saturates quickly and that orchestration’s contribution is modest compared to the candidate models themselves.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Oct 15

GIFT-Eval-CTX: A Benchmark For Contextual Forecasting Model Evaluation

GIFT‑Eval‑CTX is a new benchmark for contextual forecasting that tests whether models can use verified future information to produce accurate time‑series predictions. It builds on GIFT‑Eval and contains 10,000 instances across 20 datasets, each annotated with macro‑level and micro‑level effects derived from actual future events. The benchmark evaluates traditional TSFMs, advanced LLMs, and agentic systems, showing that structured effects can substantially lower MASE for models like GPT‑5.6 Sol and Claude Opus 4.8, with MoiraiAgent achieving the best overall performance.

By Xu Liu, Hanshu Yan, Taha Aksu, Quang Pham, Zhongzheng Qiao, Jun Hao Liew, Silvio Savarese, Doyen Sahoo, Junnan Li
arXiv Machine Learning
Oct 16

TimeRSI: Towards Self-Improved Agentic Deployment for Time-Series Foundation Models

TimeRSI is a self‑improving deployment system for time‑series foundation models that automates the creation and refinement of forecasting pipelines. A coding agent translates task descriptions into executable changes, tests each revision on historical data, and uses error feedback to guide further revisions. During live deployment, an adaptive selector chooses the best pipeline based on completed forecasts under similar conditions, achieving superior performance on 198 tasks compared to all other submissions.

By Haoxin Liu, Deqing Fu, Lucheng Fu, Yiqiao Jin, Rushi Qiang, Harshavardhan Kamarthi, B. Aditya Prakash