arXiv AI
Oct 16

Prospective multi-pathogen disease forecasting using autonomous LLM-guided tree search

The paper introduces Empirical Research Assistance (ERA), an autonomous system that employs Large Language Model‑guided tree search to create, evaluate, and refine executable forecasting software for infectious diseases. In a real‑time evaluation during the 2025‑26 U.S. respiratory season, ERA produced diverse models for influenza, COVID‑19, and RSV, and an ensemble of these models outperformed the CDC’s gold‑standard forecast ensembles across all three pathogens. ERA also demonstrated robustness in data‑scarce RSV scenarios and showed that higher‑tier language models and specific optimization metrics can improve forecast accuracy.

By Sarah Martinson, Michael P. Brenner, Martyna Plomecka, Brian P. Williams, Nicholas G. Reich, Zahra Shamsi
arXiv Machine Learning
Sep 22

Beyond Average Error through Oracle-Informed Stress Tests for Time-Series Forecasting

The paper introduces paired, mechanism‑controlled stress tests that decompose changes in expected squared error for time‑series forecasting into environmental risk and forecast‑oracle distance. Using an origin‑conditioned predictive oracle, the authors validate three end‑to‑end controls and apply the benchmark to 24 forecasters, revealing that many models exhibit higher realized MSE yet lower oracle distance under frequent switching, and that environmental risk dominates in most scenarios. The study also demonstrates that visually compelling discovery profiles often fail to replicate on independent data‑generating process realizations, underscoring the importance of component‑wise diagnosis and held‑out stability audits.

By Xu Lin (Tsinghua University, Beijing, China), Runheng Zuo (Tsinghua University, Beijing, China), Shengxuan Xu (Tsinghua University, Beijing, China), Qitai Tan (Tsinghua University, Beijing, China), Hongyu Lin (Tsinghua University, Beijing, China), Xiao-Ping Zhang (Tsinghua University, Beijing, China)