arXiv Machine Learning

Design a Reliable LLM-Integrated Interface for Mortality Forecasting

arXiv:2606. 06235v1 Announce Type: new Abstract: Mortality forecasting plays an important role in actuarial and policy decision-making, but its implementation remains technically complex and inaccessible to non-expert users.

arXiv AI
Aug 25

LLM-based Agents for Forecasting and Prediction: Methods, Training, Evaluation, and Applications

arXiv:2608.23058v1 Announce Type: new Abstract: Large language models (LLMs) now support forecasting systems that combine language-based reasoning with temporal data, evidence retrieval, external too...

By Xiaogang Xu, Jiaqi Tang, Jianmin Chen, Yingying Yan, Zhenchao Tang, Xiangxin Zhou, Xiaobin Hu, Wei Wei, Jinfeng Wu, Qifeng Chen, Lu Zhou, Jiafei Wu, Zhe Liu, Jianwei Yin, Weimin Zheng
arXiv AI
Oct 16

Prospective multi-pathogen disease forecasting using autonomous LLM-guided tree search

The paper introduces Empirical Research Assistance (ERA), an autonomous system that employs Large Language Model‑guided tree search to create, evaluate, and refine executable forecasting software for infectious diseases. In a real‑time evaluation during the 2025‑26 U.S. respiratory season, ERA produced diverse models for influenza, COVID‑19, and RSV, and an ensemble of these models outperformed the CDC’s gold‑standard forecast ensembles across all three pathogens. ERA also demonstrated robustness in data‑scarce RSV scenarios and showed that higher‑tier language models and specific optimization metrics can improve forecast accuracy.

By Sarah Martinson, Michael P. Brenner, Martyna Plomecka, Brian P. Williams, Nicholas G. Reich, Zahra Shamsi
arXiv Machine Learning
Sep 22

SafeTune: A Unified Faithful Library for Auditing and Repairing Safety Drift in Fine-Tuned LLMs

SafeTune is a source‑available library that consolidates four safety‑intervention paradigms—post‑hoc weight recovery, safety‑constrained fine‑tuning, gradient‑based unlearning, and inference‑time steering—into a single, configuration‑driven workflow. It offers shared interpretability, evaluation, and deployment tools, and its modular registry allows easy addition of new methods, benchmarks, judges, models, and fine‑tuning domains. The authors demonstrate SafeTune with controlled comparisons and case studies in finance and medical deployments, showing how it characterizes safety drift, evaluates interventions on refusal‑behavior and capability metrics, and supports calibrated or layered mitigation.

By Pratinav Seth, Saisab Sadhu, Anshul Kaushal, Vinay Kumar Sankarapu
arXiv Machine Learning
Oct 19

CastClaw: A Human-in-the-Loop Autonomous Agent for Interactive Time Series Forecasting

CastClaw is an interactive forecasting system that combines an autonomous forecasting loop with a forecasting-oriented harness. Users define and refine forecasting tasks in natural language via command-line or Web interfaces, while an internal large language model agent selects tool actions or requests human feedback, using checked results to guide the forecasting process. The system integrates tool execution, state management, and validation, and has been evaluated on five public electricity‑price datasets, outperforming 16 baselines in point‑estimate MSE and MAE, with case studies on Nord Pool and North China electricity‑load data.

By Xiaoyu Tao, Mingyue Cheng, Ze Guo, Bokai Pan, Qi Liu, Shijin Wang, Enhong Chen
arXiv AI
Aug 12

Locally Deployable Small Language Models for Emergency Department Decision Support: A Systematic Benchmark of Fine-Tuning Strategies

arXiv:2608. 10273v1 Announce Type: cross Abstract: Deploying large language models (LLMs) for decision support in emergency departments (EDs) faces two major challenges: privacy risks of transmitting patient data to closed-source commercial LLMs and the lack of systematic evaluation of fine-tuning strategies for locally deployable open-source small language models (SLMs).

By Qingfeng Zhang, Yuanxiong Guo, Yanmin Gong
arXiv Machine Learning
Oct 22

SSMCGM-Stream: A Streaming State-Space Model for Personalized Diabetes Management

SSMCGM-Stream is a streaming state‑space model designed for personalized diabetes management. It updates a hidden state with each new glucose reading, enabling constant‑time forecasting, physiologically structured counterfactual reasoning, and interpretable forecasts via hidden‑state attribution. The model, evaluated on the T1DEXI cohort, matches strong neural baselines in accuracy while significantly lowering computational cost, making continuous on‑device decision support feasible.

By Shakson Isaac, Chirag Patel