arXiv Computation and Language

Perceive, Solve, Reason: Progressive Capability Formation in Time Series-LLMs

arXiv AI
6d ago

STRIDE: Reasoning-Aware Training for Time Series Forecasting

STRIDE (Strategic Time-series Reasoning Injected via Distilled Embeddings) is a framework that embeds LLM reasoning directly into the continuous embedding space of Time Series Foundation Models (TSFMs). By distilling reasoning traces into a lightweight LLM and projecting its pooled hidden states as a continuous cross‑modal prior, STRIDE integrates semantic reasoning without fragmenting numerical values or inflating sequence lengths. The method is jointly optimized with cross‑entropy and quantile losses, can be attached to various TSFM architectures, and achieves top performance on the GIFT‑Eval leaderboard and strong results on TFRBench, with ablations showing that the gains come from strategic reasoning integration.

By Md Atik Ahamed, Mihir Parmar, Palash Goyal, Chun-Liang Li, Qiang Cheng, Tomas Pfister, Jinsung Yoon
arXiv AI
Sep 25

TimeBraid: Unifying Time Series and Language for Understanding and Forecasting

TimeBraid is a family of unified models that combine pretrained language models with pretrained time‑series foundation models using interleaved global residual attention layers. The models inherit instruction following, reasoning, and continuous‑signal perception, fusing both modalities into a shared representation space for understanding and generation. The design focuses on aligning representation spaces, grounding language in temporal structure, balancing understanding with generation, and maintaining stable joint optimization, supported by 2.2 M curated series‑text pairs and 4.9 M instruction‑tuning samples. Across diverse benchmarks, TimeBraid competes with larger general‑purpose and task‑specific models.

By Xinyue Wang, Jiacheng Pang, Kun Zhou, Kexin Zhang, Defu Cao, Fan Feng, Faisal, Songyao Jin, Yan Liu, Biwei Huang
arXiv Machine Learning
Oct 9

Lapras: Latent Reasoning for Time Series Language Models

Lapras is a post‑training framework for Time Series Language Models that replaces explicit Chain‑of‑Thought reasoning with continuous latent thoughts in a joint time‑series‑language space. By self‑distilling from a teacher that generates textual rationales, the student model aligns its hidden states at the answer stage, transferring reasoning ability while producing only the final answer in text. Experiments on four TSLM backbones and five benchmarks show Lapras boosts average F1 by up to 10.79% over explicit CoT and reduces token generation by 23.9×, while still enabling readable reasoning traces through standard decoding.

By Yuliang Chen, Yu Yvonne Wu, Patrick Langer, Arvind Pillai, Sudarshan Regmi, Martin Maritsch, Juncheng Liu, Robert Jakob, Thomas Kaar, Tess Z. Griffin, Lisa Marsch, Michael V. Heinz, Nicholas C. Jacobson, Andrew Campbell
arXiv AI
Oct 16

Twice Upon a Time: Complementary Representations for Time-Series Reasoning

The paper introduces a dual‑view approach for time‑series language models, combining line plots that preserve absolute measurements with normalized delay embeddings that highlight temporal structure. By fusing these complementary visual representations through dedicated encoders and multi‑level feature fusion, the model achieves significant performance gains on several benchmarks, outperforming single‑view baselines and existing TSLMs. The results demonstrate that preserving both measurement frame and temporal structure is an effective design principle for general‑purpose time‑series reasoning.

By Hedi Zisling, Liran Nochumsohn, Ilan Naiman, Mihir Parmar, Omri Azencot