arXiv Machine Learning

Delay-Guided Attention for Quality Prediction in Multistage Manufacturing

The paper introduces Delay‑Guided Attention for Multi‑stage Forecasting (DAMF), a method that explicitly models inter‑stage lag distributions in multistage manufacturing to improve quality prediction. DAMF uses a lag predictor to estimate the probability and magnitude of delays between adjacent stages, incorporates these soft distributions into cross‑stage attention, and employs gated residual fusion for information flow. The approach is evaluated on the LiquidSugar dataset and two controlled‑delay benchmarks, showing better quality prediction and more accurate lag recovery compared to baselines.

arXiv Machine Learning
Aug 31

D-TAIA: Domain-Aware LLM Adaptation for Multi-Task Predictive Process Monitoring

D-TAIA is a framework that adapts large language models for multi‑task predictive process monitoring, jointly predicting the next activity and remaining time of ongoing cases. It uses domain‑aware triplet loss pre‑training, FAISS‑based nearest‑neighbor retrieval for time estimation, and a TAIA inference strategy to preserve sequential reasoning while fine‑tuning a 10 M‑parameter backbone. Across four real‑world event logs, D‑TAIA achieves state‑of‑the‑art or competitive results compared to a fine‑tuned LLM and a recurrent neural network baseline, with ablation studies showing the effectiveness of NLP and computer‑vision techniques for this domain.

By Sjoerd van Straten, Christine Jacob, Marwan Hassani
arXiv Machine Learning
Jul 17

GAttNHP: Group Attention Neural Hawkes Process for Extrapolation Reasoning in Temporal Knowledge Graphs

arXiv:2607. 14733v1 Announce Type: new Abstract: Temporal Knowledge Graphs (TKGs) record how facts evolve over time, but forecasting future events on a TKG remains difficult for three reasons: (i) long-range temporal dependencies are hard to encode; (ii) events on different chains mutually excite or inhibit one another in ways that snapshot-level models cannot express; and (iii) inter-arrival times are heavy-tailed and statistically sparse, so deterministic time predictors are unreliable.

By Xiangni Tian, Kaixian Yu, Runpeng Dai, Niansheng Tang, Hongtu Zhu
arXiv AI
Oct 9

AliO: Output Alignment Matters in Long-Term Time Series Forecasing

AliO: Output Alignment Matters in Long-Term Time Series Forecasting proposes a new method, AliO, to improve output alignment in LTSF models by reducing discrepancies in prediction outputs for the same timestamps across both time and frequency domains. The authors introduce a Time Alignment Metric (TAM) to quantify alignment, contrasting with traditional MSE metrics that only measure distance to ground truth. Experiments demonstrate that AliO can increase TAM by up to 58.2% while maintaining or improving forecasting performance by up to 27.5%.

By Kwangryeol Park, Jaeho Kim, Seulki Lee
arXiv Machine Learning
Jun 8

Trio: Learning Time-Series Forecasting with Temporal-Spatial-Sample Attention and Structural Causal Priors

arXiv:2606. 07291v1 Announce Type: new Abstract: Multivariate time-series forecasting requires models to reason over temporal dynamics, cross-variable dependencies, and historical input-output correspondences.

By Tao Chen, Yexu Zhou, Zhi Gong, Hengwei He, Hongda Li, Zhewei Chen, Dongjing Wang, Xin Zhang, Decheng Liu, Chunlei Peng, Zheng Chen, Wenyue Ding
arXiv Machine Learning
Sep 1

Liquid Gated Attention

arXiv:2608.30695v1 Announce Type: new Abstract: Real-world time series often exhibit irregular sampling and extended temporal horizons, requiring models to capture continuous-time dynamics across arb...

By Yiheng Jiang, Yuanbo Xu, Yongjian Yang
arXiv AI
Sep 10

Quantile-Led Feature Extraction for Multi-Horizon Predictive Maintenance in Industrial Manufacturing Systems

The paper introduces a quantile‑led feature‑extraction framework for predictive maintenance that separates representation learning from downstream modeling. Using a dual‑stage MLP‑QRNN hierarchy, it learns a ten‑quantile distribution per sensor and refines a mid‑tail quantile set into compact, channel‑resolved features. Experiments on 72 machines across nine facilities show that increasing the retained mid‑tail quantiles improves short‑term F1 scores, and that horizon‑conditioned extractors outperform a fixed short‑horizon extractor, demonstrating that feature extraction should be horizon‑dependent rather than fixed preprocessing.

By David J Poland, Daniele Ravi, Na Helian
arXiv Machine Learning
Oct 9

SACQ: Structured Decoding with Memory-Conditioned Refinement for Long-Horizon Forecasting

SACQ introduces a structured prediction head for long‑horizon time‑series forecasting that replaces the traditional flatten readout. It uses a two‑stage decoding process: a coarse patch‑grid scaffold is first generated, then each future position is refined via cross‑attention over historical memory, with a learned gate merging the corrections. A batch‑adaptive scaled log‑cosh loss further stabilizes training under long horizons and noisy labels, leading to superior MSE/MAE performance across multiple backbones with minimal overhead.

By Guo Cheng, Zhengzhuo Xu, Chenchen Jing, Jingyi Hou
arXiv Machine Learning
Oct 12

HART: Hybrid Attention-RWKV Time series Foundation Model

The paper introduces HART, a Hybrid Attention-RWKV Time-series Foundation Model that alternates attention and RWKV blocks to improve long-horizon forecasting. It identifies a problem in RWKV-7 called Placeholder Idling Decay, where repeated state transitions degrade historical information during non-autoregressive multi-step forecasting. Experiments on GIFT-Eval and TIME-Benchmark show that HART outperforms pure RWKV on medium and long horizons while matching short-horizon performance, and achieves comparable long-horizon MASE to a much larger Transformer with only 36 M parameters.

By Qingwen Lin, Boyan Xu, Shifeng Xie, Zhifeng Hao, Keli Zhang, Ruichu Cai