arXiv AI
Foundation Models for Event Prediction Across Heterogeneous Event Logs
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
Hugging Face Trending Papers
Oct 13
Foundation Models for Event Prediction Across Heterogeneous Event Logs
The paper introduces the Foundation Event Predictor (FEP), a scalable in‑context architecture that performs next‑event prediction across diverse event logs using learned, event‑level nonparametric inference. FEP employs causal self‑attention to encode context and target histories, cross‑attention for relevance‑weighted aggregation, and permutation‑robust embedding learning to decouple event IDs from semantics. Trained on 696 real‑world datasets and evaluated on 50 unseen ones, FEP generalizes effectively to new systems without parameter adaptation, often matching or surpassing models trained separately on each target dataset.
arXiv AI
Jun 10
Time Series as Language: A Universal Tokenizer for General-Purpose Time Series Foundation Models
arXiv:2606. 09861v1 Announce Type: cross Abstract: While Next-Token Prediction (NTP) has unified LLM pretraining, its adaptation to unbounded, continuous time series (TS) remains open.
arXiv Machine Learning
Aug 31
D-TAIA: Domain-Aware LLM Adaptation for Multi-Task Predictive Process Monitoring
D-TAIA is a framework that adapts large language models for multi‑task predictive process monitoring, jointly predicting the next activity and remaining time of ongoing cases. It uses domain‑aware triplet loss pre‑training, FAISS‑based nearest‑neighbor retrieval for time estimation, and a TAIA inference strategy to preserve sequential reasoning while fine‑tuning a 10 M‑parameter backbone. Across four real‑world event logs, D‑TAIA achieves state‑of‑the‑art or competitive results compared to a fine‑tuned LLM and a recurrent neural network baseline, with ablation studies showing the effectiveness of NLP and computer‑vision techniques for this domain.
arXiv Machine Learning
Sep 22
Universal Multi-Modal Traceformer: Integrating Heterogeneous Context for Process Event Prediction
arXiv:2609.24579v1 Announce Type: new Abstract: Event logs arise in a wide range of real-world processes, capturing not only event activities and timestamps but also multi-modal contextual informatio...
arXiv Machine Learning
Jun 8
One Loss to Rule Them All: Marked Time-to-Event for Structured EHR Foundation Models
arXiv:2602. 00541v2 Announce Type: replace Abstract: Clinical events captured in Electronic Health Records (EHR) are irregularly sampled and may consist of a mixture of discrete events and numerical measurements, such as laboratory values or treatment dosages.
arXiv AI
Oct 12
KITE: A Knowledge-Injected Temporal Encoder for Time-Series Event Forecasting
KITE is a knowledge‑injected temporal encoder that augments self‑supervised event forecasting with semantic priors supplied by system engineers. It uses two switchable mechanisms—a covariate mechanism and an attention‑bias mechanism—so the same architecture can incorporate different prior types without per‑dataset tuning. Experiments show that informative priors improve performance in short contexts and enable out‑of‑domain transfer, while priors already present in the observed window have little effect.