DES-JEPA introduces a joint-embedding predictive architecture that learns a shared discrete vocabulary from synthetic stochastic processes with unaligned event vocabularies. Coupled with DES-PFN, a prior‑fitted network that reuses this vocabulary for in‑context next‑event prediction, the framework can handle up to 700 distinct event types without task‑specific fine‑tuning. It achieves competitive zero‑shot performance on eight unseen real‑world datasets, addressing the limitations of current foundation models for high‑dimensional discrete event sequences.
By Hugo Math, Maximilian Forstenh\"ausler, Christos Anagnostopoulos
The paper introduces the Foundation Event Predictor (FEP), a scalable in‑context architecture that performs next‑event prediction across diverse event logs using learned, event‑level nonparametric inference. FEP employs causal self‑attention to encode context and target histories, cross‑attention for relevance‑weighted aggregation, and permutation‑robust embedding learning to decouple event IDs from semantics. Trained on 696 real‑world datasets and evaluated on 50 unseen ones, FEP generalizes effectively to new systems without parameter adaptation, often matching or surpassing models trained separately on each target dataset.
arXiv:2610.17503v1 Announce Type: cross
Abstract: Event logs are ubiquitous across real-world domains, including business processes, manufacturing workflows, healthcare, and many other operational sy...
By Fabian Spaeh, Sean Jaffe, Shandian Zhe, Bin Shen
arXiv:2607. 27797v1 Announce Type: new Abstract: Predictive process monitoring (PPM) leverages event logs to forecast the future of running process instances, for instance, predicting the next activity, the remaining time until case completion, or the time to the next event.
By Lennart Fertig, Lukas Kirchdorfer, Tobias Sesterhenn
arXiv:2608. 10120v1 Announce Type: new Abstract: Modern sequence models, from Transformers to State Space Models, have enabled powerful generative modeling across diverse domains, yet they are typically trained to predict what happens while treating when it happens as a secondary concern.
By Adrien Schoen, Nachiketa Ratnakar Patil, Arjun Bhagoji, Francesco Bronzino
arXiv:2606. 15868v1 Announce Type: new Abstract: Next activity prediction (NAP) is a cornerstone of predictive process monitoring (PPM), enabling organizations to move from retrospective analysis to proactive process steering.
By Hans Weytjens, Ingo Weber