arXiv Statistics ML
Generative sequence modeling for infinite memory processes via predictive states
Read the original on arXiv Statistics ML →The Flow has not summarised this story yet — read it at arXiv Statistics ML.
Related stories
arXiv Machine Learning
Jun 2
Theoretical Analysis of Engression and Reverse Markov Engression
arXiv:2606. 01002v1 Announce Type: cross Abstract: Engression is a recently proposed and effective framework for conditional distribution learning.
arXiv AI
Jun 2
Why Do Time Series Models Need Long Context Windows?
arXiv:2606. 01999v1 Announce Type: cross Abstract: Modern deep learning models for forecasting groups of time series rely on increasingly longer observation windows.
arXiv Machine Learning
Jul 21
Semi-Supervised Conditional Generative Learning through Stochastic Interpolation and Sufficient Representations
arXiv:2607. 16725v1 Announce Type: cross Abstract: Conditional generative modeling remains a challenging problem in semi-supervised settings where labeled data is scarce but unlabeled samples are abundant.
arXiv Machine Learning
Jul 28
Numerical Investigation of Sequence Modeling Theory using Controllable Memory Functions
arXiv:2506. 05678v3 Announce Type: replace Abstract: The evolution of sequence modeling architectures, from recurrent neural networks and convolutional models to Transformers and structured state-space models, reflects ongoing efforts to address the diverse temporal dependencies inherent in sequential data.
arXiv AI
Aug 7
The Impossibility Triangle of Long-Context Modeling
arXiv:2605. 05066v2 Announce Type: replace-cross Abstract: We identify and prove a fundamental trade-off governing long-sequence models: no model can simultaneously achieve (i) per-step computation independent of sequence length (Efficiency), (ii) state size independent of sequence length (Compactness), and (iii) the ability to recall a number of historical facts proportional to sequence length (Recall).
arXiv AI
Jun 2
Ideas in Inference-time Scaling can Benefit Generative Pre-training Algorithms
arXiv:2503. 07154v3 Announce Type: replace-cross Abstract: Generative pre-training is often framed through a false dichotomy between autoregressive models for discrete signals and diffusion models for continuous signals.