arXiv AI By Wilmer Leal, Benjamin Merlin Bumpus, Jana K. Nickel, Johan Garc\'ia, James Fairbanks, Warren Dixon

Time-Varying Data as Sheaves: an Invitation to Narratives

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv AI
Sep 10

Memory in Deep Time-Series Models

arXiv:2609.06006v1 Announce Type: cross Abstract: Deep learning for time series has progressed through successive architectural paradigms, from recurrent networks and transformers to structured state...

By Minh Hoang Nguyen, Huu Hiep Nguyen, Manh Nguyen, Van Dai Do, Dung Nguyen, Hung Le
arXiv Machine Learning
Oct 22

Compression Through Time: An Interplay of Separability, Stationarity and Capacity

The paper investigates how information-theoretic and geometric compression unfolds over time in recurrent neural networks, specifically discretized LSTMs. It finds that compression is strongest at the final timesteps of many datasets and attributes this to three mechanisms: class separability, temporal stationarity of shared dynamics, and limited representational capacity. Through synthetic and real-world experiments, the authors demonstrate that these factors jointly determine the extent of temporal compression and its role as a regularizer when excess capacity exists, but can harm generalization when it consumes task-relevant memory.

By Nikolaus Kopp, Franz Pernkopf, Bernhard Geiger
arXiv Machine Learning
Oct 19

Where Latents Belong and How They Flow: Joint Identification of Structural Roles

The paper introduces a formal definition of the structural role of latent factors in dynamical systems, describing where a latent factor is expressed, whether it receives influence from past observations, and whether it transmits influence to future observations. It addresses the challenge of correspondence across different structural identifications and proves that, under certain conditions, all three roles can be jointly identified using a common permutation at each time point. Building on this theory, the authors present RoleTrace, a framework that traces these structural roles in a shared latent coordinate system, and validate its effectiveness through synthetic experiments and real-world multiparty meeting data.

By Xintong Li, Kun Zhang, Yujia Zheng