arXiv Machine Learning

Persistent Cross Entropy

arXiv AI
Sep 2

Persistent Entropy as a Detector of Phase Transitions

The paper presents a model‑agnostic theorem that provides conditions under which a structural change in a persistence barcode leads to a detectable change in persistent entropy. By treating persistence diagrams as random objects indexed by a control parameter, the authors identify a dispersion‑condensation mechanism in the normalized persistence weights and derive an explicit lower bound on the entropy difference between two regimes, valid with high probability at finite sample size and independent of the absolute scale of bar lifetimes. The criterion is applied to convolutional networks, revealing a sharp topological phase transition in the circular organization of learned filters, and it also detects the Kuramoto synchronization and Vicsek order‑disorder transitions.

By Marcos Gutierrez-del-Pozo, Eduardo Paluzo-Hidalgo, Matteo Rucco
arXiv Machine Learning
Jun 11

From Persistence to Survival: Hypothesis Testing, Effect Sizes and Vectorisation for Topological Features

arXiv:2606. 11911v1 Announce Type: cross Abstract: Persistence diagrams are common representations in topological data analysis, but they do not naturally live in a vector space, and the statistical tools developed for comparing them have largely evolved separately from those used for downstream prediction.

By Juliette Murris, Bernadette Stolz, Karsten Borgwardt
arXiv Machine Learning
Sep 23

What Does Chain-of-Thought Entropy Measure? A Channel Audit of Scaffolding, Routing, and Content

The paper investigates how entropy over chain‑of‑thought tokens influences policy decisions such as gradient application, pruning, and collapse detection. By separating scaffold tokens from substantive content, the authors analyze entropy, Kullback–Leibler divergence, and entropy velocity for each channel, proving differences between raw and content conventions and bounding answer diversity. Empirical results across 23 configurations show that scaffold tokens can account for up to 41% of high‑entropy positions, with entropy share growing through distillation, while content conventions outperform raw surprisal on compression tasks and reveal significant answer leakage in re‑fed chains.

By Marios Papamichalis, Regina Ruane
arXiv Machine Learning
5d ago

Persistent Homology of Time Series through Complex Networks

The paper introduces a unified pipeline that classifies univariate time series by first converting them into graphs using one of five constructions from three families (visibility, transition, proximity). The resulting graph is turned into a dissimilarity matrix, from which a Vietoris–Rips filtration produces persistence diagrams that are vectorized via persistence landscapes and topological summary statistics. Experiments on twelve UCR benchmarks reveal that no single graph construction dominates, diffusion distance consistently outperforms shortest-path metrics, and persistence-based features remain robust to noise.

By \.Ismail G\"uzel