arXiv Machine Learning By Brendan Mallery, Shuchin Aeron, James Murphy

Sparse Dictionary Learning for Measure-Valued Data via Linearized Optimal Transport: Efficient Algorithms and Sample Complexity

Read the original on arXiv Machine Learning →

The paper introduces a dictionary learning framework for probability measure-valued data by embedding measures into Hilbert spaces using features derived from optimal transport geometry. It learns data‑adapted dictionaries through sparse autoencoder parameterizations, yielding fast, scalable representations of probability measures as sparse finite‑dimensional codes. The authors demonstrate the method on hyperspectral images, geometric point clouds, and document embeddings from large language models, and provide generalization bounds and covering number results for optimal transport and entropic transport map dictionaries.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
5d ago

On the Sparsity-Storage-Accuracy Tradeoff in Parsimoniously Activated Dictionary Learning

The paper revisits parsimoniously activated dictionary learning (PADL), a method that imposes a global regularization on the number of activated dictionary atoms. It shows that PADL can be reformulated as a maximum a posteriori estimation under a structured generative model, enabling derivation of generalization guarantees and an analytical tradeoff between sparsity, storage cost, and reconstruction accuracy. Leveraging this insight, the authors propose an efficient PADL algorithm that removes manual hyperparameter tuning, improves reconstruction performance on visual benchmarks, and accelerates inference for vision‑language models.

By Zihui Zhao, Yuanbo Tang, Yang Li
arXiv Machine Learning
Oct 12

Linearized Wasserstein dimensionality reduction with approximation guarantees

The paper introduces LOT Wassmap, an algorithm designed to uncover low‑dimensional structures in the Wasserstein space without computing a full pairwise distance matrix. It leverages approximation schemes such as Sinkhorn distances and linearized optimal transport to accelerate computations, and provides theoretical guarantees on embedding quality even when only finite samples are available. Experiments show that LOT Wassmap achieves accurate embeddings that improve with larger sample sizes while significantly reducing computational cost compared to traditional pairwise‑distance‑based methods.

By Alexander Cloninger, Keaton Hamm, Varun Khurana, Caroline Moosm\"uller