Hugging Face Trending Papers

What Should an Information Bottleneck Encoder Learn? Separating Representation Learning from Rate Control

arXiv Machine Learning
Oct 21

Communication Complexity of Universal Features

arXiv:2610.27402v1 Announce Type: cross Abstract: Motivated by the notion of features from machine learning, we study the complexity of representing data that allows for evaluation with a given famil...

By Lunjia Hu, Anish Jayant, Peter Li, Princewill Okoroafor, Abhishek Shetty
arXiv AI
Jul 3

Expander Sparse Autoencoders: Parameter-Efficient Dictionaries for Mechanistic Interpretability

arXiv:2607. 01799v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) decompose internal activations of neural networks into sparse linear combinations of learned features by fitting an overcomplete dictionary $\mathbf{W}\in\mathbb{R}^{m\times n}$ with $m<n$, and inferring a sparse code $\mathbf{x}\in\mathbb{R}^n$ from $\mathbf{h}\approx\mathbf{W}\mathbf{x}$.

By Rodrigo Mendoza-Smith
arXiv Machine Learning
Oct 16

The Lagrangian Structure of Cost-Penalized Active Feature Acquisition

The paper investigates Active Feature Acquisition (AFA), where features are selected sequentially to maximize predictive accuracy within a budget. It introduces a theoretical certificate that decomposes the gap between a greedy Expected Information Gain minus cost (EIG-Cost) policy and the optimal hard‑budget policy into a budget‑slack term and a greedy‑suboptimality term, δ_λ. Experiments on synthetic data, standard benchmarks, and a large clinical dataset (MIMIC‑IV) show that δ_λ is close to zero in many cases, and that EIG‑Cost achieves competitive performance while using only a small fraction of the full feature cost.

By Joseph Bingham
arXiv Computer Vision
Aug 24

When does fusing hand-crafted knowledge with learned representations pay? A cost-normalized benchmark of stacking, substitution, and interference

arXiv:2608.21098v1 Announce Type: new Abstract: Fusing prior knowledge with data-driven learning is attractive where data is scarce, yet no controlled account says when it helps, is redundant, or har...

By Ahmad AlMughrabi, Albert Clop, Benjamin Busam, Ricardo Marques, Petia Radeva