arXiv:2501.18581v5 Announce Type: replace
Abstract: Bias-variance decompositions are widely used to understand the generalization performance of machine learning models. While the squared error loss...
By Tom Heskes
arXiv:2608. 10470v1 Announce Type: new Abstract: Fair representation learning with a continuous sensitive attribute $S$ requires a representation $Z$ that is statistically independent of $S$.
By Yijin Ni, Xiaoming Huo
arXiv:2104. 11547v5 Announce Type: replace-cross Abstract: Statistical models contain variables that are not random: parameters, treatments, environments, design points.
By Patrick Forr\'e
arXiv:2606. 29693v1 Announce Type: new Abstract: We ask a simple question about decoder-only transformers: \emph{between which two layers is the probability of a predicted token actually produced?
By Duc Anh Nguyen
arXiv:2608. 25138v1 Announce Type: new Abstract: Stochastic masking, cropping, or modality removal makes deterministic reconstruction an incomplete target: one observation can admit many clean completions.
By Jiarui Cao
arXiv:2608. 15215v1 Announce Type: cross Abstract: Token-level knowledge distillation (KD) matches two conditional distributions per position, yet the standard objectives compare them pointwise: a Kullback-Leibler gradient is blind to which wrong token receives probability mass.
By Gordei Verbii, Juho Lee
arXiv:2607. 23182v1 Announce Type: cross Abstract: We prove the identifiability of deep generative models (DGMs) with piecewise-affine (PWA) decoders and Gaussian mixture model (GMM) priors, in a purely unsupervised setting.
By Pengzhou Wu
arXiv:2605. 17232v5 Announce Type: replace Abstract: Discrete diffusion has become a leading framework for generative modeling in various applications including language, vision, and biology.
By Kelvin Kan, Xingjian Li, Benjamin J. Zhang, Tuhin Sahai, Stanley Osher, Markos A. Katsoulakis
arXiv:2609.27988v1 Announce Type: cross
Abstract: Methods operating on Vision Transformer (ViT) feature spaces typically rely on Euclidean distance or cosine similarity. This assumes that every direc...
By Andrew Bond, Ege Erdem \"Ozl\"u, Tuna \c{C}imen, Ilkin Umut Melanlioglu, Tolga Birdal, Erkut Erdem, Aykut Erdem
arXiv:2511. 01064v3 Announce Type: replace-cross Abstract: Variational inference (VI) approximates a target density $p$ by the best match $q$ in a family of tractable distributions.
By Charles C. Margossian, Isaac E. Rankin, Lawrence K. Saul
arXiv:2608. 11954v1 Announce Type: cross Abstract: Structured potential outcomes such as microscopy images may be recorded after an unknown, unit-specific transformation.
By Usef Faghihi, Amir Saki
arXiv:2610.19252v1 Announce Type: cross
Abstract: Fairness audits with several sensitive attributes are often performed one coordinate at a time. This can miss purely intersectional disparities: a sc...
By Agathe Fernandes Machado, Charlotte Jamotton, Arthur Charpentier