arXiv:2607. 03551v1 Announce Type: new Abstract: Weight space learning aims to learn representations of neural network (NN) weights, enabling different downstream tasks.
By Aron Asefaw, Konstantinos Tzevelekakis, Damian Falk, L\'eo Meynent, Damian Borth
The paper investigates treating LoRA adapters as a data modality by training a transformer autoencoder to map adapter weights into a learned latent space. It finds that this latent representation preserves the same capabilities as raw weight space—such as sampling, editing, and inversion—while offering greater robustness to displacement, producing distorted yet valid faces instead of texture loss. Additionally, the authors extend the model to accommodate mixed-rank adapters, enabling a single shared latent to host heterogeneous adapter architectures.
By Moritz Gr\"avinghoff, Konstantin Wehmeyer, Aron Asefaw, Boris Knyazev, Damian Borth
The paper investigates treating LoRA adapters as a data modality rather than finished artifacts. By training a transformer autoencoder on LoRA identity adapters, the authors map the adapters into a learned, nonlinear latent space and compare operations such as sampling, editing, and inversion against direct weight-space manipulation. The latent space preserves all capabilities of weight space, offers greater robustness to displacement, and can accommodate mixed-rank adapters within a single shared representation, suggesting a path toward a general, rank‑agnostic adapter modality.
arXiv:2512. 20963v3 Announce Type: replace Abstract: Diffusion models excel at generating high-quality, diverse samples, yet they risk memorizing training data when overfit to the training objective.
By Zekai Zhang, Xiao Li, Xiang Li, Lianghe Shi, Meng Wu, Molei Tao, Qing Qu
arXiv:2610.15571v2 Announce Type: replace
Abstract: In this work, we propose a transfer learning algorithm for covariate shift, integrating sample reweighting with representation learning. A key feat...
By Yuling Jiao, Lican Kang, Yang Xiang, Jerry Zhijian Yang, Fusheng Zhou
arXiv:2306.08757v2 Announce Type: replace-cross
Abstract: While diffusion models excel at generating high-quality samples, their latent variables typically lack semantic meaning and are not suitable...
By Yingheng Wang, Yair Schiff, Aaron Gokaslan, Weishen Pan, Fei Wang, Christopher De Sa, Volodymyr Kuleshov