arXiv Machine Learning By Zhuoqian Yang, Mathieu Salzmann, Sabine S\"usstrunk

Weight Space Representation Learning via Neural Field Adaptation

Read the original on arXiv Machine Learning →

arXiv:2512. 01759v3 Announce Type: replace Abstract: We investigate the potential of weights to serve as effective representations, focusing on neural fields.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
3d ago

Adapters as Data: The Latent Space of LoRAs

The paper investigates treating LoRA adapters as a data modality by training a transformer autoencoder to map adapter weights into a learned latent space. It finds that this latent representation preserves the same capabilities as raw weight space—such as sampling, editing, and inversion—while offering greater robustness to displacement, producing distorted yet valid faces instead of texture loss. Additionally, the authors extend the model to accommodate mixed-rank adapters, enabling a single shared latent to host heterogeneous adapter architectures.

By Moritz Gr\"avinghoff, Konstantin Wehmeyer, Aron Asefaw, Boris Knyazev, Damian Borth
Hugging Face Trending Papers
4d ago

Adapters as Data: The Latent Space of LoRAs

The paper investigates treating LoRA adapters as a data modality rather than finished artifacts. By training a transformer autoencoder on LoRA identity adapters, the authors map the adapters into a learned, nonlinear latent space and compare operations such as sampling, editing, and inversion against direct weight-space manipulation. The latent space preserves all capabilities of weight space, offers greater robustness to displacement, and can accommodate mixed-rank adapters within a single shared representation, suggesting a path toward a general, rank‑agnostic adapter modality.