Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

8,201 stories · RSS feed

arXiv Computer Vision
Oct 22

Latent space configuration for neural network finetuning, fast ranking, and embedding dimensionality reduction

The paper introduces Latent Space Configuration (LSC) for fine‑tuning neural networks, enabling the creation of structured latent spaces that accelerate top‑K retrieval with O(1) candidate search. Using ArcFace‑pretrained IResNet50 models, the authors demonstrate up to three‑fold GPU speed‑ups and 40% CPU speed‑ups over exhaustive search, while also showing that reducing latent space dimensionality further speeds up queries and can improve rank‑N metrics.

By Nikita Gabdullin, Anton Raskovalov
arXiv Machine Learning
Oct 22

BatchBench: Benchmarking AI Robustness to Batch Effects and Domain Shift in Biomedical Images - A JUMP Cell Painting Leaderboard

BatchBench is a new leaderboard designed to assess AI robustness to batch effects and domain shift in biomedical images. It evaluates performance on unseen experimental batches and data sources using the large JUMP-CP dataset, which is generated via the Cell Painting assay and exhibits pronounced batch effects. The benchmark aims to highlight remaining performance gaps despite recent domain adaptation advances.

By Sonja Topf, Ana Sanchez-Fernandez, G\"unter Klambauer
arXiv Computation and Language
Oct 22

HybridResearcher: Bridging the Structured-Unstructured Boundary for Deep Research Agents

arXiv:2610.24899v2 Announce Type: replace-cross Abstract: While LLM agents are increasingly capable of gathering and synthesizing evidence from a single homogeneous source, such as structured tables...

By Soyoung Yoon, Peiran Xu, Han Wang, Ruofan Wu, Xiaodong Yu, Feng Yan, Mohit Bansal, Debiao Li, Seung-Won Hwang, Yuxiong He, Zhewei Yao
arXiv Machine Learning
Oct 22

Learning to Interfere in Non-Orthogonal Multiple-Access Joint Source-Channel Coding

The paper proposes a machine‑learning–based wireless image transmission scheme that merges compression and channel coding via a multi‑view autoencoder, enabling multiple transmitters to share the same channel resources simultaneously in a non‑orthogonal multiple‑access (NOMA) setting. A progressive fine‑tuning algorithm doubles the number of users at each iteration while preserving orthogonalized performance, allowing the system to support up to 64 users with only a 2.4 % increase in trainable parameters. The method improves recovered image quality and outperforms existing NOMA‑based approaches across various datasets, metrics, and channel conditions.

By Selim F. Yilmaz, Can Karamanli, Deniz Gunduz
arXiv Machine Learning
Oct 22

MCLR: Improving Conditional Modeling via Inter-Class Likelihood-Ratio Maximization and Unifying Classifier-Free Guidance with Alignment Objectives

arXiv:2603.22364v4 Announce Type: replace Abstract: Diffusion models achieve strong generative performance but often rely on classifier-free guidance (CFG), an inference-time intervention that modifi...

By Xiang Li, Yixuan Jia, Xiao Li, Jeffrey A. Fessler, Rongrong Wang, Qing Qu