Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

3,721 stories · RSS feed

arXiv AI

Jun 30

Distilling a Modular Reservoir Through a Genomic Bottleneck

arXiv:2606. 28380v1 Announce Type: cross Abstract: The intricate structures of biological neural networks largely emerge during development, guided by a comparatively compressed blueprint encoded in the genome.

By Mani Hamidi, Sina Khajehabdollahi, Charley M. Wu, Emmanouil Giannakakis

fine-tuning

arXiv AI

Jun 30

Conversational Query Engine for Mixed-Modality Heterogeneous Enterprise Data Sources

arXiv:2606. 28370v1 Announce Type: cross Abstract: Enterprise business intelligence queries span structured warehouses and unstructured document repositories -- modalities with fundamentally different access methods, cost profiles, and correctness semantics.

By Darshita Rathore, Vineet Kumar, Vaibhav Singal, Ankur Vivek Singh, Anindya Moitra

llms rag agents fine-tuning benchmarks

arXiv AI

Jun 30

Domain Adaptation with Adaptive Imagination for Visual Reinforcement Learning under Limited Target Data

arXiv:2606. 30192v1 Announce Type: new Abstract: Sim-to-real transfer remains a major obstacle for reinforcement learning (RL), especially for vision-based control where image observations exacerbate the state-distribution shift between simulation and the real world.

By Hyunwoo Park, Sang-Hyun Lee

reinforcement-learning robotics fine-tuning

arXiv AI

Jun 30

Child-Centric Voice Anonymization in Single and Multi-Speaker Speech via Domain-Adapted SSL Models

arXiv:2606. 29897v1 Announce Type: cross Abstract: Voice anonymization aims to protect speaker identity while preserving linguistic content and speech usability.

By Pranav Tushar, Xiao Xiao Miao, Rong Tong

fine-tuning safety

arXiv AI

Jun 30

Do We Still Need Fine Tuning? Turkish Sentiment Analysis in the Era of Large Language Model

arXiv:2606. 29614v1 Announce Type: cross Abstract: This study examines whether supervised fine-tuning remains necessary for Turkish sentiment analysis in the era of large language models.

By Sercan Karaka\c{s}, Yusuf \c{S}im\c{s}ek

llms nlp fine-tuning

arXiv AI

Jun 30

Learning from Mistakes: Rollout-Retrieval Lifelong Policy Learning for Autonomous Driving

arXiv:2606. 30537v1 Announce Type: cross Abstract: Autonomous driving policies should be able to improve continually as deployment exposes them to increasingly diverse and long-tail traffic situations.

By Cheng Gong, Haoyang Wang, Chao Lu, Zirui Li, Jianwei Gong

agents robotics fine-tuning benchmarks

arXiv AI

Jun 30

Beyond Scaling Law: A Data-Efficient Distillation Framework for Reasoning

arXiv:2508. 09883v2 Announce Type: replace-cross Abstract: Large language models (LLMs) demonstrate remarkable reasoning capabilities in tasks such as algorithmic coding and mathematical problem-solving.

By Xiaojun Wu, Xiaoguang Jiang, Huiyang Li, Jucai Zhai, Dengfeng Liu, Qiaobo Hao, Huang Liu, Zhiguo Yang, Ji Xie, Ninglun Gu, Jin Yang, Kailai Zhang, Yelun Bao, Jun Wang

llms reinforcement-learning fine-tuning efficiency benchmarks

arXiv Machine Learning

Jun 30

BaRA: Bayesian Adaptive Rank Allocation for Parameter-Efficient Fine-Tuning

arXiv:2606. 29184v1 Announce Type: new Abstract: While Low-rank adaptation (LoRA) enables highly efficient fine-tuning by constraining task-specific updates to fixed low-rank subspaces, this rigid design limits representational flexibility and often results in overconfident predictions and miscalibrated uncertainty, especially in low-data regimes.

By Zhibin Duan, Yuhong Wang, Jiahong Fu, Zongsheng Yue, Bo Chen, Zongben Xu

fine-tuning benchmarks

arXiv AI

Jun 30

GPC: Large-Scale Generative Pretraining for Transferable Motor Control

arXiv:2606. 29148v1 Announce Type: cross Abstract: Developing controllers capable of completing a wide range of tasks in a natural and life-like manner is a key challenge in enabling practical applications of physics-based character animation.

By Yi Shi, Yifeng Jiang, Chen Tessler, Xue Bin Peng

llms nlp reinforcement-learning fine-tuning efficiency

arXiv AI

Jun 30

Reward-Free Code Alignment from Pretrained or Fine-Tuned LLM: Unpacking the Trade-offs for Code Generation

arXiv:2606. 28998v1 Announce Type: cross Abstract: Large Language Model (LLM) alignment trains an LLM using preference data to produce outputs that better meet established quality standards.

By Gias Uddin, Sanjeepan Sivapiran

llms reinforcement-learning fine-tuning benchmarks safety

arXiv AI

Jun 30

Customized Generative AI Agent for Transportation Engineering Practice: A Development and Continued Pre-training Guideline

arXiv:2606. 29014v1 Announce Type: new Abstract: Recent advancements in generative artificial intelligence (AI) and large language models (LLMs) have shown significant promise in automating complex reasoning, summarization, and question-answering tasks.

By Dianwei Chen (Terry), Yuan-Zheng Lei (Terry), Zifan Zhang (Terry), Yuchen Liu (Terry), Xianfeng (Terry), Yang

llms agents nlp fine-tuning benchmarks safety

arXiv AI

Jun 30

McMg: A Learned Phase-Space Multi-channel Multigrid Preconditioner for Helmholtz Equation

arXiv:2606. 30495v1 Announce Type: cross Abstract: Solving heterogeneous Helmholtz equations at high wavenumbers remains challenging because the discretized operator is indefinite, pollution degrades phase accuracy, and scalar coarse-grid correction can discard the local phase and propagation-direction information carried by oscillatory errors.

By Jiwei Jia, Xinliang Liu, Juntao Wang, Jinchao Xu

fine-tuning

arXiv AI

Jun 30

Translating Natural Language to Strategic Temporal Specifications via LLMs

arXiv:2606. 30441v1 Announce Type: cross Abstract: A rigorous formalization of system requirements is a fundamental prerequisite for the verification of Multi-Agent Systems (MAS).

By Marco Aruta, Francesco Improta, Vadim Malvone, Aniello Murano, Vladana Perlic

llms agents fine-tuning

arXiv AI

Jun 30

Animation2Code: Evaluating Temporal Visual Reasoning in Video-to-Code Generation

arXiv:2606. 28593v1 Announce Type: cross Abstract: While recent vision-language models (VLMs) have achieved significant improvements on static visual-to-code tasks such as generating code for webpages, charts, or SVGs, it remains unclear whether they can recover temporal dynamics when motion is present.

By Anya Ji, Abhijith Varma Mudunuri, David M. Chan, Alane Suhr

llms fine-tuning multimodal benchmarks safety

arXiv AI

Jun 30

Internalized Reasoning for Long-Context Visual Document Understanding

arXiv:2604. 02371v2 Announce Type: replace-cross Abstract: Visual long-document understanding is critical for enterprise, legal, and scientific applications, yet the best performing open recipes have not explored reasoning, a capability which has driven leaps in math and code performance.

By Austin Veselka

llms fine-tuning efficiency data-engineering

arXiv Machine Learning

Jun 30

Your Data Manifold is Secretly a Reward Model: Shell-LCC for Text-to-Video Generation

arXiv:2606. 30248v1 Announce Type: cross Abstract: Recent text-to-video (T2V) diffusion models rely heavily on auxiliary reward signals (e.

By Shihao Zhang, Yuguang Yan, Junzhe Zhang, Wei Zhao, Bohan Wang, Hanwang Zhang

diffusion reinforcement-learning fine-tuning

arXiv AI

Jun 30

The Heterogeneous Safety Impacts of Benign Multilingual Fine-Tuning

arXiv:2606. 28843v1 Announce Type: cross Abstract: Fine-tuning a large language model is a ubiquitous method for enhancing its capability on a specific downstream task.

By Will Hawkins, Kaivalya Rawal, Jonathan Rystr{\o}m, Stratis Tsirtsis, Zihao Fu, Greta Warren, Ryan Brown, Eoin Delaney, Sandra Wachter, Brent Mittelstadt, Chris Russell

llms fine-tuning safety

arXiv Machine Learning

Jun 30

HiAP: A Multi-Granular Stochastic Auto-Pruning Framework for Vision Transformers

arXiv:2603. 12222v2 Announce Type: replace-cross Abstract: Vision Transformers require significant computational resources and memory bandwidth, severely limiting their deployment on resource-constraint hardware.

By Andy Li, Aiden Durrant, Milan Markovic, Georgios Leontidis

llms fine-tuning efficiency

arXiv AI

Jun 30

Dockerless: Environment-Free Program Verifier for Coding Agents

arXiv:2606. 28436v1 Announce Type: cross Abstract: Program verifiers play a central role in training coding agents, including selecting trajectories for supervised fine-tuning (SFT) and providing rewards for reinforcement learning (RL).

By Wenhao Zeng, Yuling Shi, Xiaodong Gu, Chao Hu, Chaofan Wang, Yuhao Cui, Hongting Zhou, Mengnan Qi, Jianqiao Wangni, Zhaojian Yu, Shuzheng Gao, Kai Cai, Shilin He

agents reinforcement-learning fine-tuning benchmarks

arXiv Machine Learning

Jun 30

LoRAShield: Data-Free Editing Alignment for Secure Personalized LoRA Sharing

arXiv:2507. 07056v2 Announce Type: replace-cross Abstract: The proliferation of Low-Rank Adaptation (LoRA) models has democratized personalized text-to-image generation, enabling users to share lightweight models (e.

By Jiahao Chen, Junhao Li, Yiming Wang, Yong Yang, Yi Jiang, Chunyi Zhou, Qingming Li, Tianyu Du, Shouling Ji

llms diffusion fine-tuning safety

Get the daily briefing