Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

8,201 stories · RSS feed

arXiv Machine Learning
Sep 22

Beyond Task Completion: Training Capable and Safe Computer-Use Agents

The paper introduces SCOPE, a method that post‑trains computer‑use agents to balance task completion with safety by conditioning actions on environmental risk. It combines supervised fine‑tuning on three trajectory types—capability demonstrations, safe continuations, and explicit refusals—followed by reinforcement learning to improve performance. Experiments starting from Qwen3.5‑9B show that SCOPE‑RL achieves high task success and attack‑avoidance rates, outperforming other agents on OSWorld and OS‑BLIND benchmarks.

By Zeyu Kang, Zhenyun Yin, Yang Zhang, Shan He, Shanzhe Lei, Yanjiu Zhong, Xinquan Chen, Yuhong Wang
arXiv Computer Vision
Sep 22

VideoGen-Agent: Reinforcing Video Generation Agents

VideoGen-Agent is a multimodal agent that uses multitask agentic reinforcement learning to coordinate external tools for video generation. It learns to augment, generate, and verify videos through multi‑turn interactions, guided by prompts and intermediate observations. On the new VABench benchmark, the agent improves base text‑to‑video performance by 19.1 points, and further upgrades to generation tools raise the score to 86.1, with human raters favoring the upgraded configuration in 84.3% of comparisons.

By Binxu Li, Haoyi Duan, Yuhui Zhang, Yaohui Zhang, Zihao Lin, Kaituo Feng, Suozhi Huang, Xiangyi Li, Yu Li, Chunyuan Li, Shilong Liu, Mengdi Wang
arXiv Computation and Language
Sep 22

Apollo Restore: A Foundation LLM for Historical Greek Optimized for Fill-in-the-Middle Restoration of Ancient Greek Texts

Apollo Restore is a 24‑billion‑parameter large language model fine‑tuned from Mistral Small to fill in gaps in fragmentary Ancient Greek texts using a fill‑in‑the‑middle objective. It achieves state‑of‑the‑art performance on short lacunae, placing the correct restoration among its top twenty candidates for 80.6% of documentary‑papyrus, 54.6% of literary‑papyrus, and 61.0% of stone‑inscription gaps, outperforming previous models by significant margins. In blind expert evaluations, 20 specialists preferred Apollo Restore over the strongest baseline and judged its performance at least as good as human restorations in 77% of cases, while also improving the published reading of the Vesuvius‑carbonised papyrus P.Herc. 1667.

By Hope McGovern, Anna Dolganov, Samuel Belkadi, Guillaume Kunsch, Dimitris Vlitas, David A. Smith
arXiv Computer Vision
Sep 22

Beyond Uniform Subspaces: Spectrum-Aware and Depth-Adaptive Fusion for Multi-Task Model Merging

The paper introduces SADA-Merging, a new data‑free model merging framework that addresses limitations of existing subspace‑based methods. It allocates subspace capacity based on each task’s spectral complexity, adapts spectral preservation to task‑specific plasticity, and applies depth‑dependent anchoring to mitigate projection distortion. Experiments show that SADA‑Merging consistently outperforms current data‑free merging techniques across various task scales and adaptation settings.

By Ruxi Gu, Zilei Wang, Wei Wang
arXiv Computer Vision
Sep 22

0.5\%>100\%: Bidirectional Reciprocal Learning for Referring Image Segmentation

The paper introduces Bidirectional Reciprocal Learning (BRL), a parameter‑efficient fine‑tuning framework for referring image segmentation that operates on frozen vision foundation models. BRL employs two lightweight adapters—Reciprocal Attention Adapter (RAA) for token‑level cross‑modal attention and Reciprocal Gate Adapter (RGA) for channel‑level gating—to enable hierarchical, bidirectional information flow between vision and language. Experiments on RefCOCO, RefCOCO+, and RefCOCOg show that BRL outperforms existing methods while updating fewer than 0.5% of backbone parameters.

By Xiaoqiang Lu, Licheng Jiao, Lingling Li, Yuting Yang, Long Sun, Wenping Ma, Xu Liu, Fang Liu