Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

8,208 stories · RSS feed

arXiv Machine Learning

Jul 28

FlowCTS: On-policy Continuous Trajectory Supervision of Flow Models

arXiv:2607. 24522v1 Announce Type: new Abstract: While on-policy distillation (OPD) effectively addresses sparse rewards and exposure bias in large language model post-training, its extension to flow models remains underexplored.

By Kaiyang Ye, Yuan Ge, Junxiang Zhang, Bei Li, Ziming Zhu, Haishu Zhao, Xiaoqian Liu, Chenglong Wang, Jingbo Zhu, Zhengtao Yu, Tong Xiao

llms computer-vision reinforcement-learning fine-tuning efficiency safety

arXiv AI

Jul 28

Scaling GUI Agents with Visual State Transitions

arXiv:2607. 24112v1 Announce Type: new Abstract: We introduce State Transition Pretraining (STP) as a new scaling axis for GUI agents.

By Xiangyan Liu, Kaixin Li, Haonan Wang, Biao Wu, Meng Fang, Longxu Dou, Chao Du, Michael Qizhe Shieh, Tianyu Pang

agents fine-tuning multimodal benchmarks

arXiv AI

Jul 28

TextBridgeGNN: Pre-training Graph Neural Network for Cross-Domain Recommendation via Text-Guided Transfer

arXiv:2601. 02366v3 Announce Type: replace-cross Abstract: Graph-based recommendation has achieved great success in recent years.

By Yiwen Chen, Yiqing Wu, Huishi Luo, Fuzhen Zhuang, Deqing Wang, Zhao Zhang

llms rag fine-tuning

arXiv AI

Jul 28

ConsistencyGate: Preventing Memory Contamination in LLM Agents via Self-Consistency Admission Control

arXiv:2607. 22962v1 Announce Type: new Abstract: LLM agents that operate over many turns accumulate facts in an external memory store and reuse them as premises for downstream reasoning.

By Yan Zhang, Shibo Li

llms agents fine-tuning benchmarks

arXiv Machine Learning

Jul 28

MolCryst-MLIPs: A Machine-Learned Interatomic Potentials Database for Molecular Crystals

arXiv:2604. 13897v2 Announce Type: replace Abstract: We present an open Molecular Crystal (MC) database of Machine-Learned Interatomic Potentials (MLIP) called MolCryst-MLIPs.

By Adam Lahouari, Shen Ai, Jihye Han, Jillian Hoffstadt, Philipp Hoellmer, Charlotte Infante, Pulkita Jain, Sangram Kadam, Maya M. Martirossyan, Amara McCune, Hypatia Newton, Shlok J. Paul, Willmor Pena, Jonathan Raghoonanan, Sumon Sahu, Oliver Tan, Andrea Vergara, Jutta Rogal, Mark E. Tuckerman

fine-tuning benchmarks

arXiv AI

Jul 28

Do Small Models Use the Law You Give Them? Context-Injected Fine-Tuning for Legal QA in Bangladesh

arXiv:2607. 23446v1 Announce Type: cross Abstract: A small language model can receive the governing statutory provision and still answer incorrectly.

By Moniruzzaman Mahadi, Abrar Mohammed Tanzim Alam, Sayma Siddika Monalisa, Mir Mohammad Asif Abdullah, Swakkhar Shatabda, Md Adnan Arefeen

llms fine-tuning

arXiv Machine Learning

Jul 28

From Physics to Surrogate Intelligence: A Unified Electro-Thermo-Optimization Framework for TSV Networks

arXiv:2603. 29268v2 Announce Type: replace Abstract: High-density through-substrate vias (TSVs) enable 2.

By Mohamed Gharib, Leonid Popryho, Inna Partin-Vaisband

fine-tuning

arXiv Machine Learning

Jul 28

LanteRn: Latent Visual Structured Reasoning

arXiv:2603. 25629v2 Announce Type: replace-cross Abstract: While language reasoning models excel in many tasks, visual reasoning remains challenging for current large multimodal models (LMMs).

By Andr\'e G. Viveiros, Nuno Gon\c{c}alves, Matthias Lindemann, Andr\'e Martins

llms rag diffusion reinforcement-learning fine-tuning multimodal benchmarks

arXiv AI

Jul 28

PathScale-R1: Cross-scale Reasoning for Pathological Image Analysis

arXiv:2607. 23794v1 Announce Type: cross Abstract: Pathological diagnosis is inherently multi-scale, requiring the integration of global tissue architecture at low magnification with cellular morphology at higher magnification.

By Chi Phan, Tianyi Zhang, Yufeng Wu, Qiaochu Xue, Jiajie Zhang, Linghan Cai, Zeyu Liu, Sudong Wang, Yueming Jin, Dan Hu

llms nlp reinforcement-learning fine-tuning efficiency multimodal benchmarks safety

arXiv Machine Learning

Jul 28

Transfer Learning Architectures for Scalable Multi-Fidelity Bayesian Optimization

arXiv:2607. 23404v1 Announce Type: new Abstract: Self-driving laboratories increasingly rely on multi-fidelity Bayesian optimization (MFBO) to balance cheap, approximate evaluations against scarce, expensive ones, with a predictive surrogate at its core.

By Jaewook Lee, Ethan Errington, Christian D. Lorenz, Miao Guo

robotics fine-tuning benchmarks

arXiv AI

Jul 28

Knowledge-Centric Agents for Workflow Generation in ComfyUI

arXiv:2607. 15845v2 Announce Type: replace Abstract: Workflow generation in visual creation systems such as ComfyUI demands not only syntactic accuracy but also expert-level reasoning over modular compositions.

By Zhendong Li, Lei Sun, Ruibo Ming, He Zhang, Danda Pani Paudel, Luc Van Gool, Jinjin Gu

llms agents fine-tuning

arXiv AI

Jul 28

What CLIP Knows but Cannot Say: Recovering Negation from Frozen Intermediate Features

arXiv:2607. 23271v1 Announce Type: cross Abstract: Contrastive vision-language models such as CLIP map semantically opposite phrases (e.

By Chen-Yi Lu, Yueh-Shao Chen, Somali Chaterji

llms rag diffusion fine-tuning multimodal safety

arXiv AI

Jul 28

When Activation Oracles Learn Not to Read: Concept-Specific Blind Spots in Fine-Tuned Oracles

arXiv:2607. 23379v1 Announce Type: cross Abstract: Activation Oracles (AOs) are language models trained to answer natural-language questions about another model's internal activations.

By Tobias Bersia, Tatiana Gaintseva

llms fine-tuning benchmarks safety

arXiv AI

Jul 28

TriSP: Tri-Signal Structured Pruning for Large Language Models

arXiv:2607. 22587v1 Announce Type: new Abstract: Large language models (LLMs) achieve strong performance across diverse tasks but their deployment is constrained by the memory and compute cost of their parameters.

By Manel Kara laoua, Soumia Bouyahiaoui, Aicha Boutorh

llms fine-tuning efficiency

arXiv AI

Jul 28

LazyMem: Retrieve Broadly, Construct Selectively for Efficient Long-Term Agent Memory

arXiv:2607. 22690v1 Announce Type: new Abstract: Long-term memory lets LLM agents reuse past interactions, but raw dialogue histories are verbose and information-sparse.

By Jing Yu, Yibo Zhao, Jiaming Zhang, Xiang Li

llms agents reinforcement-learning fine-tuning benchmarks

arXiv AI

Jul 28

Understanding Human-like Solutions in Combinatorial Optimization via Learning and Search

arXiv:2607. 23854v1 Announce Type: new Abstract: Humans often find good solutions to combinatorial optimization problems that are computationally hard even for advanced computer algorithms.

By Haijiang Yan, Jian-Qiao Zhu, Liqiang Huang, Ming Meng

reinforcement-learning fine-tuning

arXiv Machine Learning

Jul 28

Beyond Scale and Generation: Understanding Language Model-based Entity Matching

arXiv:2607. 24688v1 Announce Type: cross Abstract: Entity matching identifies records that refer to the same real-world entity.

By Zeyu Zhang, Xue Li, Iacer Calixto, Paul Groth, Sebastian Schelter

llms rag fine-tuning benchmarks

arXiv Machine Learning

Jul 28

IKS-Instruct: A 24,000-Example Multilingual Dataset for Teaching Language Models Indian Knowledge Systems

arXiv:2607. 23322v1 Announce Type: cross Abstract: Instruction tuning has become the standard method for adapting large language models to follow human intent, yet existing instruction datasets are dominated by English-language general-knowledge tasks and lack coverage of specialized pedagogical domains.

By Shwetha Singaravelu, Gayathri Muruganantham, Lakshmi Rajendran, Santhosh Sivasubramani

llms fine-tuning

arXiv Machine Learning

Jul 28

SPRKD: Effective Knowledge Distillation for Deep Neural Networks via Saddle Region Approximation

arXiv:2607. 23346v1 Announce Type: new Abstract: Modern deep neural networks are potent catalysts for scientific and industrial impact, yet excessive parameter counts impede deployment in low-compute settings such as hospital equipment and energy infrastructure.

By Aditya Dewan, Arjun Yogeswaran, Benjamin Fedoruk

rag fine-tuning efficiency multimodal benchmarks

arXiv Machine Learning

Jul 28

The Intruder Threshold: A Spectral Law for LoRA Fine-Tuning

arXiv:2607. 23711v1 Announce Type: new Abstract: LoRA fine-tuning can create intruder dimensions: new leading singular vectors of the updated weight matrix $W+BA$ that are nearly orthogonal to all pretrained singular vectors and that drive catastrophic forgetting.

By Peng Xie

llms fine-tuning

Get the daily briefing