arXiv Machine Learning July 7, 2026 By Wei Zhang, Lin Tang, Ming Zhao, Yuxuan Wang

Co-Adaptive Multi-Task LoRA: Transfer-Aware, Label-Free Control of Domain Participation

Read the original on arXiv Machine Learning →

arXiv:2607. 03522v1 Announce Type: new Abstract: Fine-tuning a single low-rank adapter on many domains at once is multi-task learning: the domains must be co-learned, and how they share the adapter decides whether they help or hurt one another.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

fine-tuning

arXiv Machine Learning

Sep 1

One Adapter, Many Tasks: Task-Conditioned Feature Transformations for Continual Learning

arXiv:2608.31096v1 Announce Type: cross Abstract: Class-incremental learning (CIL) requires a model to incrementally learn tasks that contain new classes without accessing earlier training data while...

By Yunxiang Fu, Meng Lou, Yizhou Yu

fine-tuning

arXiv Machine Learning

5d ago

New LoRA Skills Should Read but Never Write

The paper introduces READ, a method for composing low‑rank adapters (LoRA) in large language models. By rewriting each adapter into a balanced canonical form and enforcing a one‑directional coupling, READ allows new skills to read but never write into the output subspaces of existing skills, eliminating interference. Experiments on four benchmark suites and two model families show that READ consistently outperforms existing baselines, improving SuperGLUE scores by over twenty points and domain suite scores by more than seven points.

By Zeyan Li, Panqi Yang, Qirong Guo, Shengda Zhuo, SIyuan Qiu, Hu Xu, Chun Li, Jianfeng Xu

llms fine-tuning benchmarks

arXiv Machine Learning

Jun 18

PACT: Preserving Anchored Cores in Task-vectors for Model Merging

arXiv:2606. 18627v1 Announce Type: new Abstract: Model merging has emerged as a training-free alternative to multi-task learning, aiming to combine multiple task-specific fine-tuned models into a single multi-task model.

By Ningyuan Shi, Zhipeng Zhou, Hao Wang, Chunyan Miao, Peilin Zhao

fine-tuning benchmarks

arXiv Machine Learning

Aug 10

Training-free Task Classification for Multi-Task Model Merging

arXiv:2606. 22589v2 Announce Type: replace Abstract: Ever since the advent of foundation models and the pre-training-finetuning paradigm, there have been numerous efforts to merge multiple task-specific experts into a single multi-task model.

By Jungyong Son, Jinwook Jung, Sungyong Baik

computer-vision nlp fine-tuning benchmarks

arXiv AI

Jun 4

SUSD: Structured Unsupervised Skill Discovery through State Factorization

arXiv:2602. 01619v2 Announce Type: replace-cross Abstract: Unsupervised Skill Discovery (USD) aims to autonomously learn a diverse set of skills without relying on extrinsic rewards.

By Seyed Mohammad Hadi Hosseini, Mahdieh Soleymani Baghshah

agents reinforcement-learning

arXiv AI

Jul 21

Capacity and Redundancy Trade-offs in Multi-Task Learning

arXiv:2607. 16554v1 Announce Type: cross Abstract: In multi-task learning (MTL) negative transfer is often considered as an optimization artifact, but it can also be viewed as a consequence of limited shared capacity and weak task redundancy.

By Asif Khan

fine-tuning

One email a morning, machine-written

Related stories

One Adapter, Many Tasks: Task-Conditioned Feature Transformations for Continual Learning

New LoRA Skills Should Read but Never Write

PACT: Preserving Anchored Cores in Task-vectors for Model Merging

Training-free Task Classification for Multi-Task Model Merging

SUSD: Structured Unsupervised Skill Discovery through State Factorization

Capacity and Redundancy Trade-offs in Multi-Task Learning