arXiv AI By Victor Zhang, Yiping Yuan, Florian Raudies, Bosun Adeoti, Brian Y. C. Leung, Sanjay Surendranath Girija, Naijing Zhang

Learned Cross-Task Relationships in Multi-Task Models

Read the original on arXiv AI →

The paper introduces a framework that learns cross‑task relationships in multi‑task models by approximating the joint distribution of task labels through targeted pairwise relationships. This method improves performance via transfer learning and enhances information extraction without the intractable complexity of modeling the full joint space. The authors demonstrate its effectiveness in YouTube’s production recommendation systems, showing gains in accuracy and user satisfaction across Notifications, Homepage, and Watch Next surfaces, and provide a workflow template for broader implementation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Aug 25

From Isolation to Alignment: Unified LoRA for Efficient Multi-Task Learning

The paper introduces Align‑LoRA, a unified LoRA framework for multi‑task learning that replaces complex, isolated adapter designs with a single‑adapter model enhanced by a higher rank and an explicit alignment loss. It demonstrates that a router‑free, multi‑head model with high inter‑head redundancy can outperform more elaborate baselines, and that a unified LoRA can achieve competitive performance while enabling weight merging and zero inference latency. Extensive experiments and theoretical analysis confirm that Align‑LoRA surpasses prevailing approaches, offering a simpler, production‑friendly paradigm for parameter‑efficient fine‑tuning of large language models.

By Jinda Liu, Yi Chang, Yuan Wu