arXiv AI By Shiji Zhou, Kunlin Lyu, Lei Zhang, Ruodong Wang, Yifan Sun

MOON: Multi-Objective OrthoNormalized Updates for Multitask Learning

Read the original on arXiv AI →

arXiv:2608. 11749v1 Announce Type: cross Abstract: Multi-objective optimization (MOO) has demonstrated significant success in multi-task learning by mitigating task conflicts through gradient manipulation.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

arXiv Machine Learning
Jun 3

MAdam: Metric-Aware Multi-Objective Adam

arXiv:2606. 03904v1 Announce Type: new Abstract: Multi-objective optimization (MOO) underlies many machine learning problems, yet MOO solvers across the loss-balancing, gradient-balancing, and Pareto-based families almost universally hand their reconciled directions to Adam~\cite{kingma2015adam}.

By Fengbei Liu, Rachit Saluja, Sunwoo Kwak, Ruibo Wang, Ruining Deng, Heejong Kim, Johannes C. Paetzold, Mert R. Sabuncu
arXiv Machine Learning
Jun 16

Schattor: Schatten-family methods for deep learning optimization

arXiv:2606. 15702v1 Announce Type: cross Abstract: Modern deep learning optimization features heterogeneous parameter structures, noisy gradients, and highly nonconvex landscapes, posing significant challenges for both algorithm design and theoretical analysis.

By Bohao Ma, Junyu Zhang, Chuan He