arXiv Machine Learning June 2, 2026 By Fatemeh Nourzad, Amirhossein Roknilamouki, Eylem Ekici, Jia Liu, Ness Shroff

FIRM: Federated In-client Regularized Multi-objective Alignment for Large Language Models

Read the original on arXiv Machine Learning →

arXiv:2511. 16992v3 Announce Type: replace Abstract: Aligning Large Language Models (LLMs) with human values often involves balancing multiple, conflicting objectives such as helpfulness and harmlessness.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jun 16

Conflict-Aware Federated Fine-Tuning of Large Language Models with Mixture-of-Experts

arXiv:2606. 15625v1 Announce Type: new Abstract: The continuous scaling of large language models (LLMs) incurs prohibitive computational costs, making Mixture-of-Experts (MoE) a scalable alternative for efficient fine-tuning via sparse activation.

By Yijun Lu, Zihan Fang, Pengpeng Qiao, Zheng Lin, Jing Yang, Yuxin Zhang, Por Lip Yee, Zhe Chen, Jun Luo

llms fine-tuning safety

arXiv AI

Jun 2

Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards

arXiv:2510. 01167v2 Announce Type: replace-cross Abstract: Aligning large language models to human preferences is inherently multidimensional, yet most pipelines collapse heterogeneous signals into a single objective.

By Yiran Shen, Yu Xia, Jonathan Chang, Prithviraj Ammanabrolu

llms reinforcement-learning safety

arXiv Machine Learning

Jun 8

Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models

arXiv:2505. 10892v2 Announce Type: replace Abstract: Post-training LLMs with RLHF and preference optimization methods (e.

By Akhil Agnihotri, Rahul Jain, Deepak Ramachandran, Zheng Wen

llms reinforcement-learning fine-tuning benchmarks safety

arXiv AI

Jun 6

Multilingual Fine-Tuning via Localized Gradient Conflict Resolution

arXiv:2606. 05613v1 Announce Type: new Abstract: The rapid evolution of Large Language Models (LLMs) has established cross-lingual versatility as a defining feature of modern systems.

By Long P. Hoang, Yiran Zhao, Wei Lu, Wenxuan Zhang

llms fine-tuning

arXiv Machine Learning

Aug 13

Beyond Parameter Space: NTK-Guided Personalized Aggregation for Robust Federated Learning

arXiv:2608. 12108v1 Announce Type: new Abstract: Federated learning (FL) enables collaborative model training across distributed clients while keeping data local.

By Mirko Konstantin, Stefan Zachow, Anirban Mukhopadhyay

arXiv AI

Jun 18

Efficient Zeroth-Order Federated Finetuning of Language Models on Resource-Constrained Devices

arXiv:2502. 10239v3 Announce Type: replace-cross Abstract: Federated Learning (FL) is a promising paradigm for finetuning Large Language Models (LLMs) across distributed data sources while preserving data privacy.

By Mohamed Aboelenien Ahmed, Kilian Pfeiffer, Ramin Khalili, Heba Khdr, J\"org Henkel

llms fine-tuning safety

One email a morning, machine-written

Related stories

Conflict-Aware Federated Fine-Tuning of Large Language Models with Mixture-of-Experts

Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards

Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models

Multilingual Fine-Tuning via Localized Gradient Conflict Resolution

Beyond Parameter Space: NTK-Guided Personalized Aggregation for Robust Federated Learning

Efficient Zeroth-Order Federated Finetuning of Language Models on Resource-Constrained Devices