Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

8,201 stories · RSS feed

arXiv AI
Oct 7

Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces

The paper introduces PAIR, a pipeline that creates user-conditioned application states to evaluate mobile GUI agents across different users, and RePAIR, a reinforcement learning method that incorporates personalization-aware interaction rewards. Experiments with six agents reveal significant variability in task success and subgoal achievement across users, especially when targeting personal content. RePAIR improves success rates over supervised fine-tuning, suggesting that learning from cross-user differences can enhance GUI-agent reliability.

By Yeji Park, Jaeyun Shim, Taesik Gong
arXiv AI
Oct 7

SIGMA: Self-Improving Alignment Generalization from a Model Spec

SIGMA is a self‑improving alignment framework that uses a model’s own reasoning to generate diverse alignment dilemma scenarios from a simple "Model Spec" and then fine‑tunes the model with self‑judged rewards. By performing spec‑guided task synthesis and rubric‑based reinforcement learning, SIGMA improves safety alignment in multi‑turn agentic settings, reducing harmfulness and misalignment scores while preserving general capability. The approach demonstrates that a model can autonomously strengthen its own safety reasoning without external supervision.

By Jingyu Zhang, Shruti Palaskar, Daniel Khashabi, Benjamin Van Durme, Leon A. Gatys, Joseph Yitan Cheng
arXiv AI
Oct 7

POLAR: Ontology-Guided Risk Prevention for Tool-Calling LLM Agents

POLAR is a guardrail framework designed for small tool‑calling language‑model agents that evaluates the reversibility of each action using a two‑layer ontology. By assigning graded reversibility scores and pruning calls that fall below a threshold, POLAR aims to prevent operational risks before they occur. In experiments on the τ²‑bench across six agent models, POLAR increased mean task reward by 0.11 to 0.18 points on airline tasks for four of six agents, though improvements were limited to eight of eighteen model‑domain cells, with some domains showing regression.

By Yunju Kang, Seonghyeon Cho, Irene Li, Yeo-Chan Yoon, Chanjun Park
arXiv AI
Oct 7

Beyond Refusal Patterns: Safe-Role Internalization for Robust and Generalizable LLM Safety Alignment

The paper introduces SSRFT (Supervised Safe-Role Fine‑Tuning), a new framework that reframes safety alignment for large language models as internalizing a predefined safe role rather than relying on explicit refusal patterns. SSRFT builds a Safe‑Role Question‑Answer dataset from psychometric questions, limited jailbreak prompts, and a safe‑role description, then synthesizes and validates role‑consistent responses to expose models to diverse safety scenarios. Experiments on multiple base and instruct models demonstrate that SSRFT yields more robust and generalizable safety alignment, better resilience to prefilling attacks, improved generalization to unseen jailbreak domains, and reduced over‑refusal on benign queries while preserving general capabilities.

By Jinghao Pang, Jitai Hao, Qiang Huang, Zhaochun Ren, Jun Yu
arXiv AI
Oct 7

When Does AI Supervision Help? A Role-Aware Study of Network Fraud Decision Management with Blockchain Auditability

The paper investigates when adding a second AI component—an AI supervisor—benefits network‑fraud decision making. Using a role‑aware Decider‑Supervisor framework with blockchain auditability, the authors evaluate four configurations combining centralized ML, federated meta‑models, and large language model variants. Results show that only specific setups (e.g., DS‑4 Base in extreme high‑fraud scenarios) reduce errors, while most supervised configurations either underperform or add operational burden.

By Saviz Changizi, Nasibeh Mohammadzadeh, Mohammad Shojafar, Rahim Tafazolli
arXiv AI
Oct 7

Symphony for Text Generation: Benchmarking Clinical Note Generation

arXiv:2610.08161v1 Announce Type: cross Abstract: Ambient documentation systems are rapidly gaining adoption, yet their impact on clinical note quality remains poorly characterized. We introduce MedC...

By Daniel Varab, Victor Petr\'en Bach Hansen, Asbj{\o}rn W. Helge, Kevin Pelgrims, Mathias Baltzersen, Adrian Young-San Roessler, Vanessa Klungtvedt, Maximilian Brand, Lasse Krogsb{\o}ll, Henrik Cullen, Lars Maal{\o}e
arXiv AI
Oct 7

Aligning LLMs with Biomedical Knowledge using Balanced Fine-Tuning

arXiv:2511.21075v4 Announce Type: replace-cross Abstract: Engineering LLMs to accelerate life sciences research requires a robust alignment with biomedical knowledge. We observe that biomedical text...

By Zhenchao Tang, Fang Wang, Haohuai He, Jiale Zhou, Tianxu Lv, Jun Zhu, Shouzhi Chen, Minghao Yang, Yu Wang, Jiayang Wu, Yidong Song, Yaokun Li, Jiehui Huang, Jun Zhou, Bing He, Jianhua Yao
arXiv AI
Oct 7

Real-Time Generation of Game Video Commentary with Multimodal LLMs: Pause-Aware Decoding Approaches

arXiv:2603.02655v2 Announce Type: replace-cross Abstract: Real-time video commentary generation provides textual descriptions of ongoing events in videos. It supports accessibility and engagement in...

By Anum Afzal, Yuki Saito, Hiroya Takamura, Katsuhito Sudoh, Shinnosuke Takamichi, Graham Neubig, Florian Matthes, Tatsuya Ishigaki