Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

8,205 stories · RSS feed

arXiv AI

Sep 15

ModiGen: A Large Language Model-Based Workflow for Multi-Task Modelica Code Generation

arXiv:2503.18460v2 Announce Type: replace-cross Abstract: Modelica is a widely adopted language for simulating complex physical systems, yet effective model creation and optimization require substant...

By Jiahui Xiang, Tong Ye, Peiyu Liu, Yinan Zhang, Wenhai Wang

llms rag fine-tuning benchmarks

arXiv AI

Sep 15

CLEAR: Context Augmentation from Contrastive Learning of Experience via Agentic Reflection

arXiv:2604.07487v2 Announce Type: replace Abstract: Large language model agents rely on effective model context to obtain task-relevant information for decision-making. Many existing context engineer...

By Linbo Liu, Guande Wu, Han Ding, Yawei Wang, Qiang Zhou, Yuzhe Lu, Zhichao Xu, Huan Song, Panpan Xu, Lin Lee Cheong

llms agents reinforcement-learning fine-tuning benchmarks

arXiv AI

Sep 15

Kaininja: Extending Native 3D Generators to the Part Level

arXiv:2609.15659v1 Announce Type: cross Abstract: Native 3D generators turn one image into a single mesh. TRELLIS.2 and its peers deliver high-fidelity non-watertight geometry with materials, but the...

By Ruihan Yu, Lian Fu, Muyao Niu, Zheng-hui Huang, Yu-Ju Tsai, Sho Kuno, Fengbo Lan, Yonghao Yu, Erwin Wu, Ming-Hsuan Yang, Kaipeng Zhang, Zhixiang Wang

llms agents computer-vision fine-tuning

arXiv AI

Sep 15

ATTRICITE: Training an Open 4B Model for Citation Recovery toward Faithful Attribution

arXiv:2609.14248v1 Announce Type: cross Abstract: Faithful citation attribution begins with identifying the intended source for a scientific claim. We study this source-identification capability thro...

By Yee Man Choi, Xuehang Guo, Songcheng Cai, Yimu Wang, Yi R. Fung, Qingyun Wang

llms fine-tuning benchmarks

arXiv AI

Sep 15

Modeling, Scaling, and Decoding: Optimizing Controllable Speech Generation with Nonverbal Vocalizations

arXiv:2609.14231v1 Announce Type: cross Abstract: Controllable synthesis of nonverbal vocalizations (NVVs) is es- sential for natural and expressive speech, but remains challeng- ing due to their aco...

By Ziyu Zhang, Yun Chen, Taihui Wang, Hanzhao Li, Qicong Xie, Rilin Chen, Zhixian Zhao, Lei Xie

fine-tuning

arXiv AI

Sep 15

Adaptive Phase-Switching for Communication-Efficient Federated LoRA Fine-Tuning

arXiv:2609.13512v1 Announce Type: cross Abstract: Federated fine-tuning of large language models with low-rank adaptation reduces per-client trainable parameters, but client-to-server communication r...

By Jerry Adams Franklin

llms fine-tuning

arXiv AI

Sep 15

ShieldVLA: Feasibility-Aware Safety Alignment for Vision-Language-Action Models

arXiv:2609.13231v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models demonstrate strong generalization in robotic manipulation and navigation, but existing fine-tuning methods provid...

By Manan Tayal, Akshay Nambi

robotics fine-tuning multimodal benchmarks safety

arXiv AI

Sep 15

Shallow Beliefs: Synthetic document finetuning does not inoculate against emergent misalignment from reward hacking

arXiv:2609.14998v1 Announce Type: new Abstract: Recent work shows that models that learn to reward hack on RL environments can become broadly misaligned, and that reframing reward hacking as acceptab...

By Arun Jose, Julian Stastny

llms reinforcement-learning fine-tuning

arXiv AI

Sep 15

A Language-Guided Multimodal Foundation Model for Zero-Shot and Multi-Task Brain Signal Analysis

arXiv:2609.15740v1 Announce Type: cross Abstract: Brain signal analysis is essential for both neuroscience research and clinical diagnostics, yet current approaches face critical limitations. End-to-...

By Mingzhi Chen, Yiyu Gui, Guibo Luo, Yuchao Yang

fine-tuning multimodal safety

arXiv AI

Sep 15

When the World Lies: Backdoor Attacks on Latent World Models for Downstream Control

arXiv:2609.15781v1 Announce Type: cross Abstract: Pretrained world models, learned simulators that encode an observation into a latent state and predict how it evolves under actions, are beginning to...

By Roberto Ria\~no, Gorka Abad, Stjepan Picek, Aitor Urbieta

llms fine-tuning

arXiv Computer Vision

Sep 15

Selective Tool Use for Agentic Change Visual Question Answering in Remote Sensing

arXiv:2609.14523v1 Announce Type: new Abstract: Change visual question answering (Change VQA) requires understanding semantic changes across bi-temporal remote sensing images. Although vision languag...

By Yakoub Bazi, Mohamad M. Al Rahhal, Mohamed A. Mekhtiche, Mansour Zuair

llms agents nlp fine-tuning multimodal

arXiv Computation and Language

Sep 15

Bridging Scientific Heritage: An Arabic--Russian Parallel Corpus and LLM Benchmark for Sustainable Knowledge Transfer

arXiv:2606.30943v2 Announce Type: replace Abstract: Russian and Arabic are among the major languages of scientific communication. Language barriers impede the exchange of research results between the...

By Mullosharaf K. Arabov

llms fine-tuning benchmarks

arXiv Computer Vision

Sep 15

Adapting Open-Weight MLLMs to Generate Point Prompts for Electron Microscopy Segmentation

arXiv:2609.14080v1 Announce Type: new Abstract: Promptable models such as microSAM segment electron microscopy (EM) images from point prompts, but automation requires generating prompts without user...

By Samia Mohinta, Albert Cardona

llms computer-vision fine-tuning multimodal

arXiv Computer Vision

Sep 15

Zero-Shot Cross-Material Ptychographic Phase Reconstruction Using Deep Learning

arXiv:2609.13969v1 Announce Type: new Abstract: Ptychographic phase reconstruction is commonly formulated as an iterative inverse problem, requiring repeated object-probe updates and resulting in sub...

By Wen-Chun Lin, Yu-Chee Tseng, Jen-Jee Chen, Nan-You Chen

fine-tuning

arXiv Computation and Language

Sep 15

IROH: Insightful Ranking Of Humor using Multi-Stage Hybrid Retrieval with Rationale-Distilled LLM Judges for JOKER 2026 Track Task 1 English

arXiv:2609.15618v1 Announce Type: cross Abstract: Our team, VANGUARD, presents IROH (Insightful Ranking of Humor), a three-stage retrieval system for JOKER Task 1 English at CLEF 2026, achieving firs...

By Ana-Maria Luisa Mocanu, Sebastian Mocanu, Ciprian-Octavian Truic\u{a}, Elena-Simona Apostol

llms rag fine-tuning benchmarks

arXiv Computer Vision

Sep 15

Compositional Shift Algebra: Extrapolating Mixed Robot Shifts Without Mixed Finetuning

arXiv:2609.13651v1 Announce Type: cross Abstract: Robot deployments rarely change one mechanism at a time: cameras, action interfaces, and physical dynamics often shift together. Prior adaptation rec...

By Jinting Hang, Zhenhui Cai

robotics fine-tuning

arXiv AI

Sep 15

Route, Don't Fix: Regime-Dependent Decoding Correction and a Trajectory-Gated Router for Reliable Clinical LLM Answer Selection

arXiv:2609.14825v1 Announce Type: cross Abstract: Large language models (LLMs) are often deemed unsafe for clinical question answering because of their tendency to hallucinate. Retrieval augmentation...

By Zeyu Dong, Benjamin Wang, Joyee W. Jin

llms nlp fine-tuning benchmarks

arXiv AI

Sep 15

CAL-MOS: Bridging Layers with Adapters for Robust MOS Prediction Across Speech Foundation Models

arXiv:2609.14956v1 Announce Type: cross Abstract: Speech Quality Assessment (SQA) is essential for modern speech technologies, and recent non-intrusive SQA predictors increasingly rely on Speech Foun...

By Alef Iury Siqueira Ferreira, Pedro Lustosa Rege Botelho, Fernanda Silva, Daniel Casanova, Rafael Faustino, Frederico Oliveira, Arlindo Galv\~ao Filho, Anderson da Silva Soares

fine-tuning benchmarks

arXiv AI

Sep 15

A Unified Vision-Language Model for PSMA PET/CT Report Generation, Visual Question Answering, and Lesion Segmentation

arXiv:2609.15603v1 Announce Type: cross Abstract: Accurate PSMA PET/CT interpretation is central to prostate cancer management, yet existing PET/CT AI models typically address isolated tasks. We prop...

By Yang Xing, Jiong Wu, Savas Ozdemir, Yang Zhou, Boxiao Yu, Ying Zhang, Zheren Zhu, Chenyu You, Wei Shao, Yang Lu, Kang Wang, Tinsu Pan, Yang Yang, Kuang Gong

llms computer-vision nlp fine-tuning multimodal safety

arXiv AI

Sep 15

ParsVoice: A Large-Scale Multi-Speaker Persian Speech Corpus for Text-to-Speech Synthesis

arXiv:2510.10774v4 Announce Type: replace-cross Abstract: Persian remains substantially underrepresented in open speech-text resources, limiting progress in multi-speaker text-to-speech (TTS), speech...

By Mohammad Javad Ranjbar Kalahroodi, Heshaam Faili, Azadeh Shakery

fine-tuning multimodal

Get the daily briefing