Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

8,201 stories · RSS feed

arXiv Computation and Language
Sep 25

COILD: An Indic-Centric Parallel Corpus and Benchmark for Machine Translation Across Indian Languages

COILD is an Indic‑centric parallel corpus that contains over 1.16 million human‑translated and verified sentence pairs across 20 Indian language pairs from four language families. The corpus is sourced from original Indian language materials in eight domains, and a 2,000‑sentence domain‑centric benchmark is provided for consistent multilingual evaluation. Experiments with IndicTrans2‑Distilled and NLLB‑200 show consistent improvements in automatic metrics and human judgments, underscoring the value of high‑quality Indic‑centric data.

By Kshetrimayum Boynao Singh, Nitin Kumar Mishra, Palash Pratim Dutta, Atai Waris Khan, Aparna Kaushik, Avinash Kumar, Deeksha, Deepak Kumar, Saroj Kumar Jha, Saloka Sengupta, Anansa Roy, Umalatha Kannoth, Saifulla Samar, Meena Sharma, Manpreet Kaur, Jyoti Sharma, Ashwini Vaidya, Muralikrishna SN, Md Shad Akhtar, Poonam Bansal, Amita Dev, Sanasam Ranbir Singh, Samit Bhattacharya, Tanmoy Chakraborty, Asif Ekbal
arXiv AI
Sep 25

A Multi-level Information Integration Framework for Physically Verifiable Fault Diagnosis of Rotating Machinery

The paper proposes a Diagnostic Evidence Network (DENet) that augments traditional fault‑diagnosis outputs with structured evidence, including classification, predicted characteristic frequency, and temporal localization of impulses. This evidence aligns with theoretical bearing physics and can be validated at inference time, achieving high AUROC for misclassification detection without sacrificing accuracy. A QLoRA‑adapted language model then translates DENet’s evidence into maintenance reports, markedly reducing unsupported claims.

By Yuntong Chen, Jianyu Liu, Yingqi Li, Guobin Zhao, Ziang Wang, Chao Chen, Xitian Tian, Lijiang Huang
arXiv AI
Sep 25

Search-Aware Reinforcement Learning for Multi-Component Query Understanding in Roblox Game Search

The paper introduces a search‑aware reinforcement learning framework for multi‑component query understanding in Roblox game search. It first uses teacher‑student supervised fine‑tuning to create a schema‑compliant policy, then applies reinforcement learning that optimizes each query‑understanding component with component‑specific rewards derived from live search engine interactions. Experiments show that this approach improves per‑component utility and overall search quality, raising NDCG@20 by 8.9 points over the supervised baseline and 3.5 points over a single end‑to‑end reward strategy.

By Nayoung Choi, Shengjian Chen, Xiaokai Wei, Wenzheng Zhang, Daiyao Yi, Rachit Pareek, Vincent Su, Michelle Gong, Jinho D. Choi
arXiv AI
Sep 25

A Harness for Synthesizing Diverse Naturalistic Full-Duplex Conversations

The paper introduces a pipeline that generates intent‑labeled, two‑channel conversational speech from relational event lists, enabling controlled synthesis of full‑duplex dialogue with 42 phenomena across eight families in English and Mandarin. By having an LLM author each event’s speaker, text, conversational act, and attachment, and then aligning and timing these events independently, the system produces diverse, realistic turn‑taking signals. Experiments show that models trained on this synthetic corpus achieve higher floor‑occupancy accuracy and better start‑speaking/listening F1 scores compared to models trained on prior data.

By Matthew Sun, Vinay Kothapally, Meng Yu, Chao Huang, Hao Zhang, Yixuan Zhang, Steve Yves
arXiv AI
Sep 25

HarnessPAI: An Evolving Harness for Physical AI

HarnessPAI is a model‑ and embodiment‑agnostic framework that treats code as an executable, evolvable interface for Physical AI. It separates short‑term open‑loop program execution from long‑term closed‑loop evolution, using feedback to refine programs and distill reusable skills. Across various robots, HarnessPAI outperforms pure action models and code‑as‑policy baselines, achieving significant gains on tasks like LIBERO‑PRO and RoboCasa without retraining the underlying model.

By Xin Wang, Wenhao Wu, Menghao Zhang, Zhi Wang, Kun Shao, Jian Luan, Yang Li, Qing Li, Shangding Gu, Huichi Zhou, Shuqing Shi, Fei Ni, Shuo Lu, Weicheng Meng, Kang Li, Jin Wu, Kang Zhao, Shangmin Guo, Gen Li, Yongqiang Tang, Zhizhong Zhang, Yuan Xie, Heng Qu
arXiv AI
Sep 25

WildHSR: Metric Feed-Forward 4D People-Scene Reconstruction from a 3D Foundation Model

WildHSR introduces a lightweight adaptation of 3D foundation models to jointly recover metric cameras, scene geometry, and persistent person identities from monocular video. By generating pseudo‑scale labels from curated web footage and fine‑tuning a Scale Readout, the method predicts metric scale directly from foundation‑model tokens. It also exploits intermediate query‑key features to associate per‑frame bodies, enabling feed‑forward reconstruction that outperforms state‑of‑the‑art optimization‑based methods on several benchmarks while running at 10.1 fps.

By Jerrin Bright, John Zelek
arXiv AI
Sep 25

Where LLM Graders Succeed and Break: Evidence from Two Computer-Science Exams

The study evaluates large language model (LLM) graders on two computer‑science exams, testing 171 configurations of closed‑ and open‑weights models. While the best LLM configuration achieved a mean absolute error of 1.64/35—better than the 2.61/35 error between two human graders—its performance was highly sensitive to the prompt. A short "strict grader" preamble caused most open‑weight models to exceed acceptable error thresholds or stop grading entirely, whereas fine‑tuning with a single LoRA adapter restored parity with human graders and reduced sensitivity to harsh prompts.

By Ali Habibullah, Yazan Alshoibi, Mohammad Alshiekh, Salman Khan, Naeemullah Khan
arXiv AI
Sep 25

Tag-Aware Structured Text Translation: Towards a Systematic Understanding

The paper introduces a systematic approach to tag-aware translation, addressing the trade-off between structural tag diversity and translation naturalness in synthetic data. It proposes a hybrid synthesis strategy (Hy‑LST) and a multi‑task fine‑tuning framework that decomposes translation into four sub‑tasks. Additionally, it employs a group relative policy optimization with three reward functions—fluency, tag fidelity, and tag‑scoped translation quality—to jointly optimize these objectives, achieving superior performance across six language pairs.

By Zhanglin Wu, Hengchao Shang, Daimeng Wei, Jiaxin Guo, Zongyao Li, Tengfei Song, Ning Xie, Weidong Zhang
arXiv Machine Learning
Sep 25

Uncertainty-Gated Exploration Noise Suppresses Task Collapse in Online RL Fine-Tuning of a Flow-Matching Vision-Language-Action Policy

The paper investigates task collapse—a failure mode where online RL fine‑tuning of a pretrained flow‑matching vision‑language‑action policy erodes performance on individual tasks—using a 450M‑parameter SmolVLA policy on LIBERO‑10. Three exploration‑noise strategies are compared: a fixed noise scale, a learned noise network, and an uncertainty‑gated controller that reallocates exploration based on novelty and competence signals without task labels. The uncertainty‑gated controller prevents task collapse across all tested seeds, whereas the other two approaches consistently cause collapse, demonstrating its effectiveness in preserving task performance during fine‑tuning.

By Mehmet Turan Yard{\i}mc{\i}, Yunus Emre \c{C}o\u{g}urcu
arXiv Computer Vision
Sep 25

CinematicVQA: Benchmarking Film-Grammar Reasoning in Large Vision-Language Models

CinematicVQA is a new benchmark for evaluating large vision‑language models on film‑grammar reasoning. It introduces the Cinematic Scene Graph, a structured representation linking filming techniques to perceptual effects and narrative functions, and tests models on tasks beyond low‑level technique recognition. The study finds a semantic gap where models excel at describing visuals but struggle to identify underlying techniques, and shows that fine‑tuning improves performance on narrative function and multi‑hop reasoning.

By Shuo Xing, Pooja Verlani, Balu Adsumilli, Zhengzhong Tu
arXiv Machine Learning
Sep 25

Let Training Guide Selection: Online Synthetic Data Filtering via Real-Anchored Utility

The paper introduces FROST, an online framework that filters synthetic training data by estimating its utility through gradient feedback anchored in real data. FROST calibrates batch utility against recent history to decide when to filter, removing 20–30% of synthetic samples while improving performance on image classification and LLM fine-tuning tasks. The method is also applied to a large‑scale industrial ads re‑ranking system, yielding significant gains over an optimized production baseline.

By Yanran Wu, Sana Lakdawala, Renzo Tassara Miller, Chongyang Bai, Sharath Ciddu, Shivendra Pratap Singh, Kungang Li, Sandeep Pandey, Chunwei Liu
arXiv AI
Sep 25

Neuro-symbolic AI for Industrial Configuration

The paper "Neuro-symbolic AI for Industrial Configuration" discusses how Large Language Models (LLMs) fall short for industrial product configuration due to their probabilistic nature, which conflicts with the need for syntactically valid, semantically consistent outputs that align with extensive feature and rule knowledge bases. It proposes Neuro-symbolic (NeSy) AI as a promising solution, outlining three integration strategies—hybrid inference, hybrid fine‑tuning, and hybrid training—and presents a taxonomy of these approaches. The authors describe their efforts to implement a NeSy-based configuration copilot, derive practical design choices for trustworthy AI deployment in engineering settings, and highlight key research challenges, especially scaling NeSy methods from academic prototypes to full‑scale industrial configurators.

By Danilo Valerio, Philipp Kogler, Stefan Bischof, Thomas Hubauer, Huzefa Rangwala
arXiv Computation and Language
Sep 25

CONSISTRE: A Unified Consistency-Aware Framework for Document-Level Relation Extraction with Large Language Models

CONSISTRE is a consistency‑aware framework for document‑level relation extraction that tackles contradictions in large language model predictions. It offers two tracks: an inference‑time track that refines black‑box LLM outputs through constraint‑aware prompting, verification, and self‑reflection, and a training‑time track that distills consistency knowledge into smaller open‑source models via supervised fine‑tuning and reinforcement learning. Experiments on DocRED show both tracks outperform baselines, with the inference‑time track matching competitive F1 scores and the training‑time track narrowing the performance gap to proprietary LLMs while reducing inference cost.

By Mingxuan Sun
arXiv AI
Sep 25

Baszta: Data-Centric Fine-Tuning of a Polish Multi-Label Safety Classifier

The paper presents Baszta, a Polish multi‑label content‑safety classifier trained by fine‑tuning the 124M‑parameter allegro/herbert‑base‑cased model on five categories (hate, vulgarity, sexual content, crime, self‑harm) using a Focal + R‑Drop objective. In out‑of‑distribution evaluation on the Gadzi Język benchmark, Baszta achieves a small but statistically significant improvement in micro‑F1 over the Bielik Guard system, though the macro‑F1 advantage disappears when both models are properly tuned. The study also explores calibration techniques, showing that per‑category temperature scaling can recover performance lost by Platt scaling or isotonic regression, and discusses the trade‑offs between robust calibration and adversarial recall.

By Adam G\'orski, Mateusz J\k{a}kalak, Rafa{\l} Jakubowski
arXiv Machine Learning
Sep 25

Automatic Rank Allocation for Low-Rank Adaptation in Large Language Models via lp Regularization

The paper introduces ρ_p-LoRA, a rank-allocation strategy for low-rank adaptation (LoRA) in large language models that uses ρ_p regularization (0 < p < 1) to induce sparsity in rank-one components. By regularizing the energy of each component, redundant parts are encouraged to vanish while important ones are retained, leading to an implicit thresholding criterion derived from a two-dimensional proximal subproblem. Experiments on natural language understanding and question-answering tasks show that ρ_p-LoRA achieves performance comparable to existing LoRA baselines.

By Zebang Xie, Chuanyang Zheng, Yik-Chung Wu, Yihang Gao
arXiv AI
Sep 25

Frame-to-Panorama Localization and Context-Aware Sampling for Scene-Specific Ship Detection in a Smart Marina Testbed

The paper introduces a pipeline that localizes frames from historical PTZ maritime video onto a reference panorama and then selects a context‑aware, diverse subset for ship detection training. By combining SuperPoint‑LightGlue localization, weather and solar‑state metadata, and diversity sampling, the method reduces 40,718 candidate frames to just 220 images for annotation. Fine‑tuned YOLOv26 on this compact set achieves high detection performance (AP50 ≈ 94.8%) while cutting annotation effort by 99.5%.

By Ignat Romanov, Andreas Hadjipieris, Neofytos Dimitriou
arXiv AI
Sep 25

Pistis Technical Report

The Pistis Technical Report introduces the Pistis model family, comprising 27B- and 9B-parameter multimodal large language models built on Qwen3.6 and Qwen3.5. The models are developed through a scalable post‑training framework that begins with large‑scale multimodal supervised fine‑tuning and then applies Interleaved Distillation and Reinforcement Learning (IDRL) to integrate on‑policy distillation and reinforcement learning within a single training loop. Two specialized variants—Pistis‑Thinking for deep multimodal reasoning and Pistis‑Agentic for long‑horizon planning, iterative reasoning, and tool use—are produced at both scales, and a system‑level method called Pistis‑Auto‑Harnessing (PAH) further improves inference harness performance without updating model parameters.

By Heyun Chen, Xiaohan Lan, Jiaxi Li, Zhilin Lu, Qi She, Weiwen Xu, Fei Yu, Yujie Zhong, Jinghuan Chen, Zijian Feng, Siyu Jiao, Yiheng Lin, Xinhao Wang, Sihan Yang, Jieyu You, Changbin Zhang, Hengyu Zhang, Xudong Zhang, Yunqing Zhao, Shuai Zheng
arXiv AI
Sep 25

Beyond Surface Style: Aligning Multi-Turn User Simulators with Behavioral Consistency

The paper introduces TRACER, a multi‑turn user simulator that models evolving user intent and aligns simulated behavior with real interaction trajectories. TRACER is trained first with supervised fine‑tuning on real dialogues and then with reinforcement learning that uses hierarchical outcome‑ and trajectory‑level rewards to address reward sparsity and credit assignment. In real customer‑service sessions, TRACER‑7B outperforms the best baseline by 11.4 conversion F1, achieves the lowest group‑level conversion‑rate error and semantic trajectory distance, and generalizes to out‑of‑distribution scenarios, while human Turing tests show its conversations appear natural. The authors also present the Dynamic Marketing Benchmark, which evaluates both persuasion effectiveness and response quality of large language models through simulated interactions, demonstrating that higher response quality does not always lead to higher conversion rates.

By Geng Chen, Ruotong Pan, Zhirui Yang, Qiqi He, Jiawei Chen, Zhang Yunfei, Chongyuan Chen, Minxuan Lv, Zheng Yang, Win-Bin Huang, Xiangyu Wu, Wenwu Ou
arXiv AI
Sep 25

UO-FIE: Combining Exact-Label Supervision with Graded Utility for Factivity Inference

UO-FIE is a parameter‑efficient system for the Factivity Inference Evaluation 2026 (FIE2026) that predicts a distribution over nine ordered factivity intervals. It combines hard‑label supervision, utility‑based soft targets, scheduled class weights, and an ordinal loss to balance exact predictions with proximity to the correct interval. Using Qwen3.5‑9B with LoRA, UO‑FIE achieved the highest macro utility (0.8316) in the fine‑tuning track, while a prompt‑based ensemble ranked third in the non‑fine‑tuning track (macro utility 0.8450).

By Xinchen Xiao
arXiv AI
Sep 25

Rufus-Air: An Open LLM Post-Training Recipe

Rufus-Air is an open, reproducible post‑training recipe for the GLM‑4.5‑Air‑Base model, structured as a serial pipeline of eight stages: SFT, Reasoning RL, Coding RL, Instruction‑Following RL, General Agent, Coding Agent, Search Agent, and RLHF. The paper documents the data, reward design, infrastructure, stage order, and stagewise results required to reproduce the recipe, emphasizing that stages progress from basic to advanced capabilities and from hard, verifiable rewards to softer judge‑based signals. Key findings highlight the importance of diverse, high‑quality SFT, difficulty filtering, reward reliability for stage ordering, and the role of infrastructure and engineering choices.

By Chia-Yuan Chang, Renyuan Cheng, Rui Feng, Xiaotian Han, Yuan He, Hongye Jin, Linwei Li, Shiyang Li, Fenglin Liu, Xin Liu, Priyanka Nigam, Haoyang Wen, Zhenghao Xu, Zhuocheng Xu, Bing Yin, Qingyu Yin, Chao Zhang, Rongzhi Zhang, Zhihan Zhang, Zixuan Zhang, Zixuan Zhang, Tuo Zhao