Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

8,117 stories · RSS feed

arXiv AI
1d ago

Quantifying Trait-State Hierarchy in EEG Foundation Model and Signal Processing Embeddings

The paper investigates how EEG embeddings from signal processing and foundation models encode trait and state information. Using a hierarchy metric and kNN purity on a BCI dataset, it finds that most embeddings form a macro‑trait hierarchy with micro‑states inside, which hampers state discrimination. Normalizing embeddings reduces trait leakage and improves state classification accuracy by about 10%, and fine‑tuning shifts the hierarchy toward macro‑state organization, enhancing decoding performance.

By Anusha Madapura, Aditya Kommineni, Shrikanth Narayanan
arXiv AI
1d ago

From Handcrafted to Generative: RLVR-Optimized Icon Generation for Alexa+

Alexa+ devices use animated icons to reinforce spoken content, but the original hand‑drawn icons were too slow to scale. A new automated pipeline now generates vectorised animated icons from text, breaking the process into image generation, semantic decomposition, vectorisation, styling, and animation. The key improvement is a reinforcement‑learning‑based fine‑tuning of the image generation stage using objective verifiers, boosting the pass rate from 15.7% to 58.7% under an independent VLM judge.

By Rohan Sequeira, Matthew Rosenberg, Amin Mahmoudabadbozchelou, Oleg Poliannikov, Jonathan Rubin
arXiv AI
1d ago

LegalEvolver: Agentic Legal Judgment Prediction via Rubric-Guided Self-Evolution

LegalEvolver is a query‑optimization framework for legal judgment prediction that generates legally informative queries to improve retrieval quality. It uses heuristic query seeding, summarizes rollout experiences into rubrics, and applies rubric‑guided reinforcement learning for iterative self‑evolution. Experiments on large benchmarks show that evolving rubrics outperform fixed ones and that rubric guidance boosts performance beyond direct supervised fine‑tuning plus RL.

By Xinyu Yang, Jiejun Tan, Chenlong Deng, Chenghao Zhang, Tongyu Wen, Zhicheng Dou
arXiv AI
1d ago

SUMONE: A Simple and Efficient Summarizer for Plug-and-Play Agent Memory

SUMONE is a lightweight summarizer designed to compress long interaction histories of language‑model agents. It is trained via masked reconstruction, where a frozen reconstructor predicts randomly masked parts of the original trajectory; reconstruction quality plus a length penalty yields a task‑agnostic reward for optimizing the summarizer with GRPO. At inference, only the summarizer remains, enabling plug‑and‑play context compression that reduces inference cost by roughly 78 % on DeepSearchQA and 75 % on SWE‑bench without affecting the underlying agent.

By Jizhe Zhang, Ang Li, Chenheng Zhang, Yisen Wang
arXiv AI
1d ago

CellCanon: An Agentic Cellular World Model for Prediction, Explanation, and Observation-Driven Updating

CellCanon is an agentic cellular world model that integrates single‑cell expression prediction, evidence‑grounded explanation, and observation‑driven updating. Its predictive core reuses condition‑level biological evidence to generate gene‑specific readouts, while a shared world state links predictions, measurements, and source‑linked claims to support explanation and revision. On 339 held‑out SciPlex3 conditions across three cell lines, CellCanon outperforms baselines in differential‑expression AUPRC, Macro‑F1, and direction Macro‑F1, and its explanation module correctly answers all answerable questions with supporting proofs.

By Zhaokang Liang, Shuyang Zhuang, Xiaoran Jiao, Hao Chen
arXiv AI
1d ago

Grounding in the Dark: Text-Only Training for Zero-Shot Video Temporal Localization

The paper explores training a large language model solely on textual video descriptions to perform zero‑shot video temporal localization, eliminating the need for paired video‑text data during training. Using a 134K‑example corpus and adapting Qwen3‑8B with LoRA on CLIP or LLM2CLIP embeddings, the authors evaluate on Charades‑STA and QV‑Highlights, achieving modest performance when directly replacing text with frame embeddings. They introduce Nearest Entity Replacement (NER), a training‑free mapping that represents each video frame by the mean of its nearest text‑entity embeddings, which significantly improves results and narrows the modality gap.

By Divyanshu Mishra, Sabine Sternig, Rakshith Shetty, Erhan Gundogdu
arXiv Machine Learning
1d ago

NorthCUA Technical Report: Turbocharging Computer-Use Agents through Experience at Scale

arXiv:2611.02102v3 Announce Type: replace Abstract: Scaling computer-use agents from individual actions to complex software work requires experience that connects decisions to complete outcomes. We p...

By Chaoyun Zhang, Bingxuan Li, Pinxue Guo, Yangfan Gao, Zikun Cai, Tianci Xie, Hui Li, Yuqi Huang, Yifei Cao, Bo Mao, Tian Tang, Qichang Zheng, Tongtong Liu, Xiaoxing Wang, Jinxiu Liu, Lizhi Lin, Zhou Shao, Maosen Zhou, Miao Zheng, Shuo Zhang, Yangji He, Kepeng Lei, Ning Zhao, Wei Shen, Zhenjiang Jin, Xinyue Zhang, Peng Sun, Zhenhua Han, Rui Zheng, Hang Yan
arXiv Computation and Language
1d ago

Overview of the NTCIR-19 SciClaimEval Task: Cross-modal Claim Verification in Scientific Papers

arXiv:2611.06090v1 Announce Type: new Abstract: This paper presents an overview of \emph{SciClaimEval}, a pilot task at NTCIR-19 on verifying scientific claims against the tables and figures of the p...

By Xanh Ho, Andr\'{e} Greiner-Petter, Florian Boudin, Yun-Ang Wu, Sunisth Kumar, Tian Cheng Xia, Hiba Akbi, Tim Schopf, Akiko Aizawa