Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

3,511 stories · RSS feed

arXiv AI

Jul 7

ICR-RL: Deep Reinforcement Learning via In-Context Regression

arXiv:2509. 11259v2 Announce Type: replace-cross Abstract: Recent advancements in machine learning have largely been driven by foundation models (FMs) trained on large, diverse datasets, enabling them to generalize effectively to new, related tasks.

By David Schiff, Ofir Lindenbaum, Yonathan Efroni

agents reinforcement-learning fine-tuning benchmarks

arXiv AI

Jul 7

Domain Knowledge-Informed Self-Supervised Representations for Workout Form Assessment

arXiv:2202. 14019v3 Announce Type: replace-cross Abstract: Maintaining proper form while exercising is important for preventing injuries and maximizing muscle mass gains.

By Paritosh Parmar, Amol Gharat, Helge Rhodin

computer-vision fine-tuning

arXiv AI

Jul 7

Multi-Robot Open Adaptive Teaming Across Unseen Environments, Partners, and Scales

arXiv:2607. 04972v1 Announce Type: cross Abstract: Deploying robot teams in the real world requires simultaneous adaptation to unseen environments, unknown partners, and varying team sizes, yet existing approaches often address these challenges in isolation under the closed-world assumption of fixed teammates.

By Yang Li, Feng Xue, Fan Mo, Yunhao Liu, Jianhong Wang, Ying Wen, Qingrui Zhang, Shaoshuai Mou, Wei Pan

agents robotics fine-tuning

arXiv AI

Jul 7

When Claws Remember but Do Not Tell: Stealthy Memory Injection in Persistent Personal Agents

arXiv:2607. 05189v1 Announce Type: cross Abstract: Persistent personal agents combine long-term memory with access to users' external environments, enabling personalized foreground assistance and proactive background execution.

By Yechao Zhang, Shiqian Zhao, Jiawen Zhang, Jie Zhang, Gelei Deng, Xiaogeng Liu, Chaowei Xiao, Tianwei Zhang

llms agents reinforcement-learning fine-tuning benchmarks

arXiv AI

Jul 7

Localized LoRA-MoE: Block-wise Low-Rank Experts With Adaptive Routing

arXiv:2607. 05114v1 Announce Type: cross Abstract: Large Language Models (LLMs) and high-dimensional perception networks increasingly rely on parameter-efficient fine-tuning (PEFT) to adapt to diverse operational contexts.

By Babak Barazandeh, Subhabrata Majumdar, Vinay Prithyani, George Michailidis

llms agents fine-tuning benchmarks

arXiv AI

Jul 7

AIFS-SUBS: Extending Data-Driven Forecasting to Sub-Seasonal Timescales

arXiv:2607. 05100v1 Announce Type: cross Abstract: Data-driven models now rival numerical weather prediction in the medium range, but extending them to sub-seasonal lead times raises challenges absent at shorter horizons.

By Jakob Schloer, Steffen Tietsche, Christopher D. Roberts, Lorenzo Zampieri, Simon Lang, Gert Mertes, Gareth Jones, Matthew Chantry, Frederic Vitart

fine-tuning

arXiv AI

Jul 7

TORINO: Token Reduction via Interpretable Concept Overlap in Vision-Language Models

arXiv:2607. 04593v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have demonstrated impressive capabilities across different tasks, but their computational cost is dominated by the large number of visual tokens fed to the language model.

By Riccardo Renzulli, Gabriele Spadaro, Shruthi Gowda, Alaa Eddine Mazouz, Van-Tam Nguyen

llms diffusion fine-tuning efficiency multimodal benchmarks

arXiv AI

Jul 7

One Framework for All: Cross-Modal Membership Inference for Generative Models

arXiv:2607. 04339v1 Announce Type: cross Abstract: Large generative models across text-to-text, text-to-image, and image-to-text modalities have been shown to pose significant privacy risks.

By Dayong Ye, Tainqing Zhu, Kun Gao, Junhao Liu, Yichuan Chen, Shuai Zhou, Hengzhu Liu, Bo Liu, Wanlei Zhou

rag diffusion fine-tuning multimodal benchmarks safety

arXiv AI

Jul 7

Full-Stack FP4: Stable LLM Pretraining with Quantized Projections, Optimizers, and Attention

arXiv:2607. 04422v1 Announce Type: cross Abstract: Recent NVFP4 pretraining methods mainly target transformer linear layers, leaving optimizer states, optimizer arithmetic and attention underexplored in 4-bit pipelines.

By Siyu Ding, Mingchuan Ma, Jiabo Tong, Xingrun Xing, Ziming Wang, Guoqi Li

llms fine-tuning efficiency safety

arXiv AI

Jul 7

CritiqueDriveVLM: From Verifier-Guided Reinforcement Learning to Latent Thought Distillation for Autonomous Driving

arXiv:2607. 04179v1 Announce Type: cross Abstract: End-to-end Vision-Language Models (VLMs) show immense potential in autonomous driving.

By Zhaohong Liu, Hao Ye, Xianlin Zhang, Mengshi Qi

llms agents reinforcement-learning robotics fine-tuning efficiency multimodal benchmarks safety

arXiv AI

Jul 7

Parametric Memory Decoding for Zero-Shot Routing in LoRA-Based External Parametric Memory

arXiv:2607. 04118v1 Announce Type: cross Abstract: With the rise of parametric memory, LoRA-based External Parametric Memory (EPM) has emerged as a modular solution, but existing routing methods often introduce additional training, deployment, and maintenance overhead.

By Fengxian Ji, Zhuohan Xie, Jingpu Yang, Fan Zhang, Zirui Song, Xiuying Chen

fine-tuning

arXiv AI

Jul 7

KARMA: Knowledge graph-based Automated Reasoning Materialization and Alignment

arXiv:2607. 03166v1 Announce Type: cross Abstract: Template-based contrastive synthesis is scalable, but its candidates often differ only in a few entity-slots while sequence-level optimization spreads supervision over mostly shared templates.

By Jinkyeong Choi, Chaebin Jeong, Donghyeon Park

llms fine-tuning benchmarks safety

arXiv AI

Jul 7

A Multi-Task Deep Learning Framework for Real-Time Intelligent Video Surveillance with Temporal Event Validation

arXiv:2607. 03131v1 Announce Type: cross Abstract: Modern video surveillance systems generate far more video streams than human operators can effectively monitor, making automated analysis essential for timely detection of security events.

By Estera Dumitru, Stelian Sp\^inu

fine-tuning

arXiv AI

Jul 7

SNR-Adaptive Unified Diffusion for Multi-Task Medical Image Segmentation

arXiv:2607. 03103v1 Announce Type: cross Abstract: Clinical cardiac imaging pipelines currently deploy separate models for each dataset and modality, incurring redundant training costs and precluding knowledge sharing across anatomically related tasks.

By Jiahao Liu, Hang Wei, Shuai Wu

diffusion computer-vision fine-tuning benchmarks safety

arXiv AI

Jul 7

Post-Generation Curation of Synthetic Images via Homogeneous-Heterogeneous Splitting

arXiv:2607. 02637v1 Announce Type: cross Abstract: Recent generative models can produce high-quality synthetic images, offering scalable training training data for data-hungry models.

By Disheng Liu, Tuo Liang, Chaoda Song, Yu Yin

llms computer-vision fine-tuning benchmarks safety

arXiv AI

Jul 7

CARL: Constraint-Aware Reinforcement Learning for Planning with LLMs

arXiv:2607. 04854v1 Announce Type: new Abstract: Despite their strong reasoning capabilities and extensive world knowledge, Large Language Models (LLMs) frequently generate plans that violate task constraints, undermining their reliability in real-world applications.

By Qiuyi Qi, Jinjian Zhang, Mutian Bao, Tian Liang, Guocong Li, Dongnan Liu, Wei Zhou, Jie Liu, Ming Kong, Linjian Mo, Feng Zhang, Qiang Zhu

llms reinforcement-learning fine-tuning benchmarks

arXiv AI

Jul 7

Oyster-II: Reinforcement Learning for Constructive Safety Alignment in Large Language Models

arXiv:2607. 02914v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated remarkable capabilities across diverse applications, yet ensuring their simultaneous safety, helpfulness, and trustworthiness remains a persistent challenge.

By Jiyang Guan, Yong Xie, Jun Chen, Jiexi Liu, Zipeng Ye, Defeng Li, Jiayu Shen, Jialing Tao, Hui Xue

llms reinforcement-learning fine-tuning benchmarks safety

arXiv AI

Jul 7

EyeMulator: Improving Code Language Models by Mimicking Human Visual Attention

arXiv:2508. 16771v3 Announce Type: replace-cross Abstract: Code Language Models (CodeLLMs) learn token importance from data correlations, whereas human developers attend selectively to semantically salient code.

By Yifan Zhang, Chen Huang, Yueke Zhang, Jiahao Zhang, Toby Jia-Jun Li, Collin McMillan, Kevin Leach, Yu Huang

llms nlp fine-tuning benchmarks

arXiv Machine Learning

Jul 7

AMT-APC: Automatic Piano Cover by Fine-Tuning an Automatic Music Transcription Model

arXiv:2409. 14086v2 Announce Type: replace-cross Abstract: There have been several studies on automatically generating piano covers, and recent advancements in deep learning have enabled the creation of more sophisticated covers.

By Kazuma Komiya, Yoshihisa Fukuhara

fine-tuning

arXiv AI

Jul 7

Punching Above Their Weight: Classification-Head Fine-Tuning of Tiny Language Models (TLMs) for Verifiable Multiple-Choice Tasks

arXiv:2607. 03801v1 Announce Type: cross Abstract: We define Tiny Language Models (TLMs) as models below roughly 3B parameters that fit on mainstream consumer devices.

By Bhavesh Sood, Jaromir Savelka

llms fine-tuning benchmarks

Get the daily briefing