Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

8,201 stories · RSS feed

arXiv Computer Vision

Oct 27

Late Breaking Results: Audio-Language-Action Models with Direct Speech Conditioning for Robotic Manipulation

arXiv:2610.33866v1 Announce Type: new Abstract: Vision-language-action (VLA) models enable robots to follow instructions in typed text, limiting broader deployment in natural speech. The traditional...

By Enfu Nan, Pu Zhao, Yixiao Chen, Lin Zhao, Juyi Lin, Chen Wang, Weiwei Chen, Yanzhi Wang

robotics fine-tuning multimodal

arXiv Computer Vision

Oct 27

ChronoReplay: One Answer Interface Is Not Enough for Streaming Spatial Intelligence

arXiv:2610.34283v1 Announce Type: new Abstract: Training a spatial VLM to answer which side an object lies on does not require it to preserve the metric displacement that determines that answer, whil...

By Yihao Hu, Yitong Lin, Pan Wang, Zhihao Wen, Hang Wang, Yiwen Zhao, Deyuan Liu, Yutong Li, Mingda Wan, Yuchen Mao, Tao Lin

fine-tuning multimodal benchmarks

arXiv Computer Vision

Oct 27

TopX: Text-to-Motion for Unseen Skeletons from the Skeleton File Alone

arXiv:2610.34321v1 Announce Type: new Abstract: Text-to-motion models generate for the skeletons they were trained on, while a new character arrives as a skeleton file and nothing else. We study text...

By Tengjiao Sun, Pengcheng Fang, Xiaoyu Zhan, Dongjie Fu, Xiaohao Cai, Hansung Kim

llms fine-tuning

arXiv Computer Vision

Oct 27

Finetuning Prompt-Based Image Editor for Geometry-Consistent Room Defurnishing

arXiv:2610.34597v1 Announce Type: new Abstract: Erasing all furniture from a single room image to generate its empty counterpart is valuable for XR applications such as diminished reality and virtual...

By Prakhar Kulshreshtha, Brian Pugh, Zachary Nussdorfer, Salma Jiddi

fine-tuning

arXiv Computer Vision

Oct 27

GIFT: Representation Geometry Matters for Single-Domain Generalized Object Detection

arXiv:2610.35374v1 Announce Type: new Abstract: Single-Domain Generalized Object Detection (S-DGOD) aims to generalize from a single source domain to unseen domains under distribution shifts. Existin...

By Yin Zhang, Yaoyue Zheng, Yongqiang Zhang, Bogdan Raducanu, Dan Li

computer-vision fine-tuning benchmarks

arXiv Computer Vision

Oct 27

S$^2$-RL: Sample-Set Dual Reinforcement Learning for Generative Semantic Segmentation Dataset Distillation

arXiv:2610.35491v1 Announce Type: new Abstract: While dataset distillation has witnessed significant advances in image classification, its extension to dense prediction tasks such as semantic segment...

By Haoyu Wang, Fei Zhou, Qingqing Qiu, Lei Zhang, Wei Wei, Chen Ding

diffusion computer-vision reinforcement-learning fine-tuning efficiency benchmarks safety

arXiv Computer Vision

Oct 27

HiFiPix: Bringing High-Fidelity Real-World Super-Resolution Back to Pixel Space

arXiv:2610.35515v1 Announce Type: new Abstract: Diffusion-based real-world image super-resolution suffers from limited reconstruction fidelity due to information loss in VAE-based latent representati...

By Wenjie Li, Du Chen, Hui Wang, Linlong Fan, Youwei Lv, Zeyi Chen, Zehan Chen, Jinwei Chen, Heng Guo, Zhanyu Ma, Qingnan Fan

diffusion fine-tuning efficiency benchmarks

arXiv Computer Vision

Oct 27

Back to Basics: A Skill-Centric Approach to Generalist Web Agents

arXiv:2610.35823v1 Announce Type: new Abstract: Browser agents do not just need more practice. They need to practice the right things. We introduce MiniWeb, a realistic miniature of the web comprisin...

By Minh Pham-Dinh, Md Farhan Ishmam, Hernan Yupanqui, Reaz Hassan Joarder, Kenneth Marino

agents fine-tuning benchmarks

arXiv Computer Vision

Oct 27

WebUniverse: Scaling Verified Training Data for Agentic Web Development

arXiv:2610.33149v1 Announce Type: cross Abstract: Training agents for front-end web development requires demonstrations of code editing, execution, browser inspection and revision, yet public traject...

By Yaorui Ding, Fengqing Jiang, Yichen Feng, Yuetai Li, Zhangchen Xu, Kaiyuan Zheng, Xuanyu Lu, Bhaskar Ramasubramanian, Basel Alomair, Luyao Niu, Radha Poovendran

agents fine-tuning

arXiv Computer Vision

Oct 27

TinyFlow: Breaking the Warping Bottleneck for Edge Optical Flow

arXiv:2610.33338v1 Announce Type: cross Abstract: High-performance optical flow networks are difficult to deploy on resource-constrained edge accelerators because their iterative refinement warps fea...

By Xiao'ao Song, Chahat Deep Singh

computer-vision fine-tuning efficiency

arXiv Computer Vision

Oct 27

Accuracy and efficiency of compact foundation models for surface-water mapping during floods

arXiv:2610.34904v1 Announce Type: cross Abstract: Pretrained Earth observation models may reduce the effort needed to map surface water, but their value depends on the alternative against which they...

By Parastoo Farajpoor, Mohammadreza Narimani

llms fine-tuning

arXiv Computer Vision

Oct 27

AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Driving

arXiv:2509.13769v2 Announce Type: replace Abstract: While reasoning technology like Chain of Thought (CoT) has been widely adopted in Vision Language Action (VLA) models, it demonstrates promising ca...

By Yuechen Luo, Fang Li, Shaoqing Xu, Zhiyi Lai, Lei Yang, Qimao Chen, Ziang Luo, Zixun Xie, Shengyin Jiang, Jiaxin Liu, Long Chen, Bing Wang, Ken Deng, Zhi-xin Yang

agents nlp reinforcement-learning robotics fine-tuning benchmarks

arXiv Computer Vision

Oct 27

DOCFORGE-BENCH: A Comprehensive 0-shot Benchmark for Document Forgery Detection and Analysis

arXiv:2603.01433v3 Announce Type: replace Abstract: We present DOCFORGE-BENCH, the first unified zero-shot benchmark for document forgery detection, evaluating 14 methods across eight datasets spanni...

By Zengqi Zhao, Weidi Xia, En Wei, Yan Zhang, Jane Mo, Tiannan Zhang, Yuanqin Dai, Zexi Chen, Yiran Tao, Simiao Ren

llms diffusion robotics fine-tuning benchmarks

arXiv Computer Vision

Oct 27

A Novel Geographic Graph-Regulated Disentangling Mamba Model with Sparse Tokens for Enhanced Tree Species Classification from MODIS Time Series

arXiv:2605.05549v2 Announce Type: replace Abstract: Tree species classification from Moderate Resolution Imaging Spectroradiometer (MODIS) time series is critical for environmental monitoring, yet ch...

By Motasem Alkayid, Zhengsen Xu, Naser El-Sheimy, Lincoln Linlin Xu

fine-tuning benchmarks

arXiv Computer Vision

Oct 27

GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation

arXiv:2609.05588v3 Announce Type: replace-cross Abstract: World-action models (WAM) predict future states to guide robot actions, enabling learning from both action-free video and action-labeled inte...

By Renhang Liu, Wenzhi Zhao, Zhuo Yang, Liliang Chen, Pengfei Zhou, Shengcong Chen, Guanghui Ren, Youlun Peng, Rongjun Jin, Nan Wang, Sukai Wang, Xindong He, Jinyuan Feng, Ziyu Xiong, Linqing Zhong, Yifei Wei, Feng Han, Long Zhang, Da Huang, Nanshu Zhao, Chenghao Yin, Mo Wu, Zhaodong Yan, Kongtao Hu, Yuxiang Yan, Aogelijiang Niyazi, Yu Fang, Jia Zeng, Lizhu Meng, Daizhen Lv, Haoyu Cao, Zhiwen Hou, Lianjin Ye, Yuehan Niu, Zhikai Cai, Xuan Hu, Hui Min, Xiongfeng Cai, Yue Liao, Jing Wu, Soujanya Poria, Ye Li, Sanping Zhou, Maoqing Yao, AgiBot Research Team

robotics fine-tuning

arXiv Statistics ML

Oct 27

HIFI: A Highly Efficient Framework for Statistical Inference with Foundation Models

arXiv:2610.34550v1 Announce Type: new Abstract: Foundation models provide powerful representations for unstructured data, such as text and images, and parameter-efficient fine-tuning (PEFT) makes the...

By Po-Wei Chen, Shan Yu, Chunlin Li

fine-tuning safety

arXiv AI

Oct 27

A Comprehensive Framework for All Stages of Large-Model Training: From Data and Tokenization, through Pretraining, to Post-Training Alignment

arXiv:2610.33451v1 Announce Type: new Abstract: The capabilities of large language models (LLMs) and multimodal LLMs (MLLMs) arise from the synergy of the full training pipeline, including data and t...

By Xiangjing An, Zhibin Jiao, Aiting Chen

llms nlp reinforcement-learning fine-tuning multimodal safety data-engineering

arXiv AI

Oct 27

An actively trained neural operator for near-explicit atmospheric chemistry

arXiv:2610.33771v1 Announce Type: new Abstract: Earth-system models simplify atmospheric chemistry into condensed mechanisms, because near-explicit mechanisms such as the Master Chemical Mechanism (M...

By Zhi-Song Liu, Wenqing Peng, Ammar Kheder, Michael Boy

fine-tuning

arXiv AI

Oct 27

DocTalk: Enhancing Medical Knowledge Retrieval via Fine-tuned Large Language Models with Chain-of-Thought Reasoning for Robust Clinical Decision Support

arXiv:2610.34871v1 Announce Type: new Abstract: Objective: The rapid advancement of large language models (LLMs) in healthcare has opened new possibilities for AI-assisted clinical decision-making; h...

By Asad Gohar, Md Ariful Islam Mozumder, Moon-Il Joo, Hee-Cheol Kim

llms fine-tuning safety

arXiv AI

Oct 27

CANS: Capability-Preserving Neuron Steering for Large Language Models

arXiv:2610.35530v1 Announce Type: new Abstract: Activation steering offers training-free and dynamic control of target behaviors in large language models, but existing methods can impair general capa...

By Yucheng Wu, Chengyi Xie, Chenpeng Wang, Liangming Pan

llms fine-tuning benchmarks safety

Get the daily briefing