Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

3,721 stories · RSS feed

arXiv AI

Jun 30

Decomposing Memorization Reduction in Privacy-Preserving Fine-Tuning of SLMs for CSIRTs

arXiv:2606. 28479v1 Announce Type: cross Abstract: CSIRTs increasingly fine tune language models on vulnerability scan records, but these records expose internal network topology and create privacy risks under regulations such as GDPR and LGPD.

By Cristhian Kapelinski, Diego Kreutz

llms fine-tuning safety

arXiv AI

Jun 30

McMg: A Learned Phase-Space Multi-channel Multigrid Preconditioner for Helmholtz Equation

arXiv:2606. 30495v1 Announce Type: cross Abstract: Solving heterogeneous Helmholtz equations at high wavenumbers remains challenging because the discretized operator is indefinite, pollution degrades phase accuracy, and scalar coarse-grid correction can discard the local phase and propagation-direction information carried by oscillatory errors.

By Jiwei Jia, Xinliang Liu, Juntao Wang, Jinchao Xu

fine-tuning

arXiv AI

Jun 30

Translating Natural Language to Strategic Temporal Specifications via LLMs

arXiv:2606. 30441v1 Announce Type: cross Abstract: A rigorous formalization of system requirements is a fundamental prerequisite for the verification of Multi-Agent Systems (MAS).

By Marco Aruta, Francesco Improta, Vadim Malvone, Aniello Murano, Vladana Perlic

llms agents fine-tuning

arXiv AI

Jun 30

KnowsTFM: Knowledge-Informed Fine-Tuning of Small Tabular Foundation Models

arXiv:2606. 30258v1 Announce Type: cross Abstract: Tabular foundation models have advanced deep learning for tabular data by delivering strong default performance across many small and medium tasks.

By Boshko Koloski, Xiangjian Jiang, Senja Pollak, Bla\v{z} \v{S}krlj, Mateja Jamnik, Nikola Simidjievski

fine-tuning

arXiv Machine Learning

Jun 30

On Surrogate Modeling of Static Response of AM Short-Fiber Thermoplastics Using Graph Neural Networks

arXiv:2606. 28996v1 Announce Type: new Abstract: Short-fiber thermoplastic (SFT) composites are increasingly employed in lightweight aerospace and automotive structures owing to their favorable strength-to-weight ratio, high production rates, and recyclability.

By Pharindra Pathak (Auburn University, Oakridge National Lab, NASA Glenn Research Center, Auburn University, Auburn University), Vipin Kumar (Auburn University, Oakridge National Lab, NASA Glenn Research Center, Auburn University, Auburn University), Trenton M. Ricks (Auburn University, Oakridge National Lab, NASA Glenn Research Center, Auburn University, Auburn University), Suhasini Gururaja (Auburn University, Oakridge National Lab, NASA Glenn Research Center, Auburn University, Auburn University), Siddhartha Srivastava (Auburn University, Oakridge National Lab, NASA Glenn Research Center, Auburn University, Auburn University)

fine-tuning

arXiv AI

Jun 30

Post-training for Efficient Communication via Convention Formation

arXiv:2508. 06482v2 Announce Type: replace-cross Abstract: Humans communicate with increasing efficiency in multi-turn interactions, by adapting their language and forming ad-hoc conventions.

By Yilun Hua, Evan Wang, Yoav Artzi

llms fine-tuning benchmarks

arXiv AI

Jun 30

Skin-R1: Clinical Knowledge-Guided Dermatological Diagnosis Using Vision-Language Models

arXiv:2511. 14900v2 Announce Type: replace-cross Abstract: Vision--language models (VLMs) have recently shown promise for assisting clinical reasoning in dermatological diagnosis.

By Zehao Liu, Weijieying Ren, Jipeng Zhang, Tianxiang Zhao, Jingxi Zhu, Xiaoting Li, Vasant G Honavar

llms reinforcement-learning fine-tuning multimodal benchmarks

arXiv AI

Jun 30

Dockerless: Environment-Free Program Verifier for Coding Agents

arXiv:2606. 28436v1 Announce Type: cross Abstract: Program verifiers play a central role in training coding agents, including selecting trajectories for supervised fine-tuning (SFT) and providing rewards for reinforcement learning (RL).

By Wenhao Zeng, Yuling Shi, Xiaodong Gu, Chao Hu, Chaofan Wang, Yuhao Cui, Hongting Zhou, Mengnan Qi, Jianqiao Wangni, Zhaojian Yu, Shuzheng Gao, Kai Cai, Shilin He

agents reinforcement-learning fine-tuning benchmarks

arXiv AI

Jun 30

Few-Shot Domain Incremental Learning via Continual Vision-Language Consolidation

arXiv:2606. 30190v1 Announce Type: cross Abstract: Existing domain-incremental learning (DIL) strategies call for massive amounts of data to adapt to new domains and suffer from the overfitting problem in the case of data scarcity.

By Naeem Paeedeh, Mahardhika Pratama, Wolfgang Mayer, Mukesh Prasad, Weiping Ding, Yew-Soon Ong

llms diffusion fine-tuning multimodal benchmarks

arXiv AI

Jun 30

Animation2Code: Evaluating Temporal Visual Reasoning in Video-to-Code Generation

arXiv:2606. 28593v1 Announce Type: cross Abstract: While recent vision-language models (VLMs) have achieved significant improvements on static visual-to-code tasks such as generating code for webpages, charts, or SVGs, it remains unclear whether they can recover temporal dynamics when motion is present.

By Anya Ji, Abhijith Varma Mudunuri, David M. Chan, Alane Suhr

llms fine-tuning multimodal benchmarks safety

arXiv AI

Jun 30

When Medical Safety Alignment Fails: A Benchmark for Evaluating LLMs on High-Risk Medical Queries

arXiv:2606. 28332v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used for medical and health-related questions, yet their safety in high-risk medical scenarios remains poorly understood.

By Yige Li, Jun Sun, Wei Zhao, Zhe Li, Yutao Wu, Hanxun Huang, Xiang Zheng, Xingjun Ma

llms fine-tuning benchmarks safety

arXiv Machine Learning

Jun 30

HiAP: A Multi-Granular Stochastic Auto-Pruning Framework for Vision Transformers

arXiv:2603. 12222v2 Announce Type: replace-cross Abstract: Vision Transformers require significant computational resources and memory bandwidth, severely limiting their deployment on resource-constraint hardware.

By Andy Li, Aiden Durrant, Milan Markovic, Georgios Leontidis

llms fine-tuning efficiency

arXiv Machine Learning

Jun 30

LoRAShield: Data-Free Editing Alignment for Secure Personalized LoRA Sharing

arXiv:2507. 07056v2 Announce Type: replace-cross Abstract: The proliferation of Low-Rank Adaptation (LoRA) models has democratized personalized text-to-image generation, enabling users to share lightweight models (e.

By Jiahao Chen, Junhao Li, Yiming Wang, Yong Yang, Yi Jiang, Chunyi Zhou, Qingming Li, Tianyu Du, Shouling Ji

llms diffusion fine-tuning safety

arXiv Machine Learning

Jun 30

Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluation

arXiv:2602. 09305v2 Announce Type: replace Abstract: Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable.

By Pei-Chi Pan, Yingbin Liang, Sen Lin

llms reinforcement-learning fine-tuning benchmarks safety

arXiv Machine Learning

Jun 30

HSAP: A Hierachical Sequence-aware Parallelism for Hybrid-Context Generative Models

arXiv:2606. 30460v1 Announce Type: new Abstract: In this paper, we aim to combine the advantages of existing sequence parallelism paradigms and overcomes their drawbacks, the most serious of which is the incapability to correctly compute causal attention on the hybrid-context packed sequences, in a stronger sequence parallelism framework.

By Songxin Zhang, Zejian Xie, Zhuoyang Song, Cong lin, Junyu Lu, Jiaxing Zhang, Bingyi Jing

llms fine-tuning

arXiv Machine Learning

Jun 30

GLIP: Graph and LLM Joint Pretraining for Graph-Level Tasks

arXiv:2606. 29773v1 Announce Type: new Abstract: Graphs are widely used to model relational systems, with applications in domains such as social networks, finance, and biomedicine.

By Haoxin Sun, Yiqing Lin, Yajun Huang, Chenhui Dong, Mingjun Li, Zhongzhi Zhang

llms diffusion fine-tuning benchmarks safety

arXiv Machine Learning

Jun 30

Prototype Latent World Model Replay for Class-Incremental Learning

arXiv:2606. 29465v1 Announce Type: new Abstract: Class-incremental learning requires a model to learn new classes while preserving decision regions for old ones.

By Weizhi Nie, Hui Wang, Weijie Wang, Yuting Su

fine-tuning benchmarks

arXiv Machine Learning

Jun 30

PCGD: Physics-Guided Conditional Graph Diffusion for TCAD Device Simulation

arXiv:2606. 29272v1 Announce Type: new Abstract: Technology computer-aided design (TCAD) semiconductor device simulation is fundamentally constrained by the high computational cost of iteratively solving coupled drift-diffusion equations.

By Yihan Zhang, Zhiteng Zhang, Kun Chen, Chen Wang

diffusion fine-tuning benchmarks

arXiv Machine Learning

Jun 30

BrainRiem: Riemannian Prototype Learning for Source-Free Cross-Site Brain Network Diagnosis

arXiv:2606. 29200v1 Announce Type: new Abstract: Multi-site functional MRI (fMRI) studies are essential for robust neuropsychiatric diagnosis yet suffer severe domain shifts from scanner heterogeneity, demographics, and site-specific acquisition protocols.

By Kunyu Zhang, Tianxiang Xu

fine-tuning benchmarks safety

arXiv Machine Learning

Jun 30

GLACIER: Rethinking Mass Spectrum Prediction as an Object Detection Problem

arXiv:2606. 29161v1 Announce Type: new Abstract: Predicting tandem mass spectra (MS/MS) from molecular structures represents a central task in analytical chemistry with direct relevance to clinical metabolomics, systems biology, and adjacent disciplines.

By Rui-Xi Wang, Runzhong Wang, Connor W. Coley

llms computer-vision fine-tuning benchmarks

Get the daily briefing