The paper introduces Pancreas‑MedNeXt, a unified MRI segmentation model that simultaneously delineates the entire pancreas, its subregions, pancreatic tumors, and surrounding organs at risk (OARs) from a single MRI volume. Using a shared MedNeXt encoder‑decoder and an annotation‑aware loss, the model is trained on partially labeled data and fine‑tuned for multitask output heads. In cross‑validation on 142 PANTHER patients and external test sets, Pancreas‑MedNeXt outperforms state‑of‑the‑art methods, achieving higher Dice similarity coefficients for pancreas, tumor, and OARs.
"whyItMatters":"The model’s superior performance and unified approach could streamline contouring workflows for pancreatic cancer radiotherapy, potentially improving treatment planning efficiency."
By Zach Eidex, Mojtaba Safari, Kundan Thind, Parag J. Parikh, Zhen Tian, Xiaofeng Yang
The paper investigates the faithfulness of visual information in multimodal chain-of-thought (MCoT) reasoning by large vision-language models (LVLMs). It shows that visual cues in MCoT are often inaccurate and largely ignored, as predictions change little when visual input is altered but significantly when textual input is changed. To improve visual faithfulness, the authors propose an annotation‑free Sufficient‑Component Cause Model (SCCM) that encourages the generation of minimal yet sufficient visual components, and demonstrate its effectiveness across fine‑grained perception and reasoning benchmarks.
By Zujing Liu, Junwen Pan, Qi She, Yuan Gao, Guisong Xia
The paper critiques current LLM safety evaluations that rely solely on severity taxonomies, arguing they ignore the probability that a threat will actually be executed. It introduces Expected Harm, a metric that multiplies severity by execution likelihood—modeled via execution cost—to better gauge real-world risk. Empirical studies show that models over‑refuse low‑likelihood, high‑cost threats while remaining vulnerable to high‑likelihood, low‑cost ones, a miscalibration traced to the distribution of safety examples in supervised fine‑tuning. This misalignment can be exploited to double the success rate of jailbreak attacks.
By Yen-Shan Chen, Zhi Rui Tam, Cheng-Kuang Wu, Yun-Nung Chen
The paper proposes pre-training uncertainty estimators on large, diverse materials science datasets to improve uncertainty quantification (UQ) for machine‑learned interatomic potentials (MLIPs). By evaluating these pre‑trained models on both in‑distribution and out‑of‑domain adsorption‑energy predictions, the authors demonstrate that zero‑shot UQ is viable and that fine‑tuning yields strong correlations between predicted uncertainty and actual prediction error, even on challenging datasets. This approach aims to provide foundational UQ models that enable broader, more reliable deployment of MLIPs across chemical space.
By Stefan P. Schmid, Tobias Setzer, Maximilian Scheurer
The paper investigates model merging as a scalable alternative to multi-task training for multi-domain automatic speech recognition (ASR). It benchmarks 11 merging algorithms across 10 European Portuguese domains, assessing in‑domain accuracy, robustness to distribution shift, and performance on English and multilingual data. The authors introduce BoostedTSV‑M, a new merging method that mitigates rank collapse through singular‑value boosting, achieving better performance than full fine‑tuning while maintaining out‑of‑distribution generalisation in a single model.
By Carlos Carvalho, Francisco Teixeira, Thomas Rolland, Alberto Abad
RECAST is a reconstruction-based framework that generates chain-of-thought (CoT) explanations from closed‑source reasoning models that only expose final answers, such as Claude‑Sonnet‑5.5, GPT‑6.1, and Gemini 3. Unlike prior extraction methods that rely on visible reasoning fields or scratchpads, RECAST conditions a decoder on the question and the model’s final answer to produce a first‑person structured rationale, cleans it, and outputs data ready for supervised fine‑tuning. The system is open‑source, packaged as an agent skill, and demonstrates successful qualitative reconstructions on the mentioned models using an answer‑only protocol.
By Qi Wang, Kang Xu, Chengcheng Wan, Jiangtao Wang
The study evaluates whether a large language model (LLM) can manage multi‑zone variable‑air‑volume HVAC control without building‑specific training, and whether reinforcement fine‑tuning verified by rollout can enhance a smaller, deployable model. Five controllers were tested in a physics‑based four‑zone emulator over five summer days; the LLM (GPT‑5) reduced electricity use by 6.8‑7.4% compared to a guideline baseline but performed worse on outdoor‑air usage and CO₂ compliance. A reinforcement‑learning controller achieved a 4.5% electricity savings while improving temperature and CO₂ compliance, yet its critic’s high correlation with deterministic rollout did not reliably rank actions, and fine‑tuning a smaller LLM with rollout returns yielded no sustained performance gains due to unreliable next‑state predictions.
By Takumi Shioda, Kohei Terashima, Tatsuo Nagai
The paper introduces Counterfactual Pairwise Augmentation (CPA), a method that enhances small language model judges by generating counterfactual responses to clarify decision boundaries during training. CPA jointly fine‑tunes models on both pointwise and pairwise data, enabling the judge to operate in pointwise mode while benefiting from explicit pairwise comparisons. Experiments on Qwen3‑8B adapters show CPA improves macro‑F1 scores by 2.5 points over pointwise‑only training and outperforms both model merging and the Gemini 3.6 Flash zero‑shot judge by significant margins.
By Mohammad Zangooei, Peyvand Teymoori, Mohammad Robati Shirzad, Soroosh Shahtalebi
The paper presents a multi‑task neural network and scalar‑potential solver for reconstructing bilateral coronary artery trees from cardiac CT angiography. It operates on $128^3$ regions of interest, using a 3D pyramid encoder, tubular decoder, and specialized heads for sub‑voxel displacement, ipsilateral territory prediction, and ostium localization. The method achieves sub‑millimetre accuracy on out‑of‑sample and development datasets, outperforming baseline 3D U‑Net models.
By Zeyu Jia, Xin Ming
Latent‑Lens is a lightweight codec that enables a frozen vision‑language model (VLM) to communicate visual information to a frozen small language model (SLM) directly in latent space, avoiding the lossy bottleneck of discrete text. The codec uses a domain encoder to project VLM hidden states into the SLM’s embedding space and an attention decoder (a LoRA) that teaches the SLM to attend to these visual prefixes, training only about 1.6 M parameters (0.2 % of the combined model size). On visual question answering tasks (CLEVR, GQA) and image captioning (Flickr8k), Latent‑Lens significantly outperforms text‑based communication with the same LoRA budget, achieving up to +69.8 pp improvement on VQA and +18.8 pp on captioning.
By Mo Shahdloo, Faegheh Sardari, Mathew Salvaris
The paper formalizes controllable user simulation as a causal inference problem, showing that standard supervised fine‑tuning on post‑hoc trajectory labels introduces a look‑ahead bias that breaks causal consistency. This bias leads to a phenomenon called controllability collapse, where evaluation metric variance explodes under policy shift. The authors propose theoretical conditions for accurate simulation and practical training mitigations—such as a priori controls, step‑wise dynamic controls, and direct policy‑conditioned learning—to eliminate look‑ahead bias, preserve natural variance, and achieve robust zero‑shot generalization to unseen agent behaviors.
By Guy Tennenholtz, Ofer Meshi, Amir Globerson, Uri Shalit, Jihwan Jeong, Craig Boutilier
The study investigates how Jacobian-based fine‑tuning affects neural emulators of chaotic partial differential equations (PDEs). By decomposing error growth into physical and model‑induced components, the authors introduce an amplification ratio that quantifies how the emulator’s dynamics magnify prediction errors. Across 21 experimental setups, Jacobian fine‑tuning significantly reduced errors—especially for configurations with high amplification ratios—while matching the solver’s Jacobian along the model’s error direction (EDJM) outperformed random directions and input‑noise injection.
By Shreeyam Bangera, Manya Gupta
The paper investigates a new security vulnerability in fine‑tuned Mixture‑of‑Experts large language models, termed structural memorization, where the model not only memorizes training data but also the internal routing pathways used during fine‑tuning. The authors demonstrate that these memorized expert pathways can be recovered from the model’s unconditional generation using only routing and output logits, even without access to the fine‑tuning data. They further show that this vulnerability is amplified in distributed deployments and that traditional membership inference metrics fail to detect it, proposing composite metrics that improve detection of memorized routing structures.
By Fei Wang, Baochun Li, Bo Li
TalentRL is a strategy‑guided reinforcement learning framework that routes natural‑language skills hierarchically, using coarse‑grained talents to guide fine‑grained skill retrieval. The method trains talent routing via reward contrasts and optimizes execution with group‑relative advantages, achieving significant performance gains on open‑domain QA benchmarks and agentic tasks such as ALFWorld and WebShop.
By Huancheng Chen, Xiaodi Sun, Zhaoqiong Huang, Michelle Chang, Jingwen Lu
The paper introduces LOCOGEN, a method for designing regulatory DNA sequences that balances activity, novelty, and plausibility. LOCOGEN treats guidance as a locality problem, protecting motif positions with an invariant mask while applying out‑of‑distribution damping only to background regions. Experiments on HepG2, K562, and SK‑N‑SH datasets show that LOCOGEN reaches a previously underexplored region of the property‑novelty‑plausibility space, outperforming existing baselines.
By Dabin Jeong, Marwane Bourdim, Mo Lotfollahi
Mage‑VL‑Cowork is a 4‑billion‑parameter hybrid computer‑use agent that integrates visual GUI interaction with code and terminal execution in a single policy. It is trained via a progressive five‑stage curriculum—mid‑training, supervised fine‑tuning, and reinforcement learning—starting from a multimodally aligned checkpoint. The training pipeline, Mage‑CUA‑Forge, automates task generation and skill conditioning, producing nearly 300,000 desktop and web tasks while cutting per‑task costs by 82.6%, and the resulting model achieves 66.0% on OSWorld‑Verified, setting a new state‑of‑the‑art for its size.
By Xiaoyi Zhang, Haoqing Wang, Xinjie Zhang, Xiang Ming, Xing Wang, Senqiao Yang, Kaichen Zhang, Zhaoyang Jia, Andong Tan, Xinjiang Wang, Jinghao Guo, Yifei Shen, Xiao Li, Peng Zhang, Xun Guo, Jiahao Li, Shicheng Zheng, Jinglu Wang, Zongyu Guo, Wenxuan Xie, Bin Li, Yan Lu
Steering vectors (SVs) are residual-stream directions that can shift LLM behavior when added to hidden states during inference. This study investigates whether the same SVs can guide parameter updates during post‑training, exploring supervised learning (SFT and distillation) and reinforcement learning with verifiable rewards (RLVR). The authors find that SV injection improves performance over plain SFT and distillation, achieving up to a 12% gain in certain distillation settings, and that applying a correctness‑contrast direction as advantage repair in RL recovers learning signals for held‑out math benchmarks. They also identify failure boundaries related to code generation, cross‑family layer transfer, and inference‑time application on SV‑trained checkpoints.
By Tiejin Chen, Maunil Vyas, Huaiyuan Yao, Hua Wei
The paper introduces PG‑FM, a Prompt‑Guided Feature Modulation method that adapts RGB‑thermal object detectors to the estimated corruption type and severity of each modality. Unlike restoration‑based approaches, PG‑FM performs per‑input adaptation without significant latency and maintains clean‑set performance while boosting mAP50 by up to 20.8 points on FLIR and 19.9 points on KAIST under simulated corruptions. The method also transfers effectively to unmodified, naturally acquired external RGB‑T datasets without retraining.
By Liuyin Shi, Chengqi Li, Wenbo He
The paper investigates where fine‑tuned behaviors in language models are instantiated by patching the key‑value (KV) cache between a LoRA‑fine‑tuned model and its base version. Results show that certain behaviors, such as German responses or emergent misalignment, can be transferred or removed by swapping KV cache segments, and that the impact grows with the amount patched and is concentrated at a few pivotal positions like system‑prompt and chat‑template tokens.
By Jonas Loos, Oliver Eberle
arXiv:2610. 41588v1 Announce Type: cross Abstract: Direct Preference Optimization (DPO) treats every reported comparison as correct, yet preference data contain reversed, tied or otherwise noisy comparisons.
By Bin Luo, Param Venkat Vivek Kesireddy, Anil Vallepu