arXiv AI

LLM Detoxification via Transition-Aware Reward-Guided Representation Sampling

The paper introduces Transition-Aware Reward-Guided Representation Sampling (TARGRS), a test-time detoxification framework for large language models that learns reward guidance over toxicity transitions in latent representation space. TARGRS constructs trajectories from non‑toxic to toxic states, uses toxicity scores along these paths to train a token‑level reward model, and then guides coarse‑to‑fine sampling in the opposite direction to produce detoxified outputs with minimal perturbation. Experiments on ten LLMs and three LVLMs show that TARGRS consistently outperforms existing baselines, reducing toxicity by up to 69.38% on RealToxicityPrompts and up to 64.23% on LVLMs while maintaining near‑original speed and core capabilities.

arXiv Computation and Language
Sep 23

Learning Diagnostic Reasoning for Decision Support in Toxicology

The paper introduces DeToxR, a reinforcement‑learning‑enhanced large language model designed to support decision making in acute toxicology cases. It fuses unstructured narratives from paramedics and patients with structured vital‑sign data to predict co‑ingested substances across 14 classes. In preliminary validation, DeToxR outperforms baseline models, achieving higher micro‑F1 and recall scores for poison identification.

By Nico Oberl\"ander, David Bani-Harouni, Tobias Zellner, Nassir Navab, Florian Eyer, Matthias Keicher
arXiv Computation and Language
Sep 10

Why Do LLM Agents Fail in Exploring New Environments? A World-Modeling Perspective

arXiv:2510.15047v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) as agents often fail to improve in new environments. We identify and characterize a failure mode we call explora...

By Shiqi Chen, Tongyao Zhu, Zian Wang, Jinghan Zhang, Kangrui Wang, Ruochen Zhou, Siyang Gao, Teng Xiao, Yee Whye Teh, Junxian He, Manling Li
arXiv Machine Learning
Aug 26

Round-trip Reinforcement Learning: Self-Consistent Training for Better Chemical LLMs

The paper introduces Round-Trip Reinforcement Learning (RTRL), a framework that trains chemical language models to improve round‑trip consistency by rewarding successful forward and reverse transformations. By iteratively training forward and reverse mappings, RTRL leverages abundant unlabeled chemical data to enhance both consistency and overall performance across supervised, self‑supervised, and synthetic data regimes. Experiments show that RTRL outperforms strong baselines, demonstrating that round‑trip consistency can be treated as a trainable objective for more robust foundation models.

By Lecheng Kong, Xiyuan Wang, Yixin Chen, Muhan Zhang