arXiv AI

Detecting Perspective Shifts in Multi-agent Systems

arXiv:2512. 05013v2 Announce Type: replace Abstract: Generative models augmented with external tools and update mechanisms (or \textit{agents}) have demonstrated capabilities beyond intelligent prompting of base models.

arXiv AI
Sep 11

Do Agents Know When They Succeed? Calibrating Agent Confidence from Internal Representations

The paper examines whether internal representations of agentic systems can better indicate task success than traditional confidence measures. It introduces two methods—Latent Trajectory Dynamics (LTD) and Action Representation Probe (ARP)—that analyze changes in residual-stream representations and action-level representations, respectively. Experiments on Bash, SQL, and Python benchmarks with Qwen and DeepSeek models show these methods outperform conventional surface-level and sequence-based calibration baselines, offering a zero‑overhead reliability monitor without prompt changes or multiple rollouts.

By Priyanka Mary Mammen, Emil Joswin, Srujananjali Medicherla
arXiv AI
Jun 16

LatentGym: A Testbed For Cross-Task Experiential Learning With Controllable Latent Structure

arXiv:2606. 15306v1 Announce Type: cross Abstract: We envision continually learning agentic systems that become more useful over time: as they encounter sequences of related tasks, they should infer the hidden structure shared across those tasks and use it to improve future decisions.

By Daksh Mittal, Tommaso Castellani, Thomson Yen, Naimeng Ye, Fangyu Wu, Minghui Chen, Tiffany Cai, Emmanouil Koukoumidis, William Zeng, Hongseok Namkoong
Hugging Face Trending Papers
Aug 18

EvoTS-Agent: A Self-Evolving LLM Agent for Financial Time Series Change Point Detection

EvoTS-Agent is a self‑evolving large language model agent designed for autonomous change‑point detection in financial time series. It begins with curated exploratory data analysis to set up candidate models, then iteratively refines detection pipelines using three operators—Revision, Alternative Strategy, and Recombination—guided by validation feedback. Across four benchmark datasets, EvoTS-Agent consistently outperforms existing LLM‑based agents and achieves a 100% execution success rate with all tested backbone LLMs.

arXiv AI
Sep 18

Deep Noir: Autonomous Steering Discovery via Architectural Chronometry in Transformer Models

Deep Noir is a framework that autonomously discovers optimal activation‑steering parameters in transformer models by leveraging Logit Lens convergence and causal head‑level attribution. It demonstrates significant performance gains across models ranging from 1B to 9B parameters, improving spam detection by up to 42 percentage points and SST‑2 sentiment classification by 13.1 percentage points without code changes. The approach also reveals that increased steering magnitude expands a predictable prompt‑injection attack surface, highlighting security implications for agent systems using steered classifiers.

By Frank E. Bobe III, Gregory D. Vetaw, Darshan W. Bryner, Matthew G. Cook, Jose L. Salas-Vernis
Hugging Face Trending Papers
Jul 13

DeepBias: Adaptive In-depth Probing of Social Biases in LVLMs

While Large Vision-Language Models (LVLMs) demonstrate remarkable capabilities, they remain highly susceptible to embedded social biases. Existing bias evaluation protocols predominantly rely on static datasets, which provide only a superficial assessment, as their fixed test cases cannot adaptively evolve to measure the true depth and limits of model vulnerabilities.

arXiv AI
2d ago

ReLiveGym: Evaluating Long-Lived Agents over Weeks of Replayed Reality

ReLiveGym is a diagnostic environment that evaluates long‑lived language‑model agents over weeks of chronologically replayed real‑world streams such as news, market data, and social media. The tasks vary in time sensitivity, reasoning depth, and recurrence, and the study tests eight base language models to see how model choice and harness design—especially action timing—affect performance. Continuous learning from hindsight feedback is also examined to address failure modes in these long‑term tasks.

By Xisen Jin, Jingheng Li, Zhenglun Chen, Junyi Du, Xiang Ren