Towards Data Science By Shuai Guo

Let Decision Models Watch Your Agents

Read the original on Towards Data Science →

Let Decision Models Watch Your Agents is a hands‑on guide that explains how to detect behavioral anomalies by analyzing an agent’s evolving execution history. The article provides practical steps and techniques for monitoring agent behavior over time. It is published on Towards Data Science.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Towards Data Science.

Towards Data Science
Oct 30

Your Agent’s Tools Can Make Decisions, Too

The article titled "Your Agent’s Tools Can Make Decisions, Too" discusses decision models as tools and offers a hands‑on guide for their implementation. It highlights how agents can leverage these tools to make informed choices. The post was originally published on Towards Data Science.

By Shuai Guo
arXiv AI
1d ago

Signals: Continuous Diagnostics of AI Agents

The paper "Signals: Continuous Diagnostics of AI Agents" introduces a method for diagnosing problems in AI agents by analyzing agentic traces. It defines 45 problem types across eight families, categorizes findings into engineering issues called Signals, and assesses their severity. The method was evaluated on public agent executions, achieving a 91.43% F1 score in matching Signals to reference issues, outperforming a one-pass LLM control by about 18 percentage points.

By Amey Rambatla, Vatsal Goel, Sagar Gaur, Siddhant Loya, Anurag Mishra, Asif Mohammad
arXiv AI
Aug 20

Position: Behavioral Systems Require Behavioral Tests

The paper argues that artificial agentic systems, which operate as behavioral systems by interacting with dynamic environments, pursuing goals, and adapting over time, should be evaluated through systematic observation, perturbation, and interpretation of their actions rather than solely on performance outcomes. It draws on lessons from behavioral sciences to motivate this position and proposes a research agenda that includes methods for recovering decision strategies from action sequences, constructing environments that isolate behavioral differences, and probing emergent dynamics in multi‑agent systems. These directions aim to establish a rigorous science of AI behavior.

By Manuel Cherep, Nikhil Singh, Pattie Maes