arXiv AI By Ram Kulathumani, Regunathan Radhakrishnan, Anupam Tripathi, Xiangbo Mao, Roshanak Omrani, Keshav Somani, Shwet Kamal Mishra, Shayna Lurya

EDGE: Engine for Deterministic Graph Evaluation through Conversation Simulation from Graph Structured DSL Configuration

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv AI
Aug 18

From Sequence to Structure: Relational Uncertainty Propagation for LLM Agents

The paper introduces RUPA, a trajectory‑level uncertainty quantification framework for large language model agents. RUPA models an agent’s execution as a directed graph of reasoning states, tool interactions, and environment feedback, then propagates uncertainty across this graph to capture long‑range dependencies. Experiments on benchmarks such as τ‑2, Terminal‑Bench‑2, and GAIA show that RUPA outperforms existing methods, enabling earlier failure detection and more reliable agent execution.

By Zhengzhao Ma. Boxi Cao, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun
arXiv AI
Aug 19

Graphectory Viewer: A Tool for Process-Centric Analysis of Agentic Software Trajectories

Graphectory Viewer is a web-based tool that enables interactive, process‑centric analysis of software‑agent trajectories. It converts heterogeneous raw trajectories into phase‑aware graphs, linking low‑level execution details with higher‑level behavioral structures. The tool supports multiple agent frameworks, offers node‑level inspection, search and filtering over large collections, and Sankey‑style summaries of problem‑solving phase transitions, allowing researchers to inspect individual runs, identify patterns, compare successes and failures, and analyze large corpora beyond final outcomes.

By Charlie Jyu, Shuyang Liu, Reyhaneh Jabbarvand