arXiv AI By Tung-Wei Lin, Gabe Fierro, Han Li, Tianzhen Hong, Pierluigi Nuzzo, Alberto Sangiovanni-Vinentelli

Selective Retrieval Routing for Multi-Violation Knowledge Graph Repair

Read the original on arXiv AI →

The paper introduces a selective retrieval routing framework for repairing knowledge graphs that contain multiple compatible violations. An LLM repair agent edits the graph while a router decides when to allow a researcher agent to fetch external evidence, reducing unnecessary retrievals. Experiments on building‑automation datasets show that selective access can improve or degrade repair quality depending on the violation, and the router uses fewer tokens yet achieves higher F1 scores in most evaluation suites.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 3

When Agents Implement Systems: A Case Study in Defects, Detection, and Evaluation Rigor

The paper reports a case study of a large language model (LLM) coding agent tasked with building a multi‑component data system from a detailed specification. During a single session the agent introduced five defects, which were categorized by violated constraints and detection methods. The study also evaluates the agent’s retrieval‑filtering strategy on the HotpotQA benchmark, showing that filtering to a graph‑identified entity set yields higher recall than unfiltered search, with a statistically significant gap across all tested budgets.

By Phanindra Reddy Madduru
arXiv Machine Learning
Sep 24

Learning from Failures: Heterogeneous Graph Memory for Small Language Model Tool-Using Agents

The paper introduces FRESH, a Failure-aware Retrieval framework that uses Experience-Structured Heterogeneous graphs to transform past successes and failures into structured external memory for tool‑using agents. By explicitly modeling dependencies among tasks, actions, errors, repairs, and execution conditions, FRESH enables frozen language models to reuse reliable strategies, avoid recurring failures, and make safer decisions in stateful tool interactions. Experiments on τ‑Bench and AppWorld with multiple open‑source models demonstrate that FRESH consistently improves task success and tool‑use reliability compared to no‑memory agents and other memory‑based baselines.

By Jiaxing Li, Lei Song, Rui Dong, Youyong Kong
arXiv AI
Sep 18

RAFT: A Stateful Retrieval-Augmented Framework for Troubleshooting Agents

RAFT is a retrieval‑augmented framework designed for troubleshooting agents that treats support cases as stateful, multi‑stage documents. It represents each closed case as a directed chain of timeline entries and retrieves at the entry level, matching intermediate states of an active case and returning the parent‑case trajectory anchored at the matched state. The authors evaluate RAFT on a synthetic benchmark and real Apache Jira issues, showing statistically significant improvements over vanilla RAG and GraphRAG baselines, and release the benchmark, implementation, and evaluation set.

By Mingxuan Zhang, Xiaowen Wang, Anupma Sharan, Zhengyi Chen, Chenyu Diana Zhang, Shanshan Yang, Chittibabu Pacharu
arXiv AI
Sep 18

SkillAA: Attribution-Guided Skill-Graph Updating with Targeted Validation and Rollback

SkillAA (Skill Abductive Attribution) is a structured skill‑optimization framework designed for frozen language models. It represents skill applicability, execution, and composition in a unified graph, enabling skill selection, attribution‑guided repair, and update validation within the same structure. By contrasting successful and failed executions, SkillAA routes candidate repairs to specific graph objects, updates only the selected local structure, and uses Local and Big Gates to screen candidate changes before commitment, achieving high performance on SearchQA, LiveMath, and DocVQA.

By Ziqiao Shang, Ling-Yue Ge, Lan-Zhe Guo