arXiv AI

TopoPilot: Reliable Conversational Workflow Automation for Topological Data Analysis and Visualization

TopoPilot is an agentic framework designed to automate complex scientific visualization workflows, particularly in topological data analysis and visualization. It uses a two‑agent architecture—a user‑prompt orchestrator and a verifier—to translate natural language into atomic backend actions and ensure semantic consistency before execution. The system incorporates deterministic guardrails and a taxonomy of failure modes, achieving over 95% success in 1,000 simulated multi‑turn conversations and outperforming baseline models and other code generation tools in accuracy, completion time, and token usage.

arXiv AI
3d ago

RSIV-Harness: A Recursive Self-Improvement Harness Framework for Open-Domain Conversational Text-to-Visualization

RSIV-Harness is a framework that keeps language model weights fixed while recursively improving the surrounding harness based on failure traces, using a four-layer evaluation to ensure stability. It addresses challenges in open-domain conversational text-to-visualization, such as ambiguous user requests, data source discovery, and iterative chart refinement. The introduced ODAC-Vis benchmark evaluates these capabilities across 640 tasks, and experiments show significant gains in executability and chart structure after a single RSIV-Harness iteration.

By Jiawei Lu, Chen Zhang, Jinwei Lu, Yuanwei Song, Yuanfeng Song, Raymond Chi-Wing Wong
arXiv AI
Sep 2

ChatDev 2.0: A No-Code Multi-Agent Platform for Developing Everything

ChatDev 2.0, also called DevAll, is a no-code platform that lets users build, run, and inspect heterogeneous multi‑agent systems (MAS) powered by large language models. It combines a declarative executable graph abstraction with a cycle‑aware execution engine, enabling representation and execution of dynamic, cyclic interactions among diverse agents. The integrated visual interface allows users to author, monitor, and inspect MAS—including human‑in‑the‑loop steps—without writing code, and experiments show it matches state‑of‑the‑art MAS performance across three tasks.

By Yufan Dang, Shu Yao, Bowen Lai, Chenting Xu, Ruijie Shi, Wai-Shing Leung, Huatao Li, Chen Qian, Zhiyuan Liu
arXiv AI
Jun 30

SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agents

arXiv:2603. 29139v2 Announce Type: replace Abstract: Recent advances in large language models (LLMs) have enabled agentic systems to translate natural-language intent into executable scientific visualization (SciVis) tasks.

By Kuangshi Ai, Haichao Miao, Kaiyuan Tang, Nathaniel Gorski, Jianxin Sun, Guoxi Liu, Helgi I. Ingolfsson, David Lenz, Hanqi Guo, Hongfeng Yu, Teja Leburu, Michael Molash, Bei Wang, Tom Peterka, Chaoli Wang, Shusen Liu
arXiv AI
Jul 21

DataFlow-Harness: A Grounded Code-Agent Platform for Constructing Editable LLM Data Pipelines

arXiv:2607. 16617v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used to automate data-processing workflows, yet coding agents typically produce scripts that are not automatically materialized as persistent, editable platform artifacts.

By Runming He, Zhen Hao Wong, Hao Liang, Zimo Meng, Chengyu Shen, Xiaochen Ma, Wentao Zhang
arXiv AI
Sep 28

The Hard Part Comes After Search: Benchmarking Web Agents on Synthesizing, Organizing, and Displaying Knowledge

The paper introduces KNOWS, a benchmark for evaluating web agents that act as assistants by retrieving, synthesizing, and presenting information across complex, multi-step browser tasks. It outlines a task design rubric, evaluation protocol combining deterministic checks with LLM judgments, and reports that current agents achieve only modest success, with the best performing agent succeeding on less than 3% of tasks. The study highlights significant gaps in agents’ tool use, visual understanding, and long‑horizon reasoning.

By Alexander Gill, Md Farhan Ishmam, Xuyen Nguyen, Neha Bhat, Parker Henry DeYoung, Fateme Hashemi Chaleshtori, Nathan Stringham, Kenneth Marino, Ana Marasovi\'c