arXiv AI

ATWL: A Formal Language for Representing, Comparing, and Reusing Visual Analytics Workflows

The paper introduces ATWL, a declarative language that formalizes visual analytics workflows by specifying typed artifacts and transforms with defined analytical intents and actors. A library of 54 workflows, curated from published papers with LLM assistance, demonstrates patterns such as human-machine labor division and refinement cycles. Experiments show that using ATWL and the library improves LLM-designed workflows, though branching remains a limitation requiring syntax extension.

arXiv AI
Jul 21

DataFlow-Harness: A Grounded Code-Agent Platform for Constructing Editable LLM Data Pipelines

arXiv:2607. 16617v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used to automate data-processing workflows, yet coding agents typically produce scripts that are not automatically materialized as persistent, editable platform artifacts.

By Runming He, Zhen Hao Wong, Hao Liang, Zimo Meng, Chengyu Shen, Xiaochen Ma, Wentao Zhang
arXiv AI
Aug 12

Workflow Cards: Structured Summaries of Workflow Executions Using Provenance Data

arXiv:2608. 11022v1 Announce Type: cross Abstract: Model Cards and Data Cards have demonstrated the value of structured, human-readable documentation for machine learning artifacts, capturing their context, parameters, limitations, and intended use.

By Nicola Giuseppe Marchioro, Gabriele Padovani, Amal Gueroudji, Rafael Ferreira da Silva, Wesley Brewer, Valentine Anantharaj, Sandro Fiore, Renan Souza
arXiv Machine Learning
Jun 9

Orange Lab: Lowering Barriers to Data Mining through Embedded Interactive Workflows

arXiv:2606. 09239v1 Announce Type: new Abstract: While visual programming of data analysis workflows has become an important vehicle for the democratization of data science, such systems remain largely confined to standalone applications and offer limited support for transitioning their visual analytics solutions into interactive web environments.

By Matej Bevec, Ale\v{s} Erjavec, Vesna Tanko, Lena Trnovec, Lan \v{Z}agar, Ana Fari\v{c}, Janez Dem\v{s}ar, Bla\v{z} Zupan
arXiv AI
Oct 15

TopoPilot: Reliable Conversational Workflow Automation for Topological Data Analysis and Visualization

TopoPilot is an agentic framework designed to automate complex scientific visualization workflows, particularly in topological data analysis and visualization. It uses a two‑agent architecture—a user‑prompt orchestrator and a verifier—to translate natural language into atomic backend actions and ensure semantic consistency before execution. The system incorporates deterministic guardrails and a taxonomy of failure modes, achieving over 95% success in 1,000 simulated multi‑turn conversations and outperforming baseline models and other code generation tools in accuracy, completion time, and token usage.

By Nathaniel Gorski, Shusen Liu, Bei Wang
arXiv AI
Sep 28

The Hard Part Comes After Search: Benchmarking Web Agents on Synthesizing, Organizing, and Displaying Knowledge

The paper introduces KNOWS, a benchmark for evaluating web agents that act as assistants by retrieving, synthesizing, and presenting information across complex, multi-step browser tasks. It outlines a task design rubric, evaluation protocol combining deterministic checks with LLM judgments, and reports that current agents achieve only modest success, with the best performing agent succeeding on less than 3% of tasks. The study highlights significant gaps in agents’ tool use, visual understanding, and long‑horizon reasoning.

By Alexander Gill, Md Farhan Ishmam, Xuyen Nguyen, Neha Bhat, Parker Henry DeYoung, Fateme Hashemi Chaleshtori, Nathan Stringham, Kenneth Marino, Ana Marasovi\'c