arXiv:2610.28282v1 Announce Type: new
Abstract: Multimodal large language models (MLLMs) have substantially advanced chart understanding and reasoning, yet their performance remains highly uneven acr...
By Qi Wang, Peijie Wang, Jun Cao, Haoyang Tong, Xiao-Hui Li, Fei Yin, Cheng-Lin Liu
Multimodal large language models (MLLMs) have substantially advanced chart understanding and reasoning, yet their performance remains highly uneven across chart types. While modern MLLMs perform well...
arXiv:2609.26208v1 Announce Type: new
Abstract: Data visualization is central to analytical reasoning, but real-world analysis increasingly requires language-driven interactive interfaces rather than...
By Mizanur Rahman, Aaryaman Kartha, Enamul Hoque Prince
The paper introduces KNOWS, a benchmark for evaluating web agents that act as assistants by retrieving, synthesizing, and presenting information across complex, multi-step browser tasks. It outlines a task design rubric, evaluation protocol combining deterministic checks with LLM judgments, and reports that current agents achieve only modest success, with the best performing agent succeeding on less than 3% of tasks. The study highlights significant gaps in agents’ tool use, visual understanding, and long‑horizon reasoning.
By Alexander Gill, Md Farhan Ishmam, Xuyen Nguyen, Neha Bhat, Parker Henry DeYoung, Fateme Hashemi Chaleshtori, Nathan Stringham, Kenneth Marino, Ana Marasovi\'c
VisInteract introduces a new paradigm for Text-to-Visualization that treats imperfect user queries as a dynamic, interaction-driven problem, requiring the system to recover true intent through multi-turn dialogue. The authors present VisInteract-Bench, the first benchmark for interactive Text-to-Vis, featuring controlled imperfection injection, a realistic user agent, and dual-perspective automated evaluation. They also propose Vis-MCTS, an enhanced Monte Carlo Tree Search algorithm that incorporates progressive widening, cross-rollout information sharing, and dimension-aware reward decomposition, achieving significant performance gains over existing baselines.
By Wenxin Xu, Jinwei Lu, Hwanhee Kim, Chen Jason Zhang, Xiao-Yong Wei, Haoyang Li, Yuanfeng Song
arXiv:2608. 02650v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly rely on external tools to complete complex real-world tasks.
By Zian Zhai, Xingyu Tan, Gaowang Zou, Xiaoyang Wang, Wenjie Zhang