arXiv Computation and Language August 28, 2026 By Shicheng Liu, Yucheng Jiang, Sajid Farook, Camila Nicollier Sanchez, David Fernando Castro Pena, Monica S. Lam

DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytelling

Read the original on arXiv Computation and Language →

DataSTORM is an LLM‑based agentic system designed to conduct deep research over large‑scale structured databases and internet sources. It applies principles of Exploratory Data Analysis and Data Storytelling to frame research as a thesis‑driven analytical process, iteratively generating hypotheses, performing quantitative reasoning, and crafting coherent narratives. Evaluations on InsightBench and a new ACLED‑based dataset show that DataSTORM surpasses existing systems, achieving significant improvements in insight‑level recall and summary‑level scores.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI

Jul 8

Data Analysis in the Wild: Benchmarking Large Language Models Against Real-World Data Complexities

arXiv:2607. 06482v1 Announce Type: cross Abstract: Current benchmarks for evaluating Large Language Models (LLMs) in data analysis often fail to reflect real-world settings.

By So Hasegawa, Shailaja Keyur Sampat, Lei Liu, Wei-Peng Chen

llms agents benchmarks

arXiv AI

Jul 3

AgenticDataBench: A Comprehensive Benchmark for Data Agents

arXiv:2607. 01647v1 Announce Type: cross Abstract: Data science aims to derive actionable insights from heterogeneous raw data, unlocking the value of the massive amounts of data generated in modern society.

By Zhaoyan Sun, Shan Zhong, Daizhou Wen, Jiaxing Han, Guoliang Li, Ying Yan, Peng Zhang, Yu Su, Xiang Qi, Baolin Sun, Chengyuan Yang, Tao Fang, Huaiyu Ruan

llms agents benchmarks

arXiv AI

Jun 16

S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agents

arXiv:2606. 15367v1 Announce Type: new Abstract: Deep research agents aim to solve complex knowledge-intensive tasks through long-horizon planning, evidence gathering, reasoning, and report generation.

By Yao Dong, Xinglin Xiao, Liwei Dong, Xinlong Jin, Zhengbo Li, Heng Zhang, Duyun Wang, Nan Xu

agents nlp benchmarks

arXiv AI

6d ago

Nomad: Autonomous Exploration and Discovery

Nomad is an autonomous system designed to explore and discover insights within large data corpora. It builds an explicit Exploration Map to systematically traverse a domain, generating and testing hypotheses with an explorer agent that leverages document, web, and database searches. After verification, it produces cited reports and meta-reports, and its evaluation framework assesses trustworthiness, quality, and diversity, showing superior performance over baselines on UN, WHO, and arXiv datasets.

By Bokang Jia, Samta Kamboj, Satheesh Katipomu, Seung Hun Han, Neha Sengupta, Andrew Jackson

llms agents nlp

Hugging Face Trending Papers

Jul 29

SciDataSailor: Deep Scientific Data Exploring

Scientific datasets are commonly organized as hierarchical repositories containing heterogeneous and interdependent files, making their inspection, integration, and analysis labor-intensive and reliant on domain expertise. Although large language model (LLM) agents have advanced substantially in planning, reasoning, and tool use, existing research has largely overlooked their ability to interact with real scientific data assets through executable environments.

llms agents nlp fine-tuning

arXiv AI

Jun 10

LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake

arXiv:2606. 10460v1 Announce Type: cross Abstract: Recent large language models (LLMs) have shown rapid progress in reading-based question answering (QA), where evidence is explicitly provided or can be trivially retrieved.

By Haonan Wang, Jiaxiang Liu, Yurong Liu, Austin Senna Wijaya, Tianle Zhou, Eden Wu, Yijia Chen, Wanting You, Reya Vir, Daniela Pinto, Grace Fan, Yusen Zhang, Juliana Freire, Eugene Wu

llms agents nlp benchmarks

One email a morning, machine-written

Related stories

Data Analysis in the Wild: Benchmarking Large Language Models Against Real-World Data Complexities

AgenticDataBench: A Comprehensive Benchmark for Data Agents

S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agents

Nomad: Autonomous Exploration and Discovery

SciDataSailor: Deep Scientific Data Exploring

LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake