arXiv AI

StocksTalk: A Voice-Enabled Conversational Agent for Structured Query Generation over Web Data

StocksTalk is a voice‑enabled conversational agent that turns spoken financial screening requests into validated structured queries over real‑world market data. It integrates streaming speech recognition, retrieval‑augmented constraint extraction, schema‑grounded LLM‑based SQL generation, rule‑based validation, and human‑in‑the‑loop verification, exposing intermediate reasoning artifacts for user inspection. A benchmark of 150 spoken prompts shows that its retrieval grounding, constrained query generation, and interactive verification improve constraint extraction accuracy, SQL executability, logical consistency, and multi‑turn stability over baseline LLM approaches.

arXiv Computation and Language
Sep 3

A Tri-Agent Framework for Evaluating and Aligning Question Clarification Capabilities of Large Language Models

The paper presents a tri‑agent framework for evaluating large language models’ question‑clarification abilities. It involves a Question Clarifying Agent that identifies ambiguities and asks follow‑up questions, a Respondent Agent that simulates human replies, and an Evaluator Agent that judges the dialogue using metrics such as ambiguity handling, question quality, dialogue efficiency, language appropriateness, and intent alignment. The authors illustrate the approach with synthetic supply‑chain data and discuss validating the evaluator against human judgments.

By Yikai Zhao, Saurabh Pandey, Pradeep Kumar Misra
arXiv AI
Aug 28

CIFQA: A Deterministic Tool-Grounded Multi-Agent LLM Framework for Financial Query Answering

CIFQA is a deterministic, tool‑grounded multi‑agent framework that separates language understanding from numerical execution for financial question answering. It assigns specialized agents for interpretation, routing, parameter extraction, computation planning, and response generation, while deterministic Python tools perform the calculations. On a fixed‑deposit benchmark, CIFQA achieves 95.54% accuracy on calculation‑intensive queries and 90.87% overall, outperforming larger LLM baselines and showing that architecture, not scale, drives numerical reliability.

By Kunjesh Parekh, Anil Kumar Tiwari, Divya Saxena
arXiv AI
Jun 4

FinTradeBench: A Financial Reasoning Benchmark for LLMs

arXiv:2603. 19225v3 Announce Type: replace-cross Abstract: Real-world financial decision-making is a challenging problem that requires reasoning over heterogeneous signals, including company fundamentals derived from regulatory filings and trading signals computed from price dynamics.

By Yogesh Agrawal, Aniruddha Dutta, Md Mahadi Hasan, Santu Karmaker, Aritra Dutta
arXiv AI
Aug 20

A Multi-Agent Platform for Automated Enterprise Analytics and Insight Generation

The paper introduces a multi‑agent platform built on CrewAI for conversational business intelligence. Five specialized agents process natural language queries, retrieve and analyze data, generate visualizations via the Model Context Protocol, and deliver actionable insights. The system includes a defense‑in‑depth security architecture, a query parameterization mechanism, and achieves 95.3% functional accuracy with a 24‑second mean latency, outperforming a single‑agent baseline by 22.6 percentage points in accuracy and 20.2% in quality.

By Manoj N M, Vijayakrishna S, Manjunath Srinivas, Rohit Pahan
arXiv AI
Oct 5

From Benchmarks to Production: A Text-to-SQL System for Complex Financial Data

The paper introduces FLINT, a domain‑specialized Text‑to‑SQL system designed for complex financial databases where data is stored as opaque integer keys. FLINT employs a lookup agent to resolve natural‑language concepts, uses embedding‑based retrieval of query templates from a compact expert‑authored bank, and prunes large schemas by traversing foreign‑key chains. Evaluated on 359 questions across two production financial schemas, FLINT outperforms state‑of‑the‑art baselines and is already deployed in a financial data retrieval service.

By Arijit Sehanobish, Bruno Gomes Coelho, Guillaume Michel, Sophia Zhi, Valerie Faucon-Morin, Kristen Howell
arXiv AI
Oct 19

NL2SQL with Iterative Self-Refinement

The paper presents a multi‑agent, persona‑driven NL2SQL framework that addresses common LLM shortcomings such as schema hallucination, syntax errors, and intent mismatch. It incorporates domain relevance detection, schema‑grounded knowledge construction, KPI‑aware SQL synthesis, syntax‑level self‑repair via sqlite feedback, and semantic consistency checking through SQL‑to‑NL reverse engineering. Evaluated on 60 queries, the system achieves 90% correctness using Mistral across seven coordinated LLM calls, demonstrating a significant improvement in reliability for high‑stakes environments.

By Anjali Vemula, Akshat Dasula
arXiv AI
Jul 7

SpreadsheetArena: Decomposing Preference in LLM Generation of Spreadsheet Workbooks

arXiv:2603. 10002v2 Announce Type: replace-cross Abstract: We consider the task of end-to-end spreadsheet generation, where language models produce spreadsheet artifacts to satisfy users' explicit and implicit constraints, specified in natural language.

By Srivatsa Kundurthy, Clara Na, Michael Handley, Zach Kirshner, Chen Bo Calvin Zhang, Manasi Sharma, Emma Strubell, John Ling