arXiv AI

CIFQA: A Deterministic Tool-Grounded Multi-Agent LLM Framework for Financial Query Answering

CIFQA is a deterministic, tool‑grounded multi‑agent framework that separates language understanding from numerical execution for financial question answering. It assigns specialized agents for interpretation, routing, parameter extraction, computation planning, and response generation, while deterministic Python tools perform the calculations. On a fixed‑deposit benchmark, CIFQA achieves 95.54% accuracy on calculation‑intensive queries and 90.87% overall, outperforming larger LLM baselines and showing that architecture, not scale, drives numerical reliability.

arXiv AI
Sep 4

Enhancing Financial Question Answering: A Novel Benchmark Dataset of Banks' financial statements

FinRAG-QA is a new benchmark dataset for financial question answering, featuring 999 practitioner-curated questions on 10 standardised indicators drawn from 209 annual and Pillar 3 reports of 24 major European and U.S. banks between 2019 and 2023. The dataset focuses on cross‑institutional retrieval over documents averaging 198k words, making it longer than any existing financial QA resource. Experiments on a multi‑stage Retrieval‑Augmented Generation pipeline show that contextual chunk enrichment and a retrieval‑optimised embedding model significantly improve NDCG@10, while a reasoning‑optimised generator boosts answer accuracy from 44.6% to 79.0% when the correct document is retrieved.

By Arianna Miola, Bruno Spaccavento, Lorenzo Silotto, Marco Bianchetti, Luca Cagliero
arXiv AI
Sep 25

Automated Regulatory Compliance Question Answering in Financial Services with Domain-Adapted Retrieval-Augmented Generation

The paper presents a retrieval‑augmented generation pipeline for answering regulatory compliance questions in finance. It builds a three‑stage retriever on LegalBERT and a compact 2B–12B generator served with 4‑bit quantization, achieving a Recall@10 of 0.774 on the ObliQA benchmark and improving answer quality via RAFT‑LoRA fine‑tuning. However, the adapted models fail to transfer to Australian case‑law questions, and a closed‑book model performs almost as well while lacking verifiable grounding.

By Tobias Deu{\ss}er, Abhishek Pillai, Aurelio F. Bariviera, Dhananjay Bhardwaj, Lorenz Sparrenberg, David Berghaus, Christian Bauckhage, Rafet Sifa
arXiv AI
Jun 4

FinTradeBench: A Financial Reasoning Benchmark for LLMs

arXiv:2603. 19225v3 Announce Type: replace-cross Abstract: Real-world financial decision-making is a challenging problem that requires reasoning over heterogeneous signals, including company fundamentals derived from regulatory filings and trading signals computed from price dynamics.

By Yogesh Agrawal, Aniruddha Dutta, Md Mahadi Hasan, Santu Karmaker, Aritra Dutta
Hugging Face Trending Papers
Jun 22

IPO Finance Agent: Evaluation of LLM Financial Analysts beyond Finance Agent v2, with Automated Rubric Generation -- the Case of the SpaceX (SPCX) IPO

Finance Agent v2 (by Vals AI) has emerged as the reference benchmark for evaluating both Anthropic Claude and OpenAI ChatGPT frontier language models on financial tasks. However, it narrowly deals with periodic reporting from publicly traded companies (SEC 10-K and 10-Q filings), and its agentic harness relies on naive, unenriched chunk retrieval.

arXiv Computation and Language
3d ago

PRISM: Prompt-Refined In-Context System Modelling for Financial Retrieval

PRISM is a training‑free framework for financial information retrieval that combines prompt engineering, in‑context learning, and a candidate refinement module, with optional multi‑agent coordination. On FiQA‑2018 it improves Recall@100 from 0.7783 to 0.8326, and on FinAgentBench it achieves a Cohere‑refined top‑50 pool that raises NDCG@5 while cutting per‑query cost by about 35%. The authors also release an expert‑annotated evaluation set, a label‑robustness sweep, and a Pareto frontier of quality‑cost‑latency trade‑offs, and PRISM ranks third on the private FinAgentBench leaderboard without fine‑tuning.

By Chun Chet Ng, Jia Yu Lim, Zhen Hao Chu, Yixi Zhou, Wei Zeng Low