arXiv AI

TxnQA: Benchmarking Analytical Reasoning and Evidence Grounding over Transaction Event Sequences

TxnQA is a new analytical QA benchmark that tests reasoning and evidence grounding over transaction event sequences. It contains 27 task families with 81 templates and a 5‑scenario fraud‑risk reasoning suite built on synthetic, privacy‑mitigated transaction data. The benchmark evaluates models using format‑following rate, conditional content accuracy, and end‑to‑end correctness, revealing distinct bottlenecks in schema compliance, semantic calculation, and evidence attribution.

arXiv AI
Aug 20

FinRCA-Bench: Benchmarking Evidence Retrieval and Reasoning for Financial AI Systems

FinRCA-Bench is a deterministic synthetic benchmark comprising 2,250 accounts‑payable‑to‑bank reconciliation cases that span 14 operational tables and include 1,500 injected failures across 15 causal categories. The benchmark hides root‑cause labels and record‑level evidence contracts from models, enabling independent evaluation of evidence retrieval versus reasoning accuracy. Experiments show that retrieval architecture dramatically influences performance, with retrieval improvements raising macro‑required‑record recall from 0.83% to 77.70% and exact 16‑class accuracy from 2.05% to 72.44%.

By Pratik Ghawate
Hugging Face Trending Papers
Aug 19

FinRCA-Bench: Benchmarking Evidence Retrieval and Reasoning for Financial AI Systems

FinRCA-Bench is a synthetic benchmark designed to evaluate evidence retrieval and reasoning in financial AI systems, specifically for accounts‑payable‑to‑bank reconciliation. It contains 2,250 cases across 14 operational tables, with 1,500 injected failures in 15 causal categories and 750 hard‑negative cases, and hides root‑cause labels and evidence contracts to isolate retrieval performance. Experiments show that retrieval architecture dramatically affects accuracy, with structured retrieval methods like Typed Provenance Graph Retrieval vastly improving macro‑recall and exact‑class accuracy compared to dense semantic retrieval or classical ML.

arXiv AI
Jul 21

Detection, Attribution, Narration: An End-to-End Pipeline for Explainable Money Mule Identification

arXiv:2607. 17586v1 Announce Type: cross Abstract: Money mule accounts are critical facilitators of financial fraud, yet detecting them at scale remains challenging due to the heterogeneous nature of transactional and behavioural data.

By Yuge Zhang, Yuanxing Zhang, Yichao Jin, Khairul Amsyar Mohd Razis, Nicholas Qi An Choo, Kai Yin Anders Wong, Xinyan Tang, Kenneth Zhu Ke, Wee Keong Dennis Lee, Jingyuan Zhao
arXiv Machine Learning
Sep 25

From Prediction to Explainable Provider Behavior Profiles for Fraud, Waste, and Abuse Review

The paper proposes a shift from predictive modeling to descriptive provider behavior profiles for fraud, waste, and abuse (FWA) review. By decomposing billed revenue into provider scale and procedure composition, the authors construct lineage‑aware profiles that capture scale history, code lineage, and clinical family shares. In a large Medicare audit, these simple, interpretable descriptions outperform complex forecasts and improve recall for high‑cost rare events, while an optional semantic factorization adds context without inferring intent.

By Yubin Park, Evan Brociner
arXiv AI
Jun 12

Fin-RATE: A Real-world Financial Analytics and Tracking Evaluation Benchmark for LLMs on SEC Filings

arXiv:2602. 07294v4 Announce Type: replace-cross Abstract: With the increasing deployment of Large Language Models (LLMs) in the finance domain, LLMs are increasingly expected to parse complex regulatory disclosures.

By Yidong Jiang, Junrong Chen, Eftychia Makri, Jialin Chen, Peiwen Li, Ali Maatouk, Leandros Tassiulas, Eliot Brenner, Bing Xiang, Rex Ying
arXiv Machine Learning
Sep 24

SR-Fraud: An Outcome-Supervised Reflective LLM Agent Framework for Non-Stationary Payment Fraud Detection

SR‑Fraud is a framework that uses a frozen, stateless LLM agent to score transactions in real time while an offline reflection agent proposes boundary hypotheses based on matured errors. The system then verifies these hypotheses deterministically before updating its knowledge state. On a production payment‑fraud benchmark, SR‑Fraud outperforms both static and periodically retrained CatBoost models and successfully detects an emerging fraud burst.

By Xuwei Tan, Yao Ma, Xueru Zhang