arXiv AI By Rabimba Karanjai, Yiming Bian, Yun-Shiuan Chuang, Jenna L. Ballard, Zijie Pan, Shivani Shekhar, Yixi Li, Yirou Ge, Avinash Thangali, Richard Williamson, Linsey Pang, Prakhar Mehrotra

TxnQA: Benchmarking Analytical Reasoning and Evidence Grounding over Transaction Event Sequences

Read the original on arXiv AI →

TxnQA is a new analytical QA benchmark that tests reasoning and evidence grounding over transaction event sequences. It contains 27 task families with 81 templates and a 5‑scenario fraud‑risk reasoning suite built on synthetic, privacy‑mitigated transaction data. The benchmark evaluates models using format‑following rate, conditional content accuracy, and end‑to‑end correctness, revealing distinct bottlenecks in schema compliance, semantic calculation, and evidence attribution.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Aug 20

FinRCA-Bench: Benchmarking Evidence Retrieval and Reasoning for Financial AI Systems

FinRCA-Bench is a deterministic synthetic benchmark comprising 2,250 accounts‑payable‑to‑bank reconciliation cases that span 14 operational tables and include 1,500 injected failures across 15 causal categories. The benchmark hides root‑cause labels and record‑level evidence contracts from models, enabling independent evaluation of evidence retrieval versus reasoning accuracy. Experiments show that retrieval architecture dramatically influences performance, with retrieval improvements raising macro‑required‑record recall from 0.83% to 77.70% and exact 16‑class accuracy from 2.05% to 72.44%.

By Pratik Ghawate
Hugging Face Trending Papers
Aug 19

FinRCA-Bench: Benchmarking Evidence Retrieval and Reasoning for Financial AI Systems

FinRCA-Bench is a synthetic benchmark designed to evaluate evidence retrieval and reasoning in financial AI systems, specifically for accounts‑payable‑to‑bank reconciliation. It contains 2,250 cases across 14 operational tables, with 1,500 injected failures in 15 causal categories and 750 hard‑negative cases, and hides root‑cause labels and evidence contracts to isolate retrieval performance. Experiments show that retrieval architecture dramatically affects accuracy, with structured retrieval methods like Typed Provenance Graph Retrieval vastly improving macro‑recall and exact‑class accuracy compared to dense semantic retrieval or classical ML.

arXiv AI
Jul 21

Detection, Attribution, Narration: An End-to-End Pipeline for Explainable Money Mule Identification

arXiv:2607. 17586v1 Announce Type: cross Abstract: Money mule accounts are critical facilitators of financial fraud, yet detecting them at scale remains challenging due to the heterogeneous nature of transactional and behavioural data.

By Yuge Zhang, Yuanxing Zhang, Yichao Jin, Khairul Amsyar Mohd Razis, Nicholas Qi An Choo, Kai Yin Anders Wong, Xinyan Tang, Kenneth Zhu Ke, Wee Keong Dennis Lee, Jingyuan Zhao
arXiv Machine Learning
Sep 25

From Prediction to Explainable Provider Behavior Profiles for Fraud, Waste, and Abuse Review

The paper proposes a shift from predictive modeling to descriptive provider behavior profiles for fraud, waste, and abuse (FWA) review. By decomposing billed revenue into provider scale and procedure composition, the authors construct lineage‑aware profiles that capture scale history, code lineage, and clinical family shares. In a large Medicare audit, these simple, interpretable descriptions outperform complex forecasts and improve recall for high‑cost rare events, while an optional semantic factorization adds context without inferring intent.

By Yubin Park, Evan Brociner