arXiv Machine Learning By Yao Cheng, Siqiang Luo

RDL-Bench: A Benchmark for Task-Aware Question Answering over Relational Databases

Read the original on arXiv Machine Learning →

RDL-Bench is a new benchmark for task-aware question answering over relational databases, introduced in arXiv:2610.21382v1. It categorizes user questions into reasoning-oriented queries, which depend on the current database state, and prediction-oriented queries, which rely on future outcomes under temporal constraints. Each benchmark instance includes a natural-language question, task metadata, schema details, temporal context, executable evidence or target-construction logic, and denotation-level ground truth, supporting evaluation in both native solver and task-aware modular system settings.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Jun 10

LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake

arXiv:2606. 10460v1 Announce Type: cross Abstract: Recent large language models (LLMs) have shown rapid progress in reading-based question answering (QA), where evidence is explicitly provided or can be trivially retrieved.

By Haonan Wang, Jiaxiang Liu, Yurong Liu, Austin Senna Wijaya, Tianle Zhou, Eden Wu, Yijia Chen, Wanting You, Reya Vir, Daniela Pinto, Grace Fan, Yusen Zhang, Juliana Freire, Eugene Wu
arXiv AI
Aug 26

PARTAB: Partition-Aware Reasoning with Structured Evidence for Scalable Table Understanding

PARTAB is a framework that improves large language model reasoning on tables by constructing a structured evidence interface. It represents query‑relevant evidence as semantically coherent, row‑linked table regions and performs hierarchical selection over column groups and row‑level partitions before composing the evidence for answer generation. Evaluations on multiple table reasoning benchmarks show that PARTAB consistently outperforms full‑table prompting and recent methods, achieving strong performance on WikiTableQuestions and TabFact while remaining competitive on numerical reasoning tasks.

By Md Mahadi Hasan Nahid, Davood Rafiei