arXiv AI
Automated Testing of LLM-Based Post Hoc Explainers Using Model Checking as an Oracle
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
Hugging Face Trending Papers
Aug 31
Automated Testing of LLM-Based Post Hoc Explainers Using Model Checking as an Oracle
Large language models (LLMs) are used as post hoc explainers of sequential decision-making policies, producing natural-language explanations of why an action was chosen. However, LLMs often generate p...
arXiv AI
Jun 9
LGMT: Logic-Grounded Metamorphic Testing for Evaluating the Reasoning Reliability of LLMs
arXiv:2605. 23965v2 Announce Type: replace Abstract: Large Language Models (LLMs) achieve strong performance on logical reasoning benchmarks, yet their reliability remains uncertain.
arXiv Computation and Language
Aug 25
TraceSQL: Traceable Answerability Estimation for Reference-Free Text-to-SQL Verification
arXiv:2608.17795v2 Announce Type: replace Abstract: Text-to-SQL systems are commonly evaluated using ground-truth SQL queries or reference execution results, but such supervision is unavailable at in...
arXiv AI
Jul 14
Fail-Aware and Explainable Test Oracle Prediction
arXiv:2607. 11342v1 Announce Type: cross Abstract: Despite their central role in fault detection, test oracles remain challenging to construct effectively.
arXiv AI
Jun 19
Analyzing the Narration Gap in LLM-Solver Loops
arXiv:2606. 19588v1 Announce Type: new Abstract: Formal tools such as SAT and SMT solvers are increasingly embedded in language model reasoning pipelines when a safety or security critical question can be formulated in logic.
arXiv AI
Jun 3
DDOR: Delta Debugging for Explainable Overrefusal Testing and Repair
arXiv:2606. 03601v1 Announce Type: cross Abstract: While safety alignment and guardrails help large language models (LLMs) avoid harmful outputs, they can also induce overrefusal, i.