arXiv AI
VisExMEM: Visual Evidence-Based Explainable Multimodal Evaluation Metric
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computation and Language
3d ago
M$^3$R-Bench: A Unified Benchmark for Evidence-Grounded Multimodal Metaphor Understanding
M$^3$R-Bench is a new benchmark comprising 1,000 human‑annotated image‑text pairs that jointly label metaphor occurrence, Target‑Source mapping, and sentiment, and provide step‑by‑step explanations for evidence identification, mapping, and sentiment inference. Existing models often rely on textual shortcuts and produce mappings that conflict with visual evidence, as shown by evaluations on this dataset. To address this, the authors propose M$^3$R‑Reasoner, a model that uses curriculum‑based reasoning supervision and task‑aware reinforcement learning, achieving a 37.90% Joint Label Accuracy and outperforming both proprietary baselines and GPT‑5.5 on evidence and sentiment justification.
arXiv AI
Jul 21
Seeing What Is Actually There: PriVE-Bench and PriVE-Tools for Counterfactual Evaluation of Agentic Visual Evidence in VLMs
arXiv:2607. 16311v1 Announce Type: cross Abstract: Vision-language models (VLMs) often answer visual questions using learned language and category priors rather than grounding their predictions in the image itself.
arXiv AI
Jul 20
ToolSciVer: Multimodal Scientific Claim Verification with Visual Tool Augmented Reinforcement Learning
arXiv:2607. 16131v1 Announce Type: cross Abstract: Multimodal Scientific Claim Verification (MSCV) requires models to verify scientific claims using visually grounded evidence from papers, including figures, tables, charts, and textual context.
arXiv AI
Jul 15
Evidence Recomposition and Predictive Context Residualization for Visual Attribution in Multimodal Large Language Models
arXiv:2509. 22415v3 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have achieved strong vision-language performance, yet their token-level visual evidence remains difficult to inspect.
Hugging Face Trending Papers
Jul 29
SciFigQual-Bench: A Benchmark for Scientific Figure Quality Assessment with Full-Manuscript Context
Scientific images are the core elements of presenting experimental conclusions, elaborating system architecture, and supporting comparative arguments in scientific papers. However, existing image quality assessment (IQA) methods are predominantly designed for natural photographs or AI-generated content, which cannot be directly applied to scientific papers.
arXiv Computer Vision
Sep 30
Tracing the Evidence: Faithful Token Attribution Through Vision-Language Reasoning
arXiv:2609.37656v1 Announce Type: new Abstract: Large vision-language models (LVLMs) exhibit strong reasoning capabilities, yet the visual and textual evidence supporting the generated responses rema...