arXiv Computation and Language
Improving VLMs on Scientific Chart Analysis via Autonomous Evolution
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
Hugging Face Trending Papers
Oct 26
Improving VLMs on Scientific Chart Analysis via Autonomous Evolution
Understanding and operating with scientific charts is a standard approach in data analysis, and while humans are good at interpreting such charts, open vision-language models (VLMs) are known to perfo...
arXiv Computer Vision
Sep 22
Pay More Attention To Text In High-Resolution MLLMs
The paper introduces EviSpec, a training‑free compiler that generates complementary evidence specifications to improve high‑resolution multimodal large language models (MLLMs). By explicitly guiding visual search with structured evidence specifications, EviSpec achieves significant relative gains—up to 14.8% over random evidence—across five MLLMs and three benchmarks, and also sets new state‑of‑the‑art results on VQA and hallucination‑focused tasks.
arXiv Computation and Language
3d ago
Fewer Tokens, More Answers: Verifiable-Reward Tuning of an Ornith-Style VLM for Multi-View Driving QA
The paper reports on a verifiable‑reward tuning approach applied to an Ornith‑style vision‑language model for multi‑view driving question answering. Using a 256‑token limit, the GRPO method raises answer extraction from 78.25 % to 90.25 % and accuracy from 55.50 % to 63.75 %. On a larger 2,511‑question set, the tuned pipeline cuts average token usage from 108.6 to 47.1, though the accuracy improvement is not statistically significant.
arXiv AI
Aug 10
Ask-E: An Environment for Calibrated Question Generation
arXiv:2608. 06933v1 Announce Type: cross Abstract: Today, we improve models by training and evaluating them on problems at the frontier of their abilities.
arXiv AI
Oct 9
VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoning
VICO proposes a co‑evolutionary framework where a vision‑language model (actor) and an Environment‑as‑Rewriter (EnvRewriter) are trained together. The EnvRewriter edits visual structures—such as scene graphs, chart tables, or protected region masks—to generate new training samples whose difficulty is calibrated to the actor’s current performance via a pass‑rate reward. Across nine multimodal benchmarks, VICO‑8B outperforms its base model by up to +5.0 % on out‑of‑domain tasks and surpasses other co‑evolution baselines while requiring far fewer labeled samples.
arXiv AI
Oct 26
Cycle-of-Thought: Self-Evaluative Iterative Reasoning for Table Visual Question Answering in Document Images
The paper introduces Self-RefineVQA, a training‑free, inference‑time framework that lets a single Vision‑Language Model iteratively generate, critique, and refine its own answers for table visual question answering. By forming a closed self‑feedback loop guided by prompts, the method corrects common reasoning errors such as spatial misalignment and logical hallucinations without requiring additional labeled data or model updates. Experiments on tabular VQA benchmarks show consistent accuracy gains across monolingual and cross‑lingual settings, especially for lightweight models, while keeping inference cost linear and eliminating the need for expensive supervised fine‑tuning.