arXiv AI
Looking Again: Measuring Sycophancy in the Reasoning Chains of Multimodal Models Under Pressure
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Oct 2
Talked Out of the Truth: Sycophancy in the Reasoning Chains of Multimodal Models
arXiv:2608.28623v2 Announce Type: replace-cross Abstract: Large multimodal reasoning models (LMRMs) are increasingly capable, largely through generating explicit chain-of-thought reasoning before ans...
arXiv Machine Learning
Jul 2
VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning
arXiv:2511. 17731v2 Announce Type: replace-cross Abstract: Chain-of-Thought (CoT) prompting has proven remarkably effective for eliciting complex reasoning in large language models (LLMs).
arXiv AI
Aug 12
Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes
arXiv:2608. 10954v1 Announce Type: cross Abstract: While Multimodal Large Language Models (MLLMs) demonstrate impressive performance in benign scenarios, their cognitive reliability deteriorates significantly in complex scenes under adverse conditions.
arXiv Computer Vision
1d ago
ANCHOR: Audio-Visually Grounded Chain-of-Thought Reasoning Benchmark
ANCHOR is a new benchmark for audio‑visually grounded chain‑of‑thought reasoning, containing 2,319 videos and 8,272 question‑answer pairs with structured reasoning traces, spatial bounding boxes, temporal intervals, and audio cues. It evaluates not only answer correctness but also hallucination, logical divergence, and conciseness, providing direct spatial and temporal grounding measurements on a focused subset. The benchmark reveals a substantial alignment gap among contemporary multimodal large language models, showing that similar answer accuracy can mask differences in evidence‑supported explanations.
arXiv AI
Sep 1
Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes
arXiv:2506.09557v2 Announce Type: replace-cross Abstract: While Multimodal Large Language Models (MLLMs) demonstrate impressive performance in benign scenarios, their cognitive reliability deteriorat...
arXiv AI
Aug 6
Reasoning Dynamics and the Limits of Monitoring Modality Reliance in Vision-Language Models
arXiv:2604. 14888v3 Announce Type: replace-cross Abstract: Recent advances in vision language models (VLMs) offer reasoning capabilities, yet how these unfold and integrate visual and textual information remains unclear.