arXiv AI

CounterFlow: Target-Conditioned Flow Matching for Visual Counterfactuals

arXiv Computer Vision
Oct 19

CLEAR: Cooperative Latent Flow for Visual Counterfactual Explanations with Accurate Region Preservation

The paper introduces CLEAR, a latent Flow Matching framework designed to generate visual counterfactual explanations (VCEs) that alter a classifier’s prediction while preserving realistic and decision‑irrelevant content. CLEAR addresses two main issues in latent‑space VCEs: opposing update directions between latent generation and classifier guidance, and unintended changes from VAE reconstruction. By decomposing classifier guidance into cooperative and conflicting components and selectively attenuating the conflicting part, CLEAR achieves counterfactual quality comparable to image‑space methods while being 2.5× faster.

By Yan Zeng, Changlu Guo, Oskar Kristoffersen, Anders Nymark Christensen, Morten Rieger Hannemose, Anders Bjorholm Dahl
arXiv AI
Aug 28

CounterVid: Counterfactual Video Generation for Mitigating Action and Temporal Hallucinations in Video-Language Models

CounterVid introduces a scalable counterfactual video generation framework that creates videos differing only in actions or temporal structure while keeping scene context intact. The approach uses multimodal LLMs for action proposals and diffusion models for editing, producing a synthetic dataset of ~26k preference pairs for action recognition and sequence ordering. With the MixDPO optimization method, the authors demonstrate significant improvements in action recognition and temporal ordering on Qwen2.5‑VL and InternVL3 backbones, while maintaining overall video understanding.

By Tobia Poppi, Burak Uzkent, Amanmeet Garg, Lucas Porto, Garin Kessler, Yezhou Yang, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara, Florian Schiffers
Hugging Face Trending Papers
Sep 2

Generating Medical Image Counterfactuals using Causal Explanations

The paper introduces a new method for generating medical image counterfactuals that does not rely on auxiliary generative models. By extracting causal evidence directly from the classifier, the approach deterministically edits user-specified regions to alter predictions while staying closer to the original image than generative baselines. Experiments on real-world medical imaging datasets show that this technique provides a more direct and transparent view of the classifier’s decision boundary.

arXiv Computer Vision
Sep 3

Generating Medical Image Counterfactuals using Causal Explanations

The paper introduces a new framework for generating medical image counterfactuals that does not rely on auxiliary generative models. By extracting causal evidence directly from a classifier, the method deterministically produces edits within user-specified regions, requiring no additional training. Experiments on real-world medical imaging datasets show that these counterfactuals alter classifier predictions while staying closer to the original image than generative baselines, offering a clearer view of the model’s decision boundary.

By David A. Kelly, Tom Yaacov, Nathan Blake, Sander Beckers, Hana Chockler
arXiv AI
Sep 10

Counterfactual Tests for Measuring Chain-of-Thought Faithfulness in Visual Language Models

The paper introduces visual adaptations of counterfactual tests—vCT and vCCT—to evaluate whether chain-of-thought explanations in vision‑language models faithfully reflect the visual evidence driving predictions. Using these tests, the authors benchmark eight open‑source VLMs on two datasets and find that CoTs often fail to track visual evidence, sometimes omitting removed objects or mentioning them inconsistently. They also release two new datasets, Counter‑SNLI‑VE and Counter‑A‑OKVQA, consisting of image pairs that differ by a single object to facilitate further research.

By Bayar Menzat, Maximilian S\"uss, Ruizhi Wang, Benno Steinegger, Thomas Lukasiewicz, Oana-Maria Camburu