arXiv AI By Dongsu Song, DaeYun GO, Boseung Seo, Jay Hoon Jung

SegPAR: Class-Centric Decision-Based Sparse Attack for Semantic Segmentation

Read the original on arXiv AI →

arXiv:2608. 11285v1 Announce Type: cross Abstract: Despite the practical relevance of sparse decision-based black-box threats, they have received limited attention in semantic segmentation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Sep 7

FSPGD: Rethinking Black-box Attacks on Semantic Segmentation

FSPGD introduces a feature-space black-box attack for semantic segmentation that targets intermediate representations rather than just output logits. The method uses a dual loss: an external loss to disrupt cross-model feature alignment and an internal loss to reduce consistency among same-class instances. Experiments on Pascal VOC 2012 and Cityscapes show that FSPGD outperforms existing logit-level and segmentation-specific attacks across CNN and Transformer backbones, and its adversarial examples improve robustness when used for training.

By Eun-Sol Park, MiSo Park, Yong-Goo Shin
arXiv Machine Learning
Sep 7

LookThere! Sparse Vision by Reinforced Selection

LookThere! Sparse Vision by Reinforced Selection proposes an end‑to‑end reinforcement learning framework that jointly trains a shallow input selector and a deep representation extractor for vision transformers. The selector learns where to focus and the extractor learns what to process, enabling the model to use only a tiny fraction of the input tokens—down to 0.2%—while preserving accuracy. The method outperforms existing selection techniques across diverse tasks and models, including high‑resolution recognition, segmentation, zero‑shot classification, and regression, establishing a new Pareto frontier in performance‑compute trade‑offs.

By Sreehari Rammohan, Yousef Yassin, Anthony Fuller, Junfeng Wen, Carl Vondrick, Evan Shelhamer