The paper studies Graph-Guided Token Merging (G2TM), a module that reduces token count in Vision Transformers. It evaluates G2TM across multiple segmentation frameworks and decoder types, finding that its performance gains are tied to the encoder rather than the decoder. The authors report consistent reductions in GFLOPs (22‑47%) and throughput improvements (up to 74%) on ADE20K, with optimal hyperparameters depending mainly on backbone pre‑training and target dataset.
By Victor Bercy, Martyna Poreba, Michal Szczepanski, Samia Bouchafa
arXiv:2509. 10334v2 Announce Type: replace-cross Abstract: Vision Transformers (ViTs) have recently achieved strong results in semantic segmentation, yet their deployment on resource-constrained devices remains limited due to their high memory footprint and computational cost.
By Jordan Sassoon, Michal Szczepanski, Martyna Poreba
arXiv:2603. 26551v2 Announce Type: replace-cross Abstract: Vision backbone networks play a central role in modern computer vision.
By Moritz Nottebaum, Matteo Dunnhofer, Christian Micheloni
MoE-ViE introduces a Mixture-of-Experts vision encoder that scales efficiently for image and video understanding, outperforming dense counterparts across various sizes. The study shows fine‑grained MoE topologies provide significant gains, and proposes an auxiliary‑loss‑free balancing variant and a specialized MoE kernel to reduce inference latency. With frame‑level distillation and a novel freezing mechanism, the largest MoE‑ViE model matches state‑of‑the‑art zero‑shot performance while being 1.7× larger and 76% faster, and it outperforms other encoders when paired with a language model on both image and video benchmarks.
arXiv:2605.18177v2 Announce Type: replace
Abstract: Query-based Vision Transformer segmentation models typically reconstruct dense spatial feature maps to predict masks, inheriting design patterns fr...
By Calvin Galagain, Martyna Poreba, Fran\c{c}ois Goulette
arXiv:2606. 02092v1 Announce Type: cross Abstract: Semantic segmentation of remote sensing imagery requires models that capture both global context and local detail under tight computational budgets.
By \"Umit Mert \c{C}a\u{g}lar, Alptekin Temizel