arXiv Machine Learning

HiRo: A Compact Four-Directional Hierarchical Reservoir Token-Mixer for Efficient Image Classification

arXiv:2606. 15151v1 Announce Type: cross Abstract: Recent image classification models must balance local feature modeling, cross-window interaction, and parameter efficiency.

arXiv Computer Vision
6d ago

MCL: Meta Convolution Layer

The paper introduces the Meta Convolution Layer (MCL), a dynamic convolution approach that models kernels as input‑conditioned high‑order polynomial functions instead of linear mixtures of basis kernels. MCL generates a single adaptive kernel through a structured polynomial meta‑network, improving training stability and expressivity. Experiments show significant accuracy gains on ImageNet, CIFAR, and fine‑grained classification tasks when MCL is added to ResNet, Wide‑ResNet, Swin, and ViT backbones.

By Naim Reza, Md Al Amin, Ho Yub Jung
arXiv AI
Aug 25

Hyperbolic Hierarchical Clustering for Visual Representation Learning

The paper introduces ClusterMixer, a token mixer based on hierarchical clustering in hyperbolic space, designed to be transparent and interpretable. It forms the core of a new vision backbone called HCFormer, which incorporates multiple clustering strategies to maintain strong performance. Experiments show HCFormer surpasses existing backbones on tasks such as image classification, object detection, instance segmentation, and semantic segmentation.

By Jianan Wei, Guikun Chen, Zhiyuan Weng, Chunchao Guo, Yujia Wang, Wenguan Wang
arXiv Machine Learning
Sep 23

GTR: Gated Token Recurrence for Efficient Dense Prediction

The paper introduces Gated Token Recurrence (GTR), a softmax‑free recurrent vision backbone that replaces global softmax attention with gated linear attention, alternating scan directions, and enhanced SwiGLU blocks. GTR is distilled from a DINOv3 teacher using only final‑layer patch‑token alignment, and achieves strong performance on COCO object detection (58.9 box AP) with very low latency (1.908 ms on an RTX 4090). The backbone also transfers to multiple dense prediction tasks and runs efficiently on edge hardware via a specialized CUDA operator and TensorRT deployment.

By Zhe Feng, Longfei Liu, Wei Liu, Kai Chen, Jiangjiang Kong, Wei Zhou, Yifeng Qian, Dexiong Chen, Xuanlong Yu, Xi Shen
Hugging Face Trending Papers
Jun 29

HTC-SGA Former: A Hybrid Transformer-CNN Network with Self-Guided Attention and a New Boundary-Weighted Adaptive Loss for Coronary DSA Vessel Segmentation

Accurate coronary Digital Subtraction Angiography (DSA) vessel segmentation is essential for computer-aided diagnosis and treatment planning of coronary artery disease (CAD). However, thin low-contrast vessels, background interference, and severe vessel-background class imbalance make reliable segmentation of weak distal branches and vessel boundaries challenging.

arXiv AI
Jul 29

Argus-Unified: Towards A Compact and Economical Unified Model for Image Understanding and Generation

arXiv:2607. 25527v1 Announce Type: cross Abstract: Unifying visual understanding and generation in one model holds immense promise, but remains challenging and expensive due to heavy compute and data demands and conflicts between the visual features needed for these two capabilities.

By Weiming Zhuang, Jiabo Huang, Jingtao Li, Zhizhong Li, Chen Chen, Sina Sajadmanesh, Lingjuan Lyu