arXiv Computer Vision

Depth-guided Geometric Adaptation for Few-shot Image Classification

The paper introduces DAFIC, a geometry‑guided framework for few‑shot image classification that leverages monocular depth information. DAFIC first learns geometry‑aware token representations via RGB‑D self‑supervised pre‑training, then refines patch representations using a Depth‑guided Geometric Adaptation module that incorporates depth‑derived geometry while suppressing background interference. Finally, Spatial Bidirectional Patch Matching performs dense bidirectional matching on the refined features, reducing sensitivity to spurious correspondences and background clutter. Experiments on four benchmarks demonstrate that DAFIC outperforms existing methods, with ablation and robustness analyses confirming the benefits of coupling geometry‑conditioned episodic adaptation with bidirectional matching.

Hugging Face Trending Papers
Jun 23

Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matching

Cross-domain Few-shot Segmentation (CD-FSS) aims to transfer knowledge learned from source domain to distinct target domains, segmenting unseen target classes with only a few annotated samples. Although existing methods have made significant progress, they still rely on training or fine-tuning processes, which incur high computational costs and risk overfitting.

arXiv AI
Oct 16

UniFGVC: Universal Training-Free Few-Shot Fine-Grained Vision Classification via Attribute-Aware Multimodal Retrieval

UniFGVC introduces a training‑free framework for few‑shot fine‑grained visual classification that reframes the task as a multimodal retrieval problem. It uses a Category‑Discriminative Visual Captioner to generate attribute‑aware textual descriptions, then matches image‑description pairs with category templates via pre‑trained encoders. Experiments on 12 datasets show that UniFGVC consistently outperforms existing CLIP‑based and fully‑supervised MLLM methods, demonstrating the effectiveness of the retrieval paradigm.

By Haiyun Guo, Hongyu Guo, Xiangzhao Hao, Jiarui Guo, Jinqiao Wang, Tat-Seng Chua
Hugging Face Trending Papers
Aug 4

SeCo-SBIR: Semantically Consistent Prompt Learning for Zero-Shot Sketch-Based Image Retrieval

Adapting CLIP for zero-shot sketch-based image retrieval (ZS-SBIR) via prompt learning faces a fundamental tension: the model must bridge the sketch-photo domain gap through task-specific adaptation, yet the added flexibility risks overfitting to seen training categories and eroding CLIP's zero-shot generalization. We present SeCo-SBIR, a semantically consistent prompt learning framework that resolves this tension from both sides.

arXiv Computer Vision
Oct 19

Learning to Discriminate Scene Structures Makes Self-Supervised Depth Learning Scalable

The paper introduces MaSS, a framework that adds a dedicated structural representation pathway to self‑supervised monocular depth estimation. By using a scene‑structure discrimination objective, MaSS learns generalized, layout‑aware structural representations that decouple from contextual features. Experiments on four diverse datasets show MaSS outperforms prior methods and benefits from mixed‑domain training, while zero‑shot tests on eight additional datasets confirm its strong generalizability to out‑of‑distribution scenes.

By Mengtan Zhang, Yuchuan Cui, Yu Ma, Zizhan Guo, Wei Ye, Rui Fan
arXiv Computer Vision
Oct 9

Pose-Free Feed-Forward 3D Inpainting via Learnable Mask Attention and Support Token Refinement

FreeInpaint is a feed‑forward 3D inpainting framework that reconstructs complete, geometrically consistent scenes directly from unposed multi‑view images with masked regions. It extends a 3D foundation model by propagating masked areas across views, using a Learnable Mask Attention mechanism to maintain reliable cross‑view correspondences and a Support Token Refinement strategy that injects diffusion‑generated auxiliary tokens for high‑fidelity completion. Experiments on diverse datasets show that FreeInpaint delivers superior inpainting quality without requiring pre‑computed camera poses, while maintaining fast inference speed.

By Jingyi Pan, Dan Xu, Qiong Luo