arXiv Machine Learning By Alejandro Galan-Cuenca, Marcelo Saval-Calvo, Antonio Javier Gallego

Are We Really Doing Few-Shot Learning? A Critical Examination of Pre-Training Assumptions

Read the original on arXiv Machine Learning →

The paper critically evaluates common few‑shot learning protocols that rely on pre‑training a model on a large auxiliary set with classes disjoint from the target but drawn from the same visual domain. By comparing no pre‑training, class‑disjoint in‑domain pre‑training, supervised out‑of‑domain pre‑training, and label‑free out‑of‑domain pre‑training across eight datasets and three architectures, the authors find that in‑domain pre‑training yields a 33.41‑point average improvement, while out‑of‑domain pre‑training offers a 23.75‑point gain, revealing a 9.66‑point optimistic bias due to domain overlap. They also demonstrate that a label‑free augmentation strategy can match supervised out‑of‑domain performance and propose a descriptor‑based source‑selection method that closely approximates oracle selection, underscoring the need to move beyond in‑domain pre‑training as the default evaluation protocol.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Oct 2

Geometry-Aware Adaptation for Pretrained Models

arXiv:2307.12226v3 Announce Type: replace-cross Abstract: Machine learning models -- including prominent zero-shot models -- are often trained on datasets whose labels are only a small proportion of...

By Nicholas Roberts, Xintong Li, Dyah Adila, Sonia Cromp, Tzu-Heng Huang, Jitian Zhao, Frederic Sala
arXiv Computer Vision
Sep 22

Training-Free Spectral Transductive Refinement for Cross-Domain Few-Shot Classification

The paper introduces Spectral Transductive Refinement (STR), a training‑free method that refines class prototypes at test time using the geometry of a joint k‑nearest‑neighbour graph and a normalized‑Laplacian spectral coordinate system. STR operates solely on frozen visual embeddings, iteratively updating pseudo‑labelled queries to improve one‑shot and few‑shot classification under domain shift. Experiments on ResNet‑18 and ResNet‑10 backbones show STR outperforms single‑prototype baselines and rivals meta‑trained cross‑domain few‑shot methods, achieving the best 1‑shot average across eight target domains.

By Fahim Rahman, S. M. Tanjeeb Meheran Rohan, Md. Taimum Ibne Sayed, Asaduzzaman Herok, Md. Bakhtiar Hasan
arXiv Machine Learning
Oct 23

Few-shot Classification as Multi-instance Verification: Effective Backbone-agnostic Transfer across Domains

The paper proposes treating few-shot classification as a series of multiple instance verification (MIV) tasks, enabling effective transfer across domains without fine-tuning the backbone. It introduces the MIV-head, a backbone‑agnostic, computationally efficient classification head that achieves competitive accuracy on cross‑domain few‑shot image classification using frozen, pre‑trained backbones. Experiments on an extended Meta‑Dataset benchmark show that the MIV-head outperforms state‑of‑the‑art adapter methods while incurring lower adaptation cost.

By Xin Xu, Eibe Frank, Geoffrey Holmes
Hugging Face Trending Papers
Jun 23

Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matching

Cross-domain Few-shot Segmentation (CD-FSS) aims to transfer knowledge learned from source domain to distinct target domains, segmenting unseen target classes with only a few annotated samples. Although existing methods have made significant progress, they still rely on training or fine-tuning processes, which incur high computational costs and risk overfitting.