arXiv Machine Learning September 11, 2026 By Alejandro Galan-Cuenca, Marcelo Saval-Calvo, Antonio Javier Gallego

Are We Really Doing Few-Shot Learning? A Critical Examination of Pre-Training Assumptions

Read the original on arXiv Machine Learning →

The paper critically evaluates common few‑shot learning protocols that rely on pre‑training a model on a large auxiliary set with classes disjoint from the target but drawn from the same visual domain. By comparing no pre‑training, class‑disjoint in‑domain pre‑training, supervised out‑of‑domain pre‑training, and label‑free out‑of‑domain pre‑training across eight datasets and three architectures, the authors find that in‑domain pre‑training yields a 33.41‑point average improvement, while out‑of‑domain pre‑training offers a 23.75‑point gain, revealing a 9.66‑point optimistic bias due to domain overlap. They also demonstrate that a label‑free augmentation strategy can match supervised out‑of‑domain performance and propose a descriptor‑based source‑selection method that closely approximates oracle selection, underscoring the need to move beyond in‑domain pre‑training as the default evaluation protocol.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

safety

arXiv Machine Learning

Jun 26

LLMTabBench: Evaluating LLMs on Binary Tabular Classification From Zero to Few Shots

arXiv:2605. 24417v2 Announce Type: replace Abstract: Supervised classification on tabular data remains a central machine learning task, but its dependence on large labeled datasets limits its applicability in data-scarce settings.

By Daria Grushina, Kseniia Kuvshinova, Alina Kostromina, Aziz Temirkhanov, Mile Mitrovic, Dmitry Simakov

llms benchmarks

Hugging Face Trending Papers

Jun 23

Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matching

Cross-domain Few-shot Segmentation (CD-FSS) aims to transfer knowledge learned from source domain to distinct target domains, segmenting unseen target classes with only a few annotated samples. Although existing methods have made significant progress, they still rely on training or fine-tuning processes, which incur high computational costs and risk overfitting.

computer-vision fine-tuning benchmarks

arXiv Machine Learning

Jun 24

Solving Semi-Supervised Few-Shot Learning from an Auto-Annotation Perspective

arXiv:2512. 10244v2 Announce Type: replace-cross Abstract: Semi-supervised few-shot learning (SSFSL) resembles real-world applications such as auto-annotation, as it aims to learn a model from a few labeled and abundant unlabeled task-specific examples to annotate the unlabeled ones.

By Tian Liu, Anwesha Basu, James Caverlee, Shu Kong

llms fine-tuning multimodal benchmarks

arXiv Machine Learning

Jul 21

DA-MergeLoRA: Hypernetwork-Based LoRA Merging for Few-Shot Test-Time Domain Adaptation

arXiv:2607. 17467v1 Announce Type: cross Abstract: Few-shot Test-Time Domain Adaptation (FSTT-DA) seeks to adapt models to novel domains using only a handful of unlabeled target samples.

By Siobhan Reid, Zhixiang Chi, Li Gu, Omid Reza Heidari, Ziqiang Wang, Yang Wang

fine-tuning benchmarks

Hugging Face Trending Papers

Jul 13

MED-DSLC: Multi-Expert-Domain Classification via Domain Supervision and Logit Calibration

Vision-language models (VLMs) such as CLIP enable zero-shot classification by comparing image features with text prompts in a shared embedding space. A fundamental property underlying this capability is the global comparability of logits across arbitrary candidate classes.

llms rag fine-tuning multimodal benchmarks

arXiv AI

Jun 2

GiPL: Generative augmented iterative Pseudo-Labeling for Cross-Domain Few-Shot Object Detection

arXiv:2605. 29539v2 Announce Type: replace-cross Abstract: Vision-language foundation models have shown promising zero-shot generalization for Cross-Domain Few-Shot Object Detection (CD-FSOD).

By Jiacong Liu, Shu Luo, Yikai Qin, Yaze Zhao, Yongwei Jiang, Yixiong Zou

llms computer-vision fine-tuning multimodal benchmarks

One email a morning, machine-written

Related stories

LLMTabBench: Evaluating LLMs on Binary Tabular Classification From Zero to Few Shots

Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matching

Solving Semi-Supervised Few-Shot Learning from an Auto-Annotation Perspective

DA-MergeLoRA: Hypernetwork-Based LoRA Merging for Few-Shot Test-Time Domain Adaptation

MED-DSLC: Multi-Expert-Domain Classification via Domain Supervision and Logit Calibration

GiPL: Generative augmented iterative Pseudo-Labeling for Cross-Domain Few-Shot Object Detection