arXiv AI By Kentaro Oda

A Shared Encoder Is Not a Shared Task: Conditional Comparison for Deep Expert Pools

Read the original on arXiv AI →

The paper demonstrates that sharing a deep encoder alone does not eliminate the confounding effects in task-comparison scores. By introducing a conditional two‑discriminator discrepancy within the embedding space, the authors achieve robust detection of task changes, maintaining stability under input rotations and accurately tracking label‑permutation drift. This approach, integrated into a mixture‑of‑heads framework, outperforms traditional novelty triggers and generalizes across multiple backbones and datasets, including ImageNet‑21k ViT‑B/16, DINOv2, and CIFAR‑100.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 24

What Changed? Drift Detection with Real, Virtual, and Incomparable Diagnosis

The paper investigates drift detection in deep learning models, showing that sharing a deep encoder alone does not eliminate confounding in task-comparison scores. By introducing a conditional two‑discriminator discrepancy into the embedding space, the authors create a two‑axis gate that remains stable under input rotations and accurately tracks label‑permutation drift. This approach outperforms traditional exchange or novelty triggers, achieving high AUROC in distinguishing semantic novelty from photometric shift across multiple backbones and datasets.

By Kentaro Oda
arXiv Computation and Language
Oct 26

Semantically Rich, Metrically Affect-Blind: A Geometric Blind Spot in Modern Text Embedders

The paper uncovers a systematic mismatch in modern text embeddings: while sentiment can be extracted with high accuracy from frozen encoders, the embeddings’ cosine similarity metric barely reflects polarity differences. Across eleven models from 2021–2026, a linear probe achieves up to 91.3% accuracy, yet cosine similarity margins are only 0.003–0.064, leading to poor retrieval performance (e.g., Qwen3-Embedding-4B’s 64.3 MAP). Introducing a lightweight supervised‑contrastive head (Sentiment‑Injected Sentence Embeddings) dramatically improves probe accuracy, retrieval MAP, and polarity margins, but at the cost of downstream semantic similarity. "whyItMatters":"The findings reveal that widely used retrieval and clustering systems may ignore valuable sentiment information encoded in embeddings, impacting their effectiveness."

By Mahdi Naser Moghadasi
arXiv Machine Learning
Nov 2

Beyond Scarcity: When Encoder Adaptation Is Worthwhile

The paper introduces a controlled evaluation framework to determine when encoder adaptation is beneficial after correcting for class imbalance in long‑tailed recognition tasks. By separating unique support from representation allocation and comparing classifier‑only versus full‑network continuations, the study shows that encoder updates become worthwhile only when representation allocation is highly imbalanced, a transition that persists across various corrections and scales to ImageNet. The framework uses stage‑specific controls, multiple objectives, whole‑distribution metrics, and hierarchical inference to robustly estimate incremental encoder value.

By Zexing Zhang, Jichao Li, Tianyang Lei, Yiyin Zhang, Kewei Yang
Hugging Face Trending Papers
Nov 2

Unlocking the Potential of Vision Foundation Models for Multi-Task Dense Prediction via Mixture of Task Adapters

The paper introduces D2MoE, a Mixture of Task Adapters designed for vision foundation models to handle multi-task dense prediction. It separates adaptation into a task‑generic low‑rank channel (TG‑LoRA) that preserves pretrained priors and a task‑adaptive sparse expert module (TA‑MoE) that resolves task‑specific conflicts. A Semantic Prior Injector further aligns multi‑level task features with frozen foundation knowledge, achieving robust multi‑task performance with a small trainable footprint.