The paper benchmarks six long‑tail loss functions—cross‑entropy, weighted CE, class‑balanced loss, focal loss, LDAM, and logit‑adjusted softmax—across three single‑cell foundation model architectures (scGPT, scBERT, Geneformer) and three datasets (Multiple Sclerosis, Zheng68K, human Pancreas). It shows that overall accuracy masks systematic failures on rare, disease‑relevant cell types, with a consistent gap between overall accuracy, Macro‑F1, and rare‑class recall under plain cross‑entropy. The study identifies two distinct regimes of rare‑class failure, predicts reweighting efficacy by absolute training‑set size, and finds class‑balanced loss and LDAM to be the most reliable across all settings.
arXiv:2610.27443v1 Announce Type: new Abstract: Set-valued classification (SVC) offers a practical approach to communicating uncertainty while maintaining accuracy by predicting variable-sized sets p...
Density‑Ratio Rescoring (DRR) enhances a classifier trained with the original class prior by adding a survey‑raking dual score that reweights the majority class to match minority feature moments within a tolerance. The method standardizes both the dual and base scores, combines them with equal weight, and uses the fitted dual directly for prediction without resampling or refitting the base model. Experiments on 24 tabular benchmarks and a gene‑expression cohort show that DRR improves average precision over the standardized base on every dataset, with a mean gain of 0.034, and outperforms a shared‑dual raking‑and‑relabeling resampler on most datasets.
arXiv:2609.23926v1 Announce Type: cross Abstract: Density-Ratio Rescoring (DRR) augments a classifier trained at the original class prior with a survey-raking dual score. Raking reweights the majorit...
arXiv:2607. 19426v1 Announce Type: cross Abstract: Single-cell datasets are increasingly costly to store, audit, and reuse for model training.
arXiv:2509. 07605v2 Announce Type: replace-cross Abstract: Class imbalance poses a significant challenge to supervised classification, particularly in critical domains like medical diagnostics and anomaly detection where minority class instances are rare.
arXiv:2606. 10250v1 Announce Type: cross Abstract: Class imbalance is a common problem in deep learning that severely degrades performance.
arXiv:2607. 09832v1 Announce Type: new Abstract: Long-tailed recognition methods often modify losses, margins, or representations to reduce the dominance of frequent classes.
The paper introduces Distilled Rapid Embedding Transfer (DRET), a parameter‑efficient method that injects biomedical domain knowledge from large specialized models into a smaller general‑purpose model without retraining on the original specialized corpora. DRET evolves through iterative strategies—tokenizer‑merge (DRET 1.x), hybrid embedding averaging (DRET 2.0), priority‑based embedding transfer (DRET 3.x), and further refinements (DRET 4.x)—and demonstrates that a 66‑million‑parameter DistilBERT can achieve competitive or superior performance on token‑level PICO classification compared to much larger models, while remaining lightweight. The authors validate the embedding‑level transfer with cosine similarity, semantic‑shift, and t‑SNE analyses, highlighting DRET’s potential for scalable, resource‑efficient biomedical text mining.
arXiv:2606. 29471v1 Announce Type: new Abstract: Strictly proper scoring rules identify the true conditional class distribution at population level, but their curvature can alter optimization and finite-sample behavior.
arXiv:2506. 01486v2 Announce Type: replace Abstract: Data imbalance persists as a pervasive challenge in regression tasks, introducing bias in model performance and undermining predictive reliability.
arXiv:2505. 13518v3 Announce Type: replace-cross Abstract: Imbalanced datasets, where one class significantly outnumbers others, remain a persistent challenge in machine learning, often biasing predictions toward the majority class and degrading classifier performance.
The paper introduces a controlled evaluation framework to determine when encoder adaptation is beneficial after correcting for class imbalance in long‑tailed recognition tasks. By separating unique support from representation allocation and comparing classifier‑only versus full‑network continuations, the study shows that encoder updates become worthwhile only when representation allocation is highly imbalanced, a transition that persists across various corrections and scales to ImageNet. The framework uses stage‑specific controls, multiple objectives, whole‑distribution metrics, and hierarchical inference to robustly estimate incremental encoder value.