arXiv Machine Learning By Allen Schmaltz

Similarity-Distance-Magnitude Activations

Read the original on arXiv Machine Learning →

arXiv:2509. 12760v5 Announce Type: replace Abstract: We introduce the Similarity-Distance-Magnitude (SDM) activation function, a more robust and interpretable formulation of the standard softmax activation function, adding Similarity (i.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computation and Language
Sep 2

Post-hoc Alignment of LLM-judges to Human Judgment Distribution

The paper introduces NAPHA, a lightweight post‑hoc alignment method that improves large language model (LLM) predictions of human judgment distributions (HJD) by matching LLM output distributions to HJD through entropy‑based class assignment and specialized alignment models. Experiments on five datasets show that while LLMs perform near human‑level on hard‑label tasks, they struggle with soft‑label predictions, and NAPHA consistently enhances soft‑label accuracy, especially on high‑entropy instances. The study also demonstrates that better entropy class prediction can further boost NAPHA’s effectiveness.

By Sebastian Steindl, Nikos Voskarides, Alberto Gasparin, Diego Marcheggiani
arXiv Machine Learning
Jul 30

The Advantage of Fine-Grained Training

arXiv:2509. 05130v2 Announce Type: replace Abstract: In classification problems, models are trained to predict a class label based on the input data features.

By Davide Pirovano, Federico Milanesio, Michele Caselle, Piero Fariselli, Matteo Osella
arXiv AI
Sep 4

ScoreMix: Synthetic Data Generation by Score Composition in Diffusion Models Improves Recognition

ScoreMix is a self‑contained synthetic data generation method that improves recognition tasks by mixing class‑conditioned scores along reverse diffusion trajectories, thereby creating hard synthetic samples without external resources. The approach shows that selecting classes far apart in the discriminator’s embedding space yields larger performance gains, up to 3% more improvement than proximity‑based selection. Across eight public face recognition benchmarks, ScoreMix boosts accuracy by up to 7 percentage points, demonstrating robustness and practicality without hyperparameter tuning.

By Parsa Rahimi, Sebastien Marcel