arXiv AI June 18, 2026 By Jiequan Cui, Beier Zhu, Qingshan Xu, Zhuotao Tian, Xiaojuan Qi, Bei Yu, Hanwang Zhang, Richang Hong

Generalized Kullback-Leibler Divergence Loss

Read the original on arXiv AI →

arXiv:2503. 08038v2 Announce Type: replace-cross Abstract: In this paper, we delve deeper into the Kullback-Leibler (KL) Divergence loss and mathematically prove that it is equivalent to the Decoupled Kullback-Leibler (DKL) Divergence loss that consists of (1) a weighted Mean Square Error (wMSE) loss and (2) a Cross-Entropy loss incorporating soft labels.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

arXiv AI

Jun 16

ALCL: An Adaptive Log-Correntropy Loss for Robust Learning under Non-Gaussian Noise

arXiv:2606. 16050v1 Announce Type: cross Abstract: Robust deep learning under heavy-tailed and impulsive noise remains challenging because conventional losses such as mean squared error (MSE) exhibit unbounded sensitivity to outliers.

By Mainak Kundu, Ria Kanjilal, Ismail Uysal

benchmarks

arXiv AI

Jul 1

Sparsity-Inducing Divergence Losses for Biometric Verification

arXiv:2606. 31664v1 Announce Type: cross Abstract: Performance in face and speaker verification is largely driven by margin-penalty softmax losses such as CosFace and ArcFace.

By Dimitrios Koutsianos, Ladislav Mo\v{s}ner, Yannis Panagakis, Themos Stafylakis

rag efficiency benchmarks

arXiv Machine Learning

1d ago

The Distributional View of Knowledge Distillation

arXiv:2608. 15215v1 Announce Type: cross Abstract: Token-level knowledge distillation (KD) matches two conditional distributions per position, yet the standard objectives compare them pointwise: a Kullback-Leibler gradient is blind to which wrong token receives probability mass.

By Gordei Verbii, Juho Lee

rag fine-tuning efficiency

arXiv Machine Learning

Jun 16

Enhancing Visual Feature Attribution via Weighted Integrated Gradients

arXiv:2505. 03201v4 Announce Type: replace-cross Abstract: Integrated Gradients (IG) is a widely used attribution method in explainable AI, particularly in computer vision applications where reliable feature attribution is essential.

By Kien Tran Duc Tuan, Tam Nguyen Trong, Son Nguyen Hoang, Khoat Than, Anh Nguyen Duc

llms computer-vision

arXiv Machine Learning

Jun 2

Sensitivity as a Double-Edged Sword: A Trade-off Between Discriminability and Adversarial Robustness

arXiv:2606. 01746v1 Announce Type: cross Abstract: Modern neural networks are highly susceptible to adversarial perturbations.

By Kai Wang

fine-tuning benchmarks safety

arXiv Machine Learning

Aug 11

ReliableNet: A Chance-Constrained Approach to Trustworthy Classification in Deep Learning

arXiv:2608. 09768v1 Announce Type: new Abstract: A prediction that is both confident and wrong is a critical reliability failure because it can bypass abstention and human review precisely when the model is mistaken.

By Ange-Cl\'ement Akazan, Ineza Remy Mugenga, Abebe Geletu, Jean Medard Ngnotchouye, Issa Karambal

benchmarks

Related stories

ALCL: An Adaptive Log-Correntropy Loss for Robust Learning under Non-Gaussian Noise

Sparsity-Inducing Divergence Losses for Biometric Verification

The Distributional View of Knowledge Distillation

Enhancing Visual Feature Attribution via Weighted Integrated Gradients

Sensitivity as a Double-Edged Sword: A Trade-off Between Discriminability and Adversarial Robustness

ReliableNet: A Chance-Constrained Approach to Trustworthy Classification in Deep Learning