arXiv Machine Learning

Convex losses and their applications to SVM, SVR, and Shallow Neural Networks

arXiv:2608. 14288v1 Announce Type: new Abstract: We propose multiple new convex losses for SVM and Neural Networks, applied to binary classification tasks.

arXiv Machine Learning
Jul 16

How the Hessian-Spectrum of Neural Networks Depends on Data

arXiv:2607. 13631v1 Announce Type: new Abstract: The Hessian matrix is an important quantity of interest when it comes to studying the loss landscape and optimization dynamics in deep learning, as well as designing measures of generalization, second-order learning algorithms, etc.

By Jasraj Singh, Enea Monzio Compagnoni, Antonio Orvieto
Hugging Face Trending Papers
Jul 15

How the Hessian-Spectrum of Neural Networks Depends on Data

The Hessian matrix is an important quantity of interest when it comes to studying the loss landscape and optimization dynamics in deep learning, as well as designing measures of generalization, second-order learning algorithms, etc. Prior works have focused on empirical results or pursued a theoretical treatment under overly simplified settings.

arXiv AI
Jun 9

Investigating the Histogram Loss in Regression

arXiv:2402. 13425v3 Announce Type: replace-cross Abstract: It is becoming increasingly common in regression to train neural networks that model the entire distribution even if only the mean is required for prediction.

By Ehsan Imani, Kai Luedemann, Sam Scholnick-Hughes, Esraa Elelimy, Martha White
Hugging Face Trending Papers
Jul 14

Contrastive-Collapsed Loss for Flexible and Geometrically Optimal Embeddings and Faster Convergence

In this work, we introduce CoCo, a loss function aimed at learning normalized and well-structured representations. The proposed loss encourages intra-class collapse and inter-class contrast while preserving sufficient flexibility for neural networks to approximate geometrically optimal embeddings with large angular separation between classes.