arXiv Machine Learning By Konstantinos Fotopoulos, Petros Maragos

Correlational Training of Morphological Neural Networks

Read the original on arXiv Machine Learning →

The paper introduces a new weight update method for morphological neural networks based on the Multiplicative Weights Update scheme. It treats each morphological perceptron as a learning-from-experts problem in logarithmic space and uses a correlation-based reward that favors inputs aligned with the desired output change, even when gradient signals are weak. Experiments on fully connected layers and transformer components across nine benchmarks show that correlational training improves performance on eight tasks, up to 32.84 percentage points, and reduces run‑to‑run variability.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers
Oct 8

Correlational Training of Morphological Neural Networks

The paper introduces a new weight update method for morphological neural networks based on the Multiplicative Weights Update scheme. It treats each morphological perceptron as a learning-from-experts problem in logarithmic space, using a correlation-based reward that favors inputs aligned with the desired output change even when gradient signals are weak. Experiments on fully connected layers and transformer components across nine benchmarks show that correlational training improves performance on eight tasks, up to 32.84 percentage points, and reduces run‑to‑run variability.

arXiv Machine Learning
Sep 10

Conditioned Initialization for Attention

arXiv:2609.07086v1 Announce Type: new Abstract: Transformers are a dominant architecture in modern machine learning, powering applications across vision, language, and beyond. At the core of their su...

By Hemanth Saratchandran, Simon Lucey