← Back to all news
arXiv Machine Learning By Alex Gower

PotentialEP: Backprop-Free Training of CIFAR-Scale Generative Models via Equilibrium Propagation

Read the original on arXiv Machine Learning →

The paper introduces PotentialEP, a backpropagation‑free method for training generative models at CIFAR scale using Equilibrium Propagation. It shows that a predictive coding network with a small linear injection can relax to a state that inherently carries the gradient needed for sampling, allowing an Energy Matching model trained with backpropagation to be sampled by relaxation alone with negligible loss in FID. Moreover, the authors demonstrate that training end‑to‑end with Equilibrium Propagation yields FID scores comparable to backpropagation, marking the first competitive CIFAR‑10 generative model trained without backpropagation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Machine Learning
Sep 3

FORGE: Forward-Only Test-Time Adaptation for Integer-Only Vision Models on Microcontrollers

FORGE is a forward‑only test‑time adaptation technique designed for integer‑only vision models running on microcontrollers. It restores batch‑normalization statistics after BN folding by re‑normalizing each convolution’s per‑channel output using only forward‑pass estimates, enabling adaptation on deployed, folded integer models. The method achieves accuracy gains comparable to gradient‑based TENT, requires adapting only a few layers, works with single‑sample streaming, and has been validated on an ESP32‑S3 with minimal energy and latency overhead.

By Muhammad Rehan, Haider Ali, Muhammad Ali Munir, Moaz Amjad
efficiency
More like this →
Hugging Face Trending Papers
Aug 6

Energy-Guided Flow Matching

Pixel-space generative models bypass lossy latent compression, yet necessitate joint learning of global structure and fine-grained details in a high-dimensional space. Standard flow matching interpolates noise toward a fixed clean-image endpoint, leaving the spectral evolution to be learned implicitly.

diffusion
More like this →
arXiv AI
Oct 9

From Pixels, Without Pre-training: Joint Generative and Self-Supervised Representation Learning in One Model

The paper introduces SCION, a single-model framework that jointly learns generative and self‑supervised representation tasks without relying on labels or pretrained encoders. SCION uses a pixel‑space encoder conditioned on a flow timestep and a shared embedding, training contrastive and flow‑matching objectives simultaneously with gradient‑norm balancing and stop‑gradient techniques. On ImageNet 256×256, SCION achieves state‑of‑the‑art FID scores (8.92 with JiT‑B and 5.89/3.47 with JiT‑L) surpassing prior class‑unconditional and pretrained‑conditioned methods.

By Vicente Balmaseda, Ching-Long Lin, Tianbao Yang
ragdiffusion
More like this →