arXiv Machine Learning

Learning Through Energy Refinement and Manifold Projection: A Cooperative EBM-AE Framework

arXiv AI
Oct 9

From Pixels, Without Pre-training: Joint Generative and Self-Supervised Representation Learning in One Model

The paper introduces SCION, a single-model framework that jointly learns generative and self‑supervised representation tasks without relying on labels or pretrained encoders. SCION uses a pixel‑space encoder conditioned on a flow timestep and a shared embedding, training contrastive and flow‑matching objectives simultaneously with gradient‑norm balancing and stop‑gradient techniques. On ImageNet 256×256, SCION achieves state‑of‑the‑art FID scores (8.92 with JiT‑B and 5.89/3.47 with JiT‑L) surpassing prior class‑unconditional and pretrained‑conditioned methods.

By Vicente Balmaseda, Ching-Long Lin, Tianbao Yang
arXiv AI
Oct 26

Representation Learning via Composite Subspace Flow Matching

The paper introduces Composite Subspace Flow Matching (CSFM), a representation learning method that minimizes variance by inverting a deterministic degradation curriculum across spectral, color, and illumination subspaces. CSFM uses hard temporal style truncation to constrain an encoder, encouraging it to ignore transient style artifacts while preserving persistent content. Experiments on CIFAR-10, CIFAR-100, and STL-10 demonstrate that CSFM achieves competitive discriminative transferability and generative synthesis, outperforming standard optimal transport flows in linear probing and few‑shot classification while maintaining a smooth latent space.

By Jos\'e Afonso, M\'ario Figueiredo
arXiv Computer Vision
Sep 28

FuseReg: Regularizing Layer Fusion Mitigates the Reconstruction-Generation Gap in Representation Autoencoders

arXiv:2609.31620v1 Announce Type: new Abstract: Representation autoencoders (RAEs) reuse features from a pretrained visual encoder as reconstruction and diffusion latents, integrating strong visual r...

By Hongyang Du, Yunfei Xie, Junjie Ye, Jiawei Yang, Xiaoyan Cong, Haodong Zhang, Yongchao Huang, Haiyu Wu, Zongxia Li, Shihang Gui, Dawei Liu, Runhao Li, Jingcheng Ni, Chen Wei, Randall Balestriero, Yue Wang