arXiv Computer Vision
VideoRAE: Taming Video Foundation Models for Generative Modeling via Representation Autoencoders
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
Hugging Face Trending Papers
Aug 13
V-RAE: Rethinking Video Latent Spaces for Generation
Latent video generation relies on autoencoders to define a compact space in which generative models operate. Although video autoencoder architectures have evolved substantially, their latent spaces are still optimized primarily for pixel-level reconstruction and provide limited high-level semantic organization.
arXiv Computer Vision
Aug 26
Keep-or-Drop? Adaptive Tokenizer for Compact Video Representation
arXiv:2608.24293v1 Announce Type: new Abstract: Latent diffusion models have emerged as a dominant framework for high-fidelity image and video synthesis, operating in compact latent spaces with varia...
arXiv Machine Learning
Jun 9
MilliVid: Hierarchical Latents for Long-Range Consistency in Video Generation
arXiv:2606. 09056v1 Announce Type: cross Abstract: Video generative models have become increasingly powerful, but long-range consistency remains challenging to achieve because even a few dozen frames require impractically long transformer sequence lengths.
Hugging Face Trending Papers
Jun 9
IDEAL: In-DEpth ALignment Makes A Discrete Representation AutoEncoder
Built on pretrained vision foundation models (VFMs), representation autoencoders (RAEs) have recently emerged as a promising approach for constructing semantically rich latent spaces for image generation. However, their reconstruction quality often remains suboptimal, largely because deep VFM representations do not preserve sufficient fine-grained visual detail.
Hugging Face Trending Papers
Aug 11
Beyond Pixels: From Video Priors to 4D Worlds
4D generation synthesizes dynamic 3D scenes from conditions such as text or images. Existing methods either reconstruct generated RGB videos with a separate 4D model or adapt a particular video generator to predict geometry directly.
arXiv AI
Aug 3
MoRAE: Flow-Friendly Self-Supervised Latents for Text-to-Motion Generation
arXiv:2607. 29180v1 Announce Type: cross Abstract: Text-to-motion generation must produce motions that are semantically correct, temporally coherent, and physically plausible.