arXiv Computer Vision
VideoRAE: Taming Video Foundation Models for Generative Modeling via Representation Autoencoders
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
Hugging Face Trending Papers
Aug 13
V-RAE: Rethinking Video Latent Spaces for Generation
Latent video generation relies on autoencoders to define a compact space in which generative models operate. Although video autoencoder architectures have evolved substantially, their latent spaces are still optimized primarily for pixel-level reconstruction and provide limited high-level semantic organization.
arXiv Computer Vision
Oct 8
GRACE: Generation-aware latent compression for efficient video generation
arXiv:2610.10524v1 Announce Type: new Abstract: Highly compressed video autoencoders offer an effective way to accelerate video diffusion models, as the Diffusion Transformer (DiT) operates on far fe...
arXiv Computer Vision
Aug 26
Keep-or-Drop? Adaptive Tokenizer for Compact Video Representation
arXiv:2608.24293v1 Announce Type: new Abstract: Latent diffusion models have emerged as a dominant framework for high-fidelity image and video synthesis, operating in compact latent spaces with varia...
arXiv Machine Learning
Jun 9
MilliVid: Hierarchical Latents for Long-Range Consistency in Video Generation
arXiv:2606. 09056v1 Announce Type: cross Abstract: Video generative models have become increasingly powerful, but long-range consistency remains challenging to achieve because even a few dozen frames require impractically long transformer sequence lengths.
arXiv Computer Vision
Oct 2
SemanTok: Predictable Semantic Tokens for Efficient Autoregressive Video Generation
arXiv:2610.00686v1 Announce Type: new Abstract: Recent video-based world models pair the scalability of autoregressive (AR) prediction with the visual quality of diffusion models. The choice of scene...
Hugging Face Trending Papers
Jun 9
IDEAL: In-DEpth ALignment Makes A Discrete Representation AutoEncoder
Built on pretrained vision foundation models (VFMs), representation autoencoders (RAEs) have recently emerged as a promising approach for constructing semantically rich latent spaces for image generation. However, their reconstruction quality often remains suboptimal, largely because deep VFM representations do not preserve sufficient fine-grained visual detail.