arXiv Computer Vision
GRACE: Generation-aware latent compression for efficient video generation
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Oct 1
DC-SAE: Deep Compression Semantic Autoencoder for Faster Diffusion Convergence
arXiv:2609.39222v1 Announce Type: new Abstract: High-compression tokenizers are essential for scaling latent image generative models. However, aggressive compression creates a fundamental tradeoff be...
Hugging Face Trending Papers
Aug 13
V-RAE: Rethinking Video Latent Spaces for Generation
Latent video generation relies on autoencoders to define a compact space in which generative models operate. Although video autoencoder architectures have evolved substantially, their latent spaces are still optimized primarily for pixel-level reconstruction and provide limited high-level semantic organization.
arXiv Computer Vision
Aug 24
Instruction-Based Video Editing by Repurposing an Image Editing Model
Instruction-Based Video Editing by Repurposing an Image Editing Model demonstrates that a strong image‑editing model can be adapted to edit videos by operating on video‑VAE latents. The authors tile latent frames into a large virtual image, reuse the editor’s positional encoding, and bridge latent spaces with lightweight projections, fine‑tuning on Ditto‑1M editing triplets. Their experiments show that per‑frame video latents are close enough to the image domain that mature image‑editing priors transfer with minimal adaptation.
arXiv AI
Sep 3
VoRTeC: Taming Foundation Flow for One-step Real time Video Compression
The paper introduces VoRTeC, a video compression framework that leverages a foundational flow model to encode latent video representations compactly and predict their positions along flow trajectories. By integrating multi‑scale priors and avoiding access to flow‑matching network parameters, VoRTeC achieves one‑step decoding with high perceptual fidelity, while maintaining temporal consistency through tail‑frame reuse and prior caching. Experiments show a 58% reduction in bit consumption compared to prior diffusion‑based methods and a decoding speed increase ranging from 3 to 197 times, reaching 13 FPS at 720p and 32 FPS at 480p.
arXiv Computer Vision
Sep 1
VideoRAE: Taming Video Foundation Models for Generative Modeling via Representation Autoencoders
arXiv:2607.14088v2 Announce Type: replace Abstract: Video generation models typically rely on 3D-VAEs trained for pixel-level reconstruction, whose latent spaces may underrepresent semantic structure...
arXiv AI
Jul 17
FlashDecoder: Real-Time Latent-to-Pixel Streaming Decoder with Transformers
arXiv:2607. 14898v1 Announce Type: cross Abstract: Real-time video generation demands fast decoding as much as fast denoising, yet current latent video diffusion models rely on 3D convolutional decoders that are slow and memory-intensive at high resolutions or for long video.