Generalization over Memorization: Generalization-Aware Diffusion Adaptation for Single-Image Multi-View Synthesis
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The paper introduces GeoNeXt, a framework that repurposes pretrained video generative models for geometry estimation by framing it as a next‑frame prediction task. Unlike prior methods that either train separate depth/normal models or fine‑tune image diffusion backbones, GeoNeXt jointly models images and geometric targets, leveraging the structured knowledge of video models for more data‑efficient learning. Experiments show zero‑shot monocular depth and surface normal estimation that outperforms existing generative approaches and rivals discriminative state‑of‑the‑art methods while using far less training data.
arXiv:2603. 06741v2 Announce Type: replace-cross Abstract: Training frontier-scale diffusion models often requires substantial computational resources concentrated in tightly-coupled clusters, limiting participation to well-resourced institutions.
Memory-V2V is a memory‑augmented video‑to‑video diffusion framework designed to improve cross‑turn consistency in multi‑turn video editing. It stores previous outputs in an external memory, retrieves relevant edits, and incorporates them via relevance‑aware tokenization and adaptive compression, allowing scalable conditioning without linear computational growth. Experiments on iterative video novel view synthesis and text‑guided long video editing show that Memory‑V2V enhances consistency while preserving visual quality and outperforming strong baselines with modest overhead.
Swift-Image is a compact unified model that performs text-to-image generation, single-image editing, and multi-image editing using a 6B parameter DiT architecture. It employs a progressive training pipeline, parallel expert reinforcement learning, and multi-teacher distillation to balance diverse objectives, while a Prompt Enhancer decouples high-level reasoning from pixel-level rendering. After training, structural pruning and few-step distillation produce efficient 3B and accelerated variants that maintain near‑lossless performance and improve editing efficiency.
arXiv:2607. 01962v1 Announce Type: cross Abstract: We study the challenging problem of novel view video synthesis from single images or monocular videos.
arXiv:2608.14740v2 Announce Type: replace Abstract: Unified image and video creation requires a model to follow diverse instructions while preserving identity, geometry, and temporal structure from v...