arXiv Computer Vision

Generating HDR Video from SDR Video

The paper presents a framework for converting standard dynamic range (SDR) videos into high dynamic range (HDR) videos using large-scale generative video models. It introduces a Multi-Exposure Video Model (MEVM) that predicts exposure-bracketed linear SDR sequences from a single nonlinear SDR input, and a Video Merging Model (VMM) that fuses these predictions into a high-quality HDR sequence while preserving detail in shadows and highlights. Experiments, qualitative evaluation, and a user study demonstrate robust HDR conversion for casual consumer footage and iconic films, and the approach can be integrated into existing SDR generative video pipelines.

arXiv AI
Sep 2

DiffHDR: Re-Exposing LDR Videos with Video Diffusion Models

arXiv:2604.06161v3 Announce Type: replace-cross Abstract: Most digital videos are stored in 8-bit low dynamic range (LDR) formats, where much of the original high dynamic range (HDR) scene radiance i...

By Zhengming Yu, Li Ma, Mingming He, Leo Isikdogan, Yuancheng Xu, Dmitriy Smirnov, Pablo Salamanca, Dao Mi, Pablo Delgado, Ning Yu, Julien Philip, Xin Li, Wenping Wang, Paul Debevec
arXiv Computer Vision
5d ago

Recurrent Dynamic Range Extension

The paper introduces a method for progressively extending the dynamic range of an image by learning to increase it by a single exposure value first, then applying the network recurrently to achieve full HDR reconstruction. The approach is agnostic to input dynamic range, targets a bounded output domain, and utilizes RAW images with adversarial losses to produce realistic results. Memory Replay during backpropagation allows training over multiple inference stages, reducing reconstruction errors and enabling robust recovery of bright highlights in long‑tailed HDR scenes.

By Sebastian Dille, Keru Fu, S. Mahdi H. Miangoleh, Ya\u{g}{\i}z Aksoy
arXiv Computer Vision
Sep 11

InstantHDR: Single-forward Gaussian Splatting Initialization for HDR 3D Reconstruction

InstantHDR is a feed-forward network that initializes high dynamic range (HDR) 3D scenes from uncalibrated multi-exposure low dynamic range (LDR) image collections in a single forward pass. It uses geometry-guided appearance modeling for multi-exposure fusion and a meta-network for scene-specific tone mapping. The authors also created a pre-training dataset, HDR-Pretrain, with 168 Blender-rendered scenes to support generalizable HDR models, achieving a speedup of about 700× over state‑of‑the‑art optimization methods while maintaining comparable quality after lightweight post‑optimization.

By Dingqiang Ye, Jiacong Xu, Jianglu Ping, Yuxiang Guo, Chao Fan, Vishal M. Patel
arXiv Machine Learning
Jun 9

MilliVid: Hierarchical Latents for Long-Range Consistency in Video Generation

arXiv:2606. 09056v1 Announce Type: cross Abstract: Video generative models have become increasingly powerful, but long-range consistency remains challenging to achieve because even a few dozen frames require impractically long transformer sequence lengths.

By Ishaan Preetam Chandratreya, David Charatan, Basile Van Hoorick, Sergey Zakharov, Vitor Guizilini, Phillip Isola, Vincent Sitzmann
arXiv AI
Jul 24

RealVDeblur: One-Step Diffusion for Generalizable Real-World Video Deblurring

arXiv:2607. 20628v1 Announce Type: cross Abstract: Real-world video deblurring remains challenging due to diverse motion patterns, complex degradations, and the scarcity of realistic training data, yet robust restoration is critical for downstream pipelines such as mobile imaging and 3D reconstruction.

By Renbiao Jin, Mingxin Yang, Yutian Chen, Junhao Zhuang, Xin Cai, Mulin Yu, Linning Xu, Wenxian Yu, Danping Zou, Shi Guo, Tianfan Xue
arXiv Computer Vision
Aug 26

Layer-Aware Video Composition via Split-then-Merge

The paper introduces Split-then-Merge (StM), a new framework for generative video composition that improves control and tackles data scarcity. StM divides a large set of unlabeled videos into dynamic foreground and background layers, then self‑composes them to learn how subjects interact with varied scenes. The method employs a transformation‑aware training pipeline with multi‑layer fusion, augmentation, and an identity‑preservation loss, achieving superior performance over state‑of‑the‑art methods in both quantitative and qualitative evaluations.

By Ozgur Kara, Yujia Chen, Ming-Hsuan Yang, James M. Rehg, Wen-Sheng Chu, Du Tran