Hugging Face Trending Papers

Hybrid Cinematography: Previsualizing and Managing Hallucination Risk in Generative Video Reshooting

Hybrid Cinematography is a workflow that blends physical camera capture with generative video reshooting to control hallucination risk. It uses an editable 3D shot plan and a proxy of the take to evaluate hallucination risk in real time, allowing filmmakers to adjust plans, shoot guided pickups, or accept hallucinations. The approach is demonstrated via a mobile AR app for on‑set planning and an offline pipeline for existing footage, and a study shows how risk previsualization informs camera decisions and highlights tensions between creative intent and generative hallucination.

arXiv Computer Vision
Oct 9

Hybrid Cinematography: Previsualizing and Managing Hallucination Risk in Generative Video Reshooting

Hybrid Cinematography is a workflow that combines physical capture with generative video reshooting to manage hallucination risk. It uses an editable 3D shot plan and a proxy of the take to evaluate hallucination risk in real time, allowing filmmakers to adjust plans, shoot guided pickups, or accept hallucination. The approach is demonstrated through a mobile AR app for on‑set planning and an offline pipeline for existing video, and a study with experienced filmmakers shows how risk previsualization informs camera decisions and highlights tensions between creative intent and generative hallucination.

By Nhan (Nathan), Tran, Neal Wadhwa, Abe Davis, Stefan Stojanov
arXiv Computer Vision
Oct 23

FilmFlow: Agentic System for 3D Virtual Film Cinematography

FilmFlow is an agentic framework that transforms natural‑language instructions or reference videos into explicit camera trajectories for dynamic 3D environments. It uses a Director agent that composes high‑level motions from concurrent atomic operations, supported by Interpreter, Scout, and Critic agents for intent extraction, viewpoint selection, and iterative refinement. The authors also introduce CinemaBench, a benchmark of 150 Blender scenes with 750 text‑directed tasks and 60 video‑reference tasks, where FilmFlow outperforms baselines and receives the highest user preference.

By Yiming Zhang, Jiarui Guo, Haojia Wei, Yifei Liu, Yifan Yang, Hongjie Zhang, Xue Yang, Zhihang Zhong
arXiv AI
Oct 2

Generative Cinematographer: Composing Camera and Object Motion in 3D

Generative Cinematographer (GenCine) lifts a single image into an editable 3D scene scaffold, allowing artists to jointly author camera paths and foreground motion using local 3D motion handles. The system projects these controls into guidance maps that encode handle positions and colors across frames, enabling a pretrained video model to follow camera-relative, piecewise-rigid motion without physics simulation. Training recovers controls from real videos and synthetic ground-truth geometry, and experiments demonstrate consistent camera-relative motion, improved geometric consistency, and strong controllability across diverse real-world scenes.

By Jiahan Zhang, Chaohao Yang, Namitha Guruprasad, Vivekjyoti Banerjee, Trong-Tung Nguyen, Alan Yuille, Anand Bhattad
arXiv Computer Vision
Sep 7

An Evaluation Framework for Generating Multi-View Images of a Person in a Scene

The paper introduces a framework for generating multi‑view images of a person within a natural scene, addressing the scarcity of paired multi‑view datasets for human subjects. It evaluates existing diffusion‑based image‑editing models and finds they often hallucinate head‑turn angles, leading to inconsistent backgrounds. To overcome this, the authors propose the Head Scene Rotation Difference (HSRD) metric, which separates camera movement from head pose changes and enables reliable assessment of 3D spatial parallax for constructing high‑quality synthetic datasets.

By Mahir Majid, Young Kyung Kim, Guillermo Sapiro
arXiv Computer Vision
Sep 28

Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generation

Auteur is a language‑driven method that generates human‑centric camera framing for generative video models. It treats shots as framings relative to an actor, encoding shot size, angle, and composition as functions of human pose and motion, and uses a domain‑specific language that converts to standard 6‑DoF camera parameters. A fine‑tuned multimodal large language model acts as a virtual director, mapping natural language descriptions and coarse human motion to sparse DSL keyframes that are interpolated into continuous camera trajectories for video generation.

By Muhammed Burak Kizil, Enes Sanli, Niloy J. Mitra, Xuelin Chen, Erkut Erdem, Aykut Erdem, Duygu Ceylan
arXiv Computer Vision
Sep 11

CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation

CamPilot is a multi‑agent cinematic assistant that combines cinematographic planning with camera‑work control to generate more coherent and aesthetically pleasing movies from text prompts. It learns camera‑work planning from 14,000 professional films using a GRPO‑based learning paradigm, capturing motion patterns, composition principles, and cross‑shot relationships. The system is evaluated with a new benchmark, CamEval, and outperforms existing text‑to‑movie methods in cinematographic control and quality.

By Yang Wu, Stefano Petrangeli, Ishita Dasgupta, Yu Shen