PACE: Precise AI Cinematic Expression
arXiv:2609.19853v2 Announce Type: replace-cross Abstract: Between a screenplay and a film sits a planning problem that is spatial first: who stands where, and what a camera sees from where it stands....
arXiv:2609.19853v2 Announce Type: replace-cross Abstract: Between a screenplay and a film sits a planning problem that is spatial first: who stands where, and what a camera sees from where it stands....
CALIPER is a new benchmark that tests whether pretrained visual encoders can infer physical properties such as mass and friction from images. The test involves striking an object twice at known speeds, showing a third strike only up to contact, and asking a linear readout on frozen features to predict how far the object slides. Results show that in clean, fixed‑camera scenes all representations perform similarly, but when camera, lighting, and clutter are varied, only encoders that truly infer physics—like V‑JEPA 2—maintain performance, while random or raw pixel representations fail.
PACE (Precise AI Cinematic Expression) is a typed specification that captures a film’s spatial plan—screenplay evidence, characters, props, locations, and camera actions—at script, scene, shot, or panel levels, with inheritance to lower levels. A compiler transforms this plan into prompts for diffusion models and a metrically accurate 3D scene, while a camera solver ensures the declared framing is achieved. Evaluation on the Automatic Drive screenplay and 204 external shots shows high positional accuracy and improved action capture when poses are declared, though transitions and motion remain future work.
The paper introduces a counterfactual benchmark to evaluate whether vision models understand physical constraints or merely learn rendering shortcuts. Using Mitsuba 3, it generates 5,500 synthetic images across 500 scene families, each with a clean image and ten violations (shadows, reflections, support, surface response, occlusion). Diagnostic baselines (LLaVA‑1.5‑7B, Qwen2.5‑VL‑7B, InternVL3.5‑8B) achieve 64.0–67.8 % macro‑F1 on a held‑out synthetic test set, but performance drops to 40.8 % for LLaVA‑1.5‑7B under an intervention shift, indicating reliance on rendering cues rather than true physical reasoning.
The paper challenges the common assumption that figurative paintings represent a single, recoverable 3D scene. It introduces the concept of multi-solutionness, highlighting how unobserved content and ambiguous visual cues allow multiple plausible 3D configurations. The authors present a workflow that generates multiple camera-orbit video sequences from a single painting, reconstructs each with 3D Gaussian Splatting, and fabricates the resulting point-based Gaussian scenes as physical artifacts via DreamPrinting, thereby making the non-uniqueness of interpretations explicit and inspectable.
arXiv:2609.17450v1 Announce Type: new Abstract: Novel-view synthesis from a single image is a fundamentally ambiguous problem. As the camera moves away from the input viewpoint, previously hidden reg...
arXiv:2610.09344v1 Announce Type: new Abstract: General image editors are asked to make a photo look as if it were taken at f/1.4, yet it is rarely checked whether the blur they add follows thin-lens...
arXiv:2611.02433v2 Announce Type: replace Abstract: Engineering drawings specify mechanical parts through orthographic projections. Recognizing which part a drawing depicts underlies part search, des...
The paper argues that apparent capability limits in vision‑language benchmarks often stem from the way answers are presented rather than from the models themselves. By comparing performance on COCO images with answer choices given as English names versus pixel coordinates, the authors show that models like Qwen3‑VL‑4B perform far better when answers are in natural language, and that the choice of answer format can swing model rankings by dozens of points. The study also demonstrates that different conventions (e.g., hue angles vs. pixel coordinates) reveal which formats a model can actually interpret, highlighting that a fixed answer vocabulary is not neutral across models.
The paper introduces View‑Consistent Panoptic Quality (VC‑PQ), a new metric for evaluating multi‑view panoptic segmentation that treats each visible view equally and penalizes inconsistencies between predicted and ground‑truth visibility. VC‑PQ extends the traditional per‑scene PQ by decomposing the score into mask accuracy, view consistency, and matching threshold, and includes a parameter to recover area weighting for comparison. Experiments on ScanNet++ and ScanNetv2 show that VC‑PQ better reflects missed detections or ID changes across views than the conventional PQ^scene metric.
arXiv:2608.21008v1 Announce Type: new Abstract: Mobile AR frameworks attach a metric pose prior to every casual phone capture, and turning it into reconstruction-grade poses cheaply on CPU is the ste...
arXiv:2608.21402v1 Announce Type: cross Abstract: World action models (WAMs) jointly denoise future video frames and robot actions, and the video prior is expected to generalize their control. Camera...