Anchoring and Rescaling Attention for Semantically Coherent Inbetweening
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
arXiv:2609.00505v1 Announce Type: new Abstract: Video-text models adapted from image-text architectures (e.g., CLIP) frequently exhibit temporal blindness, the inability to perceive fundamental cues...
The paper introduces ELMA, a new episodic long‑term motion dataset designed to benchmark anaphoric compositions in text‑to‑motion generation. ELMA contains densely annotated 30‑second clips extracted from in‑the‑wild videos, preserving cross‑segment dependencies that current models struggle to handle. Fine‑tuning state‑of‑the‑art models on ELMA improves both global physical realism and semantic alignment, establishing a robust baseline for long‑term motion synthesis.
Video-text models adapted from image-text architectures (e.g., CLIP) frequently exhibit temporal blindness, the inability to perceive fundamental cues like order, direction, and motion dynamics. Stand...
arXiv:2607. 13421v1 Announce Type: cross Abstract: Spatio-Temporal Video Grounding (STVG) aims to retrieve the visual trajectory of a specific object from a video stream as described by a natural language expression.
TKCAM is a new framework for generating controllable camera motion conditioned on text and sparse keyframes, using a 12‑dimensional kinematic representation and a two‑stage masked transformer with residual vector quantization. It allows users to provide free‑form text prompts and RGB observations at selected timestamps, enabling temporally localized visual guidance for coherent trajectory synthesis. The authors also introduce the RealEstate10K‑Cap dataset and a Universal CLaTr Evaluator, showing that TKCAM outperforms recent baselines on FID, text‑motion matching, and retrieval metrics.
Generating high-quality and controllable camera motion is essential for AI-assisted cinematography, video synthesis, and 3D scene understanding. We introduce TKCAM, a Text- and Keyframe-conditioned CA...