arXiv Computer Vision
Oct 9

From Video Clips to Creation Trajectory: Sora100K for AI-Native Video Creation

The paper introduces Sora100K, a dataset that captures AI‑Native video creation workflows as structured trajectories rather than isolated clips. It categorizes trajectories into text‑to‑video generation roots, single‑turn editing edges, and multi‑turn editing sequences, annotating each with semantic and operation labels via a VLM. A rigorous construction pipeline ensures accurate source‑to‑edit lineage and intermediate states, and lightweight adaptation on LTX‑2 models demonstrates improved visual quality, multi‑shot generation, and cross‑shot consistency, though multi‑turn editing remains challenging.

By Sicong Yang, Ruihuan Yang, Jian Lu, Jianfei Yuan, Xiaodong Cun, Xiuli Bi