Clips2Story: Training-Free Video Storyboarding and Editing Using Multimodal Retrieval-Embedded Generation

Clips2Story is a training‑free, LLM‑based pipeline that lets users generate short videos from a pool of clips by specifying a keyword. It first extracts multimodal descriptors from each clip, retrieves the most relevant ones, and then uses an LLM to select, arrange, and narrate them into an editable storyboard. The final video is assembled by combining the chosen clips with visuals that match the narration. Evaluation on a synthetic dataset of shuffled clips from 100 long‑form videos shows that Clips2Story achieves better narrative coherence, keyword alignment, and realism than a strong baseline.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• llms
• nlp
• multimodal
• safety