arXiv Computer Vision

Not Just a Subject: Capturing Adaptive Scene-Specific Variance for Visual Storytelling

EOS-Story is a training‑free framework that improves visual storytelling by balancing identity consistency with scene‑specific adaptation. It separates narrative prompts into identity and scene sub‑prompts and introduces Cross‑Contextual Bridging to inject appearance cues into the scene embedding. In the vision space, Adaptive Identity Preservation aligns identity features to the scene scale and uses Identity‑Aware Self‑Attention to avoid structural artifacts, achieving competitive results on the extended Consistory+ benchmark.

Hugging Face Trending Papers
3d ago

Not Just a Subject: Capturing Adaptive Scene-Specific Variance for Visual Storytelling

EOS-Story is a training‑free framework that improves visual storytelling by balancing identity consistency with scene‑specific adaptation. It separates narrative prompts into identity and scene sub‑prompts, then uses Cross‑Contextual Bridging to inject appearance cues into the scene embedding. In the vision space, Adaptive Identity Preservation aligns identity features to the scene scale and employs Identity‑Aware Self‑Attention to avoid structural artifacts, achieving strong results on the Consistory+_+ benchmark.

arXiv AI
Jul 8

Prompt-Adapter Context Routing for Parameter-Efficient Multi-Shot Long Video Extrapolation

arXiv:2607. 06481v1 Announce Type: cross Abstract: We present PACR-Video, a parameter-efficient framework for multi-shot long video extrapolation that preserves recurring entities, scene structure, visual style, and causal progression without full generator fine-tuning.

By Anna C\'ordoba, Adam Puente Tercero, Nerea Angulo Hijo, Mar Linares Tercero, Julia Barrientos, Ainhoa Miranda, Jes\'us Olivera
arXiv Computer Vision
Aug 28

Sidecar: Training-Free Semantic Reuse for Character-Consistent Free-form Visual Storytelling

Sidecar is a plug‑and‑play semantic augmentation module that preserves entity‑level information from a character’s initial description and injects missing semantics into later prompt embeddings, enabling training‑free character consistency in free‑form visual storytelling. It works with existing diffusion models without architectural changes and incurs negligible computational overhead. Experiments on FreeStoryBench demonstrate consistent improvements in prompt‑image alignment and character consistency across SDXL and FLUX baselines.

By Sibo Dong, Sarah Adel Bargal
arXiv Computation and Language
Aug 28

Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models

Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models introduces the VIG‑Sampler, a method that prioritizes tokens for decoding based on their attention to image tokens and penalizes redundancy in image‑attention distributions. The approach aims to improve the quality of multimodal generation by selecting more informative tokens during diffusion decoding. Experiments on seven captioning and VQA benchmarks with three open‑source dMLLMs show that VIG‑Sampler outperforms the Info‑Gain Sampler by an average of 19.3 CIDEr points and achieves better COCO Caption results using only half as many decoding steps.

By Insu Lee, Wooje Park, Wonseok Shin, Jinwoo Son, Byonghyo Shim