Hugging Face Trending Papers

TailSteer: Trajectory-Tail Steering for Drift-Resistant Multi-turn Image Editing

arXiv AI
1d ago

TailSteer: Trajectory-Tail Steering for Drift-Resistant Multi-turn Image Editing

TailSteer is a final-stage training framework designed to improve multi-turn robustness in image editing while preserving the generative and editing capabilities of foundation models. It keeps early denoising dynamics similar to the base model and applies preservation corrections near the trajectory tail, learning from the editor’s own on-policy denoising rollouts without curated ground-truth pairs. Experiments on FLUX, SenseNova, and Qwen families show that TailSteer significantly reduces cumulative drift over 15–20 editing turns while largely maintaining base-model performance on extensive text-to-image and single-image editing benchmarks.

By Ruikang Li, Zixuan Chen, Jiarui Wu, Mingde Yao, Yiyuan Zhang, Yujin Wang, Hanming Deng, Lewei Lu, Tianfan Xue
arXiv AI
Oct 16

ACEdit: Stable Multi-Turn Image Editing via Asymmetric Conditioning

ACEdit introduces a training scheme that stabilizes multi-turn image editing by forcing the editor to operate on its own previous outputs, a concept called Self-Forcing. To overcome unreliable supervision from self-generated trajectories, the method employs a distillation objective using a teacher editor that remains anchored to the original image while receiving compound instructions. Experiments demonstrate reduced degradation over long editing sequences while preserving quality and instruction adherence.

By Sara Dorfman, Nir Goren, Gal Barak, Daniel Cohen-Or, Or Patashnik
arXiv Computer Vision
Oct 19

MTEdit: Packed Trajectories Beat Rollouts for Multi-Turn Image Editing

MTEdit is a new multi‑turn image editing dataset that uses packed trajectory canvas (PTC) generation to create 500K editing trajectories, each up to eight turns with an average of 5.38 turns. The dataset addresses visual‑quality drift by jointly generating multiple editing states within a unified visual context, covering both step‑wise and context‑aware editing scenarios. MTEdit-Bench evaluates models on instruction following, content consistency, visual‑quality drift resistance, and historical context usage, and fine‑tuned Qwen‑Image‑MTEdit outperforms other open‑source models on this benchmark.

By Houyuan Chen, Fanzhou Wang, Xiangyu Fan, Songlin Yang, Zhitao Yang, Lvmin Zhang, Pei Yang, Hao Zhao, Lei Yang, Anyi Rao
arXiv Computer Vision
Oct 22

MT Forcing: Towards Stable and Consistent Multi-Turn Image Editing with Autoregressive Diffusion

MT Forcing introduces a training paradigm for multi‑turn image editing with unified multimodal models based on autoregressive diffusion. It combines Single‑Turn Distribution Matching Distillation, which guides student rollouts with a teacher that applies all edits in one step, and Teacher‑Forcing Guidance, which supervises history‑dependent transitions to promote cross‑turn consistency. Experiments show the method yields more stable visual quality and stronger consistency across editing turns.

By Houyuan Chen, Fanzhou Wang, Xiangyu Fan, Zesong Qiu, Yukun Wei, Songlin Yang, Zhitao Yang, Lvmin Zhang, Pei Yang, Hao Zhao, Dahua Lin, Lei Yang, Anyi Rao
arXiv Computer Vision
Oct 23

One Evaluation Is Enough: Inversion-Free Image Editing with Trajectory Correction

The paper introduces Endpoint‑Calibrated Transport (ECT), a closed‑form, training‑free image editor that performs inversion‑free editing with a single temporal field evaluation. ECT leverages a duality in variance‑preserving one‑step models to compute a local angular semantic tangent and a clean endpoint displacement from one source‑target query at a shared noisy state. By integrating the tangent over the remaining VP angle and correcting the extrapolation with the endpoint displacement, ECT requires only one noise level, two text conditions in one denoiser batch, and a single latent update, achieving stable quality gains in very short editing time.

By Lifan Jiang, Taiyang Chen, Senlin cheng, Bolei Xu, Xiaobo Li, Can Ye, Dehai Zhao, Deng Cai, Boxi Wu
arXiv Computer Vision
Sep 21

Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing

Edit‑VAR is a training‑free, inversion‑free framework that uses a pretrained visual autoregressive video model for text‑guided video editing. It encodes the source video into multi‑scale discrete tokens and applies probability‑guided conditional token replacement, attention‑guided token‑wise and scale‑aware modulation, and scale‑decoupled generation to preserve source appearance while enabling precise edits. The method also includes residual‑guided token pruning to reduce inference cost, and experimental results show it outperforms existing training‑free video editing methods in fidelity, source preservation, temporal coherence, and efficiency.

By Chongbo Zhao, Jiangming Wang, Xilai Wang, Xinyu Wang, Jingyi Tang, Chunjie Hao, Pengjie Song, Yue Ma
Hugging Face Trending Papers
Jun 1

MT-EditFlow: Reinforcement Learning for Multi-Turn Image Editing with Flow Matching

Recent breakthroughs in instruction-based image editing have captured significant attention, as models are now capable of handling real-world editing demands with the practicality required by everyday users. However, editing models trained primarily for single-turn edits often break down in multi-turn editing--the natural interactive setting where a user iteratively refines an image based on the model's own previous outputs.

arXiv Machine Learning
Aug 27

Memory-V2V: Memory-Augmented Video-to-Video Diffusion for Consistent Multi-Turn Editing

Memory-V2V is a memory‑augmented video‑to‑video diffusion framework designed to improve cross‑turn consistency in multi‑turn video editing. It stores previous outputs in an external memory, retrieves relevant edits, and incorporates them via relevance‑aware tokenization and adaptive compression, allowing scalable conditioning without linear computational growth. Experiments on iterative video novel view synthesis and text‑guided long video editing show that Memory‑V2V enhances consistency while preserving visual quality and outperforming strong baselines with modest overhead.

By Dohun Lee, Chun-Hao Paul Huang, Xuelin Chen, Jong Chul Ye, Duygu Ceylan, Hyeonho Jeong
arXiv Computer Vision
Oct 19

PreciseEdit: Strong Yet Stable Semantic Transport for One-Step Image Editing

PreciseEdit is a new one‑step image editing framework that improves semantic transport by applying strong target‑directed changes only along reliable directions and spatial locations. It is model‑agnostic, training‑free, and inversion‑free, and uses a dual‑noise‑scale strategy to balance strong editing with background fidelity and structural consistency. Experiments on PIE‑Bench show that PreciseEdit outperforms existing methods across a range of editing tasks.

By Jingyi Wang, Xiao Lu