Swift-Image is a compact unified model that performs text-to-image generation, single-image editing, and multi-image editing using a 6B parameter DiT architecture. It employs a progressive training pipeline, parallel expert reinforcement learning, and multi-teacher distillation to balance diverse objectives, while a Prompt Enhancer decouples high-level reasoning from pixel-level rendering. After training, structural pruning and few-step distillation produce efficient 3B and accelerated variants that maintain near‑lossless performance and improve editing efficiency.
By Taihang Hu, Zhao Wang, Zuan Gao, Tao Liu, Hao Yan, Zhengze Xu, Yuhang Yu, Yongchao Du, Xingjian Wang, Jun Zheng, Qinye Zhou, Yaqi Cai, Zhengrui Chen, Chao Lin, Yefeng Shen, Yuan Wang, Zhengtao Wu, Ge Wu, Xiaoli Xu, Denghui Yang, Huayu Zhang, Mingzhou Zhang, Mengting Chen
PixelBench is a benchmark that evaluates large language models on their ability to generate and understand images pixel by pixel, without relying on learned image tokenizers or decoders. The benchmark includes text-to-pixel (T2P) and image-to-pixel (I2P) generation tasks across multiple resolutions, as well as a pixel-understanding evaluation. Models produce an RGB palette followed by a grid of indices that map each pixel to a palette color, and the study shows that strong models can generate recognizable images from text and outperform specialized pixelization algorithms at low resolutions, with performance correlating with pixel-understanding ability and improving up to a point before declining at high resolutions. Additionally, Pixel Reconstruction Tuning (PRT) augments visual instruction tuning with caption‑palette‑grid trajectories, and post‑training Molmo2‑4B with PRT data improves performance on 16 visual‑centric benchmarks, demonstrating the utility of explicit pixel reconstruction as auxiliary supervision.
By Haoquan Zhang, Feiyang Liu, Juanxi Tian, Wanhua Li, Haodong Duan, Weiyang Liu
arXiv:2608. 20334v1 Announce Type: new Abstract: We present Swift-Image, a compact unified model for text-to-image generation, single-image editing, and multi-image editing.
By Taihang Hu, Zhao Wang, Zuan Gao, Tao Liu, Hao Yan, Zhengze Xu, Yuhang Yu, Yongchao Du, Xingjian Wang, Jun Zheng, Qinye Zhou, Zhengrui Chen, Chao Lin, Yefeng Shen, Zhengtao Wu, Ge Wu, Xiaoli Xu, Denghui Yang, Huayu Zhang, Mingzhou Zhang, Mengting Chen
arXiv:2607. 00371v1 Announce Type: cross Abstract: Visual AutoRegressive modeling (VAR) has pioneered a coarse-to-fine multi-scale autoregressive generative paradigm, demonstrating strong capabilities in image generation.
By Nuoyan Zhou, Zhijun Tu, Lei Yu, Kun Cheng, Jie Hu, Nannan Wang, Xinghao Chen
UVU is a vision-language unified autoregressive framework that integrates visual supervision directly into the pre-training stage of multimodal large language models. By using continuous visual encoding and a large-scale iterative hierarchical clustering algorithm to build a pixel-level visual codebook, UVU enables lossless representation of visual inputs and autoregressive generation of pixel-level image tokens alongside textual tokens. This approach synergizes pixel-level visual perception with semantic-level visual understanding, allowing models to internalize visual reconstruction capabilities and improve multimodal understanding performance.
By Zhehan Kan, Xinghua Jiang, Yubo Zhu, Yanlin Liu, Xiaochen Yang, Zhixiang Wei, Shifeng Liu, Qingmin Liao, Wenming Yang, Xin Li, Yinsong Liu, Deqiang Jiang, Xing Sun
arXiv:2609.01147v1 Announce Type: cross
Abstract: Text-rich visual inputs require models that can read, retrieve, and compress language directly in pixel space, yet existing pixel-text encoders strug...
By Chaohao Yuan, Ruifeng Yuan, Zhuoxu Huang, Yu Rong, Hong Cheng, Hou Pong Chan, Chenghao Xiao