arXiv Computer Vision

Semantic-Structural Alignment for Generative Pictorial Charts

arXiv Machine Learning
Aug 28

Chart2SVG: Editable SVG Generation from Raster Chart Images

Chart2SVG is a multimodal large language model that transforms static raster chart images into editable SVGs enriched with semantic structure. By embedding chart‑specific semantic tokens into a vision‑language framework and training on the Beagle+ dataset of 33K distilled chart samples, the model captures both geometric primitives and their functional roles. The resulting SVGs are visually accurate and structurally consistent, and the accompanying Chart Structure Graph (CSG) exposes visual dependencies for interactive exploration, chart repurposing, and layout reuse.

By Jinning Cui, Lu Chen, Haoyan Shi, Yue He, Chenglong Wang, Mengyu Zhou, Weidong Huang, Yunhai Wang
arXiv AI
Sep 17

CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Art

CompArt introduces a new approach to aesthetic alignment in text-to-image generation by using the Principles of Art (PoA) such as Balance, Rhythm, and Emphasis to define explicit compositional constraints. The authors create a large dataset of 80,032 WikiArt images, each annotated with PoA analyses generated by a multimodal LLM, and present ArtDapter, a lightweight adapter that steers a pretrained diffusion model along ten PoA dimensions while preserving semantic fidelity. Experiments demonstrate that CompArt outperforms strong baselines in adhering to PoA controls under a dual evaluation protocol.

By Zhe Jin, Tat-Seng Chua
arXiv AI
Jul 22

Appearance Pointers -- Multimodal Region Control of Diffusion Transformers

arXiv:2607. 19344v1 Announce Type: cross Abstract: Controllable image generation remains challenging for creative professionals, who often require precise regional control over materials, object identities, and spatial arrangements that cannot be reliably achieved through text prompting alone.

By Rahul Sajnani, Yulia Gryaditskaya, Radom\'ir M\v{e}ch, Srinath Sridhar, Matheus Gadelha
arXiv Computer Vision
Oct 16

Text-to-Image Synthesis: A Decade Survey

This survey reviews 490 papers on text‑to‑image synthesis (T2I) over the past decade, covering key model families such as GANs, autoregressive models, and diffusion models. It organizes recent research by problem areas—controllability, personalization, editing, preference alignment, efficiency, safety, and spatial consistency—rather than strictly chronologically. The paper also examines unified multimodal models, datasets, evaluation metrics, and discusses applications, challenges, and future research directions in T2I.

By Nonghai Zhang, Hao Tang
arXiv Computer Vision
Oct 28

Token-to-Token Alignment of Text Embeddings for Semantic Blending

Token-to-Token Alignment of Text Embeddings for Semantic Blending proposes a two‑stage framework that first rephrases text prompts into a shared structured form and then aligns token embeddings across prompts based on semantic similarity. By establishing explicit semantic correspondence between tokens, the method enables smooth, coherent transitions through simple linear interpolation, facilitating image blending and continuous editing. The authors demonstrate that properly aligned text embeddings reveal an implicit continuous semantic structure in text‑to‑image models, allowing semantic control without altering the generative model.

By Saar Huberman, Ron Mokady, Or Patashnik, Daniel Cohen-Or
arXiv Computer Vision
Sep 11

SenseNova-U1.5: Towards Native Unified Visual Intelligence

SenseNova-U1.5 is an 8B‑MoT native unified multimodal model that can understand, reason about, and generate visual content without using an encoder or VAE. It improves visual fidelity and text rendering through spatially coherent patch reconstruction, large‑scale training on curated generation and editing data, and native resolutions up to 4K. Post‑training, specialized experts for visual aesthetics, bilingual text rendering, infographic generation, and image editing are optimized and distilled into a multi‑expert framework, yielding advances in image fidelity, complex composition, multi‑reference editing, and instruction following.

By Haiwen Diao, Jiahao Wang, Chenjing Ding, Hanming Deng, Jiangnan Chen, Ruixi Zhang, Ruohui Wang, Wenwen Tong, Xiangyu Fan, Yubo Wang, Yue Zhu, Yuwei Niu, Zhengqi Bai, Zhiqian Lin, Zhitao Yang, Zhongang Cai, Bo Yang, Chen Feng, Chengguang Lv, Guangjia Liu, Guanlin Wang, Hanyu Zhang, Haojia Yu, Hongcan Xiao, Hongli Wang, Huan Wu, Huaping Zhong, Jian Fang, Jianan Fan, Jiaqi Li, Jiefan Lu, Jing Zuo, Jingcheng Ni, Junxiang Xu, Linjun Dai, Mutian Xu, Peishen Yan, Penghao Wu, Ruijie Mao, Ruisi Wang, Shihao Bai, Shuang Yang, Shuya Yang, Shuyan Zheng, Silei Wu, Siying Li, Tao Chu, Tianbo Zhong, Tongxi Zhou, Weichao Luo, Weichen Fan, Wenhao Jia, Wenjie Gao, Xiangli Kong, Yan Li, Yang Yong, Zimo Wen, Zixuan Qian, Wenxiu Sun, Ruihao Gong, Quan Wang, Lewei Lu, Lei Yang, Ziwei Liu, Dahua Lin
arXiv Computer Vision
Sep 14

Unified Text-Image Generation with Weakness-Targeted Post-Training

The paper introduces a post‑training approach that enables a single inference process to transition from text reasoning to image synthesis, eliminating the need for explicit modality switching. Using the 14B BAGEL model, the authors demonstrate that targeted post‑training data and reward‑weighted training improve multimodal image generation across four independent T2I benchmarks. The study highlights the benefits of joint text‑image generation and strategic data selection for enhancing T2I performance.

By Jiahui Chen, Philippe Hansen-Estruch, Xiaochuang Han, Yushi Hu, Emily Dinan, Amita Kamath, Michal Drozdzal, Reyhane Askari-Hemmat, Luke Zettlemoyer, Marjan Ghazvininejad
arXiv Computer Vision
Sep 15

Diffusion Trajectory Modeling for Semantic Correspondence

Diffusion Trajectory Modeling (DTM) treats the evolving feature maps of diffusion models as temporally structured trajectories rather than static snapshots. By interpreting each spatial patch’s progression across multiple timesteps as a trajectory, DTM captures semantic correspondence cues that prior methods miss. Experiments on SPair-71k, SPair-U, and AP-10K demonstrate that DTM achieves strong performance, highlighting the semantic value embedded in the diffusion process’s temporal axis.

By Yusung Choi
arXiv AI
Sep 16

Text-Driven Artistic Staging: 3D Posing, Lighting, and Camera References from Paintings

The paper presents a method for generating 3D staging—human poses, lighting, and camera setup—directly from affective textual descriptions. It builds a dataset of 11,911 text–staging pairs derived from 2,328 figurative paintings, reconstructing SMPL bodies, estimating illumination, and recovering camera parameters. A flow‑matching transformer is trained to produce variable‑size scenes and multiple staging alternatives, achieving a 32.2% retrieval R@1 on held‑out prompts, outperforming a CLIP‑based baseline.

By Yunge Wen