arXiv Computer Vision

CommerceVibe: Learning to Design E-Commerce Creatives as Executable Visual Code via Dual-Feedback Reinforcement Learning

CommerceVibe is a system that generates e‑commerce creatives by synthesizing executable HTML/CSS code conditioned on product images, design requirements, and product information. It uses dual‑feedback reinforcement learning, combining rule‑based checks for text readability, product visibility, and layout validity with visual feedback from a vision‑language model that evaluates perceptual and commercial aspects. After fine‑tuning a large language model on 28,000 examples and applying dual‑feedback reinforcement learning, CommerceVibe achieves a weighted score of 94.0/100 on a 1,300‑case benchmark, outperforming both its SFT‑only counterpart and external models, and is validated by expert blind evaluations.

Hugging Face Trending Papers
Aug 17

TransAnyText: Translating Arbitrary Text in E-commerce Images via Structured Visual Generation

Cross-border e-commerce image translation is essential for global retail, where product images, banners, and detail pages need to be produced in different languages. Existing methods struggle to achieve accurate translation, faithful visual identity preservation, and easy-to-edit outputs, simultaneously.

arXiv Computer Vision
Sep 23

KwaiMind Technical Report

KwaiMind is a commercial image editing system that combines general editing capabilities with e-commerce specialization. It uses an agent-based data engine with 1.8 million editing pairs and a multimodal diffusion transformer trained through pre‑training, fine‑tuning, preference optimization, and online reinforcement learning. The system is guided by a vision‑language judge and specialized rewards for click‑through rate, text rendering, and product consistency, and it achieves top scores on ImgEdit, GEdit, REDEdit, and the new Ecom‑Bench, while improving predicted and actual CTR in offline and online experiments.

By Junlong Wu, Zijun Li, Yuting Hu, Jia Sun, Pengcheng Wei, Yimin Zhou, Honglie Wang, Huaiqing Wang, Dewen Fan, Fei Zuo, Haixuan Gao, Lihui Peng, Tingxuan She, Yuqing Li, Boheng Zhang, Fan Yang, Wenwu Ou
arXiv Computer Vision
Aug 21

PosterText: Towards Unified Visual Text Generation and Editing for E-commerce Poster

arXiv:2608. 16289v3 Announce Type: replace Abstract: Automated e-commerce poster design requires both high-quality poster generation and flexible editing of existing designs.

By Xiaoan Liu, Lichen Ma, Zipeng Guo, Yu He, Xiaoyan Su, Shaojie Guo, Jingling Fu, Xiaolong Fu, Hao Yang, Tongxuan Liu, Yu Guo, Fei Wang, Xinyi Liu, Yongjun Zhang, Junshi Huang
arXiv Computation and Language
Sep 4

Editable Visual Design

Editable Visual Design introduces a new design paradigm that combines a Coding Agent with a Vision‑Language Model (VLM) and an image generation model. The VLM acts as the creative brain, understanding requirements, planning tasks, and judging aesthetics, while the image generator produces isolated visual assets on demand. The agent follows an "imagine first, then act" workflow, generating assets, writing native HTML/CSS, and refining the design through visual feedback, ultimately producing editable, layer‑wise artifacts with real text that can be adjusted via a graphical interface.

By Junyan Ye, Wei Liu, Dongzhi Jiang, Zichen Wen, HaoDong Li, Zhutao Lv, Jiaxin Lin, Jinhua Yu, Jun He, Zilong Huang, Rui Chen, Weijia Li
arXiv AI
Jul 17

CatalogAgent: A Supervisor-mediated Self-Learning System Enabling Context Engineering for GenAI Models

arXiv:2607. 14396v1 Announce Type: new Abstract: Product catalogs are the backbone of e-commerce sites, yet a large number of structured attributes (SAs) -- such as material, color, and shape -- often have missing values.

By Zhu Cheng (Xuan), Zhenming Wang (Xuan), Yu (Xuan), Tang, Dan Liu, Bryan Zhang, Athanasios N. Nikolakopoulos, Pranav Souri Itabada, Jing Zhang, Chih-Chi Chou, Peng Gao, Fatemeh Mansoori, Bharat Bojja, Sarath Chander, Sameer Thombare, Umit Batur, Tarik Arici
arXiv Computer Vision
Aug 21

TextRefine: Improving Textual Fidelity, Spatial Placement, and Glyph Rendering for Text Editing in Product Posters

arXiv:2608. 19637v1 Announce Type: new Abstract: Text editing in product posters entails inserting new text or replacing existing text while preserving product appearance, background content, and global composition.

By Honglie Wang, Jia Sun, Zijun Li, Junlong Wu, Pengcheng Wei, Jiyuan Wang, Yongrui Heng, Boheng Zhang, Huaiqing Wang, Dewen Fan, Qianqian Gan, Fan Yang, Tingting Gao, Yan-Ming Zhang
arXiv Computer Vision
2d ago

Back2Struct: Making Structured Images Editable Again

Back2Struct is a system that converts structured images—such as diagrams, charts, and flowcharts—into editable vector graphics code (SVG/XML). By predicting semantically rich, object-level SVG code rather than low-level pixel vectorization, it allows the generated graphics to be imported into tools like PowerPoint for easy editing, restyling, and reuse. The model is trained with supervised fine‑tuning and reward‑based learning that enforces syntactic validity, concise length, and visual fidelity to the input, leading to higher accuracy, editability, and user alignment compared to baselines.

By Pengyu Yan, Yixin Wu, Yunjie Tian, David Doermann