HimmBO is a two‑stage method for preference‑driven merging of large collections of lightweight adapters used to fine‑tune text‑to‑image models. The first stage screens adapters via level‑set estimation on pre‑generated images, avoiding costly image generation, while the second stage optimizes merge coefficients in the reduced subspace using a style‑aware kernel. Experiments show HimmBO attains higher similarity with far fewer image generations than prior methods and scales robustly to collections of up to 1,080 adapters.
arXiv:2610.09015v1 Announce Type: new
Abstract: Diffusion models can generate high-quality images, yet aligning their outputs with individual user preferences remains challenging. A key bottleneck is...
By Jiamu Bai, Jiaming Hu, Yanhong Wu, Zellux Wang
Reference-based diffusion models enable highly controllable image generation by leveraging elements from input images to guide prompt-driven synthesis. However, these models are computationally expensive in runtime, and their cost scales severely with the number of input references.
Modern black-box Image-to-Video (I2V) models offer powerful capabilities in automated content creation, yet their lack of fine-grained control and reliability presents significant challenges in professional workflows. Their inherent stochasticity causes minor variations in textual prompts or hyperparameters to yield drastically different outputs often necessitating inefficient, brute-force trial-and-error processes.
The paper introduces InterIL, a joint generative model that simultaneously produces a background image and a layout of foreground elements for graphic design templates, addressing the limitations of sequential generation approaches. InterIL connects pretrained image and layout diffusion backbones via a learnable communication module, freezing the backbones to preserve prior knowledge while training only the interaction module. The model also offers a test‑time guidance strategy, enabling users to impose preferences without retraining, and demonstrates superior image, layout, and harmonization quality compared to previous methods.
By Shirong Yang, Bo Yang, Ying Cao
EditJev is a System One routing model that selects the best image editing model from a candidate pool for a given image and instruction. It predicts sample-level preference scores in a single forward pass using a lightweight head on a vision‑language backbone, avoiding autoregressive generation or parsing. By combining these scores with model speed metrics, EditJev improves overall editing quality while cutting end‑to‑end latency by up to 60.8%.
By Zhile Guan, Xu Jiang, Yule Duan, Gongbo Zhang, Shuyu Wang, Xiao Chen, Jian Zhang