arXiv Computer Vision

Distribution-Calibrated Candidate Selection for Personalized Text-to-Image Generation

The paper introduces Distribution‑Calibrated Candidate Selection (DCAL), a training‑free sequential selector that evaluates pre‑generated image candidates for personalized text‑to‑image systems. DCAL jointly scores identity, text alignment, and cross‑prompt novelty, outperforming random and identity‑only selectors on several metrics across 30 DreamBooth subjects. The authors also formalize Pareto and perturbation‑stability properties and discuss inference complexity.

Hugging Face Trending Papers
Jul 8

Stage-Aware Adaptation and Distribution Calibration for Subject-Driven Personalized Text-to-Image Generation

Subject-driven personalized text-to-image generation requires a pretrained diffusion model to acquire a specific subject from a few reference images while preserving subject identity, following novel text prompts, and maintaining sample diversity. Existing optimization-based methods instantiate subject adaptation through full fine-tuning, textual embedding optimization, or low-rank parameter updates; PaRa further constrains personalization from the perspective of parameter rank reduction.

arXiv Computer Vision
Oct 12

TextVBench: Evaluating Text Rendering and Preservation in Video Generation

TextVBench is a new benchmark and evaluation framework for assessing how well video generation models render and preserve text. It introduces two tracks—TextVBench‑T2V for prompt‑specified text creation and maintenance, and TextVBench‑Ref2V for preserving text from reference images—using a multi‑target, multi‑instance spatiotemporal correspondence approach. The framework employs target‑conditioned candidate selection, supports multiple OCR regions per target, and separates spatial and temporal fidelity, summarizing results with a length‑weighted harmonic score and detailed diagnostics.

By Ruiqiang Zhang, Hengyi Wang, Chang Liu, Guanjie Wang, Zehua Ma, Weiming Zhang
arXiv AI
Sep 25

From Text Decisions to Pixels: An Study of Jev-Style Visual Choice Model

The paper introduces PixelJev, a native-image decision interface that combines an image, a task instruction, and a runtime candidate set into a structured choice and candidate-conditioned probabilities using small open multimodal models. It unifies recognition and multiple-choice visual question answering via a language-model readout, offering options for frozen inference, language-side adaptation, and held-out calibration. Across seven benchmarks, 64-shot source adaptation significantly boosts Pets accuracy from 60.13% to 92.40%, and the system supports both VQA tasks with frozen inference, while also highlighting areas for improvement such as schema robustness and cross-family transfer.

By Xunlan Zhou, Xianliang Yang, Li Zhao
arXiv AI
Oct 5

Traversing the Satisfaction-Diversity Frontier in Text-to-Image Diffusion

The paper introduces SatisDive, a training‑free inference method that balances reward and diversity in text‑to‑image diffusion by enforcing a reward floor for each image and a diversity cutoff for the batch. By adjusting the reward floor, the method traces a Pareto frontier between worst‑candidate reward and batch diversity. Experiments on Pick‑a‑Pic show that SatisDive consistently outperforms FK steering, improving worst‑candidate reward by up to 0.70 in some settings and Pareto‑dominating FK steering across overlapping DreamSim ranges.

By Kevin Zhai, Siva Rajesh Kasa, Soumya Roy, Sumit Negi, Mubarak Shah
Hugging Face Trending Papers
Aug 14

CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets

Subject-driven image personalization---generating new images that preserve the identity of one or several reference subjects in novel scenes---is a foundational capability for modern visual content creation. It is currently dominated by generalized methods that fine-tune a pretrained multimodal diffusion transformer (MMDiT) on hundreds of thousands to millions of paired \emph{(reference, composed-target)} examples, where each composed target is a synthesized image of the subject in a novel scene.

arXiv AI
Aug 26

OmniJudge or OmniBias? Diagnosing Multimodal Judges through Balanced, Decoupled Lenses

The paper introduces D3-Omni, a balanced and decoupled benchmark designed to diagnose fine‑grained multimodal understanding in OmniJudges that evaluate text‑to‑image, text‑to‑video, and text‑to‑speech generation. D3-Omni covers 53 orthogonal binary dimensions across 10,671 samples, using fixed positive seeds and controlled prompt rewriting to generate negatives, thereby ensuring each error can be attributed to a single capability. The benchmark’s dual‑balanced, decoupled, and dynamic design achieves near 1:1 per‑dimension parity and a uniform total‑score distribution, revealing that strong OmniJudges often miss modality‑related failures and treat distinct attributes as a single decision, masking systematic blind spots.

By Guangzheng Hu, Ziyue Jiang, Weixu Qiao, Lixin Zhang, Jianye Kang, Yuru Wu, Rong Bao, Niantong Li, Wei Wang, Ziyi Cheng, Xinfa Zhu, HangRui Hu, Ting He, Bing Zhao, Lin Qu, Hu Wei, Jin Xu
Hugging Face Trending Papers
Sep 24

From Text Decisions to Pixels: An Study of Jev-Style Visual Choice Model

The paper introduces PixelJev, a native-image decision interface that combines an image, a task instruction, and a runtime candidate set to produce a structured choice and candidate-conditioned probabilities using small open multimodal models. It unifies recognition and multiple-choice visual question answering via a language-model readout, offering options for frozen inference, language-side adaptation, and held-out calibration. Across seven benchmarks, 64-shot source adaptation significantly boosts Pets accuracy from 60.13% to 92.40%, and the model supports VQA tasks without target fitting, though calibration and cross-family transfer remain challenges.

arXiv AI
Aug 25

XTC: Head-Aware Sampling by Excluding Top Choices

XTC (Exclude Top Choices) is a lightweight, head‑aware decoding operator that improves diversity in autoregressive language models by removing overly probable tokens that dominate the next‑token distribution. It works by identifying tokens above a plausibility threshold, probabilistically excluding the dominant choices, and renormalizing the remaining distribution. Across 60 experiments on models such as Gemma 3 and DeepSeek R1, XTC boosts Distinct‑2 scores by 11–15 % and cuts repeat trigrams by 27–47 %, while a Mechanical Turk study shows a 62.3 % preference for XTC‑generated text without loss of fluency.

By Philipp Emanuel Weidmann, Allen Roush, Judah Goldfeder, Sanjay Basu, Ravid Shwartz-Ziv
arXiv AI
Aug 28

Mutual Debiasing via Dual-Seed Comparison for Probabilistic Sampling in Large Language Models

The paper introduces Dual-Seed Comparison (DSC), a protocol that uses two independent LLM-generated seeds to reduce systematic bias in probabilistic sampling. DSC constructs a bit sequence from the character-level ordinal values of the seeds, normalizes it into a pseudo-uniform variate, and maps it to the target distribution via the inverse cumulative distribution function. Empirical results show DSC outperforms existing methods in 96% of evaluated settings and enhances distributional control in tasks like MCQ generation and attribute-constrained text-to-image prompting.

By Zihao Guo, Hongtao Lv, Chaoli Zhang, Laiguo Yin, Lei Liu, Yonghui Xu, Lizhen Cui