Hugging Face Trending Papers

Spatially Gated Demographic Steering for Debiasing Multi-Person Text-to-Image Generation

arXiv Computation and Language
Aug 27

GGSS: Geodesic-Gated Spherical Steering for Inference-Time Debiasing of Generative Vision-Language Models

The paper introduces GGSS (Geodesic‑Gated Spherical Steering), a norm‑preserving method for inference‑time debiasing of generative vision‑language models. GGSS identifies a counterfactual bias subspace on the unit hypersphere, steers visual tokens along geodesic arcs, and applies an adaptive gate to target tokens with strong demographic signals. Experiments on four generative VLMs show that GGSS achieves the lowest average bias across multiple tests while maintaining visual‑language performance within ±0.6 pp of the baseline.

By Yiqun Sun, Junyu Chen, Pengfei Wei, Lawrence B. Hsieh
Hugging Face Trending Papers
Jul 8

Stage-Aware Adaptation and Distribution Calibration for Subject-Driven Personalized Text-to-Image Generation

Subject-driven personalized text-to-image generation requires a pretrained diffusion model to acquire a specific subject from a few reference images while preserving subject identity, following novel text prompts, and maintaining sample diversity. Existing optimization-based methods instantiate subject adaptation through full fine-tuning, textual embedding optimization, or low-rank parameter updates; PaRa further constrains personalization from the perspective of parameter rank reduction.

arXiv Computer Vision
Aug 27

Learning Late, Guiding Early: Timestep-Decoupled Semantic Guidance for Fair Face Generation

The paper introduces Semantic Boundary Predictor (SBP), an inference‑time framework that improves demographic fairness in synthetic face generation by applying a single, one‑shot intervention during reverse denoising. SBP learns linear semantic boundaries from late‑stage latent representations and applies them only at the initial noisy latent, leaving the rest of the diffusion process unchanged. Experiments on CelebA‑HQ show significant reductions in fairness disparity—98% for gender, 95% for binary race, and 15% for four‑class race—while preserving image quality across demographic groups.

By Subir Kumar Parida, Rajbabu Velmurugan, Ketan Kotwal, R. S. Sengar, Swati Hiremath
arXiv AI
Aug 28

Multivariate Diffusion Transformer with Decoupled Attention for High-Fidelity Mask-Text Collaborative Facial Generation

The paper introduces MDiTFace, a diffusion transformer designed for high‑fidelity mask‑text collaborative facial generation. It unifies tokenization of semantic masks and text, enabling synchronous multimodal feature interaction via stacked multivariate transformer blocks. A novel decoupled attention mechanism separates dynamic and static computations, allowing caching of static features and reducing mask‑condition overhead by over 94% while preserving performance, leading to superior facial fidelity and conditional consistency compared to existing methods.

By Yushe Cao, Dianxi Shi, Xing Fu, Xuechao Zou, Haikuo Peng, Xueqi Li, Chun Yu, Junliang Xing
arXiv Computer Vision
Oct 16

Not Just a Subject: Capturing Adaptive Scene-Specific Variance for Visual Storytelling

EOS-Story is a training‑free framework that improves visual storytelling by balancing identity consistency with scene‑specific adaptation. It separates narrative prompts into identity and scene sub‑prompts and introduces Cross‑Contextual Bridging to inject appearance cues into the scene embedding. In the vision space, Adaptive Identity Preservation aligns identity features to the scene scale and uses Identity‑Aware Self‑Attention to avoid structural artifacts, achieving competitive results on the extended Consistory+ benchmark.

By SeungJu Cha, Ye-Chan Kim, Kwanyoung Lee, Dong-Jin Kim