arXiv AI
Jun 26
Reconstruction Alignment Improves Unified Multimodal Models
arXiv:2509. 07295v4 Announce Type: replace-cross Abstract: Unified multimodal models (UMMs) unify visual understanding and generation within a single architecture.
RRFC: Recursive Refinement via Feedback Conditioning for Iterative Image-to-Image Generation
arXiv:2608. 15694v1 Announce Type: cross Abstract: Conditional image-to-image generators are single-shot: they map input features to an output in one forward pass and treat it as final, with no opportunity to improve on it.
Related stories
arXiv AI
Jun 12
Iterative Visual Thinking: Teaching Vision-Language Models Spatial Self-Correction through Visual Feedback
arXiv:2606. 13156v1 Announce Type: cross Abstract: Vision-language models (VLMs) achieve strong singleshot spatial grounding, yet lack any mechanism to observe and correct their own predictions.
arXiv Machine Learning
Jul 31
Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation
arXiv:2607. 27372v1 Announce Type: new Abstract: The deep learning revolution, kicked off by AlexNet, taught us that end-to-end training beats decomposing a problem into hand-designed stages.
arXiv AI
Jun 9
Simple Self-Conditioning Adaptation for Masked Diffusion Models
arXiv:2604. 26985v2 Announce Type: replace-cross Abstract: Masked diffusion models (MDMs) generate discrete sequences by iterative denoising under an absorbing masking process.
arXiv AI
Aug 11
UniSpace: Unified Visual Representation and Scalable Multimodal Modeling
arXiv:2608. 08676v1 Announce Type: cross Abstract: Semantic vision encoders have become a central visual interface for multimodal understanding and semantic conditioning in image generation.
arXiv Machine Learning
Aug 4
FDIR: Harmonizing Fidelity and Human-Machine Preference in Lossy Compression Image Restoration
arXiv:2608. 00111v1 Announce Type: cross Abstract: Image restoration quality can be evaluated along three complementary facets: pixel-level fidelity, human perception, and downstream machine preference.
Hugging Face Trending Papers
Jul 7
From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models
Large-scale text-to-image models are attractive backbones for dense prediction because RGB generation pretraining learns rich semantic, structural, and geometric priors. Existing generative and editing approaches reuse these priors by casting dense prediction as target generation: annotations such as depth, normals, alpha mattes, masks, and heatmaps are encoded into an RGB-trained VAE latent space and decoded back as image-like targets.
arXiv AI
Jun 15
Learning What to Predict: Downstream-Guided Task Design for Continued Pretraining
arXiv:2601. 22108v2 Announce Type: replace-cross Abstract: Continued pretraining is optimized with fixed self-supervised tasks but selected by downstream performance, creating a coarse feedback loop in which practitioners evaluate checkpoints, change data mixtures or objectives, and restart runs, while individual updates remain blind to target capabilities.
arXiv AI
Aug 11
LF${}^{2}$AR: Accounting for Layerwise Dynamics to Improve Multimodal Adaptation of Language Models
arXiv:2503. 06211v3 Announce Type: replace-cross Abstract: Text-pretrained language models (LMs) encode rich world knowledge, but adapting them to process and generate perceptual modalities such as audio and images while effectively leveraging that knowledge remains challenging.
arXiv AI
Jun 4
EvoPrompt: Guided Prompt Evolution for Vision-Language Models Adaptation
arXiv:2603. 09493v2 Announce Type: replace-cross Abstract: The adaptation of large-scale vision-language models (VLMs) to downstream tasks with limited labeled data remains a significant challenge.
arXiv AI
Jul 7
Transferability Between Understanding and Generation in Unified Multimodal Models
arXiv:2607. 04423v1 Announce Type: cross Abstract: Unified Multimodal Models (UMMs) integrate image understanding and generation within a single architecture, yet how the two tasks interact remains understudied.
arXiv Machine Learning
Jun 9
Solving Inverse Problems with Flow-based Models via Model Predictive Control
arXiv:2601. 23231v2 Announce Type: replace-cross Abstract: Flow-based generative models provide strong unconditional priors for inverse problems, but guiding their dynamics for conditional generation remains challenging.