The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Intern Lumina U2 is a diffusion large language model that uses multi-codebook visual tokens in a fully discrete space, allowing each visual position to be represented by a group of complementary codes. The model concatenates embeddings at each position and employs a lightweight autoregressive head to predict codes sequentially while the diffusion backbone processes all positions in parallel. Built on the unified 4D representation of AToken, it supports image, video, and 3D inputs, achieves leading performance in visual understanding, image generation, and editing, and includes a cross‑platform training, inference, and evaluation system with a stability‑aware sampling strategy that speeds up image generation by 4.45×.
Multimodal models often build on architectures designed for generative vision-language modeling, typically combining separately pretrained vision encoders with causal language models. Visual document...
NeoMME is a family of 260M and 800M‑parameter multimodal‑native multilingual encoders that process text and raw image patches in a single bidirectional Transformer. Trained from scratch with a masked discrete‑diffusion objective conditioned on visible image patches, NeoMME supports a 16,384‑token context, enabling encoding of up to two 4K UHD images. In downstream tests, NeoMME‑Retriever models outperform all sub‑800M‑parameter baselines on the ViDoRe v3 benchmark and achieve twice the throughput of ColModernVBERT on an NVIDIA L40S, while hierarchical token pooling and asymmetric quantization compress embeddings 255× with minimal loss in retrieval performance.
arXiv:2607. 19064v1 Announce Type: cross Abstract: Large-scale visual generators are increasingly capable but costly to train, fine-tune, and deploy.
Large-scale visual generators are increasingly capable but costly to train, fine-tune, and deploy. We introduce Mage-Flow, a compact 4B-scale generative stack for efficient text-to-image generation and instruction-based image editing.
Unlike diffusion-based models that operate in continuous latent spaces, autoregressive unified multimodal models produce images by sequentially predicting discretized visual tokens. These tokens are derived from a codebook that maps embeddings to quantized visual patterns.