MoETok introduces a sparse expert routing mechanism for 1D visual tokenizers, enabling distinct Content and Detail queries to specialize in high‑level semantics and fine‑grained visual details, respectively. By jointly optimizing reconstruction and semantic objectives, the router learns role‑specialized processing paths that improve reconstruction, semantic representation, and autoregressive generation across various model scales and token budgets. On ImageNet, MoETok achieves state‑of‑the‑art class‑conditional generation within the 1D tokenizer family and, when scaled to a unified autoregressive model, matches or surpasses diffusion‑based models on benchmarks such as DPG‑Bench, GenEval2, and WISE.
By Jiahao Guo, Bao Tang, Haoxiang Cao, Jingfeng Yao, Bo Li, Wenyu Liu, Kun Gai, Changqian Yu, Xinggang Wang
arXiv:2606. 07684v1 Announce Type: cross Abstract: Disaggregated serving alleviates memory bottlenecks in Large Language Model (LLM) inference but creates a severe communication bottleneck: transmitting high-dimensional Key-Value (KV) caches often dominates time-to-first-token (TTFT).
By Qianli Ma, Zhiqing Tang, Hanshuai Cui, Zhi Yao, Weijia Jia
The paper introduces a token‑oriented semantic communication framework that transmits only task‑relevant image latents instead of full token embeddings, reducing communication cost and improving interoperability. It leverages a spatial alignment between vision transformer patch tokens and learned image compression latents, enabling token‑level relevance estimation and selective transmission. Experiments on ImageNet demonstrate a superior rate–accuracy trade‑off compared to existing semantic communication methods and hand‑crafted codecs.
By Jiwoong Im, Minwoo Kim, Jaeho Lee, Yo-Seb Jeon, Yongjune Kim
The paper introduces ReToK, a flexible image tokenizer that uses redundant token padding and hierarchical semantic regularization to better utilize all tokens in autoregressive image generation. By activating tail tokens more frequently and aligning early token features with a pre‑trained vision model while gradually reducing regularization, ReToK mitigates the information concentration problem of traditional nested dropout tokenizers. Experiments on ImageNet 256×256 show that ReToK outperforms both flexible and fixed‑length tokenizers in generation quality.
By Zixuan Fu, Lanqing Guo, Chong Wang, Binbin Song, Ding Liu, Bihan Wen
CatchUp is a training‑free framework that improves efficiency in large vision‑language models by depth‑aware re‑admission of visual tokens. It repeatedly evaluates query‑conditioned relevance, processes only selected tokens per decoder interval, and preserves deferred tokens for later re‑admission, using reference‑to‑current transition signals to approximate missed representation evolution. Experiments on three referring‑expression grounding datasets and six multimodal benchmarks show that CatchUp retains over 92% of full‑model performance with 88.9% fewer active tokens and reduces end‑to‑end latency by 8.0% at a 64‑token budget.
By Eunju Park, Uiwon Hwang
arXiv:2505. 10946v3 Announce Type: replace-cross Abstract: Token communications (TokenCom) is an emerging generative semantic communication paradigm, where tokens serve as compact representation units across modalities.
By Li Qiao, Mahdi Boloursaz Mashhadi, Zhen Gao, Robert Schober, Deniz G\"und\"uz