arXiv Machine Learning
Aug 27

Token-Oriented Semantic Communication with Pretrained Vision Transformers

The paper introduces a token‑oriented semantic communication framework that transmits only task‑relevant image latents instead of full token embeddings, reducing communication cost and improving interoperability. It leverages a spatial alignment between vision transformer patch tokens and learned image compression latents, enabling token‑level relevance estimation and selective transmission. Experiments on ImageNet demonstrate a superior rate–accuracy trade‑off compared to existing semantic communication methods and hand‑crafted codecs.

By Jiwoong Im, Minwoo Kim, Jaeho Lee, Yo-Seb Jeon, Yongjune Kim
arXiv AI
Oct 12

GeoGR: Spatial-Semantic Token Compression and Group Routing for Efficient 3D VLMs

GeoGR introduces a two‑stage framework for efficient 3D vision‑language models. The first stage, GeoSemZip, compresses multi‑view visual tokens into compact 3D voxel representations while preserving important scene information through contextual anchors. The second stage, GroupRoute, dynamically routes tokens through the language model, allowing low‑relevance tokens to skip layers and rejoin later, thereby reducing computation without significant loss of performance.

By Yongxin Zheng, Hao Wu, Fang Li, Hu Fu, Peiran Yin, Xudong Wang, Haozhe Hu, Xinghao Chen, Yunpu Ma, Wei Zhang, Xiaoyu Shen