arXiv Computer Vision

Knowledge Distillation Driven Semantic NOMA with GAN Refinement for 6G Robotic Vehicle Networks

The paper introduces KDG‑SemNOMA, a framework for 6G robotic vehicle networks that combines knowledge distillation and generative models to improve semantic communication over uplink non‑orthogonal multiple access (NOMA). It employs a ConvNeXt‑based deep joint source‑channel coding architecture with an enhanced attention feature module for dynamic channel adaptation, and uses an orthogonal teacher model to guide a NOMA student model via two‑stage knowledge distillation. A channel‑conditional GAN further refines the reconstructed images, yielding higher pixel‑level accuracy and perceptual fidelity on the FFHQ‑256 dataset compared to state‑of‑the‑art methods.

arXiv Computer Vision
Aug 31

GAN-Based Semantic Communication for Image Transmission in IoV

The paper introduces a GAN‑based semantic communication framework for image transmission in the Internet of Vehicles, aiming to overcome bandwidth and channel limitations. At the transmitter, a pyramid attention network extracts semantic label maps and a priority mechanism assigns weights to categories based on driving safety, guiding bit allocation and loss design. The receiver reconstructs images using a coarse‑to‑fine multi‑resolution generator, multi‑scale discriminator, temporal consistency, spatial pyramid pooling, and class‑aware convolutions, achieving high‑fidelity results with combined adversarial, feature‑matching, and perceptual losses. Experiments on Cityscapes demonstrate superior semantic segmentation accuracy and image quality compared to existing methods, with stable performance under AWGN and Rayleigh channels.

By Ruixing Ren, Shan Chen, Junhui Zhao, Xiaoke Sun
Hugging Face Trending Papers
Aug 11

Grid-Preserving Knowledge Distillation: Transferring Convolutional Inductive Bias to Vision Transformers under Data Scarcity

Vision Transformers underperform convolutional networks when training data is scarce, and distilling convolutional inductive biases from a CNN teacher is an effective remedy that leaves the deployed model unchanged. General-purpose feature distillation, however, transfers little in this setting.

arXiv AI
Jul 7

BEVLM: Distilling Semantic Knowledge from LLMs into Bird's-Eye View Representations

arXiv:2603. 06576v2 Announce Type: replace-cross Abstract: The integration of Large Language Models (LLMs) into autonomous driving has attracted growing interest for their strong reasoning and semantic understanding abilities, which are essential for handling complex decision-making and long-tail scenarios.

By Thomas Monninger, Shaoyuan Xie, Qi Alfred Chen, Sihao Ding
arXiv AI
Jun 6

Drive-KD: Multi-Teacher Distillation for VLMs in Autonomous Driving

arXiv:2601. 21288v2 Announce Type: replace Abstract: Autonomous driving is an important and safety-critical task, and recent advances in LLMs/VLMs have opened new possibilities for reasoning and planning in this domain.

By Weitong Lian, Zecong Tang, Haoran Li, Tianjian Gao, Yifei Wang, Zixu Wang, Lingyi Meng, Tengju Ru, Zhejun Cui, Yichen Zhu, Hangshuo Cao, Qi Kang, Tianxing Chen, Kaixuan Wang, Yu Zhang