arXiv Machine Learning By Ziqiong Wang, Tianqi Ren, Rongpeng Li, Zhifeng Zhao, Honggang Zhang

In-Context Source and Channel Coding

Read the original on arXiv Machine Learning →

arXiv:2601. 10267v2 Announce Type: replace Abstract: Separate Source-Channel Coding (SSCC) remains attractive for text transmission due to its modularity and compatibility with mature entropy coders and powerful channel codes.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Aug 26

Contextual Memory-Enhanced Source Coding for Low-SNR Communications

The paper introduces Memory-Augmented Source Coding (MASC), a scheme that embeds contextual patterns into a source model to improve robustness in low‑SNR communications. MASC uses a shared Parameterized Contextual Memory (PCM) for multi‑order n‑gram patterns and a Mixture‑of‑Memory‑Experts Router (MMER) to selectively activate memory experts based on hidden states, thereby refining probability estimates and shortening code length. Experiments on Rayleigh fading and AWGN channels show that MASC reduces decoding sensitivity to residual channel errors compared to traditional SSCC with autoregressive decoding and LLM‑based Arithmetic Coding.

By Ziqiong Wang, Rongpeng Li, Zhifeng Zhao, Honggang Zhang