arXiv AI By Rui Wang, Yan Zhao, Li Song, Zhengxue Cheng

LLMCodec: Adapting Video Codecs for Efficient Weight Compression of Large Language Models

Read the original on arXiv AI →

arXiv:2606. 05861v1 Announce Type: cross Abstract: The rapid development of large language models(LLMs) has led to remarkable advances in natural language processing.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 2

Can LLMs Design Video Coding Tools? A Case Study on Planar Mode

The paper investigates whether large language models (LLMs) can design video coding tools, focusing on the Planar mode used in video coding standards. Using a generation-and-evaluation loop, the LLM generates new Planar predictors, which are then tested in the Fraunhofer Versatile Video Encoder (VVenC) and the Enhanced Compression Model (ECM). Results show that the LLM-generated mode can outperform the conventional Planar mode, achieving a 0.18% bitrate saving with a 0.4% complexity increase, and that similar gains are possible when integrating the new predictor into ECM under low‑resolution settings.

By Yingwen Zhang, Meng Wang, Liqiang He, Shiqi Wang
arXiv AI
Aug 26

Compression Trinity: Exploring Sparsity, Quantization, and Low-Rank Approximations for LLM Compression

The paper introduces the "Compression Trinity," a unified framework that jointly applies sparsity, quantization, and low‑rank approximations to compress large language models. It presents several methods—MKOR, SLoPe, OPTIMA, PATCH, and SLiM—that leverage these three pillars to accelerate training, reduce memory bandwidth, and recover accuracy, achieving significant speedups and accuracy gains over existing techniques. The results demonstrate that combining all three compression strategies is essential for efficient, scalable, high‑performance LLM deployment.

By Mohammad Mozaffari
arXiv Computer Vision
Sep 7

Multi-scale Image Representation Compression

The paper introduces MIRC, an overfitted image codec that quantizes and entropy‑codes all components—including latents, synthesis network, and entropy models—within a single end‑to‑end rate‑distortion framework inspired by NVRC. It adds a multi‑scale representation with cross‑stage parameter sharing to capture cross‑scale redundancy, yielding a 10.5 % BD‑rate saving over VVC on the CLIC2020 professional set. MIRC offers multiple configurations ranging from 1.2 to 2.9 kMAC per pixel, allowing decoding complexity to be tuned to deployment needs.

By Tianhao Peng, Ho Man Kwan, Fan Zhang, Shan Liu, David Bull