arXiv AI

AGQ: Action-Guided Ultra-Low-Bit Quantization for Vision-Language-Action Models

arXiv Machine Learning
4d ago

SACQ: Structure-Aware Codebook Quantization for Ultra-Low-Bit Vision-Language-Action Models

SACQ is a weight‑only vector‑codebook quantization framework designed for Vision‑Language‑Action models, addressing the challenges of ultra‑low‑bit precision. It incorporates structure‑aware codebook fitting, action‑aware mixed‑bit allocation, and a two‑stage post‑quantization refinement to maintain policy performance. Experiments on GR00T N1.7 and SimplER show that SACQ achieves high success rates (up to 93.85%) while reducing memory usage by 4.83× and improving inference speed.

By Haesung Lee, Insu Han
arXiv Machine Learning
Aug 21

HBVLA: Pushing 1-Bit Post-Training Quantization for Vision-Language-Action Models

arXiv:2602. 13710v2 Announce Type: replace Abstract: Vision-Language-Action (VLA) models enable instruction-following embodied control, but their large compute and memory footprints hinder deployment on resource-constrained robots and edge platforms.

By Xin Yan, Zhenglin Wan, Feiyang Ye, Xingrui Yu, Hangyu Du, Yang You, Ivor Tsang
arXiv AI
Jun 8

ActQuant: Sub-4-bit Action-Guided Quantization for Vision-Language-Action Models

arXiv:2605. 24011v2 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models exhibit remarkable action generation for embodied intelligence, but their heavy compute make deployment on edge platforms impractical.

By Arash Akbari, Arman Akbari, Masih Eskandar, Qitao Tan, Yixiao Chen, Jingwu Luo, Bertha Pangaribuan, Liyun Zhang, Jennifer Dy, Geng Yuan, Xue Lin, Gaowen Liu, Stratis Ioannidis, Yanzhi Wang
arXiv AI
21h ago

ActQuant: Sub-4-bit Action-Guided Backbone Weight-Only Quantization for Vision-Language-Action Models

ActQuant is a mixed‑precision post‑training quantization framework that reduces Vision‑Language‑Action model weights to sub‑4‑bit precision. It first allocates a single bit‑width to each weight matrix based on its contribution to action prediction, then optimizes per‑block scales using action‑aware curvature to focus dynamic range on control‑critical weights. Coupled with the OmniModel.cpp conversion pipeline, ActQuant enables deployment on edge devices, achieving up to 2.5 bits‑per‑weight while preserving over 90 % of baseline performance on both simulation and a real 6‑DoF UR3 robotic arm.

By Arash Akbari, Arman Akbari, Masih Eskandar, Qitao Tan, Yixiao Chen, Jingwu Luo, Bertha Pangaribuan, Liyun Zhang, Jennifer Dy, Geng Yuan, Xue Lin, Gaowen Liu, Stratis Ioannidis, Yanzhi Wang
arXiv Machine Learning
Aug 12

HoloQ-VLA: Uniform W4A4 Quantization of Vision-Language-Action Models

arXiv:2605. 28803v3 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models unify perception, reasoning, and control in a single policy, but their multi-billion-parameter backbones and diffusion-based action heads make on-device deployment prohibitively expensive.

By Xinyu Wang, Mingze Li, Sicheng Lyu, Dongxiu Liu, Kaicheng Yang, Ziyu Zhao, Yufei Cui, Xiao-Wen Chang, Peng Lu
arXiv Machine Learning
Aug 10

{\Omega}-QVLA: Robust Quantization for Vision-Language-Action Models via Composite Rotation and Per-step Scaling

arXiv:2605. 28803v2 Announce Type: replace-cross Abstract: Vision-Language-Action (VLA) models unify perception, reasoning, and control within a single policy, yet their multi-billion-parameter backbones and diffusion-based action heads make on-device deployment prohibitively expensive.

By Xinyu Wang, Mingze Li, Sicheng Lyu, Dongxiu Liu, Kaicheng Yang, Ziyu Zhao, Yufei Cui, Xiao-Wen Chang, Peng Lu
arXiv AI
Jun 29

Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?

arXiv:2606. 27755v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models enable instruction-driven robotic manipulation, but they inherit oversized language backbones from pretrained VLMs whose capacity far exceeds what is needed for short robotic instructions.

By Guoheng Sun, Kaixi Feng, Shwai He, Xiaochuan Gong, Yexiao He, Ziyao Wang, Zheyu Shen, Wanghao Ye, Ramana Rao Kompella, Gaowen Liu, Ang Li
arXiv Machine Learning
Oct 22

Compressing Onboard Language Models for Space Robots under a Behavioral-Fidelity Requirement

The paper introduces QSelect, a method for compressing large language models for space robots by composing low‑bit quantized modules from AWQ, GPTQ, and AutoRound checkpoints. In fidelity mode, QSelect selects substitutions that reduce forward KL divergence from a BF16 reference, achieving lower perplexity and KL than any single‑family model across several 3‑ and 4‑bit settings. An optional target‑adapted mode further improves accuracy on labeled data, demonstrating the approach’s potential for meeting strict memory and behavioral‑fidelity constraints in space‑borne deployments.

By Jia Deng, Zizhe Wang, Xin Lu, Yi Huang, Zehao Jia