arXiv Machine Learning By Josef Liyanjun Chen

RoboJev: An Open Vision-Language Judge for Robot Success Detection

Read the original on arXiv Machine Learning →

RoboJev-27B is an open‑weight vision‑language model that predicts whether a robot has successfully completed a manipulation task by analyzing a task instruction, ten frames of the attempt, and optional auxiliary camera frames. Trained with a rank‑32 LoRA adapter on 52,598 episodes, it achieves 95.2% balanced accuracy and 0.993 AUROC on held‑out episodes of the same robot model, and maintains strong performance on unseen labs, robots, and community‑collected data. The model runs in 0.26 seconds per episode on an H100 GPU and is released with inference code and a large, transparent evaluation dataset for reproducible benchmarking.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Aug 13

G0.5: One Autoregressive Stream for Robot Reasoning and Action

arXiv:2608. 11739v1 Announce Type: cross Abstract: The prevailing recipe for Vision-Language-Action (VLA) models couples a pretrained VLM with a separately trained flow-matching action expert.

By Yicheng Liu, Zibin Dong, Baijun Ye, Tianyuan Yuan, Tao Jiang, Anqi Yang, Shicheng Cao, Haonan Liu, Yue Sun, Zihan Guo, Xiao Liu, Dong Ke, Changxun Pan, Chenru Wu, Tailai Cheng, Xiaoshu Ren, Xinlei Zhang, Jianning Cui, Zijie Zhao, Haoyu Zhang, Kaiming Xu, Haodong Yang, Bowen Zhang, Jiahui Niu, Shaoting Zhu, Shiduo Zhang, Hang Zhao
arXiv AI
Oct 9

IndustrialVLA-Bench: A Traceable Multi-Axis Evaluation of Open Robot Policy Models

IndustrialVLA-Bench evaluates six released vision‑language‑action (VLA) and world‑action (WAM) robot policy models using a unified reporting schema. It measures clean capability on LIBERO, non‑language robustness on LIBERO‑Plus, instruction sensitivity on LIBERO‑Para, and observed execution cost, aggregating results across three random seeds. The benchmark also reports inference latency, peak memory, runtime mode, and evidence status for each system, enabling traceable comparisons without claiming one paradigm is universally superior.

By Yiqi Wang, Zhifeng Rao, Jiaqi Zhang, Xiaoyang Li, Zhangkai Wu, Yiqun Duan, Mingkai Zheng, Fei Wang, Shan You, Taotao Cai
arXiv Computer Vision
Sep 22

An Unexpected Robot Policy: Early Evaluations of GPT-6 Astra on RoboDojo and Beyond

arXiv:2609.24170v1 Announce Type: new Abstract: Embodied AI systems are often organized into System 1 and System 2. System 1 is typically a pretrained policy that generates actions at high frequency,...

By Wenbo Zhang, Kaixuan Wang, Yutao Ouyang, Xiaoyu Huang, Liyang Li, Kailun Su, Weiyang Jin, Wenhao Chai, Haotian Liang, Zhiyang Dou, Yue Chen, Tianxing Chen
arXiv AI
Jul 29

CoTinyVLA: Chain-of-Thought Distillation for a Sub-Billion-Parameter Vision-Language-Action Model

arXiv:2607. 25487v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models translate natural-language commands into robot action sequences, but leading systems on the LIBERO-Plus robustness benchmark use three- to seven-billion-parameter backbones whose memory demands can exceed embedded robotic budgets.

By Minhyeok Lee, Chiyoung Kim, Chanhoe Gu, Seongrok Kim, Sanghyuk Roy Choi, Donghwan Hwang, Donghun Ryu, Seokhyun Kim
arXiv Computation and Language
Sep 25

Free the Language Model From the Vision Encoder: Semantic Serialization as a Perception Interface for Small Language Models

The paper introduces a perception interface that separates vision from language in vision‑language models. A frozen perception stack detects objects, a deterministic semantic serializer converts the perceived state into text, and a standard text‑only large language model (LLM) answers questions. Experiments on a campus‑robot benchmark show that this serialized interface outperforms a zero‑shot VLM of the same language‑model size, especially as the language model shrinks, and that the advantage persists under paraphrase and different supervision regimes.

By Cong Xu, Ravi Sankar