arXiv AI

Muse Glimmer 30B: An On-Device Agentic Model

arXiv AI
6d ago

Agent Skill Framework: Perspectives on the Potential of Small to Medium Language Models in Industrial Environments

The paper investigates how the skill paradigm—using modular abilities within agentic frameworks—works with small to medium open‑source language models (270 M–80 B parameters) in industrial, resource‑constrained settings. A large‑scale empirical study on an insurance‑claim classification task and a set of Python programming problems shows that very small models often fail to retrieve or select correct skills, while larger 30 B–80 B models benefit significantly from skill augmentation. The authors also present a deployment‑oriented GPU profile, reporting VRAM time occupancy (GB·min) across models, to help characterize GPU‑memory costs for different model scales. "whyItMatters":"The study provides concrete evidence on how skill augmentation scales with model size, task complexity, and GPU budget, offering practical deployment insights for industrial applications using open‑source language models."

By Yangjie Xu, Lujun Li, Lama Sleem, Niccolo Gentile, Yewei Song, Yiqun Wang, Siming Ji, Wenbo Wu, Hui Huang, Radu State
arXiv Machine Learning
3d ago

LoongSage: A Production-Grade, High-Efficiency Agentic RL Framework for Frontier LLMs with Validated Recipes

LoongSage is a lightweight, fully asynchronous reinforcement learning framework designed for large language models that perform agentic tasks. It integrates with Megatron for distributed training and SGLang for high‑throughput inference, centralizing orchestration in a single controller and using Ray actors for GPU components. The framework introduces AgentFlow for unified execution of white‑box and black‑box agents, sliding‑window strategies to limit trajectory staleness, TransferMesh for efficient weight synchronization, and a memory‑efficient Teacher Manager that supports multi‑teacher on‑policy distillation. Experiments across four training runs show steady reward improvement, controlled train‑inference gaps, and sustained hardware utilization by eliminating synchronous idle periods.

By LoongSage Team, Bowei Song, Caiwei Zhao, Chuwen Liu, Dechuang Gu, Dong Fang, Feiyu Xie, Huaiyu Li, Hui Zhang, Jian Tian, Jian Wang, Jie Zhao, Liguang Li, Maoyun Wang, Meiyan Yang, Minghan Zhu, Pai Liu, Pandeng Yao, Renbao Tian, Ru Yang, Shuai Jia, Shuai Tan, Shuailong Li, Shuliang Li, Teng Jin, Tianze Yang, Wenbo Cui, Wenjing Bai, Wenkang Wu, Xiaowei Jiang, Xiaoyi Dong, Yanpeng Wang, Yanwen Wang, Yaohui Ma, Yawen Wang, Yihang Zhang, Yingjie Yan, Zhanbiao Lian, Zhenyu Lu, Zhida Hu, Zhihui Hao, Zhihui Hu, Zhiwen Xiao, Zhiyi Gao, Zhongwei Qi, Zhuangzhuang Wu, Ziqian Liu, Ziyue Zheng
arXiv AI
Jun 12

M*: A Modular, Extensible, Serving System for Multimodal Models

arXiv:2606. 12688v1 Announce Type: cross Abstract: We are entering a new era of composite model architectures that integrate diverse components such as vision encoders, language backbones, diffusion and flow heads, audio codecs, action generators, and world-model predictors.

By Atindra Jha, Naomi Sagan, Keisuke Kamahori, Irmak Sivgin, Rohan Sanda, Steven Gao, Mark Horowitz, Luke Zettlemoyer, Olivia Hsu, Jure Leskovec, Baris Kasikci, Stephanie Wang
arXiv Computer Vision
6d ago

OpenGCUA: Toward a Fully Open Stack for Generalist Computer Use

OpenGCUA is an open‑stack project that aims to make generalist computer‑use agents (GCUs) fully accessible to the research community. The first release focuses on code execution, allowing agents to use intermediate results and programming skills directly in computer interaction, and introduces harness‑to‑model decision transfer to shift observation and task‑state decisions from fixed rules to the model. On the OSWorld‑v2 benchmark, the full configuration boosts task scores for all eight evaluated models—including GPT‑6 Astra and Claude Opus 5—by an average of +19.6 partial‑score points and cuts steps per task by 53 % compared to batched GUI‑only execution, while also providing a real‑device harness and cross‑device SDK. whyItMatters":"By releasing the full stack, OpenGCUA enables systematic study and broader experimentation with generalist computer‑use agents, addressing the current limitation of closed implementations and demonstrating significant performance gains across diverse models."

By Hanzhang Zhou, Long Li, Quyu Kong, Lei Wang, Panrong Tong, Long Chen, Tianyu Xia, Gongjie Zhang, Xu Zhang, Chen Liu, Jianan Zhang, Chenglin Cai, Zhengwen Zeng, Steven Hoi, Yue Wang
arXiv AI
Jul 28

Real2Sim2Real for Vision-Language-Action Manipulation: An AMD ROCm-Based Pipeline

arXiv:2607. 22997v1 Announce Type: cross Abstract: Physical AI -- the integration of large vision-language-action (VLA) models with embodied agents that act in the real world -- has emerged as the next major frontier for AI, echoed by industry leaders such as Jensen Huang (``the next big thing is Physical AI, AI with a body,'' GTC Paris, June 2025) and Dr.

By Qing Yang, Xun Wang, Ziguan Wang, Zhenjiang Li, Hongqiang Wang, Dongdong Weng
arXiv AI
Jul 8

KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Meta

arXiv:2512. 23236v4 Announce Type: replace-cross Abstract: Making deep learning recommendation model (DLRM) training and inference fast and efficient is important.

By Gang Liao, Hongsen Qin, Ying Wang, Alicia Golden, Michael Kuchnik, Yavuz Yetim, Jia Jiunn Ang, Chunli Fu, Yihan He, Samuel Hsia, Zewei Jiang, Dianshi Li, Uladzimir Pashkevich, Varna Puvvada, Feng Shi, Matt Steiner, Ruichao Xiao, Liyuan Li, Nathan Yan, Xiayu Yu, Zhou Fang, Roman Levenstein, Kunming Ho, Haishan Zhu, Alec Hammond, Richard Li, Ajit Mathews, Kaustubh Gondkar, Abdul Zainul-Abedin, Ketan Singh, Hongtao Yu, Wenyuan Chi, Barney Huang, Sean Zhang, Noah Weller, Zach Marine, Wyatt Cook, Carole-Jean Wu, Gaoxiang Liu