arXiv AI

PTC-Decoder: Towards Intelligent SLMs on Offline Resource-Constrained Edge Devices

The paper introduces PTC-Decoder, a training‑free, plug‑and‑play decoder designed to improve the reliability of small language models (SLMs) on offline, resource‑constrained edge devices such as remote sensing satellites. PTC-Decoder combines a Plan‑to‑Act paradigm that forces the model to invoke a planning tool at the first inference step with a deterministic finite automaton (TC‑Decoder) that imposes token‑level hard constraints on tool names while preserving the model’s reasoning capability. Evaluated on 200 real satellite tasks across seven SLMs, the approach achieves a statistically significant mean overall score gain of +1.21, with the TC‑Decoder component identified as the primary contributor to performance gains.

arXiv AI
Sep 1

SimCRAFT: Distilling Remote Sensing Agents via Synthetic Trajectories and Contextual Retrieval-Augmented Fine-Tuning

SimCRAFT is a model‑agnostic framework that distills remote sensing orchestration into a compact 7B‑scale model. It creates a large, constraint‑validated workflow planning corpus (SimRS‑14k) using a multi‑agent synthesis engine and a Mock Execution Engine, then fine‑tunes the model with Contextual Retrieval‑Augmented Fine‑Tuning (CRAFT) to reason analogically. Experiments show SimCRAFT‑7B outperforms open‑weight LLMs and rivals advanced closed‑source models, providing a lightweight, efficient baseline for autonomous remote sensing deployment.

By Haoran Wang, Jing Yao, Xu Yang, Zeqing Wang, Yang Zhang, Pedram Ghamisi, Zhengchao Chen
arXiv Machine Learning
Sep 2

CRAFT: Fine-Tuning Pre-hoc Explainability in AI-native 6G RAN

The paper introduces CRAFT, a data‑centric fine‑tuning approach that aligns small language models (SLMs) for pre‑hoc reasoning in AI‑native 6G radio access networks (RAN). By automatically generating verified (input, trace, label) triplets and fine‑tuning with low‑rank adaptation, CRAFT achieves high accuracy and F1 scores on TRACTOR and IC xApp datasets while avoiding parse failures that plague RL methods like GRPO. It also reduces energy consumption by 59% compared to GRPO baselines, offering a more sustainable path to auditable AI in 6G RAN.

By Pranshav Gajjar, Vijay K Shah
arXiv AI
Jul 20

ToolVerse: Unlocking Massive Environments and Long-Horizon Tasks for Agentic Reinforcement Learning

arXiv:2607. 15660v1 Announce Type: new Abstract: While LLM agents demonstrate strong reasoning abilities in compact and well-defined scenarios, they struggle to maintain robustness and effectiveness when faced with large-scale, diverse, and dynamic real-world environments that demand seamless tool integration.

By Shuaiyu Zhou, Fengpeng Yue, Zengjie Hu, Yuanzhe Shen, Chenyang Zhang, feng hong, Cao Liu, Ke Zeng
arXiv AI
Sep 3

SCX Router: Streaming Zero-Shot Model Selection with a Decoder-KV Classifier and a Real-World Task Ontology

The paper introduces SCX Router, a lightweight GLiClass-based model selector that assigns suitability scores to inference-time language models without autoregressive generation. It uses a 0.6B-parameter Qwen3 decoder with a shallow bidirectional scorer, preserving a text-only key–value cache across sessions and predicting task attributes such as type, difficulty, and expected output length. The authors build a comprehensive task ontology with 23 families, 115 types, and 1,173 synthetic examples, generating 150,000 verifier-scored tasks to train the router, which outperforms baseline models on LiveBench subsets with a top‑1 score of 0.707 versus 0.696 for the strongest fixed model.

By Ihor Stepanov, Aleksandr Smechov, Mykhailo Shtopko, Dmytro Vodianytskyi, Oleksandr Lukashov
arXiv Machine Learning
Sep 22

RS-Claw-Evolution: Environment-Feedback-Driven Evolution for Lightweight Remote Sensing Agents in Long-Horizon Tasks

RS-Claw-Evolution is an environment-feedback-driven framework designed to enhance lightweight remote sensing agents for long-horizon tasks. It improves agents through three stages—interaction evolution, experience evolution, and decision evolution—using executable code, failure-aware trajectory generation, and reinforcement learning with multi-dimensional rewards. On Earth-Bench, a Qwen3-4B agent trained with this framework reaches 65.9% accuracy, surpassing larger baselines and approaching GPT-5 performance.

By Kai Ouyang, Dongyang Hou, Liangtian Liu, Zeyuan Wang, Ziyu Li, Chengfu Liu, Zichao Tang, Xuezhi Cui, Shengwu Ouyang, Wentao Yang, Hanwen Yu, Haifeng Li
arXiv AI
Jun 4

StepPRM-RTL: Stepwise Process-Reward Guided LLM Fine-Tuning for Enhanced RTL Synthesis

arXiv:2606. 04246v1 Announce Type: new Abstract: Automatic generation of RTL code for digital hardware designs remains challenging due to long-horizon reasoning, multi-step dependencies, and strict correctness constraints in Verilog and VHDL.

By Prashanth Vijayaraghavan, Apoorva Nitsure, Luyao Shi, Ehsan Degan, Vandana Mukherjee