arXiv Computer Vision

R4Tun: LLM-guided adaptive segmental tunnel lining segmentation in point clouds

R4Tun is a large language model–driven framework that adapts an expert-designed segmentation pipeline (SAM4Tun) for segmental tunnel lining inspection from 3D point clouds. By tuning bounded parameters guided by structured context—memory, state, and knowledge—it improves mean Intersection-over-Union from 0.18 to 0.43–0.48 and overall accuracy from 0.42 to 0.59–0.65 across 30 tunnel subsets and three LLMs, with the best regular subsets achieving mIoU up to 0.796. The method consistently adjusts the same critical parameters across runs, offering a controlled, label‑free, cross‑LLM adaptation mechanism with auditable rationales.

arXiv AI
Sep 7

ACE: Adaptive Calibration-Free Expert Skipping for MoE-based LLMs

ACE introduces a training‑free, calibration‑free framework for adaptive expert skipping in Mixture‑of‑Experts LLMs. It combines a Global Spectral Proxy that estimates global transformation capacity with a Router‑Conditioned Refinement that builds expert‑specific direction prototypes, enabling the model to skip low‑contribution experts while always keeping the top‑1 expert. Offline computation of expert statistics leaves only lightweight table lookups during inference, and experiments on three MoE‑based LLMs show ACE outperforms static and dynamic baselines, especially at high skipping ratios.

By Zukang Xu, Zhixiong Zhao, Xing Hu, Jiangyong Yu, Houji Wen, Jun Li, Zhe Jiang, Dawei Yang
arXiv AI
Aug 24

Nexus: Depth-Adaptive KV-Cache Splicing and Retrieval-Decoupled Tool Routing for Agentic LLMs on Unified Memory

Nexus introduces a depth‑adaptive KV‑cache splicing and retrieval‑decoupled tool routing mechanism for agentic large language models that reduces the time‑to‑first‑token (TTFT) by decoupling tool routing from the expensive schema re‑encoding step. It uses an INT8 semantic lookaside buffer to select tools via retrieval and generates arguments from a compressed textual signature, maintaining about 89% routing accuracy even as the tool registry scales to 250 tools. Additionally, Nexus can splice compiled schema KV blocks into the live context, repairing the seam with a depth‑adaptive suffix redecode when rotary position embedding drift exceeds a threshold, ensuring output fidelity while achieving up to 1.7× TTFT speedup at moderate depth.

By Mustafa Arslan