arXiv AI
Aug 20

Improving Natural-Language Combinatorial-Optimization Accuracy in Resource-Constrained Language Models via Formal Abstractions

The paper introduces SDDL, a neuro‑symbolic framework that converts natural‑language combinatorial scheduling problems into compact, solver‑aligned representations, delegating low‑level modeling and search to a deterministic compiler and external solver. On a 300‑instance subset of scheduling tasks, SDDL achieves higher feasibility rates for resource‑constrained language models—up to 55.3% and 28.3%—compared to direct‑generation baselines (23.7% and 1.3%) and solver‑code baselines (21.7% and 7.0%), with a median optimality gap of 0.0% among feasible schedules.

By Shrenil Shaun Sharma, Avi Sharma
arXiv AI
Jun 29

Ranking Before Serving: Low-Latency LLM Serving via Pairwise Learning-to-Rank

arXiv:2510. 03243v3 Announce Type: replace-cross Abstract: Efficient scheduling of large language model (LLM) inference tasks is critical for achieving low latency and high throughput, a challenge that is becoming increasingly acute with the rise of reasoning-capable LLMs whose generation lengths are highly variable.

By Yiheng Tao, Yihe Zhang, Matthew Dearing, Xin Wang, Yuping Fan, Michael E. Papka, Zhiling Lan
arXiv AI
Aug 19

Efficient RLVR Scheduling via Graph-Structured Online Difficulty Estimation

Efficient RLVR Scheduling via Graph-Structured Online Difficulty Estimation proposes a plug‑and‑play graph‑based online difficulty estimator for reinforcement learning with verifiable rewards (RLVR). The method constructs a difficulty‑aware sample graph using semantic and reasoning similarities, introduces latent difficulty states with a Potts prior, aggregates rollout outcomes with a state‑level Beta‑Binomial model, and updates these estimates online via a mean‑field variational algorithm. This framework can be integrated into sample‑selection and rollout‑allocation schedulers, enabling difficulty‑adaptive exploration without dedicated probing and achieving better performance across multiple base models, RL schedulers, and benchmarks.

By Zhizhao Liu, Zhiliang Tian, Xi Wang, Zhihua Wen, Yihang Xiong, Zhiquan Lai, Dongsheng Li