Policy optimisation, reward modelling and RLHF — how models are trained by feedback rather than by labels.
arXiv:2609.01591v1 Announce Type: new Abstract: AI tutors are most useful when they adapt to each student's strengths, weaknesses, and preferred guidance, but evidence about which guidance works for...
arXiv:2609.01597v1 Announce Type: cross Abstract: Natural language is emerging as a primary feedback channel for improving language agents, capable of conveying intent, preferences, and causal struct...
arXiv:2609.01596v1 Announce Type: cross Abstract: Real-world robotic assembly at sub-millimeter tolerances demands spatial precision, compliant interaction, and robustness to contact failures. We pre...
arXiv:2609.00796v1 Announce Type: new Abstract: As one of the most critical challenges in large language models, contextual faithfulness directly determines their reliability in knowledge-intensive a...
arXiv:2605.12413v4 Announce Type: replace Abstract: Multimodal Large Language Models (MLLMs) show strong visual perception, yet remain limited in reasoning about space under changing viewpoints. We s...
arXiv:2609.00759v1 Announce Type: new Abstract: Large language models (LLMs) increasingly handle in-context learning (ICL) tasks where a long, novel context defines the rules, knowledge, and output s...
arXiv:2506.13502v4 Announce Type: replace Abstract: Next-word prediction (NWP) trains language models against a single observed continuation, even though many contexts admit multiple plausible next w...
The paper introduces WM‑RMoE, a World Model‑based Risk‑aware Mixture‑of‑Experts framework for autonomous overtaking. It uses a learned latent dynamics model to perform multi‑step rollouts, evaluating cumulative risk at the trajectory level, and employs a hierarchical gating mechanism to coordinate long‑, short‑horizon, and rule‑based safety experts. A Gaussian Mixture Model preserves multimodal maneuver branches, improving robustness and preventing behavioral averaging, leading to better safety compliance, decision stability, and generalization in experiments.
Neurosymbolics for Data Engineering introduces a neurosymbolic layer that can be added to existing LLM backbones to improve logical reasoning and reduce long‑context token usage. The layer boosts accuracy by an average of 85% on benchmarks such as BIRD‑CRITIC and LiveSQLBench without any task‑specific finetuning or RLHF. It also cuts effective token usage by over 50% and lowers time complexity from O(n²) to roughly O(n) for long‑context tasks.
arXiv:2509.25050v2 Announce Type: replace Abstract: Reinforcement Learning (RL) has emerged as a central paradigm for advancing Large Language Models (LLMs), where both pre-training and RL post-train...
The paper introduces Online Hyperparameter Optimization (OHPO), framing it as an infinitely many‑armed bandit problem over mixed and conditional search spaces. It proposes the IMABO framework, which couples any bandit policy with any oracle for proposing new configurations, and presents IMOSS—a restart‑free anytime policy with provable regret bounds. Experiments show that IMABO, combined with practical oracles such as TPE, an incumbent‑mutation oracle, and a pretrained tabular foundation model, outperforms random search across a range of settings from classical ML models to LLM‑based agents.
Large language model (LLM) agents for long-horizon interactive tasks typically follow a ReAct-style protocol, issuing one primitive action per LLM round. While this enables frequent replanning, it is...
Compact instruction-following rerankers are attractive for deployment, but conventional distillation pipelines typically train students by offline imitation of teacher outputs on a fixed set of exampl...
Real-world robotic assembly at sub-millimeter tolerances demands spatial precision, compliant interaction, and robustness to contact failures. We present Facet-0, a robotic foundation model that predi...
arXiv:2608.31106v1 Announce Type: new Abstract: Recent video generators often omit audio or synthesize it in a separate stage, limiting reciprocal modeling of visual dynamics and acoustic events. We...
arXiv:2608.30125v1 Announce Type: cross Abstract: Current video-to-music (V2M) models lack semantic control and fail to penalize instruction violations, largely due to their reliance on reconstructio...
arXiv:2606.15872v2 Announce Type: replace Abstract: Frontier scientific reasoning remains a major challenge for large language models (LLMs), where even the strongest commercial systems fall short of...
arXiv:2608.29519v1 Announce Type: new Abstract: We introduce Function-Room Generation, a new indoor 3D scene generation setting that creates rooms supporting explicit functional goals rather than mer...
arXiv:2608.30753v1 Announce Type: cross Abstract: In large-scale e-commerce retrieval, dual-encoder retrievers are op- timized for contrastive similarity, whereas downstream rerankers capture finer-g...
The paper presents an agentic retrobiosynthesis framework that uses a learned frontier selection policy to guide multistep retrosynthesis in a deterministic biochemical engine. By fine‑tuning a Qwen2.5‑7B policy with LoRA, the authors achieve higher solve rates than traditional MCTS across several benchmarks, demonstrating that route‑supervised frontier selection can improve search efficiency without changing the underlying reaction model.