arXiv AI
Jun 16
Skill-to-LoRA: From Using Skills to Learning Behaviors for Token-Efficient LLM Agents
arXiv:2606. 16769v1 Announce Type: new Abstract: Agent skills are commonly distributed as SKILL.
Procedural Knowledge Is Not Low-Rank: Why LoRA Fails to Internalize Multi-Step Procedures
arXiv:2607. 21612v1 Announce Type: cross Abstract: Parameter-efficient fine-tuning methods like LoRA have become the default for adapting large language models, succeeding across instruction following, style transfer, and factual adaptation.
Related stories
arXiv AI
Jun 6
LatentSkill: From In-Context Textual Skills to In-Weight Latent Skills for LLM Agents
arXiv:2606. 06087v1 Announce Type: cross Abstract: Agent systems increasingly use textual skills to encode reusable task procedures, but injecting these skills into the prompt at every step incurs substantial context overhead and exposes skill content as plaintext.
arXiv Machine Learning
Jul 27
IFCLoRA: Topology-Aware Rank Allocation for Parameter-Efficient Fine-Tuning
arXiv:2607. 22251v1 Announce Type: new Abstract: Low-Rank Adaptation (LoRA) is a widely used parameter-efficient fine-tuning method for large language models, but its performance depends strongly on how a fixed rank budget is distributed across Transformer modules.
arXiv AI
Jun 11
SkillJuror: Measuring How Agent Skill Organization Changes Runtime Behavior
arXiv:2606. 11543v1 Announce Type: new Abstract: Agent Skills augment large language model (LLM) agents with procedural knowledge at inference time, but current benchmarks rarely distinguish what a Skill says from how it is organized.
arXiv AI
Jul 21
A Systematic Evaluation of Trajectory Data Curation for LoRA Fine-Tuning of Code Agents
arXiv:2607. 17205v1 Announce Type: new Abstract: Supervised fine-tuning (SFT) of open-weight LLMs on expert agent trajectories has emerged as a prominent approach to building capable code agents without reliance on proprietary models.
Hugging Face Trending Papers
Jun 10
SkillJuror: Measuring How Agent Skill Organization Changes Runtime Behavior
Agent Skills augment large language model (LLM) agents with procedural knowledge at inference time, but current benchmarks rarely distinguish what a Skill says from how it is organized. We study this distinction through Progressive Disclosure, where a concise root file points agents to supporting resources on demand, and compare it with a normalized flat baseline.
arXiv AI
Jun 9
ComplexConstraints and Beyond: Expert Rubrics for RLVR
arXiv:2606. 09118v1 Announce Type: new Abstract: As LLM capabilities advance rapidly, the evaluation methods used to assess them increasingly lag behind.
arXiv AI
Jun 2
MMG2Skill: Can Agents Distill In-the-Wild Guides into Self-Evolving Skills?
arXiv:2606. 01993v1 Announce Type: cross Abstract: Abundant procedural knowledge on the Web holds great potential for helping agents solve long-horizon tasks.
arXiv AI
Jun 30
LLM-Guided Planning for Multi-hop Reasoning over Multimodal Nuclear Regulatory Documents
arXiv:2606. 29399v1 Announce Type: new Abstract: Reviewing nuclear regulatory documents requires multi-hop reasoning across tens of thousands of pages, where judgments depend on evidence assembled across multiple chapters.
arXiv AI
Jul 20
PASs-MoE: Mitigating Misaligned Co-drift among Router and Experts via Pathway Activation Subspaces for Continual Learning
arXiv:2601. 13020v2 Announce Type: replace-cross Abstract: Continual instruction tuning (CIT) requires multimodal large language models (MLLMs) to adapt to a stream of tasks without forgetting prior capabilities.
arXiv AI
Jun 26
NebulaExp-8B: An Empirical Post-Training Pipeline via Full-Scale Ablation Research
arXiv:2606. 26671v1 Announce Type: new Abstract: Post-training alignment determines the reasoning and human preference following capabilities of large language models, yet most existing works withhold detailed data construction, filtering rules and training recipes, which hinders community reproducibility and lightweight model optimization.
arXiv AI
Jun 2
Evaluating Deep Research Agents on Expert Consulting Work: A Benchmark with Verifiers, Rubrics, and Cognitive Traps
arXiv:2605. 17554v2 Announce Type: replace Abstract: Frontier deep research agents (DRAs) plan a research task, synthesize across documents, and return a structured deliverable on demand.