LoRA training scripts of the world, unite!

Goodbye cold boot - how we made LoRA Inference 300% faster

PLoRA: Efficient Concurrent LoRA Training for Large Language Models

arXiv:2508. 02932v2 Announce Type: replace Abstract: Low-Rank Adaptation (LoRA) has gained popularity as a fine-tuning approach for Large Language Models (LLMs) due to its low resource requirements and good performance.

Code Llama: Llama 2 learns to code

Beyond LoRA: Can you beat the most popular fine-tuning technique?

Skill-to-LoRA: From Using Skills to Learning Behaviors for Token-Efficient LLM Agents

arXiv:2606. 16769v1 Announce Type: new Abstract: Agent skills are commonly distributed as SKILL.

Procedural Knowledge Is Not Low-Rank: Why LoRA Fails to Internalize Multi-Step Procedures

arXiv:2607. 21612v1 Announce Type: cross Abstract: Parameter-efficient fine-tuning methods like LoRA have become the default for adapting large language models, succeeding across instruction following, style transfer, and factual adaptation.

Training CodeParrot 🦜 from Scratch

The Appeal and Reality of Recycling LoRAs with Adaptive Merging

arXiv:2602. 12323v2 Announce Type: replace Abstract: The widespread availability of fine-tuned LoRA modules for open pre-trained models has led to an interest in methods that can adaptively merge LoRAs to improve performance.

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Non-engineers guide: Train a LLaMA 2 chatbot

SmolVLA: Efficient Vision-Language-Action Model trained on Lerobot Community Data

The all new le Chat: Your AI assistant for life and work