Accelerating PyTorch distributed fine-tuning with Intel technologies

Accelerating PyTorch Transformers with Intel Sapphire Rapids - part 1

Accelerating PyTorch Transformers with Intel Sapphire Rapids - part 2

Fine-tuning Llama 2 70B using PyTorch FSDP

Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP

Accelerate your models with 🤗 Optimum Intel and OpenVINO

KernelGenBench: A Multi-Source and Multi-Chip Benchmark for LLM-based Kernel Generation

arXiv:2607. 27231v1 Announce Type: cross Abstract: Large language models (LLMs) have significantly increased the demand for efficient accelerator kernels, but kernel development remains a highly specialized and labor-intensive task.

OpenAI standardizes on PyTorch

We are standardizing OpenAI’s deep learning framework on PyTorch.

An Efficient Heterogeneous Co-Design for Fine-Tuning on a Single GPU

arXiv:2603. 16428v2 Announce Type: replace-cross Abstract: Fine-tuning Large Language Models (LLMs) has become essential for domain adaptation, but its memory-intensive property exceeds the capabilities of most GPUs.

KernelBench-Verified: Do LLM-Generated Kernels Actually Beat PyTorch?

arXiv:2607. 16241v1 Announce Type: cross Abstract: Recent large language models (LLMs) can generate custom CUDA kernels that appear to outperform PyTorch on benchmarks such as KernelBench.

nanoVLM: The simplest repository to train your VLM in pure PyTorch

(LoRA) Fine-Tuning FLUX.1-dev on Consumer Hardware

20x Faster TRL Fine-tuning with RapidFire AI