Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler

Profiling in PyTorch (Part 3): Attention is all you profile

Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP

Visualize and understand GPU memory in PyTorch

torchsom: The Reference PyTorch Library for Self-Organizing Maps

arXiv:2510. 11147v2 Announce Type: replace-cross Abstract: This paper introduces torchsom, an open-source Python library that provides a reference implementation of the Self-Organizing Map (SOM) in PyTorch.

nanoVLM: The simplest repository to train your VLM in pure PyTorch

OpenAI standardizes on PyTorch

We are standardizing OpenAI’s deep learning framework on PyTorch.

Accelerating PyTorch distributed fine-tuning with Intel technologies

TorchKM: A GPU-Oriented Library for Kernel Learning and Model Selection

arXiv:2606. 06742v1 Announce Type: new Abstract: TorchKM is an open-source library for kernel machines, including support vector machines, kernel logistic regression, and kernel quantile regression, with GPU acceleration.

Fine-tuning Llama 2 70B using PyTorch FSDP

Accelerating PyTorch Transformers with Intel Sapphire Rapids - part 1

How 🤗 Accelerate runs very large models thanks to PyTorch

How Fast Can Reward Models Score? A Systems Study of C++ and PyTorch Inference Runtimes for RLHF

In RLHF pipelines, reward scoring blocks policy updates. Slow scoring bottlenecks the entire loop, since no update runs until every rollout gets a score.