Accelerating PyTorch distributed fine-tuning with Intel technologies

Accelerating PyTorch Transformers with Intel Sapphire Rapids - part 1

Accelerating PyTorch Transformers with Intel Sapphire Rapids - part 2

Fine-tuning Llama 2 70B using PyTorch FSDP

Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP

Accelerate your models with 🤗 Optimum Intel and OpenVINO

KernelGenBench: A Multi-Source and Multi-Chip Benchmark for LLM-based Kernel Generation

arXiv:2607. 27231v1 Announce Type: cross Abstract: Large language models (LLMs) have significantly increased the demand for efficient accelerator kernels, but kernel development remains a highly specialized and labor-intensive task.