arXiv AI
6d ago
RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks
arXiv:2608. 12004v1 Announce Type: cross Abstract: In modern AI frameworks, GPU kernels are key to overall system performance.
Introducing Triton: Open-source GPU programming for neural networks
We’re releasing Triton 1. 0, an open-source Python-like programming language which enables researchers with no CUDA experience to write highly efficient GPU code—most of the time on par with what an expert would be able to produce.
Related stories
OpenAI Blog
Nov 2, 2016
Extensions and limitations of the neural GPU
arXiv Machine Learning
Jun 8
TorchKM: A GPU-Oriented Library for Kernel Learning and Model Selection
arXiv:2606. 06742v1 Announce Type: new Abstract: TorchKM is an open-source library for kernel machines, including support vector machines, kernel logistic regression, and kernel quantile regression, with GPU acceleration.
arXiv Machine Learning
Jun 5
Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs
arXiv:2604. 23466v2 Announce Type: replace Abstract: NVIDIA's CUDA Tile (CuTile) introduces a Python-based, tile-centric abstraction for GPU kernel development that aims to simplify programming while retaining Tensor Core and Tensor Memory Accelerator (TMA) efficiency on modern GPUs.
arXiv AI
Jun 8
E2Former-V2: On-the-Fly Equivariant Attention with Linear Activation Memory
arXiv:2601. 16622v2 Announce Type: replace-cross Abstract: Equivariant Graph Neural Networks (EGNNs) have become a widely used approach for modeling 3D atomistic systems.
arXiv AI
Jun 24
BluTrain: A C++/CUDA Framework for AI Systems
arXiv:2606. 24780v1 Announce Type: new Abstract: Progress in deep learning is, at scale, more a matter of systems engineering than of modelling: the behaviour of a model in training (its throughput, its memory footprint, and the numerical fidelity of the result) is determined less by the architecture itself than by how that architecture is expressed on the hardware.
arXiv Machine Learning
Jul 21
FlashPDE: A Drop-in Fused Triton Operator Library for Neural PDE Solvers
arXiv:2607. 18020v1 Announce Type: new Abstract: Physics-Informed Neural Networks (PINNs) solve PDEs by incorporating physical constraints into neural-network training, but large-scale problems are limited by automatic-differentiation memory overhead and inefficient execution of grid-based PDE operators.
arXiv Machine Learning
Jul 24
FlashPDE: A Drop-In Fused Triton Operator Library for Neural PDE Solvers
arXiv:2607. 18020v2 Announce Type: replace Abstract: Physics-Informed Neural Networks (PINNs) solve PDEs by incorporating physical constraints into neural-network training, but large-scale problems are limited by automatic-differentiation memory overhead and inefficient execution of grid-based PDE operators.
OpenAI Blog
Mar 14, 2023
GPT-4
We’ve created GPT-4, the latest milestone in OpenAI’s effort in scaling up deep learning. GPT-4 is a large multimodal model (accepting image and text inputs, emitting text outputs) that, while less capable than humans in many real-world scenarios, exhibits human-level performance on various professional and academic benchmarks.
arXiv AI
Jun 2
SUPREME: A Multi-GPU Framework for Reproducible Image Unlearning Method Evaluation
arXiv:2606. 00380v1 Announce Type: cross Abstract: Machine unlearning removes the influence of specific training data from a trained model without retraining it from scratch.
arXiv Machine Learning
Jun 11
A Scalable PyTorch Abstraction for Multi-GPU Gaussian Splatting
arXiv:2606. 11390v1 Announce Type: cross Abstract: Gaussian splatting methods have become increasingly popular for neural reconstruction of the real world.
OpenAI Blog
Dec 6, 2017
Block-sparse GPU kernels
We’re releasing highly-optimized GPU kernels for an underexplored class of neural network architectures: networks with block-sparse weights. Depending on the chosen sparsity, these kernels can run orders of magnitude faster than cuBLAS or cuSPARSE.