OpenAI standardizes on PyTorch

Announcing the OpenAI Learning Accelerator

GPT-4

We’ve created GPT-4, the latest milestone in OpenAI’s effort in scaling up deep learning. GPT-4 is a large multimodal model (accepting image and text inputs, emitting text outputs) that, while less capable than humans in many real-world scenarios, exhibits human-level performance on various professional and academic benchmarks.

nanoVLM: The simplest repository to train your VLM in pure PyTorch

Accelerating PyTorch distributed fine-tuning with Intel technologies

OpenAI API

We’re releasing an API for accessing new AI models developed by OpenAI.

Tensorization is a powerful but underexplored tool for compression and interpretability of neural networks

The paper discusses tensorizing neural networks by reshaping dense weight matrices into higher-order tensors and approximating them with low-rank tensor network decompositions. This approach offers promising model compression and introduces bond indices that create new latent spaces, potentially enhancing interpretability. Despite encouraging empirical results, tensorized neural networks remain underused, and the authors call for more research to address practical scaling and adoption challenges.

OpenAI named Emerging Leader in Generative AI

OpenAI has been named an Emerging Leader in Gartner’s 2025 Innovation Guide for Generative AI Model Providers. The recognition reflects our enterprise momentum, with over 1 million companies building with ChatGPT.

OpenAI partners with Scale to provide support for enterprises fine-tuning models

OpenAI’s customers can leverage Scale’s AI expertise to customize our most advanced models.

Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP

OpenAI Baselines: DQN

We’re open-sourcing OpenAI Baselines, our internal effort to reproduce reinforcement learning algorithms with performance on par with published results. We’ll release the algorithms over upcoming months; today’s release includes DQN and three of its variants.

Introducing OpenAI o1

Quanto: a PyTorch quantization backend for Optimum