Large language models

Databricks ❤️ Hugging Face: up to 40% faster training and tuning of Large Language Models

New ways to manage your data in ChatGPT

ChatGPT users can now turn off chat history, allowing you to choose which conversations can be used to train our models.

Accelerating Hugging Face Transformers with AWS Inferentia2

Graph Classification with Transformers

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Fast Inference on Large Language Models: BLOOMZ on Habana Gaudi2 Accelerator

March 20 ChatGPT outage: Here’s what happened

An update on our findings, the actions we’ve taken, and technical details of the bug.

ChatGPT plugins

We’ve implemented initial support for plugins in ChatGPT. Plugins are tools designed specifically for language models with safety as a core principle, and help ChatGPT access up-to-date information, run computations, or use third-party services.

GPTs are GPTs: An early look at the labor market impact potential of large language models

Powering virtual education for the classroom

Khan Academy explores the potential for GPT-4 in a limited pilot program.

Preserving languages for the future

How Iceland is using GPT-4 to preserve its language.

GPT-4

We’ve created GPT-4, the latest milestone in OpenAI’s effort in scaling up deep learning. GPT-4 is a large multimodal model (accepting image and text inputs, emitting text outputs) that, while less capable than humans in many real-world scenarios, exhibits human-level performance on various professional and academic benchmarks.

Stripe

Stripe leverages GPT-4 to streamline user experience and combat fraud.

Transforming visual accessibility

Be My Eyes uses GPT-4 to transform visual accessibility.

Filling crucial language learning gaps

GPT-4 deepens the conversation on Duolingo.

GPT-4

It can generate, edit, and iterate with users on creative and technical writing tasks, such as composing songs, writing screenplays, or learning a user’s writing style.

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Red-Teaming Large Language Models

How should AI systems behave, and who should decide?

We’re clarifying how ChatGPT’s behavior is shaped and our plans for improving that behavior, allowing more user customization, and getting more public input into our decision-making in these areas.

Accelerating PyTorch Transformers with Intel Sapphire Rapids - part 2