Better language models and their implications

We’ve trained a large-scale unsupervised language model which generates coherent paragraphs of text, achieves state-of-the-art performance on many language modeling benchmarks, and performs rudimentary reading comprehension, machine translation, question answering, and summarization—all without task-specific training.

Summary generated by The Flow from the publisher's feed. The full article lives at OpenAI Blog.

• llms
• nlp
• benchmarks