OpenAI Blog

Solving math word problems

Read the original on OpenAI Blog →

We’ve trained a system that solves grade school math problems with nearly twice the accuracy of a fine-tuned GPT-3 model. It solves about 90% as many problems as real kids: a small sample of 9-12 year olds scored 60% on a test from our dataset, while our system scored 55% on those same problems.

Summary generated by The Flow from the publisher's feed. The full article lives at OpenAI Blog.

OpenAI Blog
Feb 2, 2022

Solving (some) formal math olympiad problems

We built a neural theorem prover for Lean that learned to solve a variety of challenging high-school olympiad problems, including problems from the AMC12 and AIME competitions, as well as two problems adapted from the IMO.

arXiv AI
Jun 3

PyraMathBench: Evaluating and Improving Mathematical Capability in Large Language Models

arXiv:2606. 03858v1 Announce Type: new Abstract: Despite the pivotal role of numerical reasoning as the cornerstone of mathematical capabilities in large language models (LLMs) across applications, few benchmarks evaluate LLMs by integrating numerical processing and mathematical reasoning, hindering the interpretability of failures in math tasks.

By Zetian Ouyang, Linlin Wang, Gerard de Melo, Liang He