← Back to all news

Related stories

arXiv Computation and Language
Sep 25

Evaluation of OpenAI o1: Opportunities and Challenges of AGI

The study evaluates OpenAI’s o1‑preview large language model on a wide range of complex reasoning tasks across domains such as computer science, mathematics, natural sciences, medicine, linguistics, and social sciences. It reports high success rates, including 83.3% on competitive programming, 100% on high‑school math reasoning, and superior performance in radiology reporting, chip design, anthropology, geology, quantitative investing, and social media analysis. While the model excels at intricate reasoning and knowledge integration, it still shows occasional errors on simpler problems and struggles with some highly specialized concepts.

By Tianyang Zhong, Zhengliang Liu, Yi Pan, Yutong Zhang, Zeyu Zhang, Yifan Zhou, Shizhe Liang, Zihao Wu, Yanjun Lyu, Peng Shu, Xiaowei Yu, Chao Cao, Hanqi Jiang, Hanxu Chen, Yiwei Li, Junhao Chen, Huawen Hu, Yiheng Liu, Huaqin Zhao, Shaochen Xu, Haixing Dai, Lin Zhao, Ruidong Zhang, Wei Zhao, Zhenyuan Yang, Jingyuan Chen, Peilong Wang, Wei Ruan, Hui Wang, Huan Zhao, Jing Zhang, Yiming Ren, Shihuan Qin, Tong Chen, Jiaxi Li, Arif Hassan Zidan, Afrar Jahin, Minheng Chen, Sichen Xia, Jason Holmes, Yan Zhuang, Jiaqi Wang, Bochen Xu, Weiran Xia, Jichao Yu, Kaibo Tang, Yaxuan Yang, Bolun Sun, Lifeng Chen, Tao Yang, Guoyu Lu, Xianqiao Wang, Lilong Chai, He Li, Jin Lu, Xin Zhang, Bao Ge, Xintao Hu, Lian Zhang, Hua Zhou, Lu Zhang, Shu Zhang, Zhen Xiang, Yudan Ren, Jun Liu, Xi Jiang, Yu Bao, Wei Zhang, Xiang Li, Gang Li, Wei Liu, Dinggang Shen, Andrea Sikora, Xiaoming Zhai, Dajiang Zhu, Tuo Zhang, Tianming Liu
llmsnlp
More like this →
OpenAI Blog
Oct 6

Sharing AI progress in mathematics

OpenAI has released new results on open problems in mathematics derived from its internal frontier model. The company is sharing Lean proof formalizations and detailed research findings on GitHub. This effort makes advanced mathematical progress publicly accessible and encourages collaboration within the research community.

More like this →