Hugging Face Blog

The Age of Machine Learning As Code Has Arrived

OpenAI Blog
May 16, 2018

AI and compute

We’re releasing an analysis showing that since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3. 4-month doubling time (by comparison, Moore’s Law had a 2-year doubling period)[^footnote-correction].

arXiv Machine Learning
Sep 11

On the Relation between Code Quality and Machine Learning Performance: A Large-scale Empirical Study

The study examined 265,363 Kaggle notebooks to explore how code quality relates to machine learning performance. Using Pylint and SonarQube, it found that general Python code quality shows negligible correlation with performance, while ML‑specific violations have a small negative association with performance. Popularity and author expertise do not predict code quality or performance, though competition expertise correlates with better performance and fewer ML‑specific violations.

By Marius Mignard (CRIStAL), Steven Costiou (CRIStAL), Anne Etien (CRIStAL, EVREF)
OpenAI Blog
Jun 21, 2016

Concrete AI safety problems

We (along with researchers from Berkeley and Stanford) are co-authors on today’s paper led by Google Brain researchers, Concrete Problems in AI Safety. The paper explores many research problems around ensuring that modern machine learning systems operate as intended.