Large Enough

Au Large

Medium is the new large.

$\mu$pscaling small models: Principled warm starts and hyperparameter transfer

arXiv:2602. 10545v2 Announce Type: replace-cross Abstract: Modern large-scale neural networks are often trained and released in multiple sizes to accommodate diverse inference budgets.

Mistral Small 3

Any-Dimensional Learning by Sampling

arXiv:2607. 07680v1 Announce Type: cross Abstract: Many machine learning models are defined for inputs of different sizes, such as point clouds containing different numbers of points, sequences of tokens of different lengths, and graphs on different numbers of nodes.

Granite 4.0 Nano: Just how small can you go?