Hugging Face Blog
The Technology Behind BLOOM Training
Read the original on Hugging Face Blog →The Flow has not summarised this story yet — read it at Hugging Face Blog.
Related stories
Hugging Face Blog
Oct 21, 2022
From PyTorch DDP to Accelerate to Trainer, mastery of distributed training with ease
arXiv AI
Jun 18
Spotlight: Synergizing Seed Exploration and Spot GPUs for DiT RL Post-Training
arXiv:2606. 19004v1 Announce Type: cross Abstract: Reinforcement learning (RL) post-training of Diffusion Transformers (DiTs) is prohibitively expensive, requiring thousands of high-end GPUs.
arXiv AI
Sep 15
Qwen-Image-Flash: Rethinking the Training Recipe for Few-Step Distillation
arXiv:2606.03746v3 Announce Type: replace-cross Abstract: Few-step distillation has emerged as a critical component in the development of advanced visual generative foundation models, substantially r...
arXiv Machine Learning
Jul 3
Denser $\neq$ Better: Limits of On-Policy Self-Distillation for Continual Post-Training
arXiv:2607. 01763v1 Announce Type: new Abstract: Continual post-training enables foundation models to acquire new knowledge while preserving existing capabilities.
arXiv AI
Jun 2
PECKER: A Precisely Efficient Critical Knowledge Erasure Recipe For Machine Unlearning in Diffusion Models
arXiv:2604. 05634v2 Announce Type: replace Abstract: Machine unlearning (MU) has become a critical technique for GenAI models' safe and compliant operation.
arXiv AI
Jun 3
Qwen-Image-Flash: Beyond Objective Design
arXiv:2606. 03746v1 Announce Type: cross Abstract: Few-step distillation has become an effective strategy for accelerating advanced visual generative models, yet prior work has largely focused on distillation objectives.