Hugging Face Blog

Streaming datasets: 100x More Efficient

arXiv Machine Learning
Jul 23

Streaming Sliced Optimal Transport

arXiv:2505. 06835v5 Announce Type: replace Abstract: Sliced optimal transport (SOT), or sliced Wasserstein (SW) distance, is widely recognized for its statistical and computational scalability.

By Khai Nguyen
arXiv Computer Vision
Sep 4

StreamTTT: Reconciling Real-Time Perception and Long-Term Memory in Streaming VLMs

StreamTTT is a streaming vision-language model that balances real-time perception with long-term memory by writing long-range history into fast weights outside the attention context, while keeping a short sliding key-value cache for recent evidence. The model is trained on both offline long-video QA and a new real-time QA corpus, and it outperforms SimpleStream-4B on OVO-Bench by 1.4 points in real-time perception and 3.7 points in backward tracing. StreamTTT-4B also competes with the larger SimpleStream-8B on the StreamingBench Real-Time Visual Understanding subset.

By Joya Chen, Zeyun Zhong, Mike Zheng Shou
arXiv AI
Aug 26

Maia 200: A Software Defined Dataflow System for Large-scale AI Acceleration

Maia 200 is a software‑defined dataflow system that delivers high performance AI acceleration, achieving 10,145 Tflop/s in FP4 and 5,072 Tflop/s in FP8 within a 750 W TDP and 7 TB/s HBM bandwidth. It exemplifies a new class of Software Defined Locally Accessed Dataflow Architectures (SDLA), which program dataflow engines to orchestrate specialized memories and data‑movement engines, shifting focus from thread‑centric to data‑movement‑centric design. The system offers significant cost and energy savings while supporting massive parallelism for AI inference workloads, positioning it as a compelling solution for next‑generation high‑performance computing.

By Sherry Xu, Marco Heddes, Jackson Peng, Tom Savell, Monica Tang, Prashant Ranjan, Jesse Benson, Ofer Dekel, Saurabh Dighe, Anupama Kurpad, Artour Levin, Matthew Mattina, George Petre, Cheng Tang, Yuan Yu, Li Zhang, Torsten Hoefler