Introducing Storage Regions on the HF Hub

From Files to Chunks: Improving HF Storage Efficiency

Designing the hf CLI as an agent-optimized way to work with the Hub

Announcing Evaluation on the Hub

Introducing Storage Buckets on the Hugging Face Hub

From Chunks to Blocks: Accelerating Uploads and Downloads on the Hub

Run AI workloads on any cloud, store on Hugging Face: zero-egress storage with SkyPilot

How to Optimize Vector Search When RAM Gets Too Expensive: On-Disk vs. In-Memory ANN Indexes

Architecting cost-effective infrastructure by navigating the latency and storage trade-offs of HNSW, SPANN, and DiskANN The post How to Optimize Vector Search When RAM Gets Too Expensive: On-Disk vs. In-Memory ANN Indexes appeared first on Towards Data Science .

Supercharged Searching on the 🤗 Hub

LayoutBench: Performance Benchmarking of Cloud Storage Layouts for Multimedia Data

arXiv:2607. 28880v1 Announce Type: cross Abstract: Modern multimedia machine learning workloads increasingly store large-scale datasets in cloud object storage services such as AWS S3.

From Tensor Buffer to Distributed Memory Hierarchy: A Survey of KV Cache Management for LLM Serving

arXiv:2607. 02574v1 Announce Type: cross Abstract: The key-value (KV) cache has become a first-order memory object in LLM serving rather than a temporary per-request tensor.

Shipping a Trillion Parameters With a Hub Bucket: Delta Weight Sync in TRL

Migrating the Hub from Git LFS to Xet