Hugging Face Hub rearchitects uploads/downloads with CAS; regional PoPs planned (us-east-1, eu-west-3, ap-southeast-1)

AI Impact Summary

Hugging Face is redesigning the Hub's upload/download path around a content-addressed store (CAS) to enable byte-level analysis, deduplication, and chunk-based transfers for large artifacts. Reads will obtain reconstruction information from CAS while data remains backed by S3 (us-east-1) and served via CloudFront, and writes will operate on chunks with CAS validation before persisting to S3. The rollout introduces regional CAS PoPs (us-east-1, eu-west-3, ap-southeast-1) with a 4/4/2 node plan, a production target by end of 2024, and an estimated 12% bandwidth reduction (48.5 Mbps to 42.5 Mbps) alongside telemetry and security improvements.