How OpenAI scaled ChatGPT storage to 1 billion users
OpenAI just detailed how its storage platform Habitat supports over 1 billion ChatGPT users across 40 regions using Azure Cosmos DB. By co-engineering custom serverless capabilities with Microsoft and rewriting proxy logic, the system achieved 12x faster reads and over 20M QPS on its largest account. Why it matters: At hyper-scale, standard cloud managed services break down, forcing AI leaders to build custom primitives directly with their cloud providers.