OpenAI's custom chip is here, and it's fast
OpenAI just published the first benchmark results for Jalapeño, its custom inference chip built around real LLM workloads. Tested on models like DeepSeek R1 and Kimi K2.5, it delivered up to 1.9x more work per watt and up to 3.6x lower end-to-end latency than commercial systems. Why it matters: Built in just nine months with AI assistance, Jalapeño proves OpenAI's full-stack strategy to slash serving costs as agentic workflows multiply compute demand.