OpenAI’s new trick to make GPT-4o edits faster
OpenAI just launched Predicted Outputs, a new API capability that slashes latency for gpt-4o and gpt-4o-mini by letting you feed in a reference string. It is tailored for partial rewrites—like updating docs, iterating on prior chat answers, or refactoring code inside an existing file.